Jun 17 04:29:31 devstack cinder-volume[81361]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=81361) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}} Jun 17 04:29:31 devstack cinder-volume[81361]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=81361) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}} Jun 17 04:29:31 devstack cinder-volume[81361]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=81361) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}} Jun 17 04:29:32 devstack cinder-volume[81361]: INFO dbcounter [None req-905e043d-471f-47d9-8e2d-5d966b967404 None None] Registered counter for database cinder Jun 17 04:29:32 devstack cinder-volume[81361]: DEBUG oslo_db.sqlalchemy.engines [None req-905e043d-471f-47d9-8e2d-5d966b967404 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81361) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jun 17 04:29:32 devstack cinder-volume[81361]: DEBUG dbcounter [-] [81361] Writer thread running {{(pid=81361) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jun 17 04:29:32 devstack cinder-volume[81361]: INFO cinder.rpc [None req-905e043d-471f-47d9-8e2d-5d966b967404 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Jun 17 04:29:32 devstack cinder-volume[81361]: INFO cinder.rpc [None req-905e043d-471f-47d9-8e2d-5d966b967404 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Jun 17 04:29:32 devstack cinder-volume[81361]: DEBUG oslo_db.sqlalchemy.engines [None req-905e043d-471f-47d9-8e2d-5d966b967404 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81361) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jun 17 04:29:32 devstack cinder-volume[81361]: INFO cinder.volume.manager [None req-905e043d-471f-47d9-8e2d-5d966b967404 None None] Determined volume DB was empty at startup. Jun 17 04:29:32 devstack cinder-volume[81361]: DEBUG cinder.volume.manager [None req-905e043d-471f-47d9-8e2d-5d966b967404 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=81361) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Jun 17 04:29:32 devstack cinder-volume[81361]: INFO cinder.volume.manager [None req-905e043d-471f-47d9-8e2d-5d966b967404 None None] Service not found for updating active_backend_id, assuming default for driver init. Jun 17 04:29:32 devstack cinder-volume[81361]: WARNING stevedore.named [None req-905e043d-471f-47d9-8e2d-5d966b967404 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jun 17 04:29:32 devstack cinder-volume[81361]: WARNING castellan.key_manager [None req-905e043d-471f-47d9-8e2d-5d966b967404 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jun 17 04:29:32 devstack cinder-volume[81361]: WARNING cinder.keymgr.conf_key_mgr [None req-905e043d-471f-47d9-8e2d-5d966b967404 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jun 17 04:29:32 devstack cinder-volume[81361]: DEBUG cinder.volume.drivers.lvm [None req-905e043d-471f-47d9-8e2d-5d966b967404 None None] Attempting to initialize LVM driver with the following target_driver: cinder.volume.targets.lio.LioAdm {{(pid=81361) __init__ /opt/stack/cinder/cinder/volume/drivers/lvm.py:106}} Jun 17 04:29:32 devstack cinder-volume[81361]: DEBUG oslo_concurrency.processutils [None req-905e043d-471f-47d9-8e2d-5d966b967404 None None] Running cmd (subprocess): cinder-rtstool verify {{(pid=81361) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:29:33 devstack cinder-volume[81361]: DEBUG oslo_concurrency.processutils [None req-905e043d-471f-47d9-8e2d-5d966b967404 None None] CMD "cinder-rtstool verify" returned: 0 in 0.366s {{(pid=81361) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:29:33 devstack cinder-volume[81361]: DEBUG oslo_db.sqlalchemy.engines [None req-905e043d-471f-47d9-8e2d-5d966b967404 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81361) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jun 17 04:29:33 devstack cinder-volume[81361]: INFO cinder.rpc [None req-905e043d-471f-47d9-8e2d-5d966b967404 None None] Automatically selected cinder-volume objects version 1.39 as minimum service version. Jun 17 04:29:33 devstack cinder-volume[81361]: INFO cinder.rpc [None req-905e043d-471f-47d9-8e2d-5d966b967404 None None] Automatically selected cinder-volume RPC version 3.20 as minimum service version. Jun 17 04:29:33 devstack cinder-volume[81361]: WARNING stevedore.named [None req-905e043d-471f-47d9-8e2d-5d966b967404 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jun 17 04:29:33 devstack cinder-volume[81361]: WARNING castellan.key_manager [None req-905e043d-471f-47d9-8e2d-5d966b967404 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jun 17 04:29:33 devstack cinder-volume[81361]: INFO cinder.volume.manager [None req-905e043d-471f-47d9-8e2d-5d966b967404 None None] Image-volume cache enabled for host devstack@lvmdriver-1. Jun 17 04:29:33 devstack cinder-volume[81361]: DEBUG oslo_db.sqlalchemy.engines [None req-905e043d-471f-47d9-8e2d-5d966b967404 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81361) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jun 17 04:29:33 devstack cinder-volume[81361]: INFO oslo_service.backend._eventlet.service [None req-905e043d-471f-47d9-8e2d-5d966b967404 None None] Starting 1 workers Jun 17 04:29:33 devstack cinder-volume[81361]: DEBUG oslo_service.backend._eventlet.service [None req-905e043d-471f-47d9-8e2d-5d966b967404 None None] Started child 81529 {{(pid=81361) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Jun 17 04:29:33 devstack cinder-volume[81361]: DEBUG oslo_service.backend._eventlet.service [None req-905e043d-471f-47d9-8e2d-5d966b967404 None None] Full set of CONF: {{(pid=81361) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Jun 17 04:29:33 devstack cinder-volume[81361]: DEBUG oslo_service.backend._eventlet.service [None req-905e043d-471f-47d9-8e2d-5d966b967404 None None] ******************************************************************************** {{(pid=81361) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2979}} Jun 17 04:29:33 devstack cinder-volume[81361]: DEBUG oslo_service.backend._eventlet.service [None req-905e043d-471f-47d9-8e2d-5d966b967404 None None] Configuration options gathered from: {{(pid=81361) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2980}} Jun 17 04:29:33 devstack cinder-volume[81361]: DEBUG oslo_service.backend._eventlet.service [None req-905e043d-471f-47d9-8e2d-5d966b967404 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=81361) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2981}} Jun 17 04:29:33 devstack cinder-volume[81361]: DEBUG oslo_service.backend._eventlet.service [None req-905e043d-471f-47d9-8e2d-5d966b967404 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=81361) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2982}} Jun 17 04:29:33 devstack cinder-volume[81361]: DEBUG oslo_service.backend._eventlet.service [None req-905e043d-471f-47d9-8e2d-5d966b967404 None None] ================================================================================ {{(pid=81361) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2987}} Jun 17 04:29:33 devstack cinder-volume[81529]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Jun 17 04:29:33 devstack cinder-volume[81361]: DEBUG oslo_service.backend._eventlet.service [None req-905e043d-471f-47d9-8e2d-5d966b967404 None None] allow_availability_zone_fallback = False {{(pid=81361) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 04:29:33 devstack cinder-volume[81361]: DEBUG oslo_service.backend._eventlet.service [None req-905e043d-471f-47d9-8e2d-5d966b967404 None None] allow_compression_on_image_upload = False {{(pid=81361) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 04:29:33 devstack cinder-volume[81361]: DEBUG oslo_service.backend._eventlet.service [None req-905e043d-471f-47d9-8e2d-5d966b967404 None None] allowed_direct_url_schemes = [] {{(pid=81361) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 04:29:33 devstack cinder-volume[81361]: DEBUG oslo_service.backend._eventlet.service [None req-905e043d-471f-47d9-8e2d-5d966b967404 None None] api_rate_limit = True {{(pid=81361) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 04:29:33 devstack cinder-volume[81361]: DEBUG oslo_service.backend._eventlet.service [None req-905e043d-471f-47d9-8e2d-5d966b967404 None None] auth_strategy = keystone {{(pid=81361) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 04:29:33 devstack cinder-volume[81361]: DEBUG oslo_service.backend._eventlet.service [None req-905e043d-471f-47d9-8e2d-5d966b967404 None None] az_cache_duration = 3600 {{(pid=81361) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 04:29:33 devstack cinder-volume[81361]: DEBUG oslo_service.backend._eventlet.service [None req-905e043d-471f-47d9-8e2d-5d966b967404 None None] backend_availability_zone = None {{(pid=81361) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 04:29:33 devstack cinder-volume[81361]: DEBUG oslo_service.backend._eventlet.service [None req-905e043d-471f-47d9-8e2d-5d966b967404 None None] backend_host = None {{(pid=81361) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 04:29:33 devstack cinder-volume[81361]: DEBUG oslo_service.backend._eventlet.service [None req-905e043d-471f-47d9-8e2d-5d966b967404 None None] backend_name = None {{(pid=81361) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 04:29:33 devstack cinder-volume[81361]: DEBUG oslo_service.backend._eventlet.service [None req-905e043d-471f-47d9-8e2d-5d966b967404 None None] backend_stats_polling_interval = 60 {{(pid=81361) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 04:29:33 devstack cinder-volume[81361]: DEBUG oslo_service.backend._eventlet.service [None req-905e043d-471f-47d9-8e2d-5d966b967404 None None] backup_api_class = cinder.backup.api.API {{(pid=81361) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 04:29:33 devstack cinder-volume[81361]: DEBUG oslo_service.backend._eventlet.service [None req-905e043d-471f-47d9-8e2d-5d966b967404 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=81361) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 04:29:33 devstack cinder-volume[81361]: DEBUG oslo_service.backend._eventlet.service [None req-905e043d-471f-47d9-8e2d-5d966b967404 None None] backup_name_template = backup-%s {{(pid=81361) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 04:29:33 devstack cinder-volume[81361]: DEBUG oslo_service.backend._eventlet.service [None req-905e043d-471f-47d9-8e2d-5d966b967404 None None] backup_use_same_host = False {{(pid=81361) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 04:29:33 devstack cinder-volume[81361]: DEBUG oslo_service.backend._eventlet.service [None req-905e043d-471f-47d9-8e2d-5d966b967404 None None] backup_use_temp_snapshot = False {{(pid=81361) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 04:29:33 devstack cinder-volume[81361]: DEBUG oslo_service.backend._eventlet.service [None req-905e043d-471f-47d9-8e2d-5d966b967404 None None] chap_password = **** {{(pid=81361) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 04:29:33 devstack cinder-volume[81361]: DEBUG oslo_service.backend._eventlet.service [None req-905e043d-471f-47d9-8e2d-5d966b967404 None None] chap_username = {{(pid=81361) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 04:29:33 devstack cinder-volume[81361]: DEBUG oslo_service.backend._eventlet.service [None req-905e043d-471f-47d9-8e2d-5d966b967404 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=81361) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 04:29:33 devstack cinder-volume[81361]: DEBUG oslo_service.backend._eventlet.service [None req-905e043d-471f-47d9-8e2d-5d966b967404 None None] cinder_internal_tenant_project_id = 8c9bda5796214d61aae41e9608b9310f {{(pid=81361) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 04:29:33 devstack cinder-volume[81361]: DEBUG oslo_service.backend._eventlet.service [None req-905e043d-471f-47d9-8e2d-5d966b967404 None None] cinder_internal_tenant_user_id = 89053059899d48acb687e042d0af46df {{(pid=81361) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 04:29:33 devstack cinder-volume[81361]: DEBUG oslo_service.backend._eventlet.service [None req-905e043d-471f-47d9-8e2d-5d966b967404 None None] cloned_volume_same_az = True {{(pid=81361) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 04:29:33 devstack cinder-volume[81361]: DEBUG oslo_service.backend._eventlet.service [None req-905e043d-471f-47d9-8e2d-5d966b967404 None None] cluster = None {{(pid=81361) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 04:29:33 devstack cinder-volume[81361]: DEBUG oslo_service.backend._eventlet.service [None req-905e043d-471f-47d9-8e2d-5d966b967404 None None] compression_format = gzip {{(pid=81361) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 04:29:33 devstack cinder-volume[81361]: DEBUG oslo_service.backend._eventlet.service [None req-905e043d-471f-47d9-8e2d-5d966b967404 None None] compute_api_class = cinder.compute.nova.API {{(pid=81361) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 04:29:33 devstack cinder-volume[81361]: DEBUG oslo_service.backend._eventlet.service [None req-905e043d-471f-47d9-8e2d-5d966b967404 None None] config_dir = [] {{(pid=81361) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 04:29:33 devstack cinder-volume[81361]: DEBUG oslo_service.backend._eventlet.service [None req-905e043d-471f-47d9-8e2d-5d966b967404 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=81361) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 04:29:33 devstack cinder-volume[81361]: DEBUG oslo_service.backend._eventlet.service [None req-905e043d-471f-47d9-8e2d-5d966b967404 None None] config_source = [] {{(pid=81361) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 04:29:33 devstack cinder-volume[81361]: DEBUG oslo_service.backend._eventlet.service [None req-905e043d-471f-47d9-8e2d-5d966b967404 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=81361) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 04:29:33 devstack cinder-volume[81361]: DEBUG oslo_service.backend._eventlet.service [None req-905e043d-471f-47d9-8e2d-5d966b967404 None None] control_exchange = openstack {{(pid=81361) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 04:29:33 devstack cinder-volume[81361]: DEBUG oslo_service.backend._eventlet.service [None req-905e043d-471f-47d9-8e2d-5d966b967404 None None] debug = True {{(pid=81361) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 04:29:33 devstack cinder-volume[81361]: DEBUG oslo_service.backend._eventlet.service [None req-905e043d-471f-47d9-8e2d-5d966b967404 None None] default_availability_zone = None {{(pid=81361) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 04:29:33 devstack cinder-volume[81361]: DEBUG oslo_service.backend._eventlet.service [None req-905e043d-471f-47d9-8e2d-5d966b967404 None None] default_group_type = None {{(pid=81361) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 04:29:33 devstack cinder-volume[81361]: DEBUG oslo_service.backend._eventlet.service [None req-905e043d-471f-47d9-8e2d-5d966b967404 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=81361) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 04:29:33 devstack cinder-volume[81361]: DEBUG oslo_service.backend._eventlet.service [None req-905e043d-471f-47d9-8e2d-5d966b967404 None None] default_volume_type = lvmdriver-1 {{(pid=81361) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 04:29:33 devstack cinder-volume[81361]: DEBUG oslo_service.backend._eventlet.service [None req-905e043d-471f-47d9-8e2d-5d966b967404 None None] disk_geometry = None {{(pid=81361) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 04:29:33 devstack cinder-volume[81361]: DEBUG oslo_service.backend._eventlet.service [None req-905e043d-471f-47d9-8e2d-5d966b967404 None None] driver_client_cert = None {{(pid=81361) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 04:29:33 devstack cinder-volume[81361]: DEBUG oslo_service.backend._eventlet.service [None req-905e043d-471f-47d9-8e2d-5d966b967404 None None] driver_client_cert_key = None {{(pid=81361) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 04:29:33 devstack cinder-volume[81361]: DEBUG oslo_service.backend._eventlet.service [None req-905e043d-471f-47d9-8e2d-5d966b967404 None None] driver_data_namespace = None {{(pid=81361) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 04:29:33 devstack cinder-volume[81361]: DEBUG oslo_service.backend._eventlet.service [None req-905e043d-471f-47d9-8e2d-5d966b967404 None None] driver_ssl_cert_path = None {{(pid=81361) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 04:29:33 devstack cinder-volume[81361]: DEBUG oslo_service.backend._eventlet.service [None req-905e043d-471f-47d9-8e2d-5d966b967404 None None] driver_ssl_cert_verify = False {{(pid=81361) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 04:29:33 devstack cinder-volume[81361]: DEBUG oslo_service.backend._eventlet.service [None req-905e043d-471f-47d9-8e2d-5d966b967404 None None] driver_use_ssl = False {{(pid=81361) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 04:29:33 devstack cinder-volume[81361]: DEBUG oslo_service.backend._eventlet.service [None req-905e043d-471f-47d9-8e2d-5d966b967404 None None] enable_force_upload = False {{(pid=81361) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 04:29:33 devstack cinder-volume[81361]: DEBUG oslo_service.backend._eventlet.service [None req-905e043d-471f-47d9-8e2d-5d966b967404 None None] enable_new_services = True {{(pid=81361) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 04:29:33 devstack cinder-volume[81361]: DEBUG oslo_service.backend._eventlet.service [None req-905e043d-471f-47d9-8e2d-5d966b967404 None None] enable_unsupported_driver = False {{(pid=81361) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 04:29:33 devstack cinder-volume[81361]: DEBUG oslo_service.backend._eventlet.service [None req-905e043d-471f-47d9-8e2d-5d966b967404 None None] enabled_backends = ['lvmdriver-1'] {{(pid=81361) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 04:29:33 devstack cinder-volume[81361]: DEBUG oslo_service.backend._eventlet.service [None req-905e043d-471f-47d9-8e2d-5d966b967404 None None] enforce_multipath_for_image_xfer = False {{(pid=81361) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 04:29:33 devstack cinder-volume[81361]: DEBUG oslo_service.backend._eventlet.service [None req-905e043d-471f-47d9-8e2d-5d966b967404 None None] filter_function = None {{(pid=81361) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 04:29:33 devstack cinder-volume[81361]: DEBUG oslo_service.backend._eventlet.service [None req-905e043d-471f-47d9-8e2d-5d966b967404 None None] glance_api_insecure = False {{(pid=81361) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 04:29:33 devstack cinder-volume[81361]: DEBUG oslo_service.backend._eventlet.service [None req-905e043d-471f-47d9-8e2d-5d966b967404 None None] glance_api_servers = ['http://192.168.122.240/image'] {{(pid=81361) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 04:29:33 devstack cinder-volume[81361]: DEBUG oslo_service.backend._eventlet.service [None req-905e043d-471f-47d9-8e2d-5d966b967404 None None] glance_api_ssl_compression = False {{(pid=81361) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 04:29:33 devstack cinder-volume[81361]: DEBUG oslo_service.backend._eventlet.service [None req-905e043d-471f-47d9-8e2d-5d966b967404 None None] glance_ca_certificates_file = None {{(pid=81361) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 04:29:33 devstack cinder-volume[81361]: DEBUG oslo_service.backend._eventlet.service [None req-905e043d-471f-47d9-8e2d-5d966b967404 None None] glance_catalog_info = image:glance:publicURL {{(pid=81361) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 04:29:33 devstack cinder-volume[81361]: DEBUG oslo_service.backend._eventlet.service [None req-905e043d-471f-47d9-8e2d-5d966b967404 None None] glance_certfile = None {{(pid=81361) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 04:29:33 devstack cinder-volume[81361]: DEBUG oslo_service.backend._eventlet.service [None req-905e043d-471f-47d9-8e2d-5d966b967404 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=81361) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 04:29:33 devstack cinder-volume[81361]: DEBUG oslo_service.backend._eventlet.service [None req-905e043d-471f-47d9-8e2d-5d966b967404 None None] glance_keyfile = None {{(pid=81361) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 04:29:33 devstack sudo[81537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 Jun 17 04:29:33 devstack cinder-volume[81361]: DEBUG oslo_service.backend._eventlet.service [None req-905e043d-471f-47d9-8e2d-5d966b967404 None None] glance_num_retries = 3 {{(pid=81361) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 04:29:33 devstack cinder-volume[81361]: DEBUG oslo_service.backend._eventlet.service [None req-905e043d-471f-47d9-8e2d-5d966b967404 None None] glance_request_timeout = None {{(pid=81361) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 04:29:33 devstack cinder-volume[81361]: DEBUG oslo_service.backend._eventlet.service [None req-905e043d-471f-47d9-8e2d-5d966b967404 None None] goodness_function = None {{(pid=81361) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 04:29:33 devstack cinder-volume[81361]: DEBUG oslo_service.backend._eventlet.service [None req-905e043d-471f-47d9-8e2d-5d966b967404 None None] graceful_shutdown_timeout = 5 {{(pid=81361) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 04:29:33 devstack cinder-volume[81361]: DEBUG oslo_service.backend._eventlet.service [None req-905e043d-471f-47d9-8e2d-5d966b967404 None None] group_api_class = cinder.group.api.API {{(pid=81361) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 04:29:33 devstack cinder-volume[81361]: DEBUG oslo_service.backend._eventlet.service [None req-905e043d-471f-47d9-8e2d-5d966b967404 None None] host = devstack {{(pid=81361) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 04:29:33 devstack cinder-volume[81361]: DEBUG oslo_service.backend._eventlet.service [None req-905e043d-471f-47d9-8e2d-5d966b967404 None None] image_compress_on_upload = True {{(pid=81361) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 04:29:33 devstack sudo[81537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:29:33 devstack cinder-volume[81361]: DEBUG oslo_service.backend._eventlet.service [None req-905e043d-471f-47d9-8e2d-5d966b967404 None None] image_conversion_address_space_limit = 1 {{(pid=81361) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 04:29:33 devstack cinder-volume[81361]: DEBUG oslo_service.backend._eventlet.service [None req-905e043d-471f-47d9-8e2d-5d966b967404 None None] image_conversion_cpu_limit = 60 {{(pid=81361) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 04:29:33 devstack cinder-volume[81361]: DEBUG oslo_service.backend._eventlet.service [None req-905e043d-471f-47d9-8e2d-5d966b967404 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=81361) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 04:29:33 devstack cinder-volume[81361]: DEBUG oslo_service.backend._eventlet.service [None req-905e043d-471f-47d9-8e2d-5d966b967404 None None] image_conversion_disable = False {{(pid=81361) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 04:29:33 devstack cinder-volume[81361]: DEBUG oslo_service.backend._eventlet.service [None req-905e043d-471f-47d9-8e2d-5d966b967404 None None] image_upload_use_cinder_backend = False {{(pid=81361) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 04:29:33 devstack cinder-volume[81361]: DEBUG oslo_service.backend._eventlet.service [None req-905e043d-471f-47d9-8e2d-5d966b967404 None None] image_upload_use_internal_tenant = False {{(pid=81361) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 04:29:33 devstack cinder-volume[81361]: DEBUG oslo_service.backend._eventlet.service [None req-905e043d-471f-47d9-8e2d-5d966b967404 None None] image_volume_cache_enabled = False {{(pid=81361) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 04:29:33 devstack cinder-volume[81361]: DEBUG oslo_service.backend._eventlet.service [None req-905e043d-471f-47d9-8e2d-5d966b967404 None None] image_volume_cache_max_count = 0 {{(pid=81361) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 04:29:33 devstack cinder-volume[81529]: INFO cinder.volume.manager [None req-81f4d17e-4515-41ce-a683-634aa574225e None None] Starting volume driver LVMVolumeDriver (3.0.0) Jun 17 04:29:33 devstack cinder-volume[81361]: DEBUG oslo_service.backend._eventlet.service [None req-905e043d-471f-47d9-8e2d-5d966b967404 None None] image_volume_cache_max_size_gb = 0 {{(pid=81361) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 04:29:33 devstack cinder-volume[81529]: DEBUG oslo_concurrency.processutils [None req-81f4d17e-4515-41ce-a683-634aa574225e None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=81529) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:29:33 devstack cinder-volume[81361]: DEBUG oslo_service.backend._eventlet.service [None req-905e043d-471f-47d9-8e2d-5d966b967404 None None] init_host_max_objects_retrieval = 0 {{(pid=81361) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 04:29:33 devstack cinder-volume[81361]: DEBUG oslo_service.backend._eventlet.service [None req-905e043d-471f-47d9-8e2d-5d966b967404 None None] instance_format = [instance: %(uuid)s] {{(pid=81361) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 04:29:33 devstack cinder-volume[81361]: DEBUG oslo_service.backend._eventlet.service [None req-905e043d-471f-47d9-8e2d-5d966b967404 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=81361) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 04:29:33 devstack cinder-volume[81361]: DEBUG oslo_service.backend._eventlet.service [None req-905e043d-471f-47d9-8e2d-5d966b967404 None None] iscsi_target_flags = {{(pid=81361) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 04:29:33 devstack cinder-volume[81361]: DEBUG oslo_service.backend._eventlet.service [None req-905e043d-471f-47d9-8e2d-5d966b967404 None None] iscsi_write_cache = on {{(pid=81361) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 04:29:33 devstack cinder-volume[81361]: DEBUG oslo_service.backend._eventlet.service [None req-905e043d-471f-47d9-8e2d-5d966b967404 None None] iser_helper = tgtadm {{(pid=81361) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 04:29:33 devstack cinder-volume[81361]: DEBUG oslo_service.backend._eventlet.service [None req-905e043d-471f-47d9-8e2d-5d966b967404 None None] iser_ip_address = 192.168.122.240 {{(pid=81361) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 04:29:33 devstack cinder-volume[81361]: DEBUG oslo_service.backend._eventlet.service [None req-905e043d-471f-47d9-8e2d-5d966b967404 None None] iser_port = 3260 {{(pid=81361) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 04:29:33 devstack cinder-volume[81361]: DEBUG oslo_service.backend._eventlet.service [None req-905e043d-471f-47d9-8e2d-5d966b967404 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=81361) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 04:29:33 devstack cinder-volume[81361]: DEBUG oslo_service.backend._eventlet.service [None req-905e043d-471f-47d9-8e2d-5d966b967404 None None] log_color = False {{(pid=81361) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 04:29:33 devstack cinder-volume[81361]: DEBUG oslo_service.backend._eventlet.service [None req-905e043d-471f-47d9-8e2d-5d966b967404 None None] log_config_append = None {{(pid=81361) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 04:29:33 devstack cinder-volume[81361]: DEBUG oslo_service.backend._eventlet.service [None req-905e043d-471f-47d9-8e2d-5d966b967404 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81361) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 04:29:33 devstack cinder-volume[81361]: DEBUG oslo_service.backend._eventlet.service [None req-905e043d-471f-47d9-8e2d-5d966b967404 None None] log_dir = None {{(pid=81361) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 04:29:33 devstack cinder-volume[81361]: DEBUG oslo_service.backend._eventlet.service [None req-905e043d-471f-47d9-8e2d-5d966b967404 None None] log_file = None {{(pid=81361) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 04:29:33 devstack cinder-volume[81361]: DEBUG oslo_service.backend._eventlet.service [None req-905e043d-471f-47d9-8e2d-5d966b967404 None None] log_options = True {{(pid=81361) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 04:29:33 devstack cinder-volume[81361]: DEBUG oslo_service.backend._eventlet.service [None req-905e043d-471f-47d9-8e2d-5d966b967404 None None] log_rotate_interval = 1 {{(pid=81361) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 04:29:33 devstack cinder-volume[81361]: DEBUG oslo_service.backend._eventlet.service [None req-905e043d-471f-47d9-8e2d-5d966b967404 None None] log_rotate_interval_type = days {{(pid=81361) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 04:29:33 devstack cinder-volume[81361]: DEBUG oslo_service.backend._eventlet.service [None req-905e043d-471f-47d9-8e2d-5d966b967404 None None] log_rotation_type = none {{(pid=81361) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 04:29:33 devstack cinder-volume[81361]: DEBUG oslo_service.backend._eventlet.service [None req-905e043d-471f-47d9-8e2d-5d966b967404 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81361) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 04:29:33 devstack cinder-volume[81361]: DEBUG oslo_service.backend._eventlet.service [None req-905e043d-471f-47d9-8e2d-5d966b967404 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81361) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 04:29:33 devstack cinder-volume[81361]: DEBUG oslo_service.backend._eventlet.service [None req-905e043d-471f-47d9-8e2d-5d966b967404 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81361) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 04:29:33 devstack cinder-volume[81361]: DEBUG oslo_service.backend._eventlet.service [None req-905e043d-471f-47d9-8e2d-5d966b967404 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81361) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 04:29:33 devstack cinder-volume[81361]: DEBUG oslo_service.backend._eventlet.service [None req-905e043d-471f-47d9-8e2d-5d966b967404 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81361) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 04:29:33 devstack cinder-volume[81361]: DEBUG oslo_service.backend._eventlet.service [None req-905e043d-471f-47d9-8e2d-5d966b967404 None None] max_age = 0 {{(pid=81361) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 04:29:33 devstack cinder-volume[81361]: DEBUG oslo_service.backend._eventlet.service [None req-905e043d-471f-47d9-8e2d-5d966b967404 None None] max_logfile_count = 30 {{(pid=81361) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 04:29:33 devstack cinder-volume[81361]: DEBUG oslo_service.backend._eventlet.service [None req-905e043d-471f-47d9-8e2d-5d966b967404 None None] max_logfile_size_mb = 200 {{(pid=81361) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 04:29:33 devstack cinder-volume[81361]: DEBUG oslo_service.backend._eventlet.service [None req-905e043d-471f-47d9-8e2d-5d966b967404 None None] max_over_subscription_ratio = 20.0 {{(pid=81361) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 04:29:33 devstack cinder-volume[81361]: DEBUG oslo_service.backend._eventlet.service [None req-905e043d-471f-47d9-8e2d-5d966b967404 None None] message_reap_interval = 86400 {{(pid=81361) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 04:29:33 devstack cinder-volume[81361]: DEBUG oslo_service.backend._eventlet.service [None req-905e043d-471f-47d9-8e2d-5d966b967404 None None] message_ttl = 2592000 {{(pid=81361) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 04:29:33 devstack cinder-volume[81361]: DEBUG oslo_service.backend._eventlet.service [None req-905e043d-471f-47d9-8e2d-5d966b967404 None None] migration_create_volume_timeout_secs = 300 {{(pid=81361) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 04:29:33 devstack cinder-volume[81361]: DEBUG oslo_service.backend._eventlet.service [None req-905e043d-471f-47d9-8e2d-5d966b967404 None None] monkey_patch = False {{(pid=81361) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 04:29:33 devstack cinder-volume[81361]: DEBUG oslo_service.backend._eventlet.service [None req-905e043d-471f-47d9-8e2d-5d966b967404 None None] monkey_patch_modules = [] {{(pid=81361) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 04:29:33 devstack cinder-volume[81361]: DEBUG oslo_service.backend._eventlet.service [None req-905e043d-471f-47d9-8e2d-5d966b967404 None None] my_ip = 192.168.122.240 {{(pid=81361) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 04:29:33 devstack cinder-volume[81361]: DEBUG oslo_service.backend._eventlet.service [None req-905e043d-471f-47d9-8e2d-5d966b967404 None None] no_snapshot_gb_quota = False {{(pid=81361) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 04:29:33 devstack cinder-volume[81361]: DEBUG oslo_service.backend._eventlet.service [None req-905e043d-471f-47d9-8e2d-5d966b967404 None None] num_iser_scan_tries = 3 {{(pid=81361) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 04:29:33 devstack cinder-volume[81361]: DEBUG oslo_service.backend._eventlet.service [None req-905e043d-471f-47d9-8e2d-5d966b967404 None None] num_shell_tries = 3 {{(pid=81361) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 04:29:33 devstack cinder-volume[81361]: DEBUG oslo_service.backend._eventlet.service [None req-905e043d-471f-47d9-8e2d-5d966b967404 None None] num_volume_device_scan_tries = 3 {{(pid=81361) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 04:29:33 devstack cinder-volume[81361]: DEBUG oslo_service.backend._eventlet.service [None req-905e043d-471f-47d9-8e2d-5d966b967404 None None] nvmeof_conn_info_version = 1 {{(pid=81361) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 04:29:33 devstack cinder-volume[81361]: DEBUG oslo_service.backend._eventlet.service [None req-905e043d-471f-47d9-8e2d-5d966b967404 None None] nvmet_ns_id = 10 {{(pid=81361) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 04:29:33 devstack cinder-volume[81361]: DEBUG oslo_service.backend._eventlet.service [None req-905e043d-471f-47d9-8e2d-5d966b967404 None None] nvmet_port_id = 1 {{(pid=81361) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 04:29:33 devstack cinder-volume[81361]: DEBUG oslo_service.backend._eventlet.service [None req-905e043d-471f-47d9-8e2d-5d966b967404 None None] osapi_max_limit = 1000 {{(pid=81361) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 04:29:33 devstack cinder-volume[81361]: DEBUG oslo_service.backend._eventlet.service [None req-905e043d-471f-47d9-8e2d-5d966b967404 None None] osapi_volume_ext_list = [] {{(pid=81361) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 04:29:33 devstack cinder-volume[81361]: DEBUG oslo_service.backend._eventlet.service [None req-905e043d-471f-47d9-8e2d-5d966b967404 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=81361) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 04:29:33 devstack cinder-volume[81361]: DEBUG oslo_service.backend._eventlet.service [None req-905e043d-471f-47d9-8e2d-5d966b967404 None None] osapi_volume_listen = 0.0.0.0 {{(pid=81361) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 04:29:33 devstack cinder-volume[81361]: DEBUG oslo_service.backend._eventlet.service [None req-905e043d-471f-47d9-8e2d-5d966b967404 None None] osapi_volume_listen_port = 8776 {{(pid=81361) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 04:29:33 devstack cinder-volume[81361]: DEBUG oslo_service.backend._eventlet.service [None req-905e043d-471f-47d9-8e2d-5d966b967404 None None] osapi_volume_use_ssl = False {{(pid=81361) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 04:29:33 devstack cinder-volume[81361]: DEBUG oslo_service.backend._eventlet.service [None req-905e043d-471f-47d9-8e2d-5d966b967404 None None] osapi_volume_workers = 2 {{(pid=81361) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 04:29:33 devstack cinder-volume[81361]: DEBUG oslo_service.backend._eventlet.service [None req-905e043d-471f-47d9-8e2d-5d966b967404 None None] per_volume_size_limit = -1 {{(pid=81361) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 04:29:33 devstack cinder-volume[81361]: DEBUG oslo_service.backend._eventlet.service [None req-905e043d-471f-47d9-8e2d-5d966b967404 None None] periodic_fuzzy_delay = 60 {{(pid=81361) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 04:29:33 devstack cinder-volume[81361]: DEBUG oslo_service.backend._eventlet.service [None req-905e043d-471f-47d9-8e2d-5d966b967404 None None] periodic_interval = 60 {{(pid=81361) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 04:29:33 devstack cinder-volume[81361]: DEBUG oslo_service.backend._eventlet.service [None req-905e043d-471f-47d9-8e2d-5d966b967404 None None] project_id_regex = [0-9a-f\-]+ {{(pid=81361) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 04:29:33 devstack cinder-volume[81361]: DEBUG oslo_service.backend._eventlet.service [None req-905e043d-471f-47d9-8e2d-5d966b967404 None None] public_endpoint = None {{(pid=81361) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 04:29:33 devstack cinder-volume[81361]: DEBUG oslo_service.backend._eventlet.service [None req-905e043d-471f-47d9-8e2d-5d966b967404 None None] publish_errors = False {{(pid=81361) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 04:29:33 devstack cinder-volume[81361]: DEBUG oslo_service.backend._eventlet.service [None req-905e043d-471f-47d9-8e2d-5d966b967404 None None] quota_backup_gigabytes = 1000 {{(pid=81361) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 04:29:33 devstack cinder-volume[81361]: DEBUG oslo_service.backend._eventlet.service [None req-905e043d-471f-47d9-8e2d-5d966b967404 None None] quota_backups = 10 {{(pid=81361) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 04:29:33 devstack cinder-volume[81361]: DEBUG oslo_service.backend._eventlet.service [None req-905e043d-471f-47d9-8e2d-5d966b967404 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=81361) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 04:29:33 devstack cinder-volume[81361]: DEBUG oslo_service.backend._eventlet.service [None req-905e043d-471f-47d9-8e2d-5d966b967404 None None] quota_gigabytes = 1000 {{(pid=81361) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 04:29:33 devstack cinder-volume[81361]: DEBUG oslo_service.backend._eventlet.service [None req-905e043d-471f-47d9-8e2d-5d966b967404 None None] quota_groups = 10 {{(pid=81361) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 04:29:33 devstack cinder-volume[81361]: DEBUG oslo_service.backend._eventlet.service [None req-905e043d-471f-47d9-8e2d-5d966b967404 None None] quota_snapshots = 10 {{(pid=81361) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 04:29:33 devstack cinder-volume[81361]: DEBUG oslo_service.backend._eventlet.service [None req-905e043d-471f-47d9-8e2d-5d966b967404 None None] quota_volumes = 10 {{(pid=81361) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 04:29:33 devstack cinder-volume[81361]: DEBUG oslo_service.backend._eventlet.service [None req-905e043d-471f-47d9-8e2d-5d966b967404 None None] rate_limit_burst = 0 {{(pid=81361) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 04:29:33 devstack cinder-volume[81361]: DEBUG oslo_service.backend._eventlet.service [None req-905e043d-471f-47d9-8e2d-5d966b967404 None None] rate_limit_except_level = CRITICAL {{(pid=81361) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 04:29:33 devstack cinder-volume[81361]: DEBUG oslo_service.backend._eventlet.service [None req-905e043d-471f-47d9-8e2d-5d966b967404 None None] rate_limit_interval = 0 {{(pid=81361) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 04:29:33 devstack cinder-volume[81361]: DEBUG oslo_service.backend._eventlet.service [None req-905e043d-471f-47d9-8e2d-5d966b967404 None None] reinit_driver_count = 3 {{(pid=81361) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 04:29:33 devstack cinder-volume[81361]: DEBUG oslo_service.backend._eventlet.service [None req-905e043d-471f-47d9-8e2d-5d966b967404 None None] replication_device = **** {{(pid=81361) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 04:29:33 devstack cinder-volume[81361]: DEBUG oslo_service.backend._eventlet.service [None req-905e043d-471f-47d9-8e2d-5d966b967404 None None] report_discard_supported = False {{(pid=81361) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 04:29:33 devstack cinder-volume[81529]: DEBUG oslo_concurrency.processutils [None req-81f4d17e-4515-41ce-a683-634aa574225e None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.040s {{(pid=81529) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:29:33 devstack cinder-volume[81361]: DEBUG oslo_service.backend._eventlet.service [None req-905e043d-471f-47d9-8e2d-5d966b967404 None None] report_interval = 120 {{(pid=81361) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 04:29:33 devstack cinder-volume[81361]: DEBUG oslo_service.backend._eventlet.service [None req-905e043d-471f-47d9-8e2d-5d966b967404 None None] reservation_clean_interval = 86400 {{(pid=81361) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 04:29:33 devstack cinder-volume[81361]: DEBUG oslo_service.backend._eventlet.service [None req-905e043d-471f-47d9-8e2d-5d966b967404 None None] reservation_expire = 86400 {{(pid=81361) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 04:29:33 devstack cinder-volume[81361]: DEBUG oslo_service.backend._eventlet.service [None req-905e043d-471f-47d9-8e2d-5d966b967404 None None] reserved_image_namespaces = [] {{(pid=81361) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 04:29:33 devstack cinder-volume[81529]: DEBUG oslo_concurrency.processutils [None req-81f4d17e-4515-41ce-a683-634aa574225e None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=81529) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:29:33 devstack cinder-volume[81361]: DEBUG oslo_service.backend._eventlet.service [None req-905e043d-471f-47d9-8e2d-5d966b967404 None None] reserved_percentage = 0 {{(pid=81361) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 04:29:33 devstack cinder-volume[81361]: DEBUG oslo_service.backend._eventlet.service [None req-905e043d-471f-47d9-8e2d-5d966b967404 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=81361) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 04:29:33 devstack cinder-volume[81361]: DEBUG oslo_service.backend._eventlet.service [None req-905e043d-471f-47d9-8e2d-5d966b967404 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=81361) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 04:29:33 devstack cinder-volume[81361]: DEBUG oslo_service.backend._eventlet.service [None req-905e043d-471f-47d9-8e2d-5d966b967404 None None] rpc_response_timeout = 120 {{(pid=81361) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 04:29:33 devstack cinder-volume[81361]: DEBUG oslo_service.backend._eventlet.service [None req-905e043d-471f-47d9-8e2d-5d966b967404 None None] run_external_periodic_tasks = True {{(pid=81361) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 04:29:33 devstack cinder-volume[81361]: DEBUG oslo_service.backend._eventlet.service [None req-905e043d-471f-47d9-8e2d-5d966b967404 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=81361) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 04:29:33 devstack cinder-volume[81361]: DEBUG oslo_service.backend._eventlet.service [None req-905e043d-471f-47d9-8e2d-5d966b967404 None None] scst_target_driver = iscsi {{(pid=81361) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 04:29:33 devstack cinder-volume[81361]: DEBUG oslo_service.backend._eventlet.service [None req-905e043d-471f-47d9-8e2d-5d966b967404 None None] scst_target_iqn_name = None {{(pid=81361) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 04:29:33 devstack cinder-volume[81361]: DEBUG oslo_service.backend._eventlet.service [None req-905e043d-471f-47d9-8e2d-5d966b967404 None None] service_down_time = 720 {{(pid=81361) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 04:29:33 devstack cinder-volume[81361]: DEBUG oslo_service.backend._eventlet.service [None req-905e043d-471f-47d9-8e2d-5d966b967404 None None] shell_completion = None {{(pid=81361) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 04:29:33 devstack cinder-volume[81361]: DEBUG oslo_service.backend._eventlet.service [None req-905e043d-471f-47d9-8e2d-5d966b967404 None None] snapshot_name_template = snapshot-%s {{(pid=81361) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 04:29:33 devstack cinder-volume[81361]: DEBUG oslo_service.backend._eventlet.service [None req-905e043d-471f-47d9-8e2d-5d966b967404 None None] snapshot_same_host = True {{(pid=81361) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 04:29:33 devstack cinder-volume[81361]: DEBUG oslo_service.backend._eventlet.service [None req-905e043d-471f-47d9-8e2d-5d966b967404 None None] split_loggers = False {{(pid=81361) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 04:29:33 devstack cinder-volume[81361]: DEBUG oslo_service.backend._eventlet.service [None req-905e043d-471f-47d9-8e2d-5d966b967404 None None] state_path = /opt/stack/data/cinder {{(pid=81361) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 04:29:33 devstack cinder-volume[81361]: DEBUG oslo_service.backend._eventlet.service [None req-905e043d-471f-47d9-8e2d-5d966b967404 None None] storage_availability_zone = nova {{(pid=81361) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 04:29:33 devstack cinder-volume[81361]: DEBUG oslo_service.backend._eventlet.service [None req-905e043d-471f-47d9-8e2d-5d966b967404 None None] storage_protocol = iSCSI {{(pid=81361) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 04:29:33 devstack cinder-volume[81361]: DEBUG oslo_service.backend._eventlet.service [None req-905e043d-471f-47d9-8e2d-5d966b967404 None None] syslog_log_facility = LOG_USER {{(pid=81361) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 04:29:33 devstack cinder-volume[81361]: DEBUG oslo_service.backend._eventlet.service [None req-905e043d-471f-47d9-8e2d-5d966b967404 None None] target_helper = lioadm {{(pid=81361) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 04:29:33 devstack cinder-volume[81361]: DEBUG oslo_service.backend._eventlet.service [None req-905e043d-471f-47d9-8e2d-5d966b967404 None None] target_ip_address = 192.168.122.240 {{(pid=81361) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 04:29:33 devstack cinder-volume[81361]: DEBUG oslo_service.backend._eventlet.service [None req-905e043d-471f-47d9-8e2d-5d966b967404 None None] target_port = 3260 {{(pid=81361) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 04:29:33 devstack cinder-volume[81361]: DEBUG oslo_service.backend._eventlet.service [None req-905e043d-471f-47d9-8e2d-5d966b967404 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=81361) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 04:29:33 devstack cinder-volume[81361]: DEBUG oslo_service.backend._eventlet.service [None req-905e043d-471f-47d9-8e2d-5d966b967404 None None] target_protocol = iscsi {{(pid=81361) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 04:29:33 devstack cinder-volume[81361]: DEBUG oslo_service.backend._eventlet.service [None req-905e043d-471f-47d9-8e2d-5d966b967404 None None] target_secondary_ip_addresses = [] {{(pid=81361) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 04:29:33 devstack cinder-volume[81361]: DEBUG oslo_service.backend._eventlet.service [None req-905e043d-471f-47d9-8e2d-5d966b967404 None None] trace_flags = None {{(pid=81361) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 04:29:33 devstack cinder-volume[81361]: DEBUG oslo_service.backend._eventlet.service [None req-905e043d-471f-47d9-8e2d-5d966b967404 None None] transfer_api_class = cinder.transfer.api.API {{(pid=81361) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 04:29:33 devstack cinder-volume[81361]: DEBUG oslo_service.backend._eventlet.service [None req-905e043d-471f-47d9-8e2d-5d966b967404 None None] transport_url = **** {{(pid=81361) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 04:29:33 devstack cinder-volume[81361]: DEBUG oslo_service.backend._eventlet.service [None req-905e043d-471f-47d9-8e2d-5d966b967404 None None] until_refresh = 0 {{(pid=81361) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 04:29:33 devstack cinder-volume[81361]: DEBUG oslo_service.backend._eventlet.service [None req-905e043d-471f-47d9-8e2d-5d966b967404 None None] use_chap_auth = False {{(pid=81361) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 04:29:33 devstack cinder-volume[81361]: DEBUG oslo_service.backend._eventlet.service [None req-905e043d-471f-47d9-8e2d-5d966b967404 None None] use_default_quota_class = True {{(pid=81361) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 04:29:33 devstack cinder-volume[81361]: DEBUG oslo_service.backend._eventlet.service [None req-905e043d-471f-47d9-8e2d-5d966b967404 None None] use_journal = False {{(pid=81361) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 04:29:33 devstack cinder-volume[81361]: DEBUG oslo_service.backend._eventlet.service [None req-905e043d-471f-47d9-8e2d-5d966b967404 None None] use_json = False {{(pid=81361) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 04:29:33 devstack cinder-volume[81361]: DEBUG oslo_service.backend._eventlet.service [None req-905e043d-471f-47d9-8e2d-5d966b967404 None None] use_multipath_for_image_xfer = False {{(pid=81361) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 04:29:33 devstack cinder-volume[81361]: DEBUG oslo_service.backend._eventlet.service [None req-905e043d-471f-47d9-8e2d-5d966b967404 None None] use_stderr = False {{(pid=81361) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 04:29:33 devstack cinder-volume[81361]: DEBUG oslo_service.backend._eventlet.service [None req-905e043d-471f-47d9-8e2d-5d966b967404 None None] use_syslog = False {{(pid=81361) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 04:29:33 devstack cinder-volume[81361]: DEBUG oslo_service.backend._eventlet.service [None req-905e043d-471f-47d9-8e2d-5d966b967404 None None] verify_glance_signatures = enabled {{(pid=81361) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 04:29:33 devstack cinder-volume[81361]: DEBUG oslo_service.backend._eventlet.service [None req-905e043d-471f-47d9-8e2d-5d966b967404 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=81361) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 04:29:33 devstack cinder-volume[81361]: DEBUG oslo_service.backend._eventlet.service [None req-905e043d-471f-47d9-8e2d-5d966b967404 None None] volume_api_class = cinder.volume.api.API {{(pid=81361) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 04:29:33 devstack cinder-volume[81361]: DEBUG oslo_service.backend._eventlet.service [None req-905e043d-471f-47d9-8e2d-5d966b967404 None None] volume_backend_name = None {{(pid=81361) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 04:29:33 devstack cinder-volume[81361]: DEBUG oslo_service.backend._eventlet.service [None req-905e043d-471f-47d9-8e2d-5d966b967404 None None] volume_clear = zero {{(pid=81361) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 04:29:33 devstack cinder-volume[81361]: DEBUG oslo_service.backend._eventlet.service [None req-905e043d-471f-47d9-8e2d-5d966b967404 None None] volume_clear_ionice = None {{(pid=81361) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 04:29:33 devstack cinder-volume[81361]: DEBUG oslo_service.backend._eventlet.service [None req-905e043d-471f-47d9-8e2d-5d966b967404 None None] volume_clear_size = 0 {{(pid=81361) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 04:29:33 devstack cinder-volume[81529]: DEBUG oslo_concurrency.processutils [None req-81f4d17e-4515-41ce-a683-634aa574225e None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.028s {{(pid=81529) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:29:33 devstack cinder-volume[81361]: DEBUG oslo_service.backend._eventlet.service [None req-905e043d-471f-47d9-8e2d-5d966b967404 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=81361) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 04:29:33 devstack cinder-volume[81361]: DEBUG oslo_service.backend._eventlet.service [None req-905e043d-471f-47d9-8e2d-5d966b967404 None None] volume_copy_bps_limit = 0 {{(pid=81361) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 04:29:33 devstack cinder-volume[81529]: DEBUG oslo_concurrency.processutils [None req-81f4d17e-4515-41ce-a683-634aa574225e None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=81529) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:29:33 devstack cinder-volume[81361]: DEBUG oslo_service.backend._eventlet.service [None req-905e043d-471f-47d9-8e2d-5d966b967404 None None] volume_dd_blocksize = 1M {{(pid=81361) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 04:29:33 devstack cinder-volume[81361]: DEBUG oslo_service.backend._eventlet.service [None req-905e043d-471f-47d9-8e2d-5d966b967404 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=81361) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 04:29:33 devstack cinder-volume[81361]: DEBUG oslo_service.backend._eventlet.service [None req-905e043d-471f-47d9-8e2d-5d966b967404 None None] volume_name_template = volume-%s {{(pid=81361) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 04:29:33 devstack cinder-volume[81361]: DEBUG oslo_service.backend._eventlet.service [None req-905e043d-471f-47d9-8e2d-5d966b967404 None None] volume_service_inithost_offload = False {{(pid=81361) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 04:29:33 devstack cinder-volume[81361]: DEBUG oslo_service.backend._eventlet.service [None req-905e043d-471f-47d9-8e2d-5d966b967404 None None] volume_usage_audit_period = month {{(pid=81361) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 04:29:33 devstack cinder-volume[81361]: DEBUG oslo_service.backend._eventlet.service [None req-905e043d-471f-47d9-8e2d-5d966b967404 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=81361) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 04:29:33 devstack cinder-volume[81361]: DEBUG oslo_service.backend._eventlet.service [None req-905e043d-471f-47d9-8e2d-5d966b967404 None None] zoning_mode = None {{(pid=81361) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 04:29:33 devstack cinder-volume[81361]: DEBUG oslo_service.backend._eventlet.service [None req-905e043d-471f-47d9-8e2d-5d966b967404 None None] oslo_concurrency.disable_process_locking = False {{(pid=81361) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:29:33 devstack cinder-volume[81361]: DEBUG oslo_service.backend._eventlet.service [None req-905e043d-471f-47d9-8e2d-5d966b967404 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=81361) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:29:33 devstack cinder-volume[81361]: DEBUG oslo_service.backend._eventlet.service [None req-905e043d-471f-47d9-8e2d-5d966b967404 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=81361) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:29:33 devstack cinder-volume[81361]: DEBUG oslo_service.backend._eventlet.service [None req-905e043d-471f-47d9-8e2d-5d966b967404 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=81361) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:29:33 devstack cinder-volume[81361]: DEBUG oslo_service.backend._eventlet.service [None req-905e043d-471f-47d9-8e2d-5d966b967404 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=81361) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:29:33 devstack cinder-volume[81361]: DEBUG oslo_service.backend._eventlet.service [None req-905e043d-471f-47d9-8e2d-5d966b967404 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=81361) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:29:33 devstack cinder-volume[81361]: DEBUG oslo_service.backend._eventlet.service [None req-905e043d-471f-47d9-8e2d-5d966b967404 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=81361) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:29:33 devstack cinder-volume[81361]: DEBUG oslo_service.backend._eventlet.service [None req-905e043d-471f-47d9-8e2d-5d966b967404 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=81361) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:29:33 devstack cinder-volume[81361]: DEBUG oslo_service.backend._eventlet.service [None req-905e043d-471f-47d9-8e2d-5d966b967404 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81361) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:29:33 devstack cinder-volume[81361]: DEBUG oslo_service.backend._eventlet.service [None req-905e043d-471f-47d9-8e2d-5d966b967404 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=81361) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:29:33 devstack cinder-volume[81361]: DEBUG oslo_service.backend._eventlet.service [None req-905e043d-471f-47d9-8e2d-5d966b967404 None None] keystone_authtoken.admin_password = **** {{(pid=81361) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:29:33 devstack cinder-volume[81361]: DEBUG oslo_service.backend._eventlet.service [None req-905e043d-471f-47d9-8e2d-5d966b967404 None None] keystone_authtoken.admin_tenant_name = admin {{(pid=81361) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:29:33 devstack cinder-volume[81361]: DEBUG oslo_service.backend._eventlet.service [None req-905e043d-471f-47d9-8e2d-5d966b967404 None None] keystone_authtoken.admin_token = **** {{(pid=81361) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:29:33 devstack cinder-volume[81361]: DEBUG oslo_service.backend._eventlet.service [None req-905e043d-471f-47d9-8e2d-5d966b967404 None None] keystone_authtoken.admin_user = None {{(pid=81361) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:29:33 devstack cinder-volume[81361]: DEBUG oslo_service.backend._eventlet.service [None req-905e043d-471f-47d9-8e2d-5d966b967404 None None] keystone_authtoken.auth_admin_prefix = {{(pid=81361) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:29:33 devstack cinder-volume[81361]: DEBUG oslo_service.backend._eventlet.service [None req-905e043d-471f-47d9-8e2d-5d966b967404 None None] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81361) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:29:33 devstack cinder-volume[81361]: DEBUG oslo_service.backend._eventlet.service [None req-905e043d-471f-47d9-8e2d-5d966b967404 None None] keystone_authtoken.auth_port = 35357 {{(pid=81361) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:29:33 devstack cinder-volume[81361]: DEBUG oslo_service.backend._eventlet.service [None req-905e043d-471f-47d9-8e2d-5d966b967404 None None] keystone_authtoken.auth_protocol = https {{(pid=81361) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:29:33 devstack cinder-volume[81361]: DEBUG oslo_service.backend._eventlet.service [None req-905e043d-471f-47d9-8e2d-5d966b967404 None None] keystone_authtoken.auth_section = None {{(pid=81361) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:29:33 devstack cinder-volume[81361]: DEBUG oslo_service.backend._eventlet.service [None req-905e043d-471f-47d9-8e2d-5d966b967404 None None] keystone_authtoken.auth_type = password {{(pid=81361) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:29:33 devstack cinder-volume[81361]: DEBUG oslo_service.backend._eventlet.service [None req-905e043d-471f-47d9-8e2d-5d966b967404 None None] keystone_authtoken.auth_uri = None {{(pid=81361) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:29:33 devstack cinder-volume[81361]: DEBUG oslo_service.backend._eventlet.service [None req-905e043d-471f-47d9-8e2d-5d966b967404 None None] keystone_authtoken.auth_version = None {{(pid=81361) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:29:33 devstack cinder-volume[81361]: DEBUG oslo_service.backend._eventlet.service [None req-905e043d-471f-47d9-8e2d-5d966b967404 None None] keystone_authtoken.cache = None {{(pid=81361) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:29:33 devstack cinder-volume[81361]: DEBUG oslo_service.backend._eventlet.service [None req-905e043d-471f-47d9-8e2d-5d966b967404 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=81361) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:29:33 devstack cinder-volume[81361]: DEBUG oslo_service.backend._eventlet.service [None req-905e043d-471f-47d9-8e2d-5d966b967404 None None] keystone_authtoken.certfile = None {{(pid=81361) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:29:33 devstack cinder-volume[81361]: DEBUG oslo_service.backend._eventlet.service [None req-905e043d-471f-47d9-8e2d-5d966b967404 None None] keystone_authtoken.delay_auth_decision = False {{(pid=81361) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:29:33 devstack cinder-volume[81361]: DEBUG oslo_service.backend._eventlet.service [None req-905e043d-471f-47d9-8e2d-5d966b967404 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=81361) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:29:33 devstack cinder-volume[81361]: DEBUG oslo_service.backend._eventlet.service [None req-905e043d-471f-47d9-8e2d-5d966b967404 None None] keystone_authtoken.http_connect_timeout = None {{(pid=81361) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:29:33 devstack cinder-volume[81361]: DEBUG oslo_service.backend._eventlet.service [None req-905e043d-471f-47d9-8e2d-5d966b967404 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=81361) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:29:33 devstack cinder-volume[81361]: DEBUG oslo_service.backend._eventlet.service [None req-905e043d-471f-47d9-8e2d-5d966b967404 None None] keystone_authtoken.identity_uri = None {{(pid=81361) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:29:33 devstack cinder-volume[81529]: DEBUG oslo_concurrency.processutils [None req-81f4d17e-4515-41ce-a683-634aa574225e None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.022s {{(pid=81529) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:29:33 devstack cinder-volume[81361]: DEBUG oslo_service.backend._eventlet.service [None req-905e043d-471f-47d9-8e2d-5d966b967404 None None] keystone_authtoken.include_service_catalog = True {{(pid=81361) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:29:33 devstack cinder-volume[81361]: DEBUG oslo_service.backend._eventlet.service [None req-905e043d-471f-47d9-8e2d-5d966b967404 None None] keystone_authtoken.insecure = False {{(pid=81361) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:29:33 devstack cinder-volume[81529]: DEBUG oslo_concurrency.processutils [None req-81f4d17e-4515-41ce-a683-634aa574225e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 {{(pid=81529) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:29:33 devstack cinder-volume[81361]: DEBUG oslo_service.backend._eventlet.service [None req-905e043d-471f-47d9-8e2d-5d966b967404 None None] keystone_authtoken.interface = public {{(pid=81361) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:29:33 devstack cinder-volume[81361]: DEBUG oslo_service.backend._eventlet.service [None req-905e043d-471f-47d9-8e2d-5d966b967404 None None] keystone_authtoken.keyfile = None {{(pid=81361) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:29:33 devstack cinder-volume[81361]: DEBUG oslo_service.backend._eventlet.service [None req-905e043d-471f-47d9-8e2d-5d966b967404 None None] keystone_authtoken.memcache_password = {{(pid=81361) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:29:33 devstack cinder-volume[81361]: DEBUG oslo_service.backend._eventlet.service [None req-905e043d-471f-47d9-8e2d-5d966b967404 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81361) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:29:33 devstack cinder-volume[81361]: DEBUG oslo_service.backend._eventlet.service [None req-905e043d-471f-47d9-8e2d-5d966b967404 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81361) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:29:33 devstack cinder-volume[81361]: DEBUG oslo_service.backend._eventlet.service [None req-905e043d-471f-47d9-8e2d-5d966b967404 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81361) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:29:33 devstack cinder-volume[81361]: DEBUG oslo_service.backend._eventlet.service [None req-905e043d-471f-47d9-8e2d-5d966b967404 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81361) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:29:33 devstack cinder-volume[81361]: DEBUG oslo_service.backend._eventlet.service [None req-905e043d-471f-47d9-8e2d-5d966b967404 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81361) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:29:33 devstack cinder-volume[81361]: DEBUG oslo_service.backend._eventlet.service [None req-905e043d-471f-47d9-8e2d-5d966b967404 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=81361) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:29:33 devstack cinder-volume[81361]: DEBUG oslo_service.backend._eventlet.service [None req-905e043d-471f-47d9-8e2d-5d966b967404 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=81361) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:29:33 devstack cinder-volume[81361]: DEBUG oslo_service.backend._eventlet.service [None req-905e043d-471f-47d9-8e2d-5d966b967404 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=81361) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:29:33 devstack cinder-volume[81361]: DEBUG oslo_service.backend._eventlet.service [None req-905e043d-471f-47d9-8e2d-5d966b967404 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=81361) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:29:33 devstack cinder-volume[81361]: DEBUG oslo_service.backend._eventlet.service [None req-905e043d-471f-47d9-8e2d-5d966b967404 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=81361) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:29:33 devstack cinder-volume[81361]: DEBUG oslo_service.backend._eventlet.service [None req-905e043d-471f-47d9-8e2d-5d966b967404 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=81361) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:29:33 devstack cinder-volume[81361]: DEBUG oslo_service.backend._eventlet.service [None req-905e043d-471f-47d9-8e2d-5d966b967404 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=81361) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:29:33 devstack cinder-volume[81361]: DEBUG oslo_service.backend._eventlet.service [None req-905e043d-471f-47d9-8e2d-5d966b967404 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=81361) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:29:33 devstack cinder-volume[81361]: DEBUG oslo_service.backend._eventlet.service [None req-905e043d-471f-47d9-8e2d-5d966b967404 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81361) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:29:33 devstack cinder-volume[81361]: DEBUG oslo_service.backend._eventlet.service [None req-905e043d-471f-47d9-8e2d-5d966b967404 None None] keystone_authtoken.memcache_username = {{(pid=81361) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:29:33 devstack cinder-volume[81361]: DEBUG oslo_service.backend._eventlet.service [None req-905e043d-471f-47d9-8e2d-5d966b967404 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=81361) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:29:33 devstack cinder-volume[81361]: DEBUG oslo_service.backend._eventlet.service [None req-905e043d-471f-47d9-8e2d-5d966b967404 None None] keystone_authtoken.region_name = None {{(pid=81361) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:29:33 devstack cinder-volume[81361]: DEBUG oslo_service.backend._eventlet.service [None req-905e043d-471f-47d9-8e2d-5d966b967404 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=81361) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:29:33 devstack cinder-volume[81361]: DEBUG oslo_service.backend._eventlet.service [None req-905e043d-471f-47d9-8e2d-5d966b967404 None None] keystone_authtoken.service_token_roles_required = False {{(pid=81361) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:29:33 devstack cinder-volume[81361]: DEBUG oslo_service.backend._eventlet.service [None req-905e043d-471f-47d9-8e2d-5d966b967404 None None] keystone_authtoken.service_type = None {{(pid=81361) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:29:33 devstack cinder-volume[81361]: DEBUG oslo_service.backend._eventlet.service [None req-905e043d-471f-47d9-8e2d-5d966b967404 None None] keystone_authtoken.token_cache_time = 300 {{(pid=81361) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:29:33 devstack cinder-volume[81361]: DEBUG oslo_service.backend._eventlet.service [None req-905e043d-471f-47d9-8e2d-5d966b967404 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.240/identity {{(pid=81361) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:29:33 devstack cinder-volume[81361]: DEBUG oslo_service.backend._eventlet.service [None req-905e043d-471f-47d9-8e2d-5d966b967404 None None] cache.backend = dogpile.cache.null {{(pid=81361) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:29:33 devstack cinder-volume[81361]: DEBUG oslo_service.backend._eventlet.service [None req-905e043d-471f-47d9-8e2d-5d966b967404 None None] cache.backend_argument = **** {{(pid=81361) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:29:33 devstack cinder-volume[81361]: DEBUG oslo_service.backend._eventlet.service [None req-905e043d-471f-47d9-8e2d-5d966b967404 None None] cache.backend_expiration_time = None {{(pid=81361) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:29:33 devstack cinder-volume[81361]: DEBUG oslo_service.backend._eventlet.service [None req-905e043d-471f-47d9-8e2d-5d966b967404 None None] cache.config_prefix = cache.oslo {{(pid=81361) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:29:33 devstack cinder-volume[81361]: DEBUG oslo_service.backend._eventlet.service [None req-905e043d-471f-47d9-8e2d-5d966b967404 None None] cache.debug_cache_backend = False {{(pid=81361) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:29:33 devstack cinder-volume[81361]: DEBUG oslo_service.backend._eventlet.service [None req-905e043d-471f-47d9-8e2d-5d966b967404 None None] cache.enable_retry_client = False {{(pid=81361) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:29:33 devstack cinder-volume[81361]: DEBUG oslo_service.backend._eventlet.service [None req-905e043d-471f-47d9-8e2d-5d966b967404 None None] cache.enable_socket_keepalive = False {{(pid=81361) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:29:33 devstack cinder-volume[81361]: DEBUG oslo_service.backend._eventlet.service [None req-905e043d-471f-47d9-8e2d-5d966b967404 None None] cache.enabled = False {{(pid=81361) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:29:33 devstack cinder-volume[81361]: DEBUG oslo_service.backend._eventlet.service [None req-905e043d-471f-47d9-8e2d-5d966b967404 None None] cache.enforce_fips_mode = False {{(pid=81361) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:29:33 devstack cinder-volume[81361]: DEBUG oslo_service.backend._eventlet.service [None req-905e043d-471f-47d9-8e2d-5d966b967404 None None] cache.expiration_time = 600 {{(pid=81361) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:29:33 devstack cinder-volume[81361]: DEBUG oslo_service.backend._eventlet.service [None req-905e043d-471f-47d9-8e2d-5d966b967404 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=81361) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:29:33 devstack cinder-volume[81361]: DEBUG oslo_service.backend._eventlet.service [None req-905e043d-471f-47d9-8e2d-5d966b967404 None None] cache.hashclient_retry_attempts = 2 {{(pid=81361) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:29:33 devstack cinder-volume[81361]: DEBUG oslo_service.backend._eventlet.service [None req-905e043d-471f-47d9-8e2d-5d966b967404 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=81361) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:29:33 devstack cinder-volume[81361]: DEBUG oslo_service.backend._eventlet.service [None req-905e043d-471f-47d9-8e2d-5d966b967404 None None] cache.memcache_dead_retry = 300 {{(pid=81361) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:29:33 devstack cinder-volume[81361]: DEBUG oslo_service.backend._eventlet.service [None req-905e043d-471f-47d9-8e2d-5d966b967404 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81361) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:29:33 devstack cinder-volume[81361]: DEBUG oslo_service.backend._eventlet.service [None req-905e043d-471f-47d9-8e2d-5d966b967404 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=81361) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:29:33 devstack cinder-volume[81361]: DEBUG oslo_service.backend._eventlet.service [None req-905e043d-471f-47d9-8e2d-5d966b967404 None None] cache.memcache_pool_maxsize = 10 {{(pid=81361) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:29:33 devstack cinder-volume[81361]: DEBUG oslo_service.backend._eventlet.service [None req-905e043d-471f-47d9-8e2d-5d966b967404 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=81361) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:29:33 devstack cinder-volume[81361]: DEBUG oslo_service.backend._eventlet.service [None req-905e043d-471f-47d9-8e2d-5d966b967404 None None] cache.memcache_sasl_enabled = False {{(pid=81361) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:29:33 devstack cinder-volume[81361]: DEBUG oslo_service.backend._eventlet.service [None req-905e043d-471f-47d9-8e2d-5d966b967404 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=81361) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:29:33 devstack cinder-volume[81361]: DEBUG oslo_service.backend._eventlet.service [None req-905e043d-471f-47d9-8e2d-5d966b967404 None None] cache.password = **** {{(pid=81361) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:29:33 devstack cinder-volume[81361]: DEBUG oslo_service.backend._eventlet.service [None req-905e043d-471f-47d9-8e2d-5d966b967404 None None] cache.proxies = [] {{(pid=81361) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:29:33 devstack cinder-volume[81361]: DEBUG oslo_service.backend._eventlet.service [None req-905e043d-471f-47d9-8e2d-5d966b967404 None None] cache.redis_db = 0 {{(pid=81361) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:29:33 devstack cinder-volume[81361]: DEBUG oslo_service.backend._eventlet.service [None req-905e043d-471f-47d9-8e2d-5d966b967404 None None] cache.redis_sentinel_service_name = mymaster {{(pid=81361) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:29:33 devstack cinder-volume[81361]: DEBUG oslo_service.backend._eventlet.service [None req-905e043d-471f-47d9-8e2d-5d966b967404 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=81361) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:29:33 devstack cinder-volume[81361]: DEBUG oslo_service.backend._eventlet.service [None req-905e043d-471f-47d9-8e2d-5d966b967404 None None] cache.redis_server = localhost:6379 {{(pid=81361) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:29:33 devstack cinder-volume[81361]: DEBUG oslo_service.backend._eventlet.service [None req-905e043d-471f-47d9-8e2d-5d966b967404 None None] cache.retry_attempts = 2 {{(pid=81361) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:29:33 devstack cinder-volume[81361]: DEBUG oslo_service.backend._eventlet.service [None req-905e043d-471f-47d9-8e2d-5d966b967404 None None] cache.retry_delay = 0.0 {{(pid=81361) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:29:33 devstack cinder-volume[81361]: DEBUG oslo_service.backend._eventlet.service [None req-905e043d-471f-47d9-8e2d-5d966b967404 None None] cache.socket_keepalive_count = 1 {{(pid=81361) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:29:33 devstack cinder-volume[81361]: DEBUG oslo_service.backend._eventlet.service [None req-905e043d-471f-47d9-8e2d-5d966b967404 None None] cache.socket_keepalive_idle = 1 {{(pid=81361) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:29:33 devstack cinder-volume[81361]: DEBUG oslo_service.backend._eventlet.service [None req-905e043d-471f-47d9-8e2d-5d966b967404 None None] cache.socket_keepalive_interval = 1 {{(pid=81361) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:29:33 devstack cinder-volume[81361]: DEBUG oslo_service.backend._eventlet.service [None req-905e043d-471f-47d9-8e2d-5d966b967404 None None] cache.socket_timeout = 1.0 {{(pid=81361) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:29:33 devstack cinder-volume[81361]: DEBUG oslo_service.backend._eventlet.service [None req-905e043d-471f-47d9-8e2d-5d966b967404 None None] cache.tls_allowed_ciphers = None {{(pid=81361) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:29:33 devstack cinder-volume[81361]: DEBUG oslo_service.backend._eventlet.service [None req-905e043d-471f-47d9-8e2d-5d966b967404 None None] cache.tls_cafile = None {{(pid=81361) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:29:33 devstack cinder-volume[81361]: DEBUG oslo_service.backend._eventlet.service [None req-905e043d-471f-47d9-8e2d-5d966b967404 None None] cache.tls_certfile = None {{(pid=81361) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:29:33 devstack cinder-volume[81361]: DEBUG oslo_service.backend._eventlet.service [None req-905e043d-471f-47d9-8e2d-5d966b967404 None None] cache.tls_enabled = False {{(pid=81361) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:29:33 devstack cinder-volume[81361]: DEBUG oslo_service.backend._eventlet.service [None req-905e043d-471f-47d9-8e2d-5d966b967404 None None] cache.tls_keyfile = None {{(pid=81361) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:29:33 devstack cinder-volume[81361]: DEBUG oslo_service.backend._eventlet.service [None req-905e043d-471f-47d9-8e2d-5d966b967404 None None] cache.username = None {{(pid=81361) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:29:33 devstack cinder-volume[81361]: DEBUG oslo_service.backend._eventlet.service [None req-905e043d-471f-47d9-8e2d-5d966b967404 None None] database.asyncio_connection = **** {{(pid=81361) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:29:34 devstack cinder-volume[81361]: DEBUG oslo_service.backend._eventlet.service [None req-905e043d-471f-47d9-8e2d-5d966b967404 None None] database.asyncio_slave_connection = **** {{(pid=81361) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:29:34 devstack cinder-volume[81361]: DEBUG oslo_service.backend._eventlet.service [None req-905e043d-471f-47d9-8e2d-5d966b967404 None None] database.backend = sqlalchemy {{(pid=81361) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:29:34 devstack cinder-volume[81361]: DEBUG oslo_service.backend._eventlet.service [None req-905e043d-471f-47d9-8e2d-5d966b967404 None None] database.connection = **** {{(pid=81361) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:29:34 devstack cinder-volume[81361]: DEBUG oslo_service.backend._eventlet.service [None req-905e043d-471f-47d9-8e2d-5d966b967404 None None] database.connection_debug = 0 {{(pid=81361) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:29:34 devstack cinder-volume[81361]: DEBUG oslo_service.backend._eventlet.service [None req-905e043d-471f-47d9-8e2d-5d966b967404 None None] database.connection_parameters = {{(pid=81361) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:29:34 devstack cinder-volume[81361]: DEBUG oslo_service.backend._eventlet.service [None req-905e043d-471f-47d9-8e2d-5d966b967404 None None] database.connection_recycle_time = 3600 {{(pid=81361) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:29:34 devstack cinder-volume[81361]: DEBUG oslo_service.backend._eventlet.service [None req-905e043d-471f-47d9-8e2d-5d966b967404 None None] database.connection_trace = False {{(pid=81361) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:29:34 devstack cinder-volume[81361]: DEBUG oslo_service.backend._eventlet.service [None req-905e043d-471f-47d9-8e2d-5d966b967404 None None] database.db_inc_retry_interval = True {{(pid=81361) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:29:34 devstack cinder-volume[81361]: DEBUG oslo_service.backend._eventlet.service [None req-905e043d-471f-47d9-8e2d-5d966b967404 None None] database.db_max_retries = 20 {{(pid=81361) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:29:34 devstack cinder-volume[81361]: DEBUG oslo_service.backend._eventlet.service [None req-905e043d-471f-47d9-8e2d-5d966b967404 None None] database.db_max_retry_interval = 10 {{(pid=81361) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:29:34 devstack cinder-volume[81361]: DEBUG oslo_service.backend._eventlet.service [None req-905e043d-471f-47d9-8e2d-5d966b967404 None None] database.db_retry_interval = 1 {{(pid=81361) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:29:34 devstack cinder-volume[81361]: DEBUG oslo_service.backend._eventlet.service [None req-905e043d-471f-47d9-8e2d-5d966b967404 None None] database.max_overflow = 50 {{(pid=81361) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:29:34 devstack cinder-volume[81361]: DEBUG oslo_service.backend._eventlet.service [None req-905e043d-471f-47d9-8e2d-5d966b967404 None None] database.max_pool_size = 5 {{(pid=81361) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:29:34 devstack cinder-volume[81361]: DEBUG oslo_service.backend._eventlet.service [None req-905e043d-471f-47d9-8e2d-5d966b967404 None None] database.max_retries = 10 {{(pid=81361) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:29:34 devstack cinder-volume[81361]: DEBUG oslo_service.backend._eventlet.service [None req-905e043d-471f-47d9-8e2d-5d966b967404 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=81361) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:29:34 devstack cinder-volume[81361]: DEBUG oslo_service.backend._eventlet.service [None req-905e043d-471f-47d9-8e2d-5d966b967404 None None] database.mysql_wsrep_sync_wait = None {{(pid=81361) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:29:34 devstack cinder-volume[81361]: DEBUG oslo_service.backend._eventlet.service [None req-905e043d-471f-47d9-8e2d-5d966b967404 None None] database.pool_timeout = None {{(pid=81361) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:29:34 devstack cinder-volume[81361]: DEBUG oslo_service.backend._eventlet.service [None req-905e043d-471f-47d9-8e2d-5d966b967404 None None] database.retry_interval = 10 {{(pid=81361) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:29:34 devstack cinder-volume[81361]: DEBUG oslo_service.backend._eventlet.service [None req-905e043d-471f-47d9-8e2d-5d966b967404 None None] database.slave_connection = **** {{(pid=81361) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:29:34 devstack cinder-volume[81361]: DEBUG oslo_service.backend._eventlet.service [None req-905e043d-471f-47d9-8e2d-5d966b967404 None None] database.sqlite_synchronous = True {{(pid=81361) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:29:34 devstack cinder-volume[81361]: DEBUG oslo_service.backend._eventlet.service [None req-905e043d-471f-47d9-8e2d-5d966b967404 None None] database.synchronous_reader = True {{(pid=81361) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:29:34 devstack cinder-volume[81361]: DEBUG oslo_service.backend._eventlet.service [None req-905e043d-471f-47d9-8e2d-5d966b967404 None None] database.use_db_reconnect = False {{(pid=81361) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:29:34 devstack cinder-volume[81361]: DEBUG oslo_service.backend._eventlet.service [None req-905e043d-471f-47d9-8e2d-5d966b967404 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81361) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:29:34 devstack cinder-volume[81361]: DEBUG oslo_service.backend._eventlet.service [None req-905e043d-471f-47d9-8e2d-5d966b967404 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=81361) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:29:34 devstack cinder-volume[81361]: DEBUG oslo_service.backend._eventlet.service [None req-905e043d-471f-47d9-8e2d-5d966b967404 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=81361) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:29:34 devstack cinder-volume[81361]: DEBUG oslo_service.backend._eventlet.service [None req-905e043d-471f-47d9-8e2d-5d966b967404 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81361) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:29:34 devstack cinder-volume[81361]: DEBUG oslo_service.backend._eventlet.service [None req-905e043d-471f-47d9-8e2d-5d966b967404 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81361) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:29:34 devstack cinder-volume[81361]: DEBUG oslo_service.backend._eventlet.service [None req-905e043d-471f-47d9-8e2d-5d966b967404 None None] profiler.connection_string = messaging:// {{(pid=81361) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:29:34 devstack cinder-volume[81361]: DEBUG oslo_service.backend._eventlet.service [None req-905e043d-471f-47d9-8e2d-5d966b967404 None None] profiler.enabled = False {{(pid=81361) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:29:34 devstack cinder-volume[81361]: DEBUG oslo_service.backend._eventlet.service [None req-905e043d-471f-47d9-8e2d-5d966b967404 None None] profiler.es_doc_type = notification {{(pid=81361) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:29:34 devstack cinder-volume[81361]: DEBUG oslo_service.backend._eventlet.service [None req-905e043d-471f-47d9-8e2d-5d966b967404 None None] profiler.es_scroll_size = 10000 {{(pid=81361) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:29:34 devstack cinder-volume[81361]: DEBUG oslo_service.backend._eventlet.service [None req-905e043d-471f-47d9-8e2d-5d966b967404 None None] profiler.es_scroll_time = 2m {{(pid=81361) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:29:34 devstack cinder-volume[81361]: DEBUG oslo_service.backend._eventlet.service [None req-905e043d-471f-47d9-8e2d-5d966b967404 None None] profiler.filter_error_trace = False {{(pid=81361) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:29:34 devstack cinder-volume[81361]: DEBUG oslo_service.backend._eventlet.service [None req-905e043d-471f-47d9-8e2d-5d966b967404 None None] profiler.hmac_keys = **** {{(pid=81361) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:29:34 devstack cinder-volume[81361]: DEBUG oslo_service.backend._eventlet.service [None req-905e043d-471f-47d9-8e2d-5d966b967404 None None] profiler.sentinel_service_name = mymaster {{(pid=81361) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:29:34 devstack cinder-volume[81361]: DEBUG oslo_service.backend._eventlet.service [None req-905e043d-471f-47d9-8e2d-5d966b967404 None None] profiler.socket_timeout = 0.1 {{(pid=81361) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:29:34 devstack cinder-volume[81361]: DEBUG oslo_service.backend._eventlet.service [None req-905e043d-471f-47d9-8e2d-5d966b967404 None None] profiler.trace_requests = False {{(pid=81361) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:29:34 devstack cinder-volume[81361]: DEBUG oslo_service.backend._eventlet.service [None req-905e043d-471f-47d9-8e2d-5d966b967404 None None] profiler.trace_sqlalchemy = False {{(pid=81361) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:29:34 devstack cinder-volume[81361]: DEBUG oslo_service.backend._eventlet.service [None req-905e043d-471f-47d9-8e2d-5d966b967404 None None] profiler_jaeger.process_tags = {} {{(pid=81361) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:29:34 devstack cinder-volume[81361]: DEBUG oslo_service.backend._eventlet.service [None req-905e043d-471f-47d9-8e2d-5d966b967404 None None] profiler_jaeger.service_name_prefix = None {{(pid=81361) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:29:34 devstack cinder-volume[81361]: DEBUG oslo_service.backend._eventlet.service [None req-905e043d-471f-47d9-8e2d-5d966b967404 None None] profiler_otlp.service_name_prefix = None {{(pid=81361) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:29:34 devstack cinder-volume[81361]: DEBUG oslo_service.backend._eventlet.service [None req-905e043d-471f-47d9-8e2d-5d966b967404 None None] oslo_policy.enforce_new_defaults = False {{(pid=81361) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:29:34 devstack cinder-volume[81361]: WARNING oslo_config.cfg [None req-905e043d-471f-47d9-8e2d-5d966b967404 None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.). Its value may be silently ignored in the future. Jun 17 04:29:34 devstack cinder-volume[81361]: DEBUG oslo_service.backend._eventlet.service [None req-905e043d-471f-47d9-8e2d-5d966b967404 None None] oslo_policy.enforce_scope = False {{(pid=81361) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:29:34 devstack cinder-volume[81361]: DEBUG oslo_service.backend._eventlet.service [None req-905e043d-471f-47d9-8e2d-5d966b967404 None None] oslo_policy.policy_default_rule = default {{(pid=81361) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:29:34 devstack cinder-volume[81361]: DEBUG oslo_service.backend._eventlet.service [None req-905e043d-471f-47d9-8e2d-5d966b967404 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81361) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:29:34 devstack cinder-volume[81361]: DEBUG oslo_service.backend._eventlet.service [None req-905e043d-471f-47d9-8e2d-5d966b967404 None None] oslo_policy.policy_file = policy.yaml {{(pid=81361) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:29:34 devstack cinder-volume[81361]: DEBUG oslo_service.backend._eventlet.service [None req-905e043d-471f-47d9-8e2d-5d966b967404 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81361) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:29:34 devstack cinder-volume[81361]: DEBUG oslo_service.backend._eventlet.service [None req-905e043d-471f-47d9-8e2d-5d966b967404 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81361) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:29:34 devstack cinder-volume[81361]: DEBUG oslo_service.backend._eventlet.service [None req-905e043d-471f-47d9-8e2d-5d966b967404 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81361) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:29:34 devstack cinder-volume[81361]: DEBUG oslo_service.backend._eventlet.service [None req-905e043d-471f-47d9-8e2d-5d966b967404 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=81361) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:29:34 devstack cinder-volume[81361]: DEBUG oslo_service.backend._eventlet.service [None req-905e043d-471f-47d9-8e2d-5d966b967404 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81361) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:29:34 devstack cinder-volume[81361]: DEBUG oslo_service.backend._eventlet.service [None req-905e043d-471f-47d9-8e2d-5d966b967404 None None] oslo_policy.remote_timeout = 60.0 {{(pid=81361) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:29:34 devstack cinder-volume[81361]: DEBUG oslo_service.backend._eventlet.service [None req-905e043d-471f-47d9-8e2d-5d966b967404 None None] coordination.backend_url = **** {{(pid=81361) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:29:34 devstack cinder-volume[81361]: DEBUG oslo_service.backend._eventlet.service [None req-905e043d-471f-47d9-8e2d-5d966b967404 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=81361) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:29:34 devstack cinder-volume[81361]: DEBUG oslo_service.backend._eventlet.service [None req-905e043d-471f-47d9-8e2d-5d966b967404 None None] privsep_osbrick.group = None {{(pid=81361) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:29:34 devstack cinder-volume[81361]: DEBUG oslo_service.backend._eventlet.service [None req-905e043d-471f-47d9-8e2d-5d966b967404 None None] privsep_osbrick.helper_command = None {{(pid=81361) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:29:34 devstack cinder-volume[81361]: DEBUG oslo_service.backend._eventlet.service [None req-905e043d-471f-47d9-8e2d-5d966b967404 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=81361) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:29:34 devstack cinder-volume[81361]: DEBUG oslo_service.backend._eventlet.service [None req-905e043d-471f-47d9-8e2d-5d966b967404 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=81361) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:29:34 devstack cinder-volume[81361]: DEBUG oslo_service.backend._eventlet.service [None req-905e043d-471f-47d9-8e2d-5d966b967404 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=81361) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:29:34 devstack sudo[81537]: pam_unix(sudo:session): session closed for user root Jun 17 04:29:34 devstack cinder-volume[81361]: DEBUG oslo_service.backend._eventlet.service [None req-905e043d-471f-47d9-8e2d-5d966b967404 None None] privsep_osbrick.user = None {{(pid=81361) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:29:34 devstack cinder-volume[81361]: DEBUG oslo_service.backend._eventlet.service [None req-905e043d-471f-47d9-8e2d-5d966b967404 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=81361) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:29:34 devstack cinder-volume[81361]: DEBUG oslo_service.backend._eventlet.service [None req-905e043d-471f-47d9-8e2d-5d966b967404 None None] cinder_sys_admin.group = None {{(pid=81361) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:29:34 devstack cinder-volume[81361]: DEBUG oslo_service.backend._eventlet.service [None req-905e043d-471f-47d9-8e2d-5d966b967404 None None] cinder_sys_admin.helper_command = None {{(pid=81361) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:29:34 devstack cinder-volume[81361]: DEBUG oslo_service.backend._eventlet.service [None req-905e043d-471f-47d9-8e2d-5d966b967404 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=81361) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:29:34 devstack cinder-volume[81361]: DEBUG oslo_service.backend._eventlet.service [None req-905e043d-471f-47d9-8e2d-5d966b967404 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=81361) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:29:34 devstack sudo[81669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jun 17 04:29:34 devstack cinder-volume[81361]: DEBUG oslo_service.backend._eventlet.service [None req-905e043d-471f-47d9-8e2d-5d966b967404 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=81361) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:29:34 devstack cinder-volume[81361]: DEBUG oslo_service.backend._eventlet.service [None req-905e043d-471f-47d9-8e2d-5d966b967404 None None] cinder_sys_admin.user = None {{(pid=81361) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:29:34 devstack cinder-volume[81361]: DEBUG oslo_service.backend._eventlet.service [None req-905e043d-471f-47d9-8e2d-5d966b967404 None None] service_user.auth_section = None {{(pid=81361) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:29:34 devstack cinder-volume[81361]: DEBUG oslo_service.backend._eventlet.service [None req-905e043d-471f-47d9-8e2d-5d966b967404 None None] service_user.auth_type = password {{(pid=81361) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:29:34 devstack cinder-volume[81361]: DEBUG oslo_service.backend._eventlet.service [None req-905e043d-471f-47d9-8e2d-5d966b967404 None None] service_user.cafile = None {{(pid=81361) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:29:34 devstack cinder-volume[81361]: DEBUG oslo_service.backend._eventlet.service [None req-905e043d-471f-47d9-8e2d-5d966b967404 None None] service_user.certfile = None {{(pid=81361) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:29:34 devstack cinder-volume[81361]: DEBUG oslo_service.backend._eventlet.service [None req-905e043d-471f-47d9-8e2d-5d966b967404 None None] service_user.collect_timing = False {{(pid=81361) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:29:34 devstack sudo[81669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:29:34 devstack cinder-volume[81361]: DEBUG oslo_service.backend._eventlet.service [None req-905e043d-471f-47d9-8e2d-5d966b967404 None None] service_user.insecure = False {{(pid=81361) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:29:34 devstack cinder-volume[81361]: DEBUG oslo_service.backend._eventlet.service [None req-905e043d-471f-47d9-8e2d-5d966b967404 None None] service_user.keyfile = None {{(pid=81361) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:29:34 devstack cinder-volume[81361]: DEBUG oslo_service.backend._eventlet.service [None req-905e043d-471f-47d9-8e2d-5d966b967404 None None] service_user.send_service_user_token = True {{(pid=81361) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:29:34 devstack cinder-volume[81361]: DEBUG oslo_service.backend._eventlet.service [None req-905e043d-471f-47d9-8e2d-5d966b967404 None None] service_user.split_loggers = False {{(pid=81361) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:29:34 devstack cinder-volume[81361]: DEBUG oslo_service.backend._eventlet.service [None req-905e043d-471f-47d9-8e2d-5d966b967404 None None] service_user.timeout = None {{(pid=81361) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:29:34 devstack cinder-volume[81361]: DEBUG oslo_service.backend._eventlet.service [None req-905e043d-471f-47d9-8e2d-5d966b967404 None None] glance.auth_section = None {{(pid=81361) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:29:34 devstack cinder-volume[81361]: DEBUG oslo_service.backend._eventlet.service [None req-905e043d-471f-47d9-8e2d-5d966b967404 None None] glance.auth_type = password {{(pid=81361) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:29:34 devstack cinder-volume[81361]: DEBUG oslo_service.backend._eventlet.service [None req-905e043d-471f-47d9-8e2d-5d966b967404 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=81361) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:29:34 devstack cinder-volume[81361]: DEBUG oslo_service.backend._eventlet.service [None req-905e043d-471f-47d9-8e2d-5d966b967404 None None] glance.certfile = None {{(pid=81361) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:29:34 devstack cinder-volume[81361]: DEBUG oslo_service.backend._eventlet.service [None req-905e043d-471f-47d9-8e2d-5d966b967404 None None] glance.collect_timing = False {{(pid=81361) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:29:34 devstack cinder-volume[81361]: DEBUG oslo_service.backend._eventlet.service [None req-905e043d-471f-47d9-8e2d-5d966b967404 None None] glance.insecure = False {{(pid=81361) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:29:34 devstack cinder-volume[81361]: DEBUG oslo_service.backend._eventlet.service [None req-905e043d-471f-47d9-8e2d-5d966b967404 None None] glance.keyfile = None {{(pid=81361) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:29:34 devstack cinder-volume[81361]: DEBUG oslo_service.backend._eventlet.service [None req-905e043d-471f-47d9-8e2d-5d966b967404 None None] glance.region_name = None {{(pid=81361) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:29:34 devstack cinder-volume[81361]: DEBUG oslo_service.backend._eventlet.service [None req-905e043d-471f-47d9-8e2d-5d966b967404 None None] glance.split_loggers = False {{(pid=81361) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:29:34 devstack cinder-volume[81361]: DEBUG oslo_service.backend._eventlet.service [None req-905e043d-471f-47d9-8e2d-5d966b967404 None None] glance.timeout = None {{(pid=81361) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:29:34 devstack cinder-volume[81361]: DEBUG oslo_service.backend._eventlet.service [None req-905e043d-471f-47d9-8e2d-5d966b967404 None None] backend_defaults.backend_availability_zone = None {{(pid=81361) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:29:34 devstack cinder-volume[81361]: DEBUG oslo_service.backend._eventlet.service [None req-905e043d-471f-47d9-8e2d-5d966b967404 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=81361) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:29:34 devstack cinder-volume[81361]: DEBUG oslo_service.backend._eventlet.service [None req-905e043d-471f-47d9-8e2d-5d966b967404 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=81361) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:29:34 devstack cinder-volume[81361]: DEBUG oslo_service.backend._eventlet.service [None req-905e043d-471f-47d9-8e2d-5d966b967404 None None] backend_defaults.chap_password = **** {{(pid=81361) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:29:34 devstack cinder-volume[81361]: DEBUG oslo_service.backend._eventlet.service [None req-905e043d-471f-47d9-8e2d-5d966b967404 None None] backend_defaults.chap_username = {{(pid=81361) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:29:34 devstack cinder-volume[81361]: DEBUG oslo_service.backend._eventlet.service [None req-905e043d-471f-47d9-8e2d-5d966b967404 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=81361) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:29:34 devstack cinder-volume[81361]: DEBUG oslo_service.backend._eventlet.service [None req-905e043d-471f-47d9-8e2d-5d966b967404 None None] backend_defaults.disk_geometry = None {{(pid=81361) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:29:34 devstack cinder-volume[81361]: DEBUG oslo_service.backend._eventlet.service [None req-905e043d-471f-47d9-8e2d-5d966b967404 None None] backend_defaults.driver_client_cert = None {{(pid=81361) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:29:34 devstack cinder-volume[81361]: DEBUG oslo_service.backend._eventlet.service [None req-905e043d-471f-47d9-8e2d-5d966b967404 None None] backend_defaults.driver_client_cert_key = None {{(pid=81361) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:29:34 devstack cinder-volume[81361]: DEBUG oslo_service.backend._eventlet.service [None req-905e043d-471f-47d9-8e2d-5d966b967404 None None] backend_defaults.driver_data_namespace = None {{(pid=81361) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:29:34 devstack cinder-volume[81361]: DEBUG oslo_service.backend._eventlet.service [None req-905e043d-471f-47d9-8e2d-5d966b967404 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=81361) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:29:34 devstack cinder-volume[81361]: DEBUG oslo_service.backend._eventlet.service [None req-905e043d-471f-47d9-8e2d-5d966b967404 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=81361) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:29:34 devstack cinder-volume[81361]: DEBUG oslo_service.backend._eventlet.service [None req-905e043d-471f-47d9-8e2d-5d966b967404 None None] backend_defaults.driver_use_ssl = False {{(pid=81361) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:29:34 devstack cinder-volume[81361]: DEBUG oslo_service.backend._eventlet.service [None req-905e043d-471f-47d9-8e2d-5d966b967404 None None] backend_defaults.enable_unsupported_driver = False {{(pid=81361) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:29:34 devstack cinder-volume[81361]: DEBUG oslo_service.backend._eventlet.service [None req-905e043d-471f-47d9-8e2d-5d966b967404 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=81361) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:29:34 devstack cinder-volume[81361]: DEBUG oslo_service.backend._eventlet.service [None req-905e043d-471f-47d9-8e2d-5d966b967404 None None] backend_defaults.extra_capabilities = {} {{(pid=81361) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:29:34 devstack cinder-volume[81361]: DEBUG oslo_service.backend._eventlet.service [None req-905e043d-471f-47d9-8e2d-5d966b967404 None None] backend_defaults.filter_function = None {{(pid=81361) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:29:34 devstack cinder-volume[81361]: DEBUG oslo_service.backend._eventlet.service [None req-905e043d-471f-47d9-8e2d-5d966b967404 None None] backend_defaults.goodness_function = None {{(pid=81361) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:29:34 devstack cinder-volume[81361]: DEBUG oslo_service.backend._eventlet.service [None req-905e043d-471f-47d9-8e2d-5d966b967404 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=81361) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:29:34 devstack cinder-volume[81361]: DEBUG oslo_service.backend._eventlet.service [None req-905e043d-471f-47d9-8e2d-5d966b967404 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=81361) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:29:34 devstack cinder-volume[81361]: DEBUG oslo_service.backend._eventlet.service [None req-905e043d-471f-47d9-8e2d-5d966b967404 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=81361) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:29:34 devstack cinder-volume[81361]: DEBUG oslo_service.backend._eventlet.service [None req-905e043d-471f-47d9-8e2d-5d966b967404 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=81361) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:29:34 devstack cinder-volume[81361]: DEBUG oslo_service.backend._eventlet.service [None req-905e043d-471f-47d9-8e2d-5d966b967404 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=81361) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:29:34 devstack cinder-volume[81361]: DEBUG oslo_service.backend._eventlet.service [None req-905e043d-471f-47d9-8e2d-5d966b967404 None None] backend_defaults.iscsi_target_flags = {{(pid=81361) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:29:34 devstack cinder-volume[81361]: DEBUG oslo_service.backend._eventlet.service [None req-905e043d-471f-47d9-8e2d-5d966b967404 None None] backend_defaults.iscsi_write_cache = on {{(pid=81361) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:29:34 devstack cinder-volume[81361]: DEBUG oslo_service.backend._eventlet.service [None req-905e043d-471f-47d9-8e2d-5d966b967404 None None] backend_defaults.iser_helper = tgtadm {{(pid=81361) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:29:34 devstack cinder-volume[81361]: DEBUG oslo_service.backend._eventlet.service [None req-905e043d-471f-47d9-8e2d-5d966b967404 None None] backend_defaults.iser_ip_address = 192.168.122.240 {{(pid=81361) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:29:34 devstack cinder-volume[81361]: DEBUG oslo_service.backend._eventlet.service [None req-905e043d-471f-47d9-8e2d-5d966b967404 None None] backend_defaults.iser_port = 3260 {{(pid=81361) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:29:34 devstack cinder-volume[81361]: DEBUG oslo_service.backend._eventlet.service [None req-905e043d-471f-47d9-8e2d-5d966b967404 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=81361) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:29:34 devstack cinder-volume[81361]: DEBUG oslo_service.backend._eventlet.service [None req-905e043d-471f-47d9-8e2d-5d966b967404 None None] backend_defaults.lvm_conf_file = /etc/cinder/lvm.conf {{(pid=81361) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:29:34 devstack cinder-volume[81361]: DEBUG oslo_service.backend._eventlet.service [None req-905e043d-471f-47d9-8e2d-5d966b967404 None None] backend_defaults.lvm_mirrors = 0 {{(pid=81361) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:29:34 devstack cinder-volume[81361]: DEBUG oslo_service.backend._eventlet.service [None req-905e043d-471f-47d9-8e2d-5d966b967404 None None] backend_defaults.lvm_share_target = False {{(pid=81361) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:29:34 devstack cinder-volume[81361]: DEBUG oslo_service.backend._eventlet.service [None req-905e043d-471f-47d9-8e2d-5d966b967404 None None] backend_defaults.lvm_suppress_fd_warnings = False {{(pid=81361) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:29:34 devstack cinder-volume[81361]: DEBUG oslo_service.backend._eventlet.service [None req-905e043d-471f-47d9-8e2d-5d966b967404 None None] backend_defaults.lvm_type = auto {{(pid=81361) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:29:34 devstack cinder-volume[81361]: DEBUG oslo_service.backend._eventlet.service [None req-905e043d-471f-47d9-8e2d-5d966b967404 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=81361) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:29:34 devstack cinder-volume[81361]: DEBUG oslo_service.backend._eventlet.service [None req-905e043d-471f-47d9-8e2d-5d966b967404 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=81361) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:29:34 devstack cinder-volume[81361]: DEBUG oslo_service.backend._eventlet.service [None req-905e043d-471f-47d9-8e2d-5d966b967404 None None] backend_defaults.num_shell_tries = 3 {{(pid=81361) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:29:34 devstack cinder-volume[81361]: DEBUG oslo_service.backend._eventlet.service [None req-905e043d-471f-47d9-8e2d-5d966b967404 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=81361) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:29:34 devstack cinder-volume[81361]: DEBUG oslo_service.backend._eventlet.service [None req-905e043d-471f-47d9-8e2d-5d966b967404 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=81361) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:29:34 devstack cinder-volume[81361]: DEBUG oslo_service.backend._eventlet.service [None req-905e043d-471f-47d9-8e2d-5d966b967404 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=81361) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:29:34 devstack cinder-volume[81361]: DEBUG oslo_service.backend._eventlet.service [None req-905e043d-471f-47d9-8e2d-5d966b967404 None None] backend_defaults.nvmet_port_id = 1 {{(pid=81361) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:29:34 devstack cinder-volume[81361]: DEBUG oslo_service.backend._eventlet.service [None req-905e043d-471f-47d9-8e2d-5d966b967404 None None] backend_defaults.replication_device = **** {{(pid=81361) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:29:34 devstack cinder-volume[81361]: DEBUG oslo_service.backend._eventlet.service [None req-905e043d-471f-47d9-8e2d-5d966b967404 None None] backend_defaults.report_discard_supported = False {{(pid=81361) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:29:34 devstack cinder-volume[81361]: DEBUG oslo_service.backend._eventlet.service [None req-905e043d-471f-47d9-8e2d-5d966b967404 None None] backend_defaults.reserved_percentage = 0 {{(pid=81361) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:29:34 devstack cinder-volume[81361]: DEBUG oslo_service.backend._eventlet.service [None req-905e043d-471f-47d9-8e2d-5d966b967404 None None] backend_defaults.scst_target_driver = iscsi {{(pid=81361) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:29:34 devstack cinder-volume[81361]: DEBUG oslo_service.backend._eventlet.service [None req-905e043d-471f-47d9-8e2d-5d966b967404 None None] backend_defaults.scst_target_iqn_name = None {{(pid=81361) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:29:34 devstack cinder-volume[81361]: DEBUG oslo_service.backend._eventlet.service [None req-905e043d-471f-47d9-8e2d-5d966b967404 None None] backend_defaults.storage_protocol = iSCSI {{(pid=81361) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:29:34 devstack cinder-volume[81361]: DEBUG oslo_service.backend._eventlet.service [None req-905e043d-471f-47d9-8e2d-5d966b967404 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=81361) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:29:34 devstack cinder-volume[81361]: DEBUG oslo_service.backend._eventlet.service [None req-905e043d-471f-47d9-8e2d-5d966b967404 None None] backend_defaults.target_helper = tgtadm {{(pid=81361) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:29:34 devstack cinder-volume[81361]: DEBUG oslo_service.backend._eventlet.service [None req-905e043d-471f-47d9-8e2d-5d966b967404 None None] backend_defaults.target_ip_address = 192.168.122.240 {{(pid=81361) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:29:34 devstack cinder-volume[81361]: DEBUG oslo_service.backend._eventlet.service [None req-905e043d-471f-47d9-8e2d-5d966b967404 None None] backend_defaults.target_port = 3260 {{(pid=81361) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:29:34 devstack cinder-volume[81361]: DEBUG oslo_service.backend._eventlet.service [None req-905e043d-471f-47d9-8e2d-5d966b967404 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=81361) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:29:34 devstack cinder-volume[81361]: DEBUG oslo_service.backend._eventlet.service [None req-905e043d-471f-47d9-8e2d-5d966b967404 None None] backend_defaults.target_protocol = iscsi {{(pid=81361) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:29:34 devstack cinder-volume[81361]: DEBUG oslo_service.backend._eventlet.service [None req-905e043d-471f-47d9-8e2d-5d966b967404 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=81361) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:29:34 devstack cinder-volume[81361]: DEBUG oslo_service.backend._eventlet.service [None req-905e043d-471f-47d9-8e2d-5d966b967404 None None] backend_defaults.trace_flags = None {{(pid=81361) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:29:34 devstack cinder-volume[81361]: DEBUG oslo_service.backend._eventlet.service [None req-905e043d-471f-47d9-8e2d-5d966b967404 None None] backend_defaults.unique_fqdn_network = True {{(pid=81361) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:29:34 devstack cinder-volume[81361]: DEBUG oslo_service.backend._eventlet.service [None req-905e043d-471f-47d9-8e2d-5d966b967404 None None] backend_defaults.use_chap_auth = False {{(pid=81361) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:29:34 devstack cinder-volume[81361]: DEBUG oslo_service.backend._eventlet.service [None req-905e043d-471f-47d9-8e2d-5d966b967404 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=81361) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:29:34 devstack cinder-volume[81361]: DEBUG oslo_service.backend._eventlet.service [None req-905e043d-471f-47d9-8e2d-5d966b967404 None None] backend_defaults.volume_backend_name = None {{(pid=81361) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:29:34 devstack cinder-volume[81361]: DEBUG oslo_service.backend._eventlet.service [None req-905e043d-471f-47d9-8e2d-5d966b967404 None None] backend_defaults.volume_clear = zero {{(pid=81361) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:29:34 devstack cinder-volume[81361]: DEBUG oslo_service.backend._eventlet.service [None req-905e043d-471f-47d9-8e2d-5d966b967404 None None] backend_defaults.volume_clear_ionice = None {{(pid=81361) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:29:34 devstack cinder-volume[81361]: DEBUG oslo_service.backend._eventlet.service [None req-905e043d-471f-47d9-8e2d-5d966b967404 None None] backend_defaults.volume_clear_size = 0 {{(pid=81361) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:29:34 devstack cinder-volume[81361]: DEBUG oslo_service.backend._eventlet.service [None req-905e043d-471f-47d9-8e2d-5d966b967404 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=81361) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:29:34 devstack cinder-volume[81361]: DEBUG oslo_service.backend._eventlet.service [None req-905e043d-471f-47d9-8e2d-5d966b967404 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=81361) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:29:34 devstack cinder-volume[81361]: DEBUG oslo_service.backend._eventlet.service [None req-905e043d-471f-47d9-8e2d-5d966b967404 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=81361) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:29:34 devstack cinder-volume[81361]: DEBUG oslo_service.backend._eventlet.service [None req-905e043d-471f-47d9-8e2d-5d966b967404 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=81361) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:29:34 devstack cinder-volume[81361]: DEBUG oslo_service.backend._eventlet.service [None req-905e043d-471f-47d9-8e2d-5d966b967404 None None] backend_defaults.volume_group = cinder-volumes {{(pid=81361) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:29:34 devstack cinder-volume[81361]: DEBUG oslo_service.backend._eventlet.service [None req-905e043d-471f-47d9-8e2d-5d966b967404 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=81361) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:29:34 devstack cinder-volume[81361]: DEBUG oslo_service.backend._eventlet.service [None req-905e043d-471f-47d9-8e2d-5d966b967404 None None] oslo_reports.file_event_handler = None {{(pid=81361) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:29:34 devstack cinder-volume[81361]: DEBUG oslo_service.backend._eventlet.service [None req-905e043d-471f-47d9-8e2d-5d966b967404 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=81361) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:29:34 devstack cinder-volume[81361]: DEBUG oslo_service.backend._eventlet.service [None req-905e043d-471f-47d9-8e2d-5d966b967404 None None] oslo_reports.log_dir = None {{(pid=81361) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:29:34 devstack cinder-volume[81361]: DEBUG oslo_service.backend._eventlet.service [None req-905e043d-471f-47d9-8e2d-5d966b967404 None None] lvmdriver-1.backend_availability_zone = None {{(pid=81361) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:29:34 devstack cinder-volume[81361]: DEBUG oslo_service.backend._eventlet.service [None req-905e043d-471f-47d9-8e2d-5d966b967404 None None] lvmdriver-1.backend_host = None {{(pid=81361) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:29:34 devstack cinder-volume[81361]: DEBUG oslo_service.backend._eventlet.service [None req-905e043d-471f-47d9-8e2d-5d966b967404 None None] lvmdriver-1.backend_native_threads_pool_size = None {{(pid=81361) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:29:34 devstack cinder-volume[81361]: DEBUG oslo_service.backend._eventlet.service [None req-905e043d-471f-47d9-8e2d-5d966b967404 None None] lvmdriver-1.backup_use_temp_snapshot = None {{(pid=81361) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:29:34 devstack cinder-volume[81361]: DEBUG oslo_service.backend._eventlet.service [None req-905e043d-471f-47d9-8e2d-5d966b967404 None None] lvmdriver-1.chap_password = **** {{(pid=81361) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:29:34 devstack cinder-volume[81361]: DEBUG oslo_service.backend._eventlet.service [None req-905e043d-471f-47d9-8e2d-5d966b967404 None None] lvmdriver-1.chap_username = None {{(pid=81361) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:29:34 devstack cinder-volume[81361]: DEBUG oslo_service.backend._eventlet.service [None req-905e043d-471f-47d9-8e2d-5d966b967404 None None] lvmdriver-1.chiscsi_conf = None {{(pid=81361) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:29:34 devstack cinder-volume[81361]: DEBUG oslo_service.backend._eventlet.service [None req-905e043d-471f-47d9-8e2d-5d966b967404 None None] lvmdriver-1.disk_geometry = None {{(pid=81361) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:29:34 devstack cinder-volume[81361]: DEBUG oslo_service.backend._eventlet.service [None req-905e043d-471f-47d9-8e2d-5d966b967404 None None] lvmdriver-1.driver_client_cert = None {{(pid=81361) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:29:34 devstack cinder-volume[81361]: DEBUG oslo_service.backend._eventlet.service [None req-905e043d-471f-47d9-8e2d-5d966b967404 None None] lvmdriver-1.driver_client_cert_key = None {{(pid=81361) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:29:34 devstack cinder-volume[81361]: DEBUG oslo_service.backend._eventlet.service [None req-905e043d-471f-47d9-8e2d-5d966b967404 None None] lvmdriver-1.driver_data_namespace = None {{(pid=81361) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:29:34 devstack cinder-volume[81361]: DEBUG oslo_service.backend._eventlet.service [None req-905e043d-471f-47d9-8e2d-5d966b967404 None None] lvmdriver-1.driver_ssl_cert_path = None {{(pid=81361) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:29:34 devstack cinder-volume[81361]: DEBUG oslo_service.backend._eventlet.service [None req-905e043d-471f-47d9-8e2d-5d966b967404 None None] lvmdriver-1.driver_ssl_cert_verify = None {{(pid=81361) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:29:34 devstack cinder-volume[81361]: DEBUG oslo_service.backend._eventlet.service [None req-905e043d-471f-47d9-8e2d-5d966b967404 None None] lvmdriver-1.driver_use_ssl = None {{(pid=81361) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:29:34 devstack cinder-volume[81361]: DEBUG oslo_service.backend._eventlet.service [None req-905e043d-471f-47d9-8e2d-5d966b967404 None None] lvmdriver-1.enable_unsupported_driver = None {{(pid=81361) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:29:34 devstack cinder-volume[81361]: DEBUG oslo_service.backend._eventlet.service [None req-905e043d-471f-47d9-8e2d-5d966b967404 None None] lvmdriver-1.enforce_multipath_for_image_xfer = None {{(pid=81361) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:29:34 devstack cinder-volume[81361]: DEBUG oslo_service.backend._eventlet.service [None req-905e043d-471f-47d9-8e2d-5d966b967404 None None] lvmdriver-1.extra_capabilities = None {{(pid=81361) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:29:34 devstack cinder-volume[81361]: DEBUG oslo_service.backend._eventlet.service [None req-905e043d-471f-47d9-8e2d-5d966b967404 None None] lvmdriver-1.filter_function = None {{(pid=81361) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:29:34 devstack cinder-volume[81361]: DEBUG oslo_service.backend._eventlet.service [None req-905e043d-471f-47d9-8e2d-5d966b967404 None None] lvmdriver-1.goodness_function = None {{(pid=81361) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:29:34 devstack cinder-volume[81361]: DEBUG oslo_service.backend._eventlet.service [None req-905e043d-471f-47d9-8e2d-5d966b967404 None None] lvmdriver-1.image_upload_use_cinder_backend = None {{(pid=81361) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:29:34 devstack cinder-volume[81361]: DEBUG oslo_service.backend._eventlet.service [None req-905e043d-471f-47d9-8e2d-5d966b967404 None None] lvmdriver-1.image_upload_use_internal_tenant = None {{(pid=81361) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:29:34 devstack cinder-volume[81361]: DEBUG oslo_service.backend._eventlet.service [None req-905e043d-471f-47d9-8e2d-5d966b967404 None None] lvmdriver-1.image_volume_cache_enabled = True {{(pid=81361) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:29:34 devstack cinder-volume[81361]: DEBUG oslo_service.backend._eventlet.service [None req-905e043d-471f-47d9-8e2d-5d966b967404 None None] lvmdriver-1.image_volume_cache_max_count = None {{(pid=81361) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:29:34 devstack cinder-volume[81361]: DEBUG oslo_service.backend._eventlet.service [None req-905e043d-471f-47d9-8e2d-5d966b967404 None None] lvmdriver-1.image_volume_cache_max_size_gb = None {{(pid=81361) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:29:34 devstack cinder-volume[81361]: DEBUG oslo_service.backend._eventlet.service [None req-905e043d-471f-47d9-8e2d-5d966b967404 None None] lvmdriver-1.iscsi_target_flags = None {{(pid=81361) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:29:34 devstack cinder-volume[81361]: DEBUG oslo_service.backend._eventlet.service [None req-905e043d-471f-47d9-8e2d-5d966b967404 None None] lvmdriver-1.iscsi_write_cache = None {{(pid=81361) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:29:34 devstack cinder-volume[81361]: DEBUG oslo_service.backend._eventlet.service [None req-905e043d-471f-47d9-8e2d-5d966b967404 None None] lvmdriver-1.iser_helper = None {{(pid=81361) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:29:34 devstack cinder-volume[81361]: DEBUG oslo_service.backend._eventlet.service [None req-905e043d-471f-47d9-8e2d-5d966b967404 None None] lvmdriver-1.iser_ip_address = None {{(pid=81361) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:29:34 devstack cinder-volume[81361]: DEBUG oslo_service.backend._eventlet.service [None req-905e043d-471f-47d9-8e2d-5d966b967404 None None] lvmdriver-1.iser_port = None {{(pid=81361) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:29:34 devstack cinder-volume[81361]: DEBUG oslo_service.backend._eventlet.service [None req-905e043d-471f-47d9-8e2d-5d966b967404 None None] lvmdriver-1.iser_target_prefix = None {{(pid=81361) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:29:34 devstack cinder-volume[81361]: DEBUG oslo_service.backend._eventlet.service [None req-905e043d-471f-47d9-8e2d-5d966b967404 None None] lvmdriver-1.lvm_conf_file = None {{(pid=81361) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:29:34 devstack cinder-volume[81361]: DEBUG oslo_service.backend._eventlet.service [None req-905e043d-471f-47d9-8e2d-5d966b967404 None None] lvmdriver-1.lvm_mirrors = None {{(pid=81361) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:29:34 devstack cinder-volume[81361]: DEBUG oslo_service.backend._eventlet.service [None req-905e043d-471f-47d9-8e2d-5d966b967404 None None] lvmdriver-1.lvm_share_target = None {{(pid=81361) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:29:34 devstack cinder-volume[81361]: DEBUG oslo_service.backend._eventlet.service [None req-905e043d-471f-47d9-8e2d-5d966b967404 None None] lvmdriver-1.lvm_suppress_fd_warnings = None {{(pid=81361) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:29:34 devstack cinder-volume[81361]: DEBUG oslo_service.backend._eventlet.service [None req-905e043d-471f-47d9-8e2d-5d966b967404 None None] lvmdriver-1.lvm_type = auto {{(pid=81361) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:29:34 devstack cinder-volume[81361]: DEBUG oslo_service.backend._eventlet.service [None req-905e043d-471f-47d9-8e2d-5d966b967404 None None] lvmdriver-1.max_over_subscription_ratio = None {{(pid=81361) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:29:34 devstack cinder-volume[81361]: DEBUG oslo_service.backend._eventlet.service [None req-905e043d-471f-47d9-8e2d-5d966b967404 None None] lvmdriver-1.num_iser_scan_tries = None {{(pid=81361) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:29:34 devstack cinder-volume[81361]: DEBUG oslo_service.backend._eventlet.service [None req-905e043d-471f-47d9-8e2d-5d966b967404 None None] lvmdriver-1.num_shell_tries = None {{(pid=81361) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:29:34 devstack cinder-volume[81361]: DEBUG oslo_service.backend._eventlet.service [None req-905e043d-471f-47d9-8e2d-5d966b967404 None None] lvmdriver-1.num_volume_device_scan_tries = None {{(pid=81361) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:29:34 devstack cinder-volume[81361]: DEBUG oslo_service.backend._eventlet.service [None req-905e043d-471f-47d9-8e2d-5d966b967404 None None] lvmdriver-1.nvmeof_conn_info_version = None {{(pid=81361) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:29:34 devstack cinder-volume[81361]: DEBUG oslo_service.backend._eventlet.service [None req-905e043d-471f-47d9-8e2d-5d966b967404 None None] lvmdriver-1.nvmet_ns_id = None {{(pid=81361) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:29:34 devstack cinder-volume[81361]: DEBUG oslo_service.backend._eventlet.service [None req-905e043d-471f-47d9-8e2d-5d966b967404 None None] lvmdriver-1.nvmet_port_id = None {{(pid=81361) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:29:34 devstack cinder-volume[81361]: DEBUG oslo_service.backend._eventlet.service [None req-905e043d-471f-47d9-8e2d-5d966b967404 None None] lvmdriver-1.replication_device = **** {{(pid=81361) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:29:34 devstack cinder-volume[81361]: DEBUG oslo_service.backend._eventlet.service [None req-905e043d-471f-47d9-8e2d-5d966b967404 None None] lvmdriver-1.report_discard_supported = None {{(pid=81361) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:29:34 devstack cinder-volume[81361]: DEBUG oslo_service.backend._eventlet.service [None req-905e043d-471f-47d9-8e2d-5d966b967404 None None] lvmdriver-1.reserved_percentage = None {{(pid=81361) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:29:34 devstack cinder-volume[81361]: DEBUG oslo_service.backend._eventlet.service [None req-905e043d-471f-47d9-8e2d-5d966b967404 None None] lvmdriver-1.scst_target_driver = None {{(pid=81361) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:29:34 devstack cinder-volume[81361]: DEBUG oslo_service.backend._eventlet.service [None req-905e043d-471f-47d9-8e2d-5d966b967404 None None] lvmdriver-1.scst_target_iqn_name = None {{(pid=81361) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:29:34 devstack cinder-volume[81361]: DEBUG oslo_service.backend._eventlet.service [None req-905e043d-471f-47d9-8e2d-5d966b967404 None None] lvmdriver-1.storage_protocol = None {{(pid=81361) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:29:34 devstack cinder-volume[81361]: DEBUG oslo_service.backend._eventlet.service [None req-905e043d-471f-47d9-8e2d-5d966b967404 None None] lvmdriver-1.suppress_requests_ssl_warnings = None {{(pid=81361) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:29:34 devstack cinder-volume[81361]: DEBUG oslo_service.backend._eventlet.service [None req-905e043d-471f-47d9-8e2d-5d966b967404 None None] lvmdriver-1.target_helper = lioadm {{(pid=81361) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:29:34 devstack cinder-volume[81361]: DEBUG oslo_service.backend._eventlet.service [None req-905e043d-471f-47d9-8e2d-5d966b967404 None None] lvmdriver-1.target_ip_address = None {{(pid=81361) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:29:34 devstack cinder-volume[81361]: DEBUG oslo_service.backend._eventlet.service [None req-905e043d-471f-47d9-8e2d-5d966b967404 None None] lvmdriver-1.target_port = 3260 {{(pid=81361) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:29:34 devstack cinder-volume[81361]: DEBUG oslo_service.backend._eventlet.service [None req-905e043d-471f-47d9-8e2d-5d966b967404 None None] lvmdriver-1.target_prefix = iqn.2010-10.org.openstack: {{(pid=81361) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:29:34 devstack cinder-volume[81361]: DEBUG oslo_service.backend._eventlet.service [None req-905e043d-471f-47d9-8e2d-5d966b967404 None None] lvmdriver-1.target_protocol = iscsi {{(pid=81361) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:29:34 devstack cinder-volume[81361]: DEBUG oslo_service.backend._eventlet.service [None req-905e043d-471f-47d9-8e2d-5d966b967404 None None] lvmdriver-1.target_secondary_ip_addresses = None {{(pid=81361) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:29:34 devstack cinder-volume[81361]: DEBUG oslo_service.backend._eventlet.service [None req-905e043d-471f-47d9-8e2d-5d966b967404 None None] lvmdriver-1.trace_flags = None {{(pid=81361) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:29:34 devstack cinder-volume[81361]: DEBUG oslo_service.backend._eventlet.service [None req-905e043d-471f-47d9-8e2d-5d966b967404 None None] lvmdriver-1.unique_fqdn_network = None {{(pid=81361) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:29:34 devstack cinder-volume[81361]: DEBUG oslo_service.backend._eventlet.service [None req-905e043d-471f-47d9-8e2d-5d966b967404 None None] lvmdriver-1.use_chap_auth = None {{(pid=81361) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:29:34 devstack cinder-volume[81361]: DEBUG oslo_service.backend._eventlet.service [None req-905e043d-471f-47d9-8e2d-5d966b967404 None None] lvmdriver-1.use_multipath_for_image_xfer = None {{(pid=81361) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:29:34 devstack cinder-volume[81361]: DEBUG oslo_service.backend._eventlet.service [None req-905e043d-471f-47d9-8e2d-5d966b967404 None None] lvmdriver-1.volume_backend_name = lvmdriver-1 {{(pid=81361) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:29:34 devstack cinder-volume[81361]: DEBUG oslo_service.backend._eventlet.service [None req-905e043d-471f-47d9-8e2d-5d966b967404 None None] lvmdriver-1.volume_clear = zero {{(pid=81361) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:29:34 devstack cinder-volume[81361]: DEBUG oslo_service.backend._eventlet.service [None req-905e043d-471f-47d9-8e2d-5d966b967404 None None] lvmdriver-1.volume_clear_ionice = None {{(pid=81361) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:29:34 devstack cinder-volume[81361]: DEBUG oslo_service.backend._eventlet.service [None req-905e043d-471f-47d9-8e2d-5d966b967404 None None] lvmdriver-1.volume_clear_size = None {{(pid=81361) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:29:34 devstack cinder-volume[81361]: DEBUG oslo_service.backend._eventlet.service [None req-905e043d-471f-47d9-8e2d-5d966b967404 None None] lvmdriver-1.volume_copy_blkio_cgroup_name = None {{(pid=81361) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:29:34 devstack cinder-volume[81361]: DEBUG oslo_service.backend._eventlet.service [None req-905e043d-471f-47d9-8e2d-5d966b967404 None None] lvmdriver-1.volume_copy_bps_limit = None {{(pid=81361) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:29:34 devstack cinder-volume[81361]: DEBUG oslo_service.backend._eventlet.service [None req-905e043d-471f-47d9-8e2d-5d966b967404 None None] lvmdriver-1.volume_dd_blocksize = None {{(pid=81361) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:29:34 devstack cinder-volume[81361]: DEBUG oslo_service.backend._eventlet.service [None req-905e043d-471f-47d9-8e2d-5d966b967404 None None] lvmdriver-1.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=81361) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:29:34 devstack cinder-volume[81361]: DEBUG oslo_service.backend._eventlet.service [None req-905e043d-471f-47d9-8e2d-5d966b967404 None None] lvmdriver-1.volume_group = stack-volumes-lvmdriver-1 {{(pid=81361) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:29:34 devstack cinder-volume[81361]: DEBUG oslo_service.backend._eventlet.service [None req-905e043d-471f-47d9-8e2d-5d966b967404 None None] lvmdriver-1.volumes_dir = None {{(pid=81361) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:29:34 devstack cinder-volume[81361]: DEBUG oslo_service.backend._eventlet.service [None req-905e043d-471f-47d9-8e2d-5d966b967404 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=81361) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:29:34 devstack cinder-volume[81361]: DEBUG oslo_service.backend._eventlet.service [None req-905e043d-471f-47d9-8e2d-5d966b967404 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=81361) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:29:34 devstack cinder-volume[81361]: DEBUG oslo_service.backend._eventlet.service [None req-905e043d-471f-47d9-8e2d-5d966b967404 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=81361) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:29:34 devstack cinder-volume[81361]: DEBUG oslo_service.backend._eventlet.service [None req-905e043d-471f-47d9-8e2d-5d966b967404 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=81361) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:29:34 devstack cinder-volume[81361]: DEBUG oslo_service.backend._eventlet.service [None req-905e043d-471f-47d9-8e2d-5d966b967404 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=81361) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:29:34 devstack cinder-volume[81361]: DEBUG oslo_service.backend._eventlet.service [None req-905e043d-471f-47d9-8e2d-5d966b967404 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=81361) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:29:34 devstack cinder-volume[81361]: DEBUG oslo_service.backend._eventlet.service [None req-905e043d-471f-47d9-8e2d-5d966b967404 None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=81361) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:29:34 devstack cinder-volume[81361]: DEBUG oslo_service.backend._eventlet.service [None req-905e043d-471f-47d9-8e2d-5d966b967404 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=81361) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:29:34 devstack cinder-volume[81361]: DEBUG oslo_service.backend._eventlet.service [None req-905e043d-471f-47d9-8e2d-5d966b967404 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=81361) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:29:34 devstack cinder-volume[81361]: DEBUG oslo_service.backend._eventlet.service [None req-905e043d-471f-47d9-8e2d-5d966b967404 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=81361) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:29:34 devstack cinder-volume[81361]: DEBUG oslo_service.backend._eventlet.service [None req-905e043d-471f-47d9-8e2d-5d966b967404 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=81361) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:29:34 devstack cinder-volume[81361]: DEBUG oslo_service.backend._eventlet.service [None req-905e043d-471f-47d9-8e2d-5d966b967404 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=81361) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:29:34 devstack cinder-volume[81361]: DEBUG oslo_service.backend._eventlet.service [None req-905e043d-471f-47d9-8e2d-5d966b967404 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=81361) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:29:34 devstack cinder-volume[81361]: DEBUG oslo_service.backend._eventlet.service [None req-905e043d-471f-47d9-8e2d-5d966b967404 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=81361) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:29:34 devstack cinder-volume[81361]: DEBUG oslo_service.backend._eventlet.service [None req-905e043d-471f-47d9-8e2d-5d966b967404 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=81361) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:29:34 devstack cinder-volume[81361]: DEBUG oslo_service.backend._eventlet.service [None req-905e043d-471f-47d9-8e2d-5d966b967404 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=81361) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:29:34 devstack cinder-volume[81361]: DEBUG oslo_service.backend._eventlet.service [None req-905e043d-471f-47d9-8e2d-5d966b967404 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=81361) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:29:34 devstack cinder-volume[81361]: DEBUG oslo_service.backend._eventlet.service [None req-905e043d-471f-47d9-8e2d-5d966b967404 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=81361) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:29:34 devstack cinder-volume[81361]: DEBUG oslo_service.backend._eventlet.service [None req-905e043d-471f-47d9-8e2d-5d966b967404 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=81361) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:29:34 devstack cinder-volume[81361]: DEBUG oslo_service.backend._eventlet.service [None req-905e043d-471f-47d9-8e2d-5d966b967404 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=81361) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:29:34 devstack cinder-volume[81361]: DEBUG oslo_service.backend._eventlet.service [None req-905e043d-471f-47d9-8e2d-5d966b967404 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=81361) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:29:34 devstack cinder-volume[81361]: DEBUG oslo_service.backend._eventlet.service [None req-905e043d-471f-47d9-8e2d-5d966b967404 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=81361) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:29:34 devstack cinder-volume[81361]: DEBUG oslo_service.backend._eventlet.service [None req-905e043d-471f-47d9-8e2d-5d966b967404 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=81361) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:29:34 devstack cinder-volume[81361]: DEBUG oslo_service.backend._eventlet.service [None req-905e043d-471f-47d9-8e2d-5d966b967404 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=81361) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:29:34 devstack cinder-volume[81361]: DEBUG oslo_service.backend._eventlet.service [None req-905e043d-471f-47d9-8e2d-5d966b967404 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=81361) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:29:34 devstack cinder-volume[81361]: DEBUG oslo_service.backend._eventlet.service [None req-905e043d-471f-47d9-8e2d-5d966b967404 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=81361) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:29:34 devstack cinder-volume[81361]: DEBUG oslo_service.backend._eventlet.service [None req-905e043d-471f-47d9-8e2d-5d966b967404 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=81361) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:29:34 devstack cinder-volume[81361]: DEBUG oslo_service.backend._eventlet.service [None req-905e043d-471f-47d9-8e2d-5d966b967404 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=81361) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:29:34 devstack cinder-volume[81361]: DEBUG oslo_service.backend._eventlet.service [None req-905e043d-471f-47d9-8e2d-5d966b967404 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=81361) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:29:34 devstack cinder-volume[81361]: DEBUG oslo_service.backend._eventlet.service [None req-905e043d-471f-47d9-8e2d-5d966b967404 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=81361) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:29:34 devstack cinder-volume[81361]: DEBUG oslo_service.backend._eventlet.service [None req-905e043d-471f-47d9-8e2d-5d966b967404 None None] oslo_messaging_rabbit.ssl = False {{(pid=81361) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:29:34 devstack cinder-volume[81361]: DEBUG oslo_service.backend._eventlet.service [None req-905e043d-471f-47d9-8e2d-5d966b967404 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=81361) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:29:34 devstack cinder-volume[81361]: DEBUG oslo_service.backend._eventlet.service [None req-905e043d-471f-47d9-8e2d-5d966b967404 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=81361) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:29:34 devstack cinder-volume[81361]: DEBUG oslo_service.backend._eventlet.service [None req-905e043d-471f-47d9-8e2d-5d966b967404 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=81361) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:29:34 devstack cinder-volume[81361]: DEBUG oslo_service.backend._eventlet.service [None req-905e043d-471f-47d9-8e2d-5d966b967404 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=81361) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:29:34 devstack cinder-volume[81361]: DEBUG oslo_service.backend._eventlet.service [None req-905e043d-471f-47d9-8e2d-5d966b967404 None None] oslo_messaging_rabbit.ssl_version = {{(pid=81361) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:29:34 devstack cinder-volume[81361]: DEBUG oslo_service.backend._eventlet.service [None req-905e043d-471f-47d9-8e2d-5d966b967404 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=81361) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:29:34 devstack cinder-volume[81361]: DEBUG oslo_service.backend._eventlet.service [None req-905e043d-471f-47d9-8e2d-5d966b967404 None None] oslo_messaging_notifications.driver = [] {{(pid=81361) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:29:34 devstack cinder-volume[81361]: DEBUG oslo_service.backend._eventlet.service [None req-905e043d-471f-47d9-8e2d-5d966b967404 None None] oslo_messaging_notifications.retry = -1 {{(pid=81361) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:29:34 devstack cinder-volume[81361]: DEBUG oslo_service.backend._eventlet.service [None req-905e043d-471f-47d9-8e2d-5d966b967404 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=81361) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:29:34 devstack cinder-volume[81361]: DEBUG oslo_service.backend._eventlet.service [None req-905e043d-471f-47d9-8e2d-5d966b967404 None None] oslo_messaging_notifications.transport_url = **** {{(pid=81361) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:29:34 devstack cinder-volume[81361]: DEBUG oslo_service.backend._eventlet.service [None req-905e043d-471f-47d9-8e2d-5d966b967404 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=81361) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:29:34 devstack cinder-volume[81361]: DEBUG oslo_service.backend._eventlet.service [None req-905e043d-471f-47d9-8e2d-5d966b967404 None None] key_manager.fixed_key = **** {{(pid=81361) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:29:34 devstack cinder-volume[81361]: DEBUG oslo_service.backend._eventlet.service [None req-905e043d-471f-47d9-8e2d-5d966b967404 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=81361) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:29:34 devstack cinder-volume[81361]: DEBUG oslo_service.backend._eventlet.service [None req-905e043d-471f-47d9-8e2d-5d966b967404 None None] barbican.barbican_api_version = None {{(pid=81361) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:29:34 devstack cinder-volume[81361]: DEBUG oslo_service.backend._eventlet.service [None req-905e043d-471f-47d9-8e2d-5d966b967404 None None] barbican.barbican_endpoint = None {{(pid=81361) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:29:34 devstack cinder-volume[81361]: DEBUG oslo_service.backend._eventlet.service [None req-905e043d-471f-47d9-8e2d-5d966b967404 None None] barbican.barbican_endpoint_type = public {{(pid=81361) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:29:34 devstack cinder-volume[81361]: DEBUG oslo_service.backend._eventlet.service [None req-905e043d-471f-47d9-8e2d-5d966b967404 None None] barbican.barbican_region_name = None {{(pid=81361) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:29:34 devstack cinder-volume[81361]: DEBUG oslo_service.backend._eventlet.service [None req-905e043d-471f-47d9-8e2d-5d966b967404 None None] barbican.cafile = None {{(pid=81361) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:29:34 devstack cinder-volume[81361]: DEBUG oslo_service.backend._eventlet.service [None req-905e043d-471f-47d9-8e2d-5d966b967404 None None] barbican.certfile = None {{(pid=81361) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:29:34 devstack cinder-volume[81361]: DEBUG oslo_service.backend._eventlet.service [None req-905e043d-471f-47d9-8e2d-5d966b967404 None None] barbican.collect_timing = False {{(pid=81361) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:29:34 devstack cinder-volume[81361]: DEBUG oslo_service.backend._eventlet.service [None req-905e043d-471f-47d9-8e2d-5d966b967404 None None] barbican.insecure = False {{(pid=81361) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:29:34 devstack cinder-volume[81361]: DEBUG oslo_service.backend._eventlet.service [None req-905e043d-471f-47d9-8e2d-5d966b967404 None None] barbican.keyfile = None {{(pid=81361) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:29:34 devstack cinder-volume[81361]: DEBUG oslo_service.backend._eventlet.service [None req-905e043d-471f-47d9-8e2d-5d966b967404 None None] barbican.number_of_retries = 60 {{(pid=81361) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:29:34 devstack cinder-volume[81361]: DEBUG oslo_service.backend._eventlet.service [None req-905e043d-471f-47d9-8e2d-5d966b967404 None None] barbican.retry_delay = 1 {{(pid=81361) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:29:34 devstack cinder-volume[81361]: DEBUG oslo_service.backend._eventlet.service [None req-905e043d-471f-47d9-8e2d-5d966b967404 None None] barbican.send_service_user_token = False {{(pid=81361) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:29:34 devstack cinder-volume[81361]: DEBUG oslo_service.backend._eventlet.service [None req-905e043d-471f-47d9-8e2d-5d966b967404 None None] barbican.split_loggers = False {{(pid=81361) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:29:34 devstack cinder-volume[81361]: DEBUG oslo_service.backend._eventlet.service [None req-905e043d-471f-47d9-8e2d-5d966b967404 None None] barbican.timeout = None {{(pid=81361) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:29:34 devstack cinder-volume[81361]: DEBUG oslo_service.backend._eventlet.service [None req-905e043d-471f-47d9-8e2d-5d966b967404 None None] barbican.verify_ssl = True {{(pid=81361) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:29:34 devstack cinder-volume[81361]: DEBUG oslo_service.backend._eventlet.service [None req-905e043d-471f-47d9-8e2d-5d966b967404 None None] barbican.verify_ssl_path = None {{(pid=81361) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:29:34 devstack cinder-volume[81361]: DEBUG oslo_service.backend._eventlet.service [None req-905e043d-471f-47d9-8e2d-5d966b967404 None None] barbican_service_user.auth_section = None {{(pid=81361) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:29:34 devstack cinder-volume[81361]: DEBUG oslo_service.backend._eventlet.service [None req-905e043d-471f-47d9-8e2d-5d966b967404 None None] barbican_service_user.auth_type = None {{(pid=81361) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:29:34 devstack cinder-volume[81361]: DEBUG oslo_service.backend._eventlet.service [None req-905e043d-471f-47d9-8e2d-5d966b967404 None None] barbican_service_user.cafile = None {{(pid=81361) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:29:34 devstack cinder-volume[81361]: DEBUG oslo_service.backend._eventlet.service [None req-905e043d-471f-47d9-8e2d-5d966b967404 None None] barbican_service_user.certfile = None {{(pid=81361) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:29:34 devstack cinder-volume[81361]: DEBUG oslo_service.backend._eventlet.service [None req-905e043d-471f-47d9-8e2d-5d966b967404 None None] barbican_service_user.collect_timing = False {{(pid=81361) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:29:34 devstack cinder-volume[81361]: DEBUG oslo_service.backend._eventlet.service [None req-905e043d-471f-47d9-8e2d-5d966b967404 None None] barbican_service_user.insecure = False {{(pid=81361) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:29:34 devstack cinder-volume[81361]: DEBUG oslo_service.backend._eventlet.service [None req-905e043d-471f-47d9-8e2d-5d966b967404 None None] barbican_service_user.keyfile = None {{(pid=81361) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:29:34 devstack cinder-volume[81361]: DEBUG oslo_service.backend._eventlet.service [None req-905e043d-471f-47d9-8e2d-5d966b967404 None None] barbican_service_user.split_loggers = False {{(pid=81361) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:29:34 devstack cinder-volume[81361]: DEBUG oslo_service.backend._eventlet.service [None req-905e043d-471f-47d9-8e2d-5d966b967404 None None] barbican_service_user.timeout = None {{(pid=81361) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:29:34 devstack cinder-volume[81361]: DEBUG oslo_service.backend._eventlet.service [None req-905e043d-471f-47d9-8e2d-5d966b967404 None None] vault.approle_role_id = **** {{(pid=81361) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:29:34 devstack cinder-volume[81361]: DEBUG oslo_service.backend._eventlet.service [None req-905e043d-471f-47d9-8e2d-5d966b967404 None None] vault.approle_secret_id = **** {{(pid=81361) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:29:34 devstack cinder-volume[81361]: DEBUG oslo_service.backend._eventlet.service [None req-905e043d-471f-47d9-8e2d-5d966b967404 None None] vault.kv_mountpoint = secret {{(pid=81361) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:29:34 devstack cinder-volume[81361]: DEBUG oslo_service.backend._eventlet.service [None req-905e043d-471f-47d9-8e2d-5d966b967404 None None] vault.kv_path = None {{(pid=81361) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:29:34 devstack cinder-volume[81361]: DEBUG oslo_service.backend._eventlet.service [None req-905e043d-471f-47d9-8e2d-5d966b967404 None None] vault.kv_version = 2 {{(pid=81361) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:29:34 devstack cinder-volume[81361]: DEBUG oslo_service.backend._eventlet.service [None req-905e043d-471f-47d9-8e2d-5d966b967404 None None] vault.namespace = None {{(pid=81361) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:29:34 devstack cinder-volume[81361]: DEBUG oslo_service.backend._eventlet.service [None req-905e043d-471f-47d9-8e2d-5d966b967404 None None] vault.root_token_id = **** {{(pid=81361) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:29:34 devstack cinder-volume[81361]: DEBUG oslo_service.backend._eventlet.service [None req-905e043d-471f-47d9-8e2d-5d966b967404 None None] vault.ssl_ca_crt_file = None {{(pid=81361) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:29:34 devstack cinder-volume[81361]: DEBUG oslo_service.backend._eventlet.service [None req-905e043d-471f-47d9-8e2d-5d966b967404 None None] vault.timeout = 60.0 {{(pid=81361) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:29:34 devstack cinder-volume[81361]: DEBUG oslo_service.backend._eventlet.service [None req-905e043d-471f-47d9-8e2d-5d966b967404 None None] vault.use_ssl = False {{(pid=81361) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:29:34 devstack cinder-volume[81361]: DEBUG oslo_service.backend._eventlet.service [None req-905e043d-471f-47d9-8e2d-5d966b967404 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=81361) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:29:34 devstack cinder-volume[81361]: DEBUG oslo_service.backend._eventlet.service [None req-905e043d-471f-47d9-8e2d-5d966b967404 None None] ******************************************************************************** {{(pid=81361) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3013}} Jun 17 04:29:34 devstack cinder-volume[81529]: DEBUG oslo_concurrency.processutils [None req-81f4d17e-4515-41ce-a683-634aa574225e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1" returned: 0 in 0.848s {{(pid=81529) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:29:34 devstack cinder-volume[81529]: DEBUG oslo_concurrency.processutils [None req-81f4d17e-4515-41ce-a683-634aa574225e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=81529) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:29:34 devstack sudo[81669]: pam_unix(sudo:session): session closed for user root Jun 17 04:29:34 devstack cinder-volume[81529]: DEBUG oslo_concurrency.processutils [None req-81f4d17e-4515-41ce-a683-634aa574225e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 5 in 0.663s {{(pid=81529) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:29:34 devstack cinder-volume[81529]: DEBUG oslo_concurrency.processutils [None req-81f4d17e-4515-41ce-a683-634aa574225e None None] 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' failed. Not Retrying. {{(pid=81529) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 17 04:29:34 devstack cinder-volume[81529]: INFO cinder.brick.local_dev.lvm [None req-81f4d17e-4515-41ce-a683-634aa574225e None None] Logical Volume not found when querying LVM info. (vg_name=stack-volumes-lvmdriver-1, lv_name=stack-volumes-lvmdriver-1-pool Jun 17 04:29:34 devstack cinder-volume[81529]: DEBUG oslo_concurrency.processutils [None req-81f4d17e-4515-41ce-a683-634aa574225e None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=81529) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:29:34 devstack cinder-volume[81529]: DEBUG oslo_concurrency.processutils [None req-81f4d17e-4515-41ce-a683-634aa574225e None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.018s {{(pid=81529) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:29:34 devstack cinder-volume[81529]: DEBUG oslo_concurrency.processutils [None req-81f4d17e-4515-41ce-a683-634aa574225e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=81529) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:29:34 devstack sudo[81883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jun 17 04:29:34 devstack sudo[81883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:29:35 devstack sudo[81883]: pam_unix(sudo:session): session closed for user root Jun 17 04:29:35 devstack cinder-volume[81529]: DEBUG oslo_concurrency.processutils [None req-81f4d17e-4515-41ce-a683-634aa574225e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.690s {{(pid=81529) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:29:35 devstack cinder-volume[81529]: DEBUG cinder.brick.local_dev.lvm [None req-81f4d17e-4515-41ce-a683-634aa574225e None None] Creating thin pool 'stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' with size 28.5g of total 30.0g {{(pid=81529) create_thin_pool /opt/stack/cinder/cinder/brick/local_dev/lvm.py:550}} Jun 17 04:29:35 devstack cinder-volume[81529]: DEBUG oslo_concurrency.processutils [None req-81f4d17e-4515-41ce-a683-634aa574225e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=81529) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:29:35 devstack sudo[82099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jun 17 04:29:35 devstack sudo[82099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:29:36 devstack sudo[82099]: pam_unix(sudo:session): session closed for user root Jun 17 04:29:36 devstack cinder-volume[81529]: DEBUG oslo_concurrency.processutils [None req-81f4d17e-4515-41ce-a683-634aa574225e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 1.236s {{(pid=81529) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:29:36 devstack cinder-volume[81529]: DEBUG oslo_concurrency.processutils [None req-81f4d17e-4515-41ce-a683-634aa574225e None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=81529) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:29:36 devstack cinder-volume[81529]: DEBUG oslo_concurrency.processutils [None req-81f4d17e-4515-41ce-a683-634aa574225e None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.027s {{(pid=81529) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:29:36 devstack cinder-volume[81529]: DEBUG oslo_concurrency.processutils [None req-81f4d17e-4515-41ce-a683-634aa574225e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=81529) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:29:36 devstack sudo[82271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jun 17 04:29:36 devstack sudo[82271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:29:37 devstack sudo[82271]: pam_unix(sudo:session): session closed for user root Jun 17 04:29:37 devstack cinder-volume[81529]: DEBUG oslo_concurrency.processutils [None req-81f4d17e-4515-41ce-a683-634aa574225e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.842s {{(pid=81529) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:29:37 devstack cinder-volume[81529]: DEBUG oslo_concurrency.processutils [None req-81f4d17e-4515-41ce-a683-634aa574225e None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=81529) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:29:37 devstack cinder-volume[81529]: DEBUG oslo_concurrency.processutils [None req-81f4d17e-4515-41ce-a683-634aa574225e None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.028s {{(pid=81529) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:29:37 devstack cinder-volume[81529]: DEBUG oslo_concurrency.processutils [None req-81f4d17e-4515-41ce-a683-634aa574225e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster {{(pid=81529) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:29:37 devstack sudo[82315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster Jun 17 04:29:37 devstack sudo[82315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:29:38 devstack sudo[82315]: pam_unix(sudo:session): session closed for user root Jun 17 04:29:38 devstack cinder-volume[81529]: DEBUG oslo_concurrency.processutils [None req-81f4d17e-4515-41ce-a683-634aa574225e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster" returned: 0 in 0.687s {{(pid=81529) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:29:38 devstack cinder-volume[81529]: DEBUG oslo_concurrency.processutils [None req-81f4d17e-4515-41ce-a683-634aa574225e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=81529) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:29:38 devstack sudo[82319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jun 17 04:29:38 devstack sudo[82319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:29:38 devstack sudo[82319]: pam_unix(sudo:session): session closed for user root Jun 17 04:29:38 devstack cinder-volume[81529]: DEBUG oslo_concurrency.processutils [None req-81f4d17e-4515-41ce-a683-634aa574225e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.594s {{(pid=81529) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:29:38 devstack cinder-volume[81529]: DEBUG oslo_concurrency.processutils [None req-81f4d17e-4515-41ce-a683-634aa574225e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=81529) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:29:38 devstack sudo[82324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jun 17 04:29:38 devstack sudo[82324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:29:39 devstack sudo[82324]: pam_unix(sudo:session): session closed for user root Jun 17 04:29:39 devstack cinder-volume[81529]: DEBUG oslo_concurrency.processutils [None req-81f4d17e-4515-41ce-a683-634aa574225e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.641s {{(pid=81529) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:29:39 devstack cinder-volume[81529]: DEBUG oslo_concurrency.processutils [None req-81f4d17e-4515-41ce-a683-634aa574225e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=81529) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:29:39 devstack sudo[82327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jun 17 04:29:39 devstack sudo[82327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:29:40 devstack sudo[82327]: pam_unix(sudo:session): session closed for user root Jun 17 04:29:40 devstack cinder-volume[81529]: DEBUG oslo_concurrency.processutils [None req-81f4d17e-4515-41ce-a683-634aa574225e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.626s {{(pid=81529) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:29:40 devstack cinder-volume[81529]: DEBUG oslo_concurrency.processutils [None req-81f4d17e-4515-41ce-a683-634aa574225e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=81529) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:29:40 devstack sudo[82336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jun 17 04:29:40 devstack sudo[82336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:29:40 devstack sudo[82336]: pam_unix(sudo:session): session closed for user root Jun 17 04:29:40 devstack cinder-volume[81529]: DEBUG oslo_concurrency.processutils [None req-81f4d17e-4515-41ce-a683-634aa574225e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.633s {{(pid=81529) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:29:40 devstack cinder-volume[81529]: DEBUG oslo_concurrency.processutils [None req-81f4d17e-4515-41ce-a683-634aa574225e None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=81529) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:29:40 devstack cinder-volume[81529]: DEBUG oslo_concurrency.processutils [None req-81f4d17e-4515-41ce-a683-634aa574225e None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.016s {{(pid=81529) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:29:40 devstack cinder-volume[81529]: DEBUG oslo_concurrency.processutils [None req-81f4d17e-4515-41ce-a683-634aa574225e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=81529) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:29:40 devstack sudo[82341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jun 17 04:29:40 devstack sudo[82341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:29:41 devstack sudo[82341]: pam_unix(sudo:session): session closed for user root Jun 17 04:29:41 devstack cinder-volume[81529]: DEBUG oslo_concurrency.processutils [None req-81f4d17e-4515-41ce-a683-634aa574225e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.687s {{(pid=81529) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:29:41 devstack cinder-volume[81529]: INFO cinder.volume.drivers.lvm [None req-81f4d17e-4515-41ce-a683-634aa574225e None None] Enabling LVM thin provisioning by default because a thin pool exists. Jun 17 04:29:41 devstack cinder-volume[81529]: DEBUG oslo_concurrency.processutils [None req-81f4d17e-4515-41ce-a683-634aa574225e None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=81529) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:29:41 devstack cinder-volume[81529]: DEBUG oslo_concurrency.processutils [None req-81f4d17e-4515-41ce-a683-634aa574225e None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.015s {{(pid=81529) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:29:41 devstack cinder-volume[81529]: DEBUG oslo_concurrency.processutils [None req-81f4d17e-4515-41ce-a683-634aa574225e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=81529) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:29:41 devstack sudo[82345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jun 17 04:29:41 devstack sudo[82345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:29:42 devstack sudo[82345]: pam_unix(sudo:session): session closed for user root Jun 17 04:29:42 devstack cinder-volume[81529]: DEBUG oslo_concurrency.processutils [None req-81f4d17e-4515-41ce-a683-634aa574225e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.698s {{(pid=81529) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:29:42 devstack cinder-volume[81529]: DEBUG cinder.volume.drivers.lvm [None req-81f4d17e-4515-41ce-a683-634aa574225e None None] Updating volume stats {{(pid=81529) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jun 17 04:29:42 devstack cinder-volume[81529]: DEBUG oslo_concurrency.processutils [None req-81f4d17e-4515-41ce-a683-634aa574225e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=81529) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:29:42 devstack sudo[82394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jun 17 04:29:42 devstack sudo[82394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:29:42 devstack sudo[82394]: pam_unix(sudo:session): session closed for user root Jun 17 04:29:42 devstack cinder-volume[81529]: DEBUG oslo_concurrency.processutils [None req-81f4d17e-4515-41ce-a683-634aa574225e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.721s {{(pid=81529) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:29:42 devstack cinder-volume[81529]: DEBUG oslo_concurrency.processutils [None req-81f4d17e-4515-41ce-a683-634aa574225e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=81529) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:29:42 devstack sudo[82491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jun 17 04:29:42 devstack sudo[82491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:29:43 devstack cinder-volume[81361]: DEBUG dbcounter [-] [81361] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=81361) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 17 04:29:43 devstack sudo[82491]: pam_unix(sudo:session): session closed for user root Jun 17 04:29:43 devstack cinder-volume[81529]: DEBUG oslo_concurrency.processutils [None req-81f4d17e-4515-41ce-a683-634aa574225e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.636s {{(pid=81529) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:29:43 devstack cinder-volume[81529]: DEBUG oslo_concurrency.processutils [None req-81f4d17e-4515-41ce-a683-634aa574225e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=81529) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:29:43 devstack sudo[82612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jun 17 04:29:43 devstack sudo[82612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:29:44 devstack sudo[82612]: pam_unix(sudo:session): session closed for user root Jun 17 04:29:44 devstack cinder-volume[81529]: DEBUG oslo_concurrency.processutils [None req-81f4d17e-4515-41ce-a683-634aa574225e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.593s {{(pid=81529) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:29:44 devstack cinder-volume[81529]: DEBUG oslo_concurrency.processutils [None req-81f4d17e-4515-41ce-a683-634aa574225e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=81529) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:29:44 devstack sudo[82615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jun 17 04:29:44 devstack sudo[82615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:29:44 devstack sudo[82615]: pam_unix(sudo:session): session closed for user root Jun 17 04:29:44 devstack cinder-volume[81529]: DEBUG oslo_concurrency.processutils [None req-81f4d17e-4515-41ce-a683-634aa574225e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.602s {{(pid=81529) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:29:44 devstack cinder-volume[81529]: INFO cinder.volume.driver [None req-81f4d17e-4515-41ce-a683-634aa574225e None None] Driver hasn't implemented _init_vendor_properties() Jun 17 04:29:44 devstack cinder-volume[81529]: DEBUG cinder.volume.driver [None req-81f4d17e-4515-41ce-a683-634aa574225e None None] Initialized capabilities list: {'volume_backend_name': 'lvmdriver-1', 'vendor_name': 'Open Source', 'driver_version': '3.0.0', 'storage_protocol': 'iSCSI', 'pools': [{'pool_name': 'lvmdriver-1', 'total_capacity_gb': 28.5, 'free_capacity_gb': 28.5, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:devstack:stack-volumes-lvmdriver-1:thin:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'total_volumes': 1, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up'}], 'shared_targets': False, 'sparse_copy_volume': True, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=81529) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Jun 17 04:29:44 devstack cinder-volume[81529]: DEBUG oslo_db.sqlalchemy.engines [None req-81f4d17e-4515-41ce-a683-634aa574225e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81529) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jun 17 04:29:44 devstack cinder-volume[81529]: DEBUG dbcounter [-] [81529] Writer thread running {{(pid=81529) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jun 17 04:29:44 devstack cinder-volume[81529]: DEBUG cinder.db.sqlalchemy.api [None req-81f4d17e-4515-41ce-a683-634aa574225e None None] Building query based on filter {{(pid=81529) _process_snaps_filters /opt/stack/cinder/cinder/db/sqlalchemy/api.py:3979}} Jun 17 04:29:44 devstack cinder-volume[81529]: DEBUG cinder.image.image_utils [None req-81f4d17e-4515-41ce-a683-634aa574225e None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=81529) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Jun 17 04:29:44 devstack cinder-volume[81529]: INFO cinder.keymgr.migration [None req-ec0c5774-7747-4044-96ff-f36c2d345c51 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Jun 17 04:29:44 devstack cinder-volume[81529]: DEBUG cinder.volume.drivers.lvm [None req-81f4d17e-4515-41ce-a683-634aa574225e None None] Updating volume stats {{(pid=81529) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jun 17 04:29:44 devstack cinder-volume[81529]: DEBUG oslo_concurrency.processutils [None req-81f4d17e-4515-41ce-a683-634aa574225e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=81529) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:29:44 devstack sudo[82619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jun 17 04:29:44 devstack sudo[82619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:29:45 devstack sudo[82619]: pam_unix(sudo:session): session closed for user root Jun 17 04:29:45 devstack cinder-volume[81529]: DEBUG oslo_concurrency.processutils [None req-81f4d17e-4515-41ce-a683-634aa574225e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.611s {{(pid=81529) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:29:45 devstack cinder-volume[81529]: DEBUG oslo_concurrency.processutils [None req-81f4d17e-4515-41ce-a683-634aa574225e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=81529) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:29:45 devstack sudo[82622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jun 17 04:29:45 devstack sudo[82622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:29:46 devstack sudo[82622]: pam_unix(sudo:session): session closed for user root Jun 17 04:29:46 devstack cinder-volume[81529]: DEBUG oslo_concurrency.processutils [None req-81f4d17e-4515-41ce-a683-634aa574225e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.611s {{(pid=81529) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:29:46 devstack cinder-volume[81529]: DEBUG oslo_concurrency.processutils [None req-81f4d17e-4515-41ce-a683-634aa574225e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=81529) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:29:46 devstack sudo[82625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jun 17 04:29:46 devstack sudo[82625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:29:46 devstack sudo[82625]: pam_unix(sudo:session): session closed for user root Jun 17 04:29:46 devstack cinder-volume[81529]: DEBUG oslo_concurrency.processutils [None req-81f4d17e-4515-41ce-a683-634aa574225e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.609s {{(pid=81529) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:29:46 devstack cinder-volume[81529]: DEBUG oslo_concurrency.processutils [None req-81f4d17e-4515-41ce-a683-634aa574225e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=81529) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:29:46 devstack sudo[82631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jun 17 04:29:46 devstack sudo[82631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:29:47 devstack sudo[82631]: pam_unix(sudo:session): session closed for user root Jun 17 04:29:47 devstack cinder-volume[81529]: DEBUG oslo_concurrency.processutils [None req-81f4d17e-4515-41ce-a683-634aa574225e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.636s {{(pid=81529) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:29:47 devstack cinder-volume[81529]: DEBUG cinder.manager [None req-81f4d17e-4515-41ce-a683-634aa574225e None None] Notifying Schedulers of capabilities ... {{(pid=81529) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 17 04:29:47 devstack cinder-volume[81529]: INFO cinder.volume.manager [None req-81f4d17e-4515-41ce-a683-634aa574225e None None] Driver initialization completed successfully. Jun 17 04:29:47 devstack cinder-volume[81529]: INFO cinder.manager [None req-81f4d17e-4515-41ce-a683-634aa574225e None None] Initiating service 2 cleanup Jun 17 04:29:47 devstack cinder-volume[81529]: INFO cinder.manager [None req-81f4d17e-4515-41ce-a683-634aa574225e None None] Service 2 cleanup completed. Jun 17 04:29:47 devstack cinder-volume[81529]: DEBUG cinder.service [None req-81f4d17e-4515-41ce-a683-634aa574225e None None] Creating RPC server for service cinder-volume {{(pid=81529) start /opt/stack/cinder/cinder/service.py:231}} Jun 17 04:29:47 devstack cinder-volume[81529]: DEBUG cinder.service [None req-81f4d17e-4515-41ce-a683-634aa574225e None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=81529) start /opt/stack/cinder/cinder/service.py:237}} Jun 17 04:29:47 devstack cinder-volume[81529]: INFO cinder.volume.manager [None req-81f4d17e-4515-41ce-a683-634aa574225e None None] Initializing RPC dependent components of volume driver LVMVolumeDriver (3.0.0) Jun 17 04:29:47 devstack cinder-volume[81529]: DEBUG cinder.volume.drivers.lvm [None req-81f4d17e-4515-41ce-a683-634aa574225e None None] Updating volume stats {{(pid=81529) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jun 17 04:29:47 devstack cinder-volume[81529]: DEBUG oslo_concurrency.processutils [None req-81f4d17e-4515-41ce-a683-634aa574225e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=81529) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:29:47 devstack sudo[82636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jun 17 04:29:47 devstack sudo[82636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:29:48 devstack sudo[82636]: pam_unix(sudo:session): session closed for user root Jun 17 04:29:48 devstack cinder-volume[81529]: DEBUG oslo_concurrency.processutils [None req-81f4d17e-4515-41ce-a683-634aa574225e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.634s {{(pid=81529) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:29:48 devstack cinder-volume[81529]: DEBUG oslo_concurrency.processutils [None req-81f4d17e-4515-41ce-a683-634aa574225e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=81529) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:29:48 devstack sudo[82640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jun 17 04:29:48 devstack sudo[82640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:29:48 devstack sudo[82640]: pam_unix(sudo:session): session closed for user root Jun 17 04:29:48 devstack cinder-volume[81529]: DEBUG oslo_concurrency.processutils [None req-81f4d17e-4515-41ce-a683-634aa574225e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.596s {{(pid=81529) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:29:48 devstack cinder-volume[81529]: DEBUG oslo_concurrency.processutils [None req-81f4d17e-4515-41ce-a683-634aa574225e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=81529) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:29:48 devstack sudo[82643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jun 17 04:29:48 devstack sudo[82643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:29:49 devstack sudo[82643]: pam_unix(sudo:session): session closed for user root Jun 17 04:29:49 devstack cinder-volume[81529]: DEBUG oslo_concurrency.processutils [None req-81f4d17e-4515-41ce-a683-634aa574225e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.618s {{(pid=81529) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:29:49 devstack cinder-volume[81529]: DEBUG oslo_concurrency.processutils [None req-81f4d17e-4515-41ce-a683-634aa574225e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=81529) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:29:49 devstack sudo[82700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jun 17 04:29:49 devstack sudo[82700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:29:49 devstack sudo[82700]: pam_unix(sudo:session): session closed for user root Jun 17 04:29:49 devstack cinder-volume[81529]: DEBUG oslo_concurrency.processutils [None req-81f4d17e-4515-41ce-a683-634aa574225e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.602s {{(pid=81529) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:29:50 devstack cinder-volume[81529]: INFO cinder.volume.manager [None req-81f4d17e-4515-41ce-a683-634aa574225e None None] Driver post RPC initialization completed successfully. Jun 17 04:29:59 devstack cinder-volume[81529]: DEBUG dbcounter [-] [81529] Writing DB stats cinder:SELECT=12,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=81529) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 17 04:29:59 devstack cinder-volume[81529]: DEBUG dbcounter [-] [81529] Writing DB stats cinder:SELECT=2,cinder:UPDATE=1 {{(pid=81529) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 17 04:30:20 devstack cinder-volume[81529]: DEBUG oslo_service.periodic_task [None req-743b2537-f621-42fe-a1e4-5a0c49b0ecac None None] Running periodic task VolumeManager._thread_info {{(pid=81529) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 17 04:30:20 devstack cinder-volume[81529]: DEBUG cinder.volume.manager [None req-743b2537-f621-42fe-a1e4-5a0c49b0ecac None None] thread count: 6 {{(pid=81529) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 17 04:30:20 devstack cinder-volume[81529]: DEBUG cinder.volume.manager [None req-743b2537-f621-42fe-a1e4-5a0c49b0ecac None None] thread info: [<_MainThread(MainThread, started 140596582752384)>, , , , , ] {{(pid=81529) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 17 04:31:20 devstack cinder-volume[81529]: DEBUG oslo_service.periodic_task [None req-743b2537-f621-42fe-a1e4-5a0c49b0ecac None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=81529) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 17 04:31:20 devstack cinder-volume[81529]: DEBUG cinder.volume.drivers.lvm [None req-743b2537-f621-42fe-a1e4-5a0c49b0ecac None None] Updating volume stats {{(pid=81529) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jun 17 04:31:20 devstack cinder-volume[81529]: DEBUG oslo_concurrency.processutils [None req-743b2537-f621-42fe-a1e4-5a0c49b0ecac None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=81529) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:31:20 devstack sudo[87419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jun 17 04:31:20 devstack sudo[87419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:31:20 devstack sudo[87419]: pam_unix(sudo:session): session closed for user root Jun 17 04:31:20 devstack cinder-volume[81529]: DEBUG oslo_concurrency.processutils [None req-743b2537-f621-42fe-a1e4-5a0c49b0ecac None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.601s {{(pid=81529) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:31:20 devstack cinder-volume[81529]: DEBUG oslo_concurrency.processutils [None req-743b2537-f621-42fe-a1e4-5a0c49b0ecac None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=81529) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:31:20 devstack sudo[87424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jun 17 04:31:20 devstack sudo[87424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:31:21 devstack sudo[87424]: pam_unix(sudo:session): session closed for user root Jun 17 04:31:21 devstack cinder-volume[81529]: DEBUG oslo_concurrency.processutils [None req-743b2537-f621-42fe-a1e4-5a0c49b0ecac None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.584s {{(pid=81529) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:31:21 devstack cinder-volume[81529]: DEBUG oslo_concurrency.processutils [None req-743b2537-f621-42fe-a1e4-5a0c49b0ecac None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=81529) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:31:21 devstack sudo[87427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jun 17 04:31:21 devstack sudo[87427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:31:21 devstack sudo[87427]: pam_unix(sudo:session): session closed for user root Jun 17 04:31:21 devstack cinder-volume[81529]: DEBUG oslo_concurrency.processutils [None req-743b2537-f621-42fe-a1e4-5a0c49b0ecac None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.585s {{(pid=81529) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:31:21 devstack cinder-volume[81529]: DEBUG oslo_concurrency.processutils [None req-743b2537-f621-42fe-a1e4-5a0c49b0ecac None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=81529) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:31:21 devstack sudo[87432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jun 17 04:31:21 devstack sudo[87432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:31:22 devstack sudo[87432]: pam_unix(sudo:session): session closed for user root Jun 17 04:31:22 devstack cinder-volume[81529]: DEBUG oslo_concurrency.processutils [None req-743b2537-f621-42fe-a1e4-5a0c49b0ecac None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.597s {{(pid=81529) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:31:22 devstack cinder-volume[81529]: DEBUG cinder.manager [None req-743b2537-f621-42fe-a1e4-5a0c49b0ecac None None] Notifying Schedulers of capabilities ... {{(pid=81529) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 17 04:31:22 devstack cinder-volume[81529]: DEBUG oslo_service.periodic_task [None req-743b2537-f621-42fe-a1e4-5a0c49b0ecac None None] Running periodic task VolumeManager._thread_info {{(pid=81529) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 17 04:31:22 devstack cinder-volume[81529]: DEBUG cinder.volume.manager [None req-743b2537-f621-42fe-a1e4-5a0c49b0ecac None None] thread count: 6 {{(pid=81529) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 17 04:31:22 devstack cinder-volume[81529]: DEBUG cinder.volume.manager [None req-743b2537-f621-42fe-a1e4-5a0c49b0ecac None None] thread info: [<_MainThread(MainThread, started 140596582752384)>, , , , , ] {{(pid=81529) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 17 04:32:00 devstack cinder-volume[81529]: DEBUG dbcounter [-] [81529] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=81529) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 17 04:32:20 devstack cinder-volume[81529]: DEBUG oslo_service.periodic_task [None req-743b2537-f621-42fe-a1e4-5a0c49b0ecac None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=81529) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 17 04:32:20 devstack cinder-volume[81529]: DEBUG cinder.volume.drivers.lvm [None req-743b2537-f621-42fe-a1e4-5a0c49b0ecac None None] Updating volume stats {{(pid=81529) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jun 17 04:32:20 devstack cinder-volume[81529]: DEBUG oslo_concurrency.processutils [None req-743b2537-f621-42fe-a1e4-5a0c49b0ecac None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=81529) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:32:20 devstack sudo[88495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jun 17 04:32:20 devstack sudo[88495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:32:20 devstack sudo[88495]: pam_unix(sudo:session): session closed for user root Jun 17 04:32:20 devstack cinder-volume[81529]: DEBUG oslo_concurrency.processutils [None req-743b2537-f621-42fe-a1e4-5a0c49b0ecac None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.612s {{(pid=81529) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:32:20 devstack cinder-volume[81529]: DEBUG oslo_concurrency.processutils [None req-743b2537-f621-42fe-a1e4-5a0c49b0ecac None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=81529) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:32:20 devstack sudo[88610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jun 17 04:32:20 devstack sudo[88610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:32:21 devstack sudo[88610]: pam_unix(sudo:session): session closed for user root Jun 17 04:32:21 devstack cinder-volume[81529]: DEBUG oslo_concurrency.processutils [None req-743b2537-f621-42fe-a1e4-5a0c49b0ecac None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.625s {{(pid=81529) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:32:21 devstack cinder-volume[81529]: DEBUG oslo_concurrency.processutils [None req-743b2537-f621-42fe-a1e4-5a0c49b0ecac None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=81529) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:32:21 devstack sudo[88655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jun 17 04:32:21 devstack sudo[88655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:32:21 devstack sudo[88655]: pam_unix(sudo:session): session closed for user root Jun 17 04:32:21 devstack cinder-volume[81529]: DEBUG oslo_concurrency.processutils [None req-743b2537-f621-42fe-a1e4-5a0c49b0ecac None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.578s {{(pid=81529) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:32:21 devstack cinder-volume[81529]: DEBUG oslo_concurrency.processutils [None req-743b2537-f621-42fe-a1e4-5a0c49b0ecac None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=81529) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:32:21 devstack sudo[88714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jun 17 04:32:21 devstack sudo[88714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:32:22 devstack sudo[88714]: pam_unix(sudo:session): session closed for user root Jun 17 04:32:22 devstack cinder-volume[81529]: DEBUG oslo_concurrency.processutils [None req-743b2537-f621-42fe-a1e4-5a0c49b0ecac None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.600s {{(pid=81529) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:32:22 devstack cinder-volume[81529]: DEBUG cinder.manager [None req-743b2537-f621-42fe-a1e4-5a0c49b0ecac None None] Notifying Schedulers of capabilities ... {{(pid=81529) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 17 04:32:22 devstack cinder-volume[81529]: DEBUG oslo_service.periodic_task [None req-743b2537-f621-42fe-a1e4-5a0c49b0ecac None None] Running periodic task VolumeManager._thread_info {{(pid=81529) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 17 04:32:22 devstack cinder-volume[81529]: DEBUG cinder.volume.manager [None req-743b2537-f621-42fe-a1e4-5a0c49b0ecac None None] thread count: 6 {{(pid=81529) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 17 04:32:22 devstack cinder-volume[81529]: DEBUG cinder.volume.manager [None req-743b2537-f621-42fe-a1e4-5a0c49b0ecac None None] thread info: [<_MainThread(MainThread, started 140596582752384)>, , , , , ] {{(pid=81529) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 17 04:33:20 devstack cinder-volume[81529]: DEBUG oslo_service.periodic_task [None req-743b2537-f621-42fe-a1e4-5a0c49b0ecac None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=81529) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 17 04:33:20 devstack cinder-volume[81529]: DEBUG cinder.volume.drivers.lvm [None req-743b2537-f621-42fe-a1e4-5a0c49b0ecac None None] Updating volume stats {{(pid=81529) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jun 17 04:33:20 devstack cinder-volume[81529]: DEBUG oslo_concurrency.processutils [None req-743b2537-f621-42fe-a1e4-5a0c49b0ecac None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=81529) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:33:20 devstack sudo[90238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jun 17 04:33:20 devstack sudo[90238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:33:20 devstack sudo[90238]: pam_unix(sudo:session): session closed for user root Jun 17 04:33:20 devstack cinder-volume[81529]: DEBUG oslo_concurrency.processutils [None req-743b2537-f621-42fe-a1e4-5a0c49b0ecac None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.607s {{(pid=81529) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:33:20 devstack cinder-volume[81529]: DEBUG oslo_concurrency.processutils [None req-743b2537-f621-42fe-a1e4-5a0c49b0ecac None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=81529) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:33:20 devstack sudo[90250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jun 17 04:33:20 devstack sudo[90250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:33:21 devstack sudo[90250]: pam_unix(sudo:session): session closed for user root Jun 17 04:33:21 devstack cinder-volume[81529]: DEBUG oslo_concurrency.processutils [None req-743b2537-f621-42fe-a1e4-5a0c49b0ecac None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.568s {{(pid=81529) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:33:21 devstack cinder-volume[81529]: DEBUG oslo_concurrency.processutils [None req-743b2537-f621-42fe-a1e4-5a0c49b0ecac None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=81529) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:33:21 devstack sudo[90268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jun 17 04:33:21 devstack sudo[90268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:33:21 devstack sudo[90268]: pam_unix(sudo:session): session closed for user root Jun 17 04:33:21 devstack cinder-volume[81529]: DEBUG oslo_concurrency.processutils [None req-743b2537-f621-42fe-a1e4-5a0c49b0ecac None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.611s {{(pid=81529) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:33:21 devstack cinder-volume[81529]: DEBUG oslo_concurrency.processutils [None req-743b2537-f621-42fe-a1e4-5a0c49b0ecac None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=81529) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:33:21 devstack sudo[90302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jun 17 04:33:21 devstack sudo[90302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:33:22 devstack sudo[90302]: pam_unix(sudo:session): session closed for user root Jun 17 04:33:22 devstack cinder-volume[81529]: DEBUG oslo_concurrency.processutils [None req-743b2537-f621-42fe-a1e4-5a0c49b0ecac None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.588s {{(pid=81529) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:33:22 devstack cinder-volume[81529]: DEBUG cinder.manager [None req-743b2537-f621-42fe-a1e4-5a0c49b0ecac None None] Notifying Schedulers of capabilities ... {{(pid=81529) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 17 04:33:22 devstack cinder-volume[81529]: DEBUG oslo_service.periodic_task [None req-743b2537-f621-42fe-a1e4-5a0c49b0ecac None None] Running periodic task VolumeManager._thread_info {{(pid=81529) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 17 04:33:22 devstack cinder-volume[81529]: DEBUG cinder.volume.manager [None req-743b2537-f621-42fe-a1e4-5a0c49b0ecac None None] thread count: 6 {{(pid=81529) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 17 04:33:22 devstack cinder-volume[81529]: DEBUG cinder.volume.manager [None req-743b2537-f621-42fe-a1e4-5a0c49b0ecac None None] thread info: [<_MainThread(MainThread, started 140596582752384)>, , , , , ] {{(pid=81529) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 17 04:33:59 devstack cinder-volume[81361]: INFO oslo_service.backend._eventlet.service [None req-905e043d-471f-47d9-8e2d-5d966b967404 None None] Caught SIGTERM, stopping children Jun 17 04:33:59 devstack cinder-volume[81361]: DEBUG oslo_concurrency.lockutils [None req-905e043d-471f-47d9-8e2d-5d966b967404 None None] Acquiring lock "singleton_lock" {{(pid=81361) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}} Jun 17 04:33:59 devstack cinder-volume[81361]: DEBUG oslo_concurrency.lockutils [None req-905e043d-471f-47d9-8e2d-5d966b967404 None None] Acquired lock "singleton_lock" {{(pid=81361) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}} Jun 17 04:33:59 devstack cinder-volume[81361]: DEBUG oslo_concurrency.lockutils [None req-905e043d-471f-47d9-8e2d-5d966b967404 None None] Releasing lock "singleton_lock" {{(pid=81361) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}} Jun 17 04:33:59 devstack cinder-volume[81361]: DEBUG oslo_service.backend._eventlet.service [None req-905e043d-471f-47d9-8e2d-5d966b967404 None None] Stop services. {{(pid=81361) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Jun 17 04:33:59 devstack cinder-volume[81361]: DEBUG oslo_service.backend._eventlet.service [None req-905e043d-471f-47d9-8e2d-5d966b967404 None None] Killing children. {{(pid=81361) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Jun 17 04:33:59 devstack cinder-volume[81361]: INFO oslo_service.backend._eventlet.service [None req-905e043d-471f-47d9-8e2d-5d966b967404 None None] Waiting on 1 children to exit Jun 17 04:34:00 devstack cinder-volume[81529]: DEBUG dbcounter [-] [81529] Writing DB stats cinder:SELECT=1 {{(pid=81529) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 17 04:34:00 devstack cinder-volume[81529]: DEBUG dbcounter [-] [81529] Writing DB stats cinder:UPDATE=1 {{(pid=81529) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 17 04:34:02 devstack cinder-volume[81529]: DEBUG oslo_concurrency.lockutils [None req-905e043d-471f-47d9-8e2d-5d966b967404 None None] Acquiring lock "singleton_lock" {{(pid=81529) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}} Jun 17 04:34:02 devstack cinder-volume[81529]: DEBUG oslo_concurrency.lockutils [None req-905e043d-471f-47d9-8e2d-5d966b967404 None None] Acquired lock "singleton_lock" {{(pid=81529) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}} Jun 17 04:34:02 devstack cinder-volume[81529]: DEBUG oslo_concurrency.lockutils [None req-905e043d-471f-47d9-8e2d-5d966b967404 None None] Releasing lock "singleton_lock" {{(pid=81529) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}} Jun 17 04:34:02 devstack cinder-volume[81529]: WARNING amqp [None req-905e043d-471f-47d9-8e2d-5d966b967404 None None] Received method (60, 30) during closing channel 1. This method will be ignored Jun 17 04:34:02 devstack cinder-volume[81529]: WARNING amqp [None req-905e043d-471f-47d9-8e2d-5d966b967404 None None] Received method (60, 30) during closing channel 1. This method will be ignored Jun 17 04:34:02 devstack cinder-volume[81361]: INFO oslo_service.backend._eventlet.service [None req-905e043d-471f-47d9-8e2d-5d966b967404 None None] Child 81529 exited with status 0 Jun 17 04:34:04 devstack cinder-volume[91233]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=91233) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}} Jun 17 04:34:04 devstack cinder-volume[91233]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=91233) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}} Jun 17 04:34:04 devstack cinder-volume[91233]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=91233) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}} Jun 17 04:34:05 devstack cinder-volume[91233]: INFO dbcounter [None req-30ff7824-65c2-4a82-981e-07bbc18faa7a None None] Registered counter for database cinder Jun 17 04:34:05 devstack cinder-volume[91233]: DEBUG oslo_db.sqlalchemy.engines [None req-30ff7824-65c2-4a82-981e-07bbc18faa7a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=91233) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jun 17 04:34:05 devstack cinder-volume[91233]: DEBUG dbcounter [-] [91233] Writer thread running {{(pid=91233) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jun 17 04:34:05 devstack cinder-volume[91233]: INFO cinder.rpc [None req-30ff7824-65c2-4a82-981e-07bbc18faa7a None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Jun 17 04:34:05 devstack cinder-volume[91233]: INFO cinder.rpc [None req-30ff7824-65c2-4a82-981e-07bbc18faa7a None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Jun 17 04:34:05 devstack cinder-volume[91233]: DEBUG oslo_db.sqlalchemy.engines [None req-30ff7824-65c2-4a82-981e-07bbc18faa7a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=91233) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jun 17 04:34:05 devstack cinder-volume[91233]: INFO cinder.volume.manager [None req-30ff7824-65c2-4a82-981e-07bbc18faa7a None None] Determined volume DB was empty at startup. Jun 17 04:34:05 devstack cinder-volume[91233]: DEBUG cinder.volume.manager [None req-30ff7824-65c2-4a82-981e-07bbc18faa7a None None] Cinder Volume DB check: vol_db_empty=True {{(pid=91233) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Jun 17 04:34:05 devstack cinder-volume[91233]: INFO cinder.volume.manager [None req-30ff7824-65c2-4a82-981e-07bbc18faa7a None None] Service not found for updating active_backend_id, assuming default for driver init. Jun 17 04:34:05 devstack cinder-volume[91233]: WARNING stevedore.named [None req-30ff7824-65c2-4a82-981e-07bbc18faa7a None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jun 17 04:34:05 devstack cinder-volume[91233]: WARNING castellan.key_manager [None req-30ff7824-65c2-4a82-981e-07bbc18faa7a None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jun 17 04:34:05 devstack cinder-volume[91233]: WARNING cinder.keymgr.conf_key_mgr [None req-30ff7824-65c2-4a82-981e-07bbc18faa7a None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jun 17 04:34:05 devstack cinder-volume[91233]: INFO cinder.volume.manager [None req-30ff7824-65c2-4a82-981e-07bbc18faa7a None None] Image-volume cache disabled for host devstack@QuobyteHD. Jun 17 04:34:05 devstack cinder-volume[91233]: DEBUG oslo_db.sqlalchemy.engines [None req-30ff7824-65c2-4a82-981e-07bbc18faa7a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=91233) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jun 17 04:34:05 devstack cinder-volume[91233]: INFO oslo_service.backend._eventlet.service [None req-30ff7824-65c2-4a82-981e-07bbc18faa7a None None] Starting 1 workers Jun 17 04:34:05 devstack cinder-volume[91233]: DEBUG oslo_service.backend._eventlet.service [None req-30ff7824-65c2-4a82-981e-07bbc18faa7a None None] Started child 91369 {{(pid=91233) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Jun 17 04:34:05 devstack cinder-volume[91233]: DEBUG oslo_service.backend._eventlet.service [None req-30ff7824-65c2-4a82-981e-07bbc18faa7a None None] Full set of CONF: {{(pid=91233) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Jun 17 04:34:05 devstack cinder-volume[91233]: DEBUG oslo_service.backend._eventlet.service [None req-30ff7824-65c2-4a82-981e-07bbc18faa7a None None] ******************************************************************************** {{(pid=91233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2979}} Jun 17 04:34:05 devstack cinder-volume[91233]: DEBUG oslo_service.backend._eventlet.service [None req-30ff7824-65c2-4a82-981e-07bbc18faa7a None None] Configuration options gathered from: {{(pid=91233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2980}} Jun 17 04:34:05 devstack cinder-volume[91233]: DEBUG oslo_service.backend._eventlet.service [None req-30ff7824-65c2-4a82-981e-07bbc18faa7a None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=91233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2981}} Jun 17 04:34:05 devstack cinder-volume[91233]: DEBUG oslo_service.backend._eventlet.service [None req-30ff7824-65c2-4a82-981e-07bbc18faa7a None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=91233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2982}} Jun 17 04:34:05 devstack cinder-volume[91233]: DEBUG oslo_service.backend._eventlet.service [None req-30ff7824-65c2-4a82-981e-07bbc18faa7a None None] ================================================================================ {{(pid=91233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2987}} Jun 17 04:34:05 devstack cinder-volume[91233]: DEBUG oslo_service.backend._eventlet.service [None req-30ff7824-65c2-4a82-981e-07bbc18faa7a None None] allow_availability_zone_fallback = False {{(pid=91233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 04:34:05 devstack cinder-volume[91233]: DEBUG oslo_service.backend._eventlet.service [None req-30ff7824-65c2-4a82-981e-07bbc18faa7a None None] allow_compression_on_image_upload = False {{(pid=91233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 04:34:05 devstack cinder-volume[91233]: DEBUG oslo_service.backend._eventlet.service [None req-30ff7824-65c2-4a82-981e-07bbc18faa7a None None] allowed_direct_url_schemes = [] {{(pid=91233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 04:34:05 devstack cinder-volume[91233]: DEBUG oslo_service.backend._eventlet.service [None req-30ff7824-65c2-4a82-981e-07bbc18faa7a None None] api_rate_limit = True {{(pid=91233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 04:34:05 devstack cinder-volume[91233]: DEBUG oslo_service.backend._eventlet.service [None req-30ff7824-65c2-4a82-981e-07bbc18faa7a None None] auth_strategy = keystone {{(pid=91233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 04:34:05 devstack cinder-volume[91233]: DEBUG oslo_service.backend._eventlet.service [None req-30ff7824-65c2-4a82-981e-07bbc18faa7a None None] backend_availability_zone = None {{(pid=91233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 04:34:05 devstack cinder-volume[91233]: DEBUG oslo_service.backend._eventlet.service [None req-30ff7824-65c2-4a82-981e-07bbc18faa7a None None] backend_host = None {{(pid=91233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 04:34:05 devstack cinder-volume[91369]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Jun 17 04:34:05 devstack cinder-volume[91233]: DEBUG oslo_service.backend._eventlet.service [None req-30ff7824-65c2-4a82-981e-07bbc18faa7a None None] backend_name = None {{(pid=91233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 04:34:05 devstack cinder-volume[91233]: DEBUG oslo_service.backend._eventlet.service [None req-30ff7824-65c2-4a82-981e-07bbc18faa7a None None] backend_stats_polling_interval = 60 {{(pid=91233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 04:34:05 devstack cinder-volume[91233]: DEBUG oslo_service.backend._eventlet.service [None req-30ff7824-65c2-4a82-981e-07bbc18faa7a None None] backup_api_class = cinder.backup.api.API {{(pid=91233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 04:34:05 devstack cinder-volume[91233]: DEBUG oslo_service.backend._eventlet.service [None req-30ff7824-65c2-4a82-981e-07bbc18faa7a None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=91233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 04:34:05 devstack cinder-volume[91233]: DEBUG oslo_service.backend._eventlet.service [None req-30ff7824-65c2-4a82-981e-07bbc18faa7a None None] backup_name_template = backup-%s {{(pid=91233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 04:34:05 devstack cinder-volume[91233]: DEBUG oslo_service.backend._eventlet.service [None req-30ff7824-65c2-4a82-981e-07bbc18faa7a None None] backup_use_same_host = False {{(pid=91233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 04:34:05 devstack cinder-volume[91233]: DEBUG oslo_service.backend._eventlet.service [None req-30ff7824-65c2-4a82-981e-07bbc18faa7a None None] backup_use_temp_snapshot = False {{(pid=91233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 04:34:05 devstack cinder-volume[91233]: DEBUG oslo_service.backend._eventlet.service [None req-30ff7824-65c2-4a82-981e-07bbc18faa7a None None] chap_password = **** {{(pid=91233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 04:34:05 devstack cinder-volume[91233]: DEBUG oslo_service.backend._eventlet.service [None req-30ff7824-65c2-4a82-981e-07bbc18faa7a None None] chap_username = {{(pid=91233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 04:34:05 devstack cinder-volume[91233]: DEBUG oslo_service.backend._eventlet.service [None req-30ff7824-65c2-4a82-981e-07bbc18faa7a None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=91233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 04:34:05 devstack cinder-volume[91233]: DEBUG oslo_service.backend._eventlet.service [None req-30ff7824-65c2-4a82-981e-07bbc18faa7a None None] cinder_internal_tenant_project_id = 8c9bda5796214d61aae41e9608b9310f {{(pid=91233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 04:34:05 devstack cinder-volume[91233]: DEBUG oslo_service.backend._eventlet.service [None req-30ff7824-65c2-4a82-981e-07bbc18faa7a None None] cinder_internal_tenant_user_id = 89053059899d48acb687e042d0af46df {{(pid=91233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 04:34:05 devstack cinder-volume[91233]: DEBUG oslo_service.backend._eventlet.service [None req-30ff7824-65c2-4a82-981e-07bbc18faa7a None None] cluster = None {{(pid=91233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 04:34:05 devstack cinder-volume[91233]: DEBUG oslo_service.backend._eventlet.service [None req-30ff7824-65c2-4a82-981e-07bbc18faa7a None None] compression_format = gzip {{(pid=91233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 04:34:05 devstack cinder-volume[91233]: DEBUG oslo_service.backend._eventlet.service [None req-30ff7824-65c2-4a82-981e-07bbc18faa7a None None] compute_api_class = cinder.compute.nova.API {{(pid=91233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 04:34:05 devstack cinder-volume[91233]: DEBUG oslo_service.backend._eventlet.service [None req-30ff7824-65c2-4a82-981e-07bbc18faa7a None None] config_dir = [] {{(pid=91233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 04:34:05 devstack cinder-volume[91233]: DEBUG oslo_service.backend._eventlet.service [None req-30ff7824-65c2-4a82-981e-07bbc18faa7a None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=91233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 04:34:05 devstack cinder-volume[91233]: DEBUG oslo_service.backend._eventlet.service [None req-30ff7824-65c2-4a82-981e-07bbc18faa7a None None] config_source = [] {{(pid=91233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 04:34:05 devstack cinder-volume[91233]: DEBUG oslo_service.backend._eventlet.service [None req-30ff7824-65c2-4a82-981e-07bbc18faa7a None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=91233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 04:34:05 devstack cinder-volume[91233]: DEBUG oslo_service.backend._eventlet.service [None req-30ff7824-65c2-4a82-981e-07bbc18faa7a None None] control_exchange = openstack {{(pid=91233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 04:34:05 devstack cinder-volume[91233]: DEBUG oslo_service.backend._eventlet.service [None req-30ff7824-65c2-4a82-981e-07bbc18faa7a None None] debug = True {{(pid=91233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 04:34:05 devstack cinder-volume[91233]: DEBUG oslo_service.backend._eventlet.service [None req-30ff7824-65c2-4a82-981e-07bbc18faa7a None None] default_availability_zone = None {{(pid=91233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 04:34:05 devstack cinder-volume[91233]: DEBUG oslo_service.backend._eventlet.service [None req-30ff7824-65c2-4a82-981e-07bbc18faa7a None None] default_group_type = None {{(pid=91233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 04:34:05 devstack cinder-volume[91233]: DEBUG oslo_service.backend._eventlet.service [None req-30ff7824-65c2-4a82-981e-07bbc18faa7a None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=91233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 04:34:05 devstack cinder-volume[91233]: DEBUG oslo_service.backend._eventlet.service [None req-30ff7824-65c2-4a82-981e-07bbc18faa7a None None] default_volume_type = QuobyteHD {{(pid=91233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 04:34:05 devstack cinder-volume[91233]: DEBUG oslo_service.backend._eventlet.service [None req-30ff7824-65c2-4a82-981e-07bbc18faa7a None None] disk_geometry = None {{(pid=91233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 04:34:05 devstack cinder-volume[91233]: DEBUG oslo_service.backend._eventlet.service [None req-30ff7824-65c2-4a82-981e-07bbc18faa7a None None] driver_client_cert = None {{(pid=91233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 04:34:05 devstack cinder-volume[91233]: DEBUG oslo_service.backend._eventlet.service [None req-30ff7824-65c2-4a82-981e-07bbc18faa7a None None] driver_client_cert_key = None {{(pid=91233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 04:34:05 devstack cinder-volume[91233]: DEBUG oslo_service.backend._eventlet.service [None req-30ff7824-65c2-4a82-981e-07bbc18faa7a None None] driver_data_namespace = None {{(pid=91233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 04:34:05 devstack cinder-volume[91233]: DEBUG oslo_service.backend._eventlet.service [None req-30ff7824-65c2-4a82-981e-07bbc18faa7a None None] driver_ssl_cert_path = None {{(pid=91233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 04:34:05 devstack cinder-volume[91233]: DEBUG oslo_service.backend._eventlet.service [None req-30ff7824-65c2-4a82-981e-07bbc18faa7a None None] driver_ssl_cert_verify = False {{(pid=91233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 04:34:05 devstack cinder-volume[91233]: DEBUG oslo_service.backend._eventlet.service [None req-30ff7824-65c2-4a82-981e-07bbc18faa7a None None] driver_use_ssl = False {{(pid=91233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 04:34:05 devstack cinder-volume[91233]: DEBUG oslo_service.backend._eventlet.service [None req-30ff7824-65c2-4a82-981e-07bbc18faa7a None None] enable_new_services = True {{(pid=91233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 04:34:05 devstack cinder-volume[91233]: DEBUG oslo_service.backend._eventlet.service [None req-30ff7824-65c2-4a82-981e-07bbc18faa7a None None] enable_unsupported_driver = False {{(pid=91233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 04:34:05 devstack cinder-volume[91233]: DEBUG oslo_service.backend._eventlet.service [None req-30ff7824-65c2-4a82-981e-07bbc18faa7a None None] enabled_backends = ['QuobyteHD'] {{(pid=91233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 04:34:05 devstack cinder-volume[91233]: DEBUG oslo_service.backend._eventlet.service [None req-30ff7824-65c2-4a82-981e-07bbc18faa7a None None] enforce_multipath_for_image_xfer = False {{(pid=91233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 04:34:05 devstack cinder-volume[91233]: DEBUG oslo_service.backend._eventlet.service [None req-30ff7824-65c2-4a82-981e-07bbc18faa7a None None] filter_function = None {{(pid=91233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 04:34:05 devstack cinder-volume[91233]: DEBUG oslo_service.backend._eventlet.service [None req-30ff7824-65c2-4a82-981e-07bbc18faa7a None None] glance_api_insecure = False {{(pid=91233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 04:34:05 devstack cinder-volume[91233]: DEBUG oslo_service.backend._eventlet.service [None req-30ff7824-65c2-4a82-981e-07bbc18faa7a None None] glance_api_servers = ['http://192.168.122.240/image'] {{(pid=91233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 04:34:05 devstack cinder-volume[91233]: DEBUG oslo_service.backend._eventlet.service [None req-30ff7824-65c2-4a82-981e-07bbc18faa7a None None] glance_api_ssl_compression = False {{(pid=91233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 04:34:06 devstack cinder-volume[91233]: DEBUG oslo_service.backend._eventlet.service [None req-30ff7824-65c2-4a82-981e-07bbc18faa7a None None] glance_ca_certificates_file = None {{(pid=91233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 04:34:06 devstack cinder-volume[91233]: DEBUG oslo_service.backend._eventlet.service [None req-30ff7824-65c2-4a82-981e-07bbc18faa7a None None] glance_catalog_info = image:glance:publicURL {{(pid=91233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 04:34:06 devstack cinder-volume[91233]: DEBUG oslo_service.backend._eventlet.service [None req-30ff7824-65c2-4a82-981e-07bbc18faa7a None None] glance_certfile = None {{(pid=91233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 04:34:06 devstack cinder-volume[91233]: DEBUG oslo_service.backend._eventlet.service [None req-30ff7824-65c2-4a82-981e-07bbc18faa7a None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=91233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 04:34:06 devstack cinder-volume[91233]: DEBUG oslo_service.backend._eventlet.service [None req-30ff7824-65c2-4a82-981e-07bbc18faa7a None None] glance_keyfile = None {{(pid=91233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 04:34:06 devstack cinder-volume[91233]: DEBUG oslo_service.backend._eventlet.service [None req-30ff7824-65c2-4a82-981e-07bbc18faa7a None None] glance_num_retries = 3 {{(pid=91233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 04:34:06 devstack cinder-volume[91233]: DEBUG oslo_service.backend._eventlet.service [None req-30ff7824-65c2-4a82-981e-07bbc18faa7a None None] glance_request_timeout = None {{(pid=91233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 04:34:06 devstack cinder-volume[91233]: DEBUG oslo_service.backend._eventlet.service [None req-30ff7824-65c2-4a82-981e-07bbc18faa7a None None] goodness_function = None {{(pid=91233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 04:34:06 devstack cinder-volume[91233]: DEBUG oslo_service.backend._eventlet.service [None req-30ff7824-65c2-4a82-981e-07bbc18faa7a None None] graceful_shutdown_timeout = 5 {{(pid=91233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 04:34:06 devstack cinder-volume[91233]: DEBUG oslo_service.backend._eventlet.service [None req-30ff7824-65c2-4a82-981e-07bbc18faa7a None None] group_api_class = cinder.group.api.API {{(pid=91233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 04:34:06 devstack cinder-volume[91233]: DEBUG oslo_service.backend._eventlet.service [None req-30ff7824-65c2-4a82-981e-07bbc18faa7a None None] host = devstack {{(pid=91233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 04:34:06 devstack cinder-volume[91233]: DEBUG oslo_service.backend._eventlet.service [None req-30ff7824-65c2-4a82-981e-07bbc18faa7a None None] image_compress_on_upload = True {{(pid=91233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 04:34:06 devstack cinder-volume[91233]: DEBUG oslo_service.backend._eventlet.service [None req-30ff7824-65c2-4a82-981e-07bbc18faa7a None None] image_conversion_address_space_limit = 1 {{(pid=91233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 04:34:06 devstack cinder-volume[91233]: DEBUG oslo_service.backend._eventlet.service [None req-30ff7824-65c2-4a82-981e-07bbc18faa7a None None] image_conversion_cpu_limit = 60 {{(pid=91233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 04:34:06 devstack cinder-volume[91233]: DEBUG oslo_service.backend._eventlet.service [None req-30ff7824-65c2-4a82-981e-07bbc18faa7a None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=91233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 04:34:06 devstack cinder-volume[91233]: DEBUG oslo_service.backend._eventlet.service [None req-30ff7824-65c2-4a82-981e-07bbc18faa7a None None] image_conversion_disable = False {{(pid=91233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 04:34:06 devstack cinder-volume[91233]: DEBUG oslo_service.backend._eventlet.service [None req-30ff7824-65c2-4a82-981e-07bbc18faa7a None None] image_upload_use_cinder_backend = False {{(pid=91233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 04:34:06 devstack cinder-volume[91233]: DEBUG oslo_service.backend._eventlet.service [None req-30ff7824-65c2-4a82-981e-07bbc18faa7a None None] image_upload_use_internal_tenant = False {{(pid=91233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 04:34:06 devstack cinder-volume[91233]: DEBUG oslo_service.backend._eventlet.service [None req-30ff7824-65c2-4a82-981e-07bbc18faa7a None None] image_volume_cache_enabled = False {{(pid=91233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 04:34:06 devstack cinder-volume[91233]: DEBUG oslo_service.backend._eventlet.service [None req-30ff7824-65c2-4a82-981e-07bbc18faa7a None None] image_volume_cache_max_count = 0 {{(pid=91233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 04:34:06 devstack cinder-volume[91233]: DEBUG oslo_service.backend._eventlet.service [None req-30ff7824-65c2-4a82-981e-07bbc18faa7a None None] image_volume_cache_max_size_gb = 0 {{(pid=91233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 04:34:06 devstack cinder-volume[91233]: DEBUG oslo_service.backend._eventlet.service [None req-30ff7824-65c2-4a82-981e-07bbc18faa7a None None] init_host_max_objects_retrieval = 0 {{(pid=91233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 04:34:06 devstack cinder-volume[91233]: DEBUG oslo_service.backend._eventlet.service [None req-30ff7824-65c2-4a82-981e-07bbc18faa7a None None] instance_format = [instance: %(uuid)s] {{(pid=91233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 04:34:06 devstack cinder-volume[91233]: DEBUG oslo_service.backend._eventlet.service [None req-30ff7824-65c2-4a82-981e-07bbc18faa7a None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=91233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 04:34:06 devstack cinder-volume[91369]: INFO cinder.volume.manager [None req-29357396-8c95-483b-87bf-705f38b47246 None None] Starting volume driver QuobyteDriver (1.1.14) Jun 17 04:34:06 devstack cinder-volume[91369]: DEBUG cinder.volume.drivers.remotefs [None req-29357396-8c95-483b-87bf-705f38b47246 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=91369) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Jun 17 04:34:06 devstack cinder-volume[91233]: DEBUG oslo_service.backend._eventlet.service [None req-30ff7824-65c2-4a82-981e-07bbc18faa7a None None] iscsi_target_flags = {{(pid=91233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 04:34:06 devstack cinder-volume[91233]: DEBUG oslo_service.backend._eventlet.service [None req-30ff7824-65c2-4a82-981e-07bbc18faa7a None None] iscsi_write_cache = on {{(pid=91233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 04:34:06 devstack cinder-volume[91233]: DEBUG oslo_service.backend._eventlet.service [None req-30ff7824-65c2-4a82-981e-07bbc18faa7a None None] iser_helper = tgtadm {{(pid=91233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 04:34:06 devstack cinder-volume[91233]: DEBUG oslo_service.backend._eventlet.service [None req-30ff7824-65c2-4a82-981e-07bbc18faa7a None None] iser_ip_address = 192.168.122.240 {{(pid=91233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 04:34:06 devstack cinder-volume[91233]: DEBUG oslo_service.backend._eventlet.service [None req-30ff7824-65c2-4a82-981e-07bbc18faa7a None None] iser_port = 3260 {{(pid=91233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 04:34:06 devstack cinder-volume[91233]: DEBUG oslo_service.backend._eventlet.service [None req-30ff7824-65c2-4a82-981e-07bbc18faa7a None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=91233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 04:34:06 devstack cinder-volume[91233]: DEBUG oslo_service.backend._eventlet.service [None req-30ff7824-65c2-4a82-981e-07bbc18faa7a None None] log_color = False {{(pid=91233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 04:34:06 devstack cinder-volume[91233]: DEBUG oslo_service.backend._eventlet.service [None req-30ff7824-65c2-4a82-981e-07bbc18faa7a None None] log_config_append = None {{(pid=91233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 04:34:06 devstack cinder-volume[91233]: DEBUG oslo_service.backend._eventlet.service [None req-30ff7824-65c2-4a82-981e-07bbc18faa7a None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=91233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 04:34:06 devstack cinder-volume[91233]: DEBUG oslo_service.backend._eventlet.service [None req-30ff7824-65c2-4a82-981e-07bbc18faa7a None None] log_dir = None {{(pid=91233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 04:34:06 devstack cinder-volume[91233]: DEBUG oslo_service.backend._eventlet.service [None req-30ff7824-65c2-4a82-981e-07bbc18faa7a None None] log_file = None {{(pid=91233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 04:34:06 devstack cinder-volume[91233]: DEBUG oslo_service.backend._eventlet.service [None req-30ff7824-65c2-4a82-981e-07bbc18faa7a None None] log_options = True {{(pid=91233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 04:34:06 devstack cinder-volume[91233]: DEBUG oslo_service.backend._eventlet.service [None req-30ff7824-65c2-4a82-981e-07bbc18faa7a None None] log_rotate_interval = 1 {{(pid=91233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 04:34:06 devstack cinder-volume[91233]: DEBUG oslo_service.backend._eventlet.service [None req-30ff7824-65c2-4a82-981e-07bbc18faa7a None None] log_rotate_interval_type = days {{(pid=91233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 04:34:06 devstack cinder-volume[91233]: DEBUG oslo_service.backend._eventlet.service [None req-30ff7824-65c2-4a82-981e-07bbc18faa7a None None] log_rotation_type = none {{(pid=91233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 04:34:06 devstack cinder-volume[91233]: DEBUG oslo_service.backend._eventlet.service [None req-30ff7824-65c2-4a82-981e-07bbc18faa7a None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=91233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 04:34:06 devstack cinder-volume[91233]: DEBUG oslo_service.backend._eventlet.service [None req-30ff7824-65c2-4a82-981e-07bbc18faa7a None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=91233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 04:34:06 devstack cinder-volume[91233]: DEBUG oslo_service.backend._eventlet.service [None req-30ff7824-65c2-4a82-981e-07bbc18faa7a None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=91233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 04:34:06 devstack cinder-volume[91233]: DEBUG oslo_service.backend._eventlet.service [None req-30ff7824-65c2-4a82-981e-07bbc18faa7a None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=91233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 04:34:06 devstack cinder-volume[91233]: DEBUG oslo_service.backend._eventlet.service [None req-30ff7824-65c2-4a82-981e-07bbc18faa7a None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=91233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 04:34:06 devstack cinder-volume[91233]: DEBUG oslo_service.backend._eventlet.service [None req-30ff7824-65c2-4a82-981e-07bbc18faa7a None None] max_age = 0 {{(pid=91233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 04:34:06 devstack cinder-volume[91233]: DEBUG oslo_service.backend._eventlet.service [None req-30ff7824-65c2-4a82-981e-07bbc18faa7a None None] max_logfile_count = 30 {{(pid=91233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 04:34:06 devstack cinder-volume[91233]: DEBUG oslo_service.backend._eventlet.service [None req-30ff7824-65c2-4a82-981e-07bbc18faa7a None None] max_logfile_size_mb = 200 {{(pid=91233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 04:34:06 devstack cinder-volume[91233]: DEBUG oslo_service.backend._eventlet.service [None req-30ff7824-65c2-4a82-981e-07bbc18faa7a None None] max_over_subscription_ratio = 20.0 {{(pid=91233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 04:34:06 devstack cinder-volume[91233]: DEBUG oslo_service.backend._eventlet.service [None req-30ff7824-65c2-4a82-981e-07bbc18faa7a None None] message_reap_interval = 86400 {{(pid=91233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 04:34:06 devstack cinder-volume[91233]: DEBUG oslo_service.backend._eventlet.service [None req-30ff7824-65c2-4a82-981e-07bbc18faa7a None None] message_ttl = 2592000 {{(pid=91233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 04:34:06 devstack cinder-volume[91233]: DEBUG oslo_service.backend._eventlet.service [None req-30ff7824-65c2-4a82-981e-07bbc18faa7a None None] migration_create_volume_timeout_secs = 300 {{(pid=91233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 04:34:06 devstack cinder-volume[91233]: DEBUG oslo_service.backend._eventlet.service [None req-30ff7824-65c2-4a82-981e-07bbc18faa7a None None] monkey_patch = False {{(pid=91233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 04:34:06 devstack cinder-volume[91233]: DEBUG oslo_service.backend._eventlet.service [None req-30ff7824-65c2-4a82-981e-07bbc18faa7a None None] monkey_patch_modules = [] {{(pid=91233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 04:34:06 devstack cinder-volume[91233]: DEBUG oslo_service.backend._eventlet.service [None req-30ff7824-65c2-4a82-981e-07bbc18faa7a None None] my_ip = 192.168.122.240 {{(pid=91233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 04:34:06 devstack cinder-volume[91233]: DEBUG oslo_service.backend._eventlet.service [None req-30ff7824-65c2-4a82-981e-07bbc18faa7a None None] no_snapshot_gb_quota = False {{(pid=91233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 04:34:06 devstack cinder-volume[91233]: DEBUG oslo_service.backend._eventlet.service [None req-30ff7824-65c2-4a82-981e-07bbc18faa7a None None] num_iser_scan_tries = 3 {{(pid=91233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 04:34:06 devstack cinder-volume[91233]: DEBUG oslo_service.backend._eventlet.service [None req-30ff7824-65c2-4a82-981e-07bbc18faa7a None None] num_shell_tries = 3 {{(pid=91233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 04:34:06 devstack cinder-volume[91233]: DEBUG oslo_service.backend._eventlet.service [None req-30ff7824-65c2-4a82-981e-07bbc18faa7a None None] num_volume_device_scan_tries = 3 {{(pid=91233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 04:34:06 devstack cinder-volume[91233]: DEBUG oslo_service.backend._eventlet.service [None req-30ff7824-65c2-4a82-981e-07bbc18faa7a None None] nvmeof_conn_info_version = 1 {{(pid=91233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 04:34:06 devstack cinder-volume[91233]: DEBUG oslo_service.backend._eventlet.service [None req-30ff7824-65c2-4a82-981e-07bbc18faa7a None None] nvmet_ns_id = 10 {{(pid=91233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 04:34:06 devstack cinder-volume[91233]: DEBUG oslo_service.backend._eventlet.service [None req-30ff7824-65c2-4a82-981e-07bbc18faa7a None None] nvmet_port_id = 1 {{(pid=91233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 04:34:06 devstack cinder-volume[91233]: DEBUG oslo_service.backend._eventlet.service [None req-30ff7824-65c2-4a82-981e-07bbc18faa7a None None] osapi_max_limit = 1000 {{(pid=91233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 04:34:06 devstack cinder-volume[91233]: DEBUG oslo_service.backend._eventlet.service [None req-30ff7824-65c2-4a82-981e-07bbc18faa7a None None] osapi_volume_ext_list = [] {{(pid=91233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 04:34:06 devstack cinder-volume[91233]: DEBUG oslo_service.backend._eventlet.service [None req-30ff7824-65c2-4a82-981e-07bbc18faa7a None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=91233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 04:34:06 devstack cinder-volume[91233]: DEBUG oslo_service.backend._eventlet.service [None req-30ff7824-65c2-4a82-981e-07bbc18faa7a None None] osapi_volume_listen = 0.0.0.0 {{(pid=91233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 04:34:06 devstack cinder-volume[91233]: DEBUG oslo_service.backend._eventlet.service [None req-30ff7824-65c2-4a82-981e-07bbc18faa7a None None] osapi_volume_listen_port = 8776 {{(pid=91233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 04:34:06 devstack cinder-volume[91233]: DEBUG oslo_service.backend._eventlet.service [None req-30ff7824-65c2-4a82-981e-07bbc18faa7a None None] osapi_volume_use_ssl = False {{(pid=91233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 04:34:06 devstack cinder-volume[91233]: DEBUG oslo_service.backend._eventlet.service [None req-30ff7824-65c2-4a82-981e-07bbc18faa7a None None] osapi_volume_workers = 2 {{(pid=91233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 04:34:06 devstack cinder-volume[91233]: DEBUG oslo_service.backend._eventlet.service [None req-30ff7824-65c2-4a82-981e-07bbc18faa7a None None] per_volume_size_limit = -1 {{(pid=91233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 04:34:06 devstack cinder-volume[91233]: DEBUG oslo_service.backend._eventlet.service [None req-30ff7824-65c2-4a82-981e-07bbc18faa7a None None] periodic_fuzzy_delay = 60 {{(pid=91233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 04:34:06 devstack cinder-volume[91233]: DEBUG oslo_service.backend._eventlet.service [None req-30ff7824-65c2-4a82-981e-07bbc18faa7a None None] periodic_interval = 60 {{(pid=91233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 04:34:06 devstack cinder-volume[91233]: DEBUG oslo_service.backend._eventlet.service [None req-30ff7824-65c2-4a82-981e-07bbc18faa7a None None] project_id_regex = [0-9a-f\-]+ {{(pid=91233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 04:34:06 devstack cinder-volume[91233]: DEBUG oslo_service.backend._eventlet.service [None req-30ff7824-65c2-4a82-981e-07bbc18faa7a None None] public_endpoint = None {{(pid=91233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 04:34:06 devstack cinder-volume[91233]: DEBUG oslo_service.backend._eventlet.service [None req-30ff7824-65c2-4a82-981e-07bbc18faa7a None None] publish_errors = False {{(pid=91233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 04:34:06 devstack cinder-volume[91233]: DEBUG oslo_service.backend._eventlet.service [None req-30ff7824-65c2-4a82-981e-07bbc18faa7a None None] quota_backup_gigabytes = 1000 {{(pid=91233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 04:34:06 devstack cinder-volume[91233]: DEBUG oslo_service.backend._eventlet.service [None req-30ff7824-65c2-4a82-981e-07bbc18faa7a None None] quota_backups = 10 {{(pid=91233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 04:34:06 devstack cinder-volume[91233]: DEBUG oslo_service.backend._eventlet.service [None req-30ff7824-65c2-4a82-981e-07bbc18faa7a None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=91233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 04:34:06 devstack cinder-volume[91233]: DEBUG oslo_service.backend._eventlet.service [None req-30ff7824-65c2-4a82-981e-07bbc18faa7a None None] quota_gigabytes = 1000 {{(pid=91233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 04:34:06 devstack cinder-volume[91233]: DEBUG oslo_service.backend._eventlet.service [None req-30ff7824-65c2-4a82-981e-07bbc18faa7a None None] quota_groups = 10 {{(pid=91233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 04:34:06 devstack cinder-volume[91233]: DEBUG oslo_service.backend._eventlet.service [None req-30ff7824-65c2-4a82-981e-07bbc18faa7a None None] quota_snapshots = 10 {{(pid=91233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 04:34:06 devstack cinder-volume[91233]: DEBUG oslo_service.backend._eventlet.service [None req-30ff7824-65c2-4a82-981e-07bbc18faa7a None None] quota_volumes = 10 {{(pid=91233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 04:34:06 devstack cinder-volume[91233]: DEBUG oslo_service.backend._eventlet.service [None req-30ff7824-65c2-4a82-981e-07bbc18faa7a None None] rate_limit_burst = 0 {{(pid=91233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 04:34:06 devstack cinder-volume[91233]: DEBUG oslo_service.backend._eventlet.service [None req-30ff7824-65c2-4a82-981e-07bbc18faa7a None None] rate_limit_except_level = CRITICAL {{(pid=91233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 04:34:06 devstack cinder-volume[91233]: DEBUG oslo_service.backend._eventlet.service [None req-30ff7824-65c2-4a82-981e-07bbc18faa7a None None] rate_limit_interval = 0 {{(pid=91233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 04:34:06 devstack cinder-volume[91233]: DEBUG oslo_service.backend._eventlet.service [None req-30ff7824-65c2-4a82-981e-07bbc18faa7a None None] reinit_driver_count = 3 {{(pid=91233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 04:34:06 devstack cinder-volume[91233]: DEBUG oslo_service.backend._eventlet.service [None req-30ff7824-65c2-4a82-981e-07bbc18faa7a None None] replication_device = **** {{(pid=91233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 04:34:06 devstack cinder-volume[91233]: DEBUG oslo_service.backend._eventlet.service [None req-30ff7824-65c2-4a82-981e-07bbc18faa7a None None] report_discard_supported = False {{(pid=91233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 04:34:06 devstack cinder-volume[91233]: DEBUG oslo_service.backend._eventlet.service [None req-30ff7824-65c2-4a82-981e-07bbc18faa7a None None] report_interval = 120 {{(pid=91233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 04:34:06 devstack cinder-volume[91233]: DEBUG oslo_service.backend._eventlet.service [None req-30ff7824-65c2-4a82-981e-07bbc18faa7a None None] reservation_clean_interval = 86400 {{(pid=91233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 04:34:06 devstack cinder-volume[91233]: DEBUG oslo_service.backend._eventlet.service [None req-30ff7824-65c2-4a82-981e-07bbc18faa7a None None] reservation_expire = 86400 {{(pid=91233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 04:34:06 devstack cinder-volume[91233]: DEBUG oslo_service.backend._eventlet.service [None req-30ff7824-65c2-4a82-981e-07bbc18faa7a None None] reserved_image_namespaces = [] {{(pid=91233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 04:34:06 devstack cinder-volume[91233]: DEBUG oslo_service.backend._eventlet.service [None req-30ff7824-65c2-4a82-981e-07bbc18faa7a None None] reserved_percentage = 0 {{(pid=91233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 04:34:06 devstack cinder-volume[91233]: DEBUG oslo_service.backend._eventlet.service [None req-30ff7824-65c2-4a82-981e-07bbc18faa7a None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=91233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 04:34:06 devstack cinder-volume[91233]: DEBUG oslo_service.backend._eventlet.service [None req-30ff7824-65c2-4a82-981e-07bbc18faa7a None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=91233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 04:34:06 devstack cinder-volume[91233]: DEBUG oslo_service.backend._eventlet.service [None req-30ff7824-65c2-4a82-981e-07bbc18faa7a None None] rpc_response_timeout = 120 {{(pid=91233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 04:34:06 devstack cinder-volume[91233]: DEBUG oslo_service.backend._eventlet.service [None req-30ff7824-65c2-4a82-981e-07bbc18faa7a None None] run_external_periodic_tasks = True {{(pid=91233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 04:34:06 devstack cinder-volume[91233]: DEBUG oslo_service.backend._eventlet.service [None req-30ff7824-65c2-4a82-981e-07bbc18faa7a None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=91233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 04:34:06 devstack cinder-volume[91233]: DEBUG oslo_service.backend._eventlet.service [None req-30ff7824-65c2-4a82-981e-07bbc18faa7a None None] scst_target_driver = iscsi {{(pid=91233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 04:34:06 devstack cinder-volume[91233]: DEBUG oslo_service.backend._eventlet.service [None req-30ff7824-65c2-4a82-981e-07bbc18faa7a None None] scst_target_iqn_name = None {{(pid=91233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 04:34:06 devstack cinder-volume[91233]: DEBUG oslo_service.backend._eventlet.service [None req-30ff7824-65c2-4a82-981e-07bbc18faa7a None None] service_down_time = 720 {{(pid=91233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 04:34:06 devstack cinder-volume[91233]: DEBUG oslo_service.backend._eventlet.service [None req-30ff7824-65c2-4a82-981e-07bbc18faa7a None None] shell_completion = None {{(pid=91233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 04:34:06 devstack cinder-volume[91233]: DEBUG oslo_service.backend._eventlet.service [None req-30ff7824-65c2-4a82-981e-07bbc18faa7a None None] snapshot_name_template = snapshot-%s {{(pid=91233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 04:34:06 devstack cinder-volume[91233]: DEBUG oslo_service.backend._eventlet.service [None req-30ff7824-65c2-4a82-981e-07bbc18faa7a None None] split_loggers = False {{(pid=91233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 04:34:06 devstack cinder-volume[91233]: DEBUG oslo_service.backend._eventlet.service [None req-30ff7824-65c2-4a82-981e-07bbc18faa7a None None] state_path = /opt/stack/data/cinder {{(pid=91233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 04:34:06 devstack cinder-volume[91233]: DEBUG oslo_service.backend._eventlet.service [None req-30ff7824-65c2-4a82-981e-07bbc18faa7a None None] storage_availability_zone = nova {{(pid=91233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 04:34:06 devstack cinder-volume[91233]: DEBUG oslo_service.backend._eventlet.service [None req-30ff7824-65c2-4a82-981e-07bbc18faa7a None None] storage_protocol = iSCSI {{(pid=91233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 04:34:06 devstack cinder-volume[91233]: DEBUG oslo_service.backend._eventlet.service [None req-30ff7824-65c2-4a82-981e-07bbc18faa7a None None] syslog_log_facility = LOG_USER {{(pid=91233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 04:34:06 devstack cinder-volume[91233]: DEBUG oslo_service.backend._eventlet.service [None req-30ff7824-65c2-4a82-981e-07bbc18faa7a None None] target_helper = lioadm {{(pid=91233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 04:34:06 devstack cinder-volume[91233]: DEBUG oslo_service.backend._eventlet.service [None req-30ff7824-65c2-4a82-981e-07bbc18faa7a None None] target_ip_address = 192.168.122.240 {{(pid=91233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 04:34:06 devstack cinder-volume[91233]: DEBUG oslo_service.backend._eventlet.service [None req-30ff7824-65c2-4a82-981e-07bbc18faa7a None None] target_port = 3260 {{(pid=91233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 04:34:06 devstack cinder-volume[91233]: DEBUG oslo_service.backend._eventlet.service [None req-30ff7824-65c2-4a82-981e-07bbc18faa7a None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=91233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 04:34:06 devstack cinder-volume[91233]: DEBUG oslo_service.backend._eventlet.service [None req-30ff7824-65c2-4a82-981e-07bbc18faa7a None None] target_protocol = iscsi {{(pid=91233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 04:34:06 devstack cinder-volume[91233]: DEBUG oslo_service.backend._eventlet.service [None req-30ff7824-65c2-4a82-981e-07bbc18faa7a None None] target_secondary_ip_addresses = [] {{(pid=91233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 04:34:06 devstack cinder-volume[91233]: DEBUG oslo_service.backend._eventlet.service [None req-30ff7824-65c2-4a82-981e-07bbc18faa7a None None] trace_flags = None {{(pid=91233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 04:34:06 devstack cinder-volume[91233]: DEBUG oslo_service.backend._eventlet.service [None req-30ff7824-65c2-4a82-981e-07bbc18faa7a None None] transfer_api_class = cinder.transfer.api.API {{(pid=91233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 04:34:06 devstack cinder-volume[91233]: DEBUG oslo_service.backend._eventlet.service [None req-30ff7824-65c2-4a82-981e-07bbc18faa7a None None] transport_url = **** {{(pid=91233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 04:34:06 devstack cinder-volume[91233]: DEBUG oslo_service.backend._eventlet.service [None req-30ff7824-65c2-4a82-981e-07bbc18faa7a None None] until_refresh = 0 {{(pid=91233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 04:34:06 devstack cinder-volume[91233]: DEBUG oslo_service.backend._eventlet.service [None req-30ff7824-65c2-4a82-981e-07bbc18faa7a None None] use_chap_auth = False {{(pid=91233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 04:34:06 devstack cinder-volume[91233]: DEBUG oslo_service.backend._eventlet.service [None req-30ff7824-65c2-4a82-981e-07bbc18faa7a None None] use_default_quota_class = True {{(pid=91233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 04:34:06 devstack cinder-volume[91233]: DEBUG oslo_service.backend._eventlet.service [None req-30ff7824-65c2-4a82-981e-07bbc18faa7a None None] use_journal = False {{(pid=91233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 04:34:06 devstack cinder-volume[91233]: DEBUG oslo_service.backend._eventlet.service [None req-30ff7824-65c2-4a82-981e-07bbc18faa7a None None] use_json = False {{(pid=91233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 04:34:06 devstack cinder-volume[91233]: DEBUG oslo_service.backend._eventlet.service [None req-30ff7824-65c2-4a82-981e-07bbc18faa7a None None] use_multipath_for_image_xfer = False {{(pid=91233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 04:34:06 devstack cinder-volume[91233]: DEBUG oslo_service.backend._eventlet.service [None req-30ff7824-65c2-4a82-981e-07bbc18faa7a None None] use_stderr = False {{(pid=91233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 04:34:06 devstack cinder-volume[91233]: DEBUG oslo_service.backend._eventlet.service [None req-30ff7824-65c2-4a82-981e-07bbc18faa7a None None] use_syslog = False {{(pid=91233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 04:34:06 devstack cinder-volume[91233]: DEBUG oslo_service.backend._eventlet.service [None req-30ff7824-65c2-4a82-981e-07bbc18faa7a None None] verify_glance_signatures = enabled {{(pid=91233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 04:34:06 devstack cinder-volume[91233]: DEBUG oslo_service.backend._eventlet.service [None req-30ff7824-65c2-4a82-981e-07bbc18faa7a None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=91233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 04:34:06 devstack cinder-volume[91233]: DEBUG oslo_service.backend._eventlet.service [None req-30ff7824-65c2-4a82-981e-07bbc18faa7a None None] volume_api_class = cinder.volume.api.API {{(pid=91233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 04:34:06 devstack cinder-volume[91233]: DEBUG oslo_service.backend._eventlet.service [None req-30ff7824-65c2-4a82-981e-07bbc18faa7a None None] volume_backend_name = None {{(pid=91233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 04:34:06 devstack cinder-volume[91233]: DEBUG oslo_service.backend._eventlet.service [None req-30ff7824-65c2-4a82-981e-07bbc18faa7a None None] volume_clear = zero {{(pid=91233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 04:34:06 devstack cinder-volume[91233]: DEBUG oslo_service.backend._eventlet.service [None req-30ff7824-65c2-4a82-981e-07bbc18faa7a None None] volume_clear_ionice = None {{(pid=91233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 04:34:06 devstack cinder-volume[91233]: DEBUG oslo_service.backend._eventlet.service [None req-30ff7824-65c2-4a82-981e-07bbc18faa7a None None] volume_clear_size = 0 {{(pid=91233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 04:34:06 devstack cinder-volume[91233]: DEBUG oslo_service.backend._eventlet.service [None req-30ff7824-65c2-4a82-981e-07bbc18faa7a None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=91233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 04:34:06 devstack cinder-volume[91233]: DEBUG oslo_service.backend._eventlet.service [None req-30ff7824-65c2-4a82-981e-07bbc18faa7a None None] volume_copy_bps_limit = 0 {{(pid=91233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 04:34:06 devstack cinder-volume[91369]: DEBUG cinder.volume.drivers.quobyte [None req-29357396-8c95-483b-87bf-705f38b47246 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=91369) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:305}} Jun 17 04:34:06 devstack cinder-volume[91233]: DEBUG oslo_service.backend._eventlet.service [None req-30ff7824-65c2-4a82-981e-07bbc18faa7a None None] volume_dd_blocksize = 1M {{(pid=91233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 04:34:06 devstack cinder-volume[91233]: DEBUG oslo_service.backend._eventlet.service [None req-30ff7824-65c2-4a82-981e-07bbc18faa7a None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=91233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 04:34:06 devstack cinder-volume[91233]: DEBUG oslo_service.backend._eventlet.service [None req-30ff7824-65c2-4a82-981e-07bbc18faa7a None None] volume_name_template = volume-%s {{(pid=91233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 04:34:06 devstack cinder-volume[91369]: WARNING cinder.volume.drivers.quobyte [None req-29357396-8c95-483b-87bf-705f38b47246 None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Jun 17 04:34:06 devstack cinder-volume[91233]: DEBUG oslo_service.backend._eventlet.service [None req-30ff7824-65c2-4a82-981e-07bbc18faa7a None None] volume_service_inithost_offload = False {{(pid=91233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 04:34:06 devstack cinder-volume[91233]: DEBUG oslo_service.backend._eventlet.service [None req-30ff7824-65c2-4a82-981e-07bbc18faa7a None None] volume_usage_audit_period = month {{(pid=91233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 04:34:06 devstack cinder-volume[91369]: WARNING cinder.volume.drivers.quobyte [None req-29357396-8c95-483b-87bf-705f38b47246 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Jun 17 04:34:06 devstack cinder-volume[91233]: DEBUG oslo_service.backend._eventlet.service [None req-30ff7824-65c2-4a82-981e-07bbc18faa7a None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=91233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 04:34:06 devstack cinder-volume[91233]: DEBUG oslo_service.backend._eventlet.service [None req-30ff7824-65c2-4a82-981e-07bbc18faa7a None None] zoning_mode = None {{(pid=91233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 04:34:06 devstack cinder-volume[91233]: DEBUG oslo_service.backend._eventlet.service [None req-30ff7824-65c2-4a82-981e-07bbc18faa7a None None] oslo_concurrency.disable_process_locking = False {{(pid=91233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:06 devstack cinder-volume[91233]: DEBUG oslo_service.backend._eventlet.service [None req-30ff7824-65c2-4a82-981e-07bbc18faa7a None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=91233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:06 devstack cinder-volume[91233]: DEBUG oslo_service.backend._eventlet.service [None req-30ff7824-65c2-4a82-981e-07bbc18faa7a None None] os_brick.lightos_discovery_client_address = localhost {{(pid=91233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:06 devstack cinder-volume[91233]: DEBUG oslo_service.backend._eventlet.service [None req-30ff7824-65c2-4a82-981e-07bbc18faa7a None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=91233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:06 devstack cinder-volume[91233]: DEBUG oslo_service.backend._eventlet.service [None req-30ff7824-65c2-4a82-981e-07bbc18faa7a None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=91233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:06 devstack cinder-volume[91233]: DEBUG oslo_service.backend._eventlet.service [None req-30ff7824-65c2-4a82-981e-07bbc18faa7a None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=91233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:06 devstack cinder-volume[91369]: DEBUG oslo_concurrency.processutils [None req-29357396-8c95-483b-87bf-705f38b47246 None None] Running cmd (subprocess): mount.quobyte {{(pid=91369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:34:06 devstack cinder-volume[91233]: DEBUG oslo_service.backend._eventlet.service [None req-30ff7824-65c2-4a82-981e-07bbc18faa7a None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=91233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:06 devstack cinder-volume[91233]: DEBUG oslo_service.backend._eventlet.service [None req-30ff7824-65c2-4a82-981e-07bbc18faa7a None None] os_brick.wait_mpath_device_interval = 1 {{(pid=91233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:06 devstack cinder-volume[91233]: DEBUG oslo_service.backend._eventlet.service [None req-30ff7824-65c2-4a82-981e-07bbc18faa7a None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=91233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:06 devstack cinder-volume[91233]: DEBUG oslo_service.backend._eventlet.service [None req-30ff7824-65c2-4a82-981e-07bbc18faa7a None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=91233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:06 devstack cinder-volume[91233]: DEBUG oslo_service.backend._eventlet.service [None req-30ff7824-65c2-4a82-981e-07bbc18faa7a None None] keystone_authtoken.admin_password = **** {{(pid=91233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:06 devstack cinder-volume[91233]: DEBUG oslo_service.backend._eventlet.service [None req-30ff7824-65c2-4a82-981e-07bbc18faa7a None None] keystone_authtoken.admin_tenant_name = admin {{(pid=91233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:06 devstack cinder-volume[91233]: DEBUG oslo_service.backend._eventlet.service [None req-30ff7824-65c2-4a82-981e-07bbc18faa7a None None] keystone_authtoken.admin_token = **** {{(pid=91233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:06 devstack cinder-volume[91233]: DEBUG oslo_service.backend._eventlet.service [None req-30ff7824-65c2-4a82-981e-07bbc18faa7a None None] keystone_authtoken.admin_user = None {{(pid=91233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:06 devstack cinder-volume[91233]: DEBUG oslo_service.backend._eventlet.service [None req-30ff7824-65c2-4a82-981e-07bbc18faa7a None None] keystone_authtoken.auth_admin_prefix = {{(pid=91233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:06 devstack cinder-volume[91233]: DEBUG oslo_service.backend._eventlet.service [None req-30ff7824-65c2-4a82-981e-07bbc18faa7a None None] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=91233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:06 devstack cinder-volume[91233]: DEBUG oslo_service.backend._eventlet.service [None req-30ff7824-65c2-4a82-981e-07bbc18faa7a None None] keystone_authtoken.auth_port = 35357 {{(pid=91233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:06 devstack cinder-volume[91233]: DEBUG oslo_service.backend._eventlet.service [None req-30ff7824-65c2-4a82-981e-07bbc18faa7a None None] keystone_authtoken.auth_protocol = https {{(pid=91233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:06 devstack cinder-volume[91233]: DEBUG oslo_service.backend._eventlet.service [None req-30ff7824-65c2-4a82-981e-07bbc18faa7a None None] keystone_authtoken.auth_section = None {{(pid=91233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:06 devstack cinder-volume[91233]: DEBUG oslo_service.backend._eventlet.service [None req-30ff7824-65c2-4a82-981e-07bbc18faa7a None None] keystone_authtoken.auth_type = password {{(pid=91233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:06 devstack cinder-volume[91233]: DEBUG oslo_service.backend._eventlet.service [None req-30ff7824-65c2-4a82-981e-07bbc18faa7a None None] keystone_authtoken.auth_uri = None {{(pid=91233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:06 devstack cinder-volume[91233]: DEBUG oslo_service.backend._eventlet.service [None req-30ff7824-65c2-4a82-981e-07bbc18faa7a None None] keystone_authtoken.auth_version = None {{(pid=91233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:06 devstack cinder-volume[91233]: DEBUG oslo_service.backend._eventlet.service [None req-30ff7824-65c2-4a82-981e-07bbc18faa7a None None] keystone_authtoken.cache = None {{(pid=91233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:06 devstack cinder-volume[91233]: DEBUG oslo_service.backend._eventlet.service [None req-30ff7824-65c2-4a82-981e-07bbc18faa7a None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=91233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:06 devstack cinder-volume[91233]: DEBUG oslo_service.backend._eventlet.service [None req-30ff7824-65c2-4a82-981e-07bbc18faa7a None None] keystone_authtoken.certfile = None {{(pid=91233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:06 devstack cinder-volume[91233]: DEBUG oslo_service.backend._eventlet.service [None req-30ff7824-65c2-4a82-981e-07bbc18faa7a None None] keystone_authtoken.delay_auth_decision = False {{(pid=91233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:06 devstack cinder-volume[91233]: DEBUG oslo_service.backend._eventlet.service [None req-30ff7824-65c2-4a82-981e-07bbc18faa7a None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=91233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:06 devstack cinder-volume[91233]: DEBUG oslo_service.backend._eventlet.service [None req-30ff7824-65c2-4a82-981e-07bbc18faa7a None None] keystone_authtoken.http_connect_timeout = None {{(pid=91233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:06 devstack cinder-volume[91233]: DEBUG oslo_service.backend._eventlet.service [None req-30ff7824-65c2-4a82-981e-07bbc18faa7a None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=91233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:06 devstack cinder-volume[91233]: DEBUG oslo_service.backend._eventlet.service [None req-30ff7824-65c2-4a82-981e-07bbc18faa7a None None] keystone_authtoken.identity_uri = None {{(pid=91233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:06 devstack cinder-volume[91233]: DEBUG oslo_service.backend._eventlet.service [None req-30ff7824-65c2-4a82-981e-07bbc18faa7a None None] keystone_authtoken.include_service_catalog = True {{(pid=91233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:06 devstack cinder-volume[91233]: DEBUG oslo_service.backend._eventlet.service [None req-30ff7824-65c2-4a82-981e-07bbc18faa7a None None] keystone_authtoken.insecure = False {{(pid=91233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:06 devstack cinder-volume[91233]: DEBUG oslo_service.backend._eventlet.service [None req-30ff7824-65c2-4a82-981e-07bbc18faa7a None None] keystone_authtoken.interface = public {{(pid=91233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:06 devstack cinder-volume[91233]: DEBUG oslo_service.backend._eventlet.service [None req-30ff7824-65c2-4a82-981e-07bbc18faa7a None None] keystone_authtoken.keyfile = None {{(pid=91233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:06 devstack cinder-volume[91233]: DEBUG oslo_service.backend._eventlet.service [None req-30ff7824-65c2-4a82-981e-07bbc18faa7a None None] keystone_authtoken.memcache_password = {{(pid=91233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:06 devstack cinder-volume[91233]: DEBUG oslo_service.backend._eventlet.service [None req-30ff7824-65c2-4a82-981e-07bbc18faa7a None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=91233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:06 devstack cinder-volume[91233]: DEBUG oslo_service.backend._eventlet.service [None req-30ff7824-65c2-4a82-981e-07bbc18faa7a None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=91233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:06 devstack cinder-volume[91233]: DEBUG oslo_service.backend._eventlet.service [None req-30ff7824-65c2-4a82-981e-07bbc18faa7a None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=91233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:06 devstack cinder-volume[91233]: DEBUG oslo_service.backend._eventlet.service [None req-30ff7824-65c2-4a82-981e-07bbc18faa7a None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=91233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:06 devstack cinder-volume[91233]: DEBUG oslo_service.backend._eventlet.service [None req-30ff7824-65c2-4a82-981e-07bbc18faa7a None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=91233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:06 devstack cinder-volume[91233]: DEBUG oslo_service.backend._eventlet.service [None req-30ff7824-65c2-4a82-981e-07bbc18faa7a None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=91233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:06 devstack cinder-volume[91233]: DEBUG oslo_service.backend._eventlet.service [None req-30ff7824-65c2-4a82-981e-07bbc18faa7a None None] keystone_authtoken.memcache_secret_key = **** {{(pid=91233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:06 devstack cinder-volume[91233]: DEBUG oslo_service.backend._eventlet.service [None req-30ff7824-65c2-4a82-981e-07bbc18faa7a None None] keystone_authtoken.memcache_security_strategy = None {{(pid=91233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:06 devstack cinder-volume[91233]: DEBUG oslo_service.backend._eventlet.service [None req-30ff7824-65c2-4a82-981e-07bbc18faa7a None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=91233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:06 devstack cinder-volume[91233]: DEBUG oslo_service.backend._eventlet.service [None req-30ff7824-65c2-4a82-981e-07bbc18faa7a None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=91233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:06 devstack cinder-volume[91233]: DEBUG oslo_service.backend._eventlet.service [None req-30ff7824-65c2-4a82-981e-07bbc18faa7a None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=91233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:06 devstack cinder-volume[91233]: DEBUG oslo_service.backend._eventlet.service [None req-30ff7824-65c2-4a82-981e-07bbc18faa7a None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=91233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:06 devstack cinder-volume[91233]: DEBUG oslo_service.backend._eventlet.service [None req-30ff7824-65c2-4a82-981e-07bbc18faa7a None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=91233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:06 devstack cinder-volume[91233]: DEBUG oslo_service.backend._eventlet.service [None req-30ff7824-65c2-4a82-981e-07bbc18faa7a None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=91233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:06 devstack cinder-volume[91233]: DEBUG oslo_service.backend._eventlet.service [None req-30ff7824-65c2-4a82-981e-07bbc18faa7a None None] keystone_authtoken.memcache_username = {{(pid=91233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:06 devstack cinder-volume[91233]: DEBUG oslo_service.backend._eventlet.service [None req-30ff7824-65c2-4a82-981e-07bbc18faa7a None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=91233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:06 devstack cinder-volume[91233]: DEBUG oslo_service.backend._eventlet.service [None req-30ff7824-65c2-4a82-981e-07bbc18faa7a None None] keystone_authtoken.region_name = None {{(pid=91233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:06 devstack cinder-volume[91233]: DEBUG oslo_service.backend._eventlet.service [None req-30ff7824-65c2-4a82-981e-07bbc18faa7a None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=91233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:06 devstack cinder-volume[91233]: DEBUG oslo_service.backend._eventlet.service [None req-30ff7824-65c2-4a82-981e-07bbc18faa7a None None] keystone_authtoken.service_token_roles_required = False {{(pid=91233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:06 devstack cinder-volume[91233]: DEBUG oslo_service.backend._eventlet.service [None req-30ff7824-65c2-4a82-981e-07bbc18faa7a None None] keystone_authtoken.service_type = None {{(pid=91233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:06 devstack cinder-volume[91233]: DEBUG oslo_service.backend._eventlet.service [None req-30ff7824-65c2-4a82-981e-07bbc18faa7a None None] keystone_authtoken.token_cache_time = 300 {{(pid=91233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:06 devstack cinder-volume[91233]: DEBUG oslo_service.backend._eventlet.service [None req-30ff7824-65c2-4a82-981e-07bbc18faa7a None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.240/identity {{(pid=91233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:06 devstack cinder-volume[91233]: DEBUG oslo_service.backend._eventlet.service [None req-30ff7824-65c2-4a82-981e-07bbc18faa7a None None] cache.backend = dogpile.cache.null {{(pid=91233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:06 devstack cinder-volume[91233]: DEBUG oslo_service.backend._eventlet.service [None req-30ff7824-65c2-4a82-981e-07bbc18faa7a None None] cache.backend_argument = **** {{(pid=91233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:06 devstack cinder-volume[91233]: DEBUG oslo_service.backend._eventlet.service [None req-30ff7824-65c2-4a82-981e-07bbc18faa7a None None] cache.backend_expiration_time = None {{(pid=91233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:06 devstack cinder-volume[91233]: DEBUG oslo_service.backend._eventlet.service [None req-30ff7824-65c2-4a82-981e-07bbc18faa7a None None] cache.config_prefix = cache.oslo {{(pid=91233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:06 devstack cinder-volume[91233]: DEBUG oslo_service.backend._eventlet.service [None req-30ff7824-65c2-4a82-981e-07bbc18faa7a None None] cache.debug_cache_backend = False {{(pid=91233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:06 devstack cinder-volume[91233]: DEBUG oslo_service.backend._eventlet.service [None req-30ff7824-65c2-4a82-981e-07bbc18faa7a None None] cache.enable_retry_client = False {{(pid=91233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:06 devstack cinder-volume[91233]: DEBUG oslo_service.backend._eventlet.service [None req-30ff7824-65c2-4a82-981e-07bbc18faa7a None None] cache.enable_socket_keepalive = False {{(pid=91233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:06 devstack cinder-volume[91233]: DEBUG oslo_service.backend._eventlet.service [None req-30ff7824-65c2-4a82-981e-07bbc18faa7a None None] cache.enabled = False {{(pid=91233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:06 devstack cinder-volume[91233]: DEBUG oslo_service.backend._eventlet.service [None req-30ff7824-65c2-4a82-981e-07bbc18faa7a None None] cache.enforce_fips_mode = False {{(pid=91233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:06 devstack cinder-volume[91233]: DEBUG oslo_service.backend._eventlet.service [None req-30ff7824-65c2-4a82-981e-07bbc18faa7a None None] cache.expiration_time = 600 {{(pid=91233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:06 devstack cinder-volume[91233]: DEBUG oslo_service.backend._eventlet.service [None req-30ff7824-65c2-4a82-981e-07bbc18faa7a None None] cache.hashclient_dead_timeout = 60.0 {{(pid=91233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:06 devstack cinder-volume[91233]: DEBUG oslo_service.backend._eventlet.service [None req-30ff7824-65c2-4a82-981e-07bbc18faa7a None None] cache.hashclient_retry_attempts = 2 {{(pid=91233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:06 devstack cinder-volume[91233]: DEBUG oslo_service.backend._eventlet.service [None req-30ff7824-65c2-4a82-981e-07bbc18faa7a None None] cache.hashclient_retry_timeout = 1.0 {{(pid=91233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:06 devstack cinder-volume[91233]: DEBUG oslo_service.backend._eventlet.service [None req-30ff7824-65c2-4a82-981e-07bbc18faa7a None None] cache.memcache_dead_retry = 300 {{(pid=91233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:06 devstack cinder-volume[91233]: DEBUG oslo_service.backend._eventlet.service [None req-30ff7824-65c2-4a82-981e-07bbc18faa7a None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=91233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:06 devstack cinder-volume[91233]: DEBUG oslo_service.backend._eventlet.service [None req-30ff7824-65c2-4a82-981e-07bbc18faa7a None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=91233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:06 devstack cinder-volume[91233]: DEBUG oslo_service.backend._eventlet.service [None req-30ff7824-65c2-4a82-981e-07bbc18faa7a None None] cache.memcache_pool_maxsize = 10 {{(pid=91233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:06 devstack cinder-volume[91233]: DEBUG oslo_service.backend._eventlet.service [None req-30ff7824-65c2-4a82-981e-07bbc18faa7a None None] cache.memcache_pool_unused_timeout = 60 {{(pid=91233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:06 devstack cinder-volume[91233]: DEBUG oslo_service.backend._eventlet.service [None req-30ff7824-65c2-4a82-981e-07bbc18faa7a None None] cache.memcache_sasl_enabled = False {{(pid=91233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:06 devstack cinder-volume[91233]: DEBUG oslo_service.backend._eventlet.service [None req-30ff7824-65c2-4a82-981e-07bbc18faa7a None None] cache.memcache_servers = ['localhost:11211'] {{(pid=91233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:06 devstack cinder-volume[91233]: DEBUG oslo_service.backend._eventlet.service [None req-30ff7824-65c2-4a82-981e-07bbc18faa7a None None] cache.password = **** {{(pid=91233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:06 devstack cinder-volume[91233]: DEBUG oslo_service.backend._eventlet.service [None req-30ff7824-65c2-4a82-981e-07bbc18faa7a None None] cache.proxies = [] {{(pid=91233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:06 devstack cinder-volume[91233]: DEBUG oslo_service.backend._eventlet.service [None req-30ff7824-65c2-4a82-981e-07bbc18faa7a None None] cache.redis_db = 0 {{(pid=91233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:06 devstack cinder-volume[91233]: DEBUG oslo_service.backend._eventlet.service [None req-30ff7824-65c2-4a82-981e-07bbc18faa7a None None] cache.redis_sentinel_service_name = mymaster {{(pid=91233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:06 devstack cinder-volume[91233]: DEBUG oslo_service.backend._eventlet.service [None req-30ff7824-65c2-4a82-981e-07bbc18faa7a None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=91233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:06 devstack cinder-volume[91233]: DEBUG oslo_service.backend._eventlet.service [None req-30ff7824-65c2-4a82-981e-07bbc18faa7a None None] cache.redis_server = localhost:6379 {{(pid=91233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:06 devstack cinder-volume[91233]: DEBUG oslo_service.backend._eventlet.service [None req-30ff7824-65c2-4a82-981e-07bbc18faa7a None None] cache.retry_attempts = 2 {{(pid=91233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:06 devstack cinder-volume[91233]: DEBUG oslo_service.backend._eventlet.service [None req-30ff7824-65c2-4a82-981e-07bbc18faa7a None None] cache.retry_delay = 0.0 {{(pid=91233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:06 devstack cinder-volume[91233]: DEBUG oslo_service.backend._eventlet.service [None req-30ff7824-65c2-4a82-981e-07bbc18faa7a None None] cache.socket_keepalive_count = 1 {{(pid=91233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:06 devstack cinder-volume[91233]: DEBUG oslo_service.backend._eventlet.service [None req-30ff7824-65c2-4a82-981e-07bbc18faa7a None None] cache.socket_keepalive_idle = 1 {{(pid=91233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:06 devstack cinder-volume[91233]: DEBUG oslo_service.backend._eventlet.service [None req-30ff7824-65c2-4a82-981e-07bbc18faa7a None None] cache.socket_keepalive_interval = 1 {{(pid=91233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:06 devstack cinder-volume[91233]: DEBUG oslo_service.backend._eventlet.service [None req-30ff7824-65c2-4a82-981e-07bbc18faa7a None None] cache.socket_timeout = 1.0 {{(pid=91233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:06 devstack cinder-volume[91233]: DEBUG oslo_service.backend._eventlet.service [None req-30ff7824-65c2-4a82-981e-07bbc18faa7a None None] cache.tls_allowed_ciphers = None {{(pid=91233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:06 devstack cinder-volume[91233]: DEBUG oslo_service.backend._eventlet.service [None req-30ff7824-65c2-4a82-981e-07bbc18faa7a None None] cache.tls_cafile = None {{(pid=91233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:06 devstack cinder-volume[91233]: DEBUG oslo_service.backend._eventlet.service [None req-30ff7824-65c2-4a82-981e-07bbc18faa7a None None] cache.tls_certfile = None {{(pid=91233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:06 devstack cinder-volume[91233]: DEBUG oslo_service.backend._eventlet.service [None req-30ff7824-65c2-4a82-981e-07bbc18faa7a None None] cache.tls_enabled = False {{(pid=91233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:06 devstack cinder-volume[91233]: DEBUG oslo_service.backend._eventlet.service [None req-30ff7824-65c2-4a82-981e-07bbc18faa7a None None] cache.tls_keyfile = None {{(pid=91233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:06 devstack cinder-volume[91233]: DEBUG oslo_service.backend._eventlet.service [None req-30ff7824-65c2-4a82-981e-07bbc18faa7a None None] cache.username = None {{(pid=91233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:06 devstack cinder-volume[91233]: DEBUG oslo_service.backend._eventlet.service [None req-30ff7824-65c2-4a82-981e-07bbc18faa7a None None] database.asyncio_connection = **** {{(pid=91233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:06 devstack cinder-volume[91233]: DEBUG oslo_service.backend._eventlet.service [None req-30ff7824-65c2-4a82-981e-07bbc18faa7a None None] database.asyncio_slave_connection = **** {{(pid=91233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:06 devstack cinder-volume[91233]: DEBUG oslo_service.backend._eventlet.service [None req-30ff7824-65c2-4a82-981e-07bbc18faa7a None None] database.backend = sqlalchemy {{(pid=91233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:06 devstack cinder-volume[91233]: DEBUG oslo_service.backend._eventlet.service [None req-30ff7824-65c2-4a82-981e-07bbc18faa7a None None] database.connection = **** {{(pid=91233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:06 devstack cinder-volume[91233]: DEBUG oslo_service.backend._eventlet.service [None req-30ff7824-65c2-4a82-981e-07bbc18faa7a None None] database.connection_debug = 0 {{(pid=91233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:06 devstack cinder-volume[91233]: DEBUG oslo_service.backend._eventlet.service [None req-30ff7824-65c2-4a82-981e-07bbc18faa7a None None] database.connection_parameters = {{(pid=91233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:06 devstack cinder-volume[91233]: DEBUG oslo_service.backend._eventlet.service [None req-30ff7824-65c2-4a82-981e-07bbc18faa7a None None] database.connection_recycle_time = 3600 {{(pid=91233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:06 devstack cinder-volume[91233]: DEBUG oslo_service.backend._eventlet.service [None req-30ff7824-65c2-4a82-981e-07bbc18faa7a None None] database.connection_trace = False {{(pid=91233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:06 devstack cinder-volume[91233]: DEBUG oslo_service.backend._eventlet.service [None req-30ff7824-65c2-4a82-981e-07bbc18faa7a None None] database.db_inc_retry_interval = True {{(pid=91233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:06 devstack cinder-volume[91233]: DEBUG oslo_service.backend._eventlet.service [None req-30ff7824-65c2-4a82-981e-07bbc18faa7a None None] database.db_max_retries = 20 {{(pid=91233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:06 devstack cinder-volume[91233]: DEBUG oslo_service.backend._eventlet.service [None req-30ff7824-65c2-4a82-981e-07bbc18faa7a None None] database.db_max_retry_interval = 10 {{(pid=91233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:06 devstack cinder-volume[91233]: DEBUG oslo_service.backend._eventlet.service [None req-30ff7824-65c2-4a82-981e-07bbc18faa7a None None] database.db_retry_interval = 1 {{(pid=91233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:06 devstack cinder-volume[91233]: DEBUG oslo_service.backend._eventlet.service [None req-30ff7824-65c2-4a82-981e-07bbc18faa7a None None] database.max_overflow = 50 {{(pid=91233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:06 devstack cinder-volume[91233]: DEBUG oslo_service.backend._eventlet.service [None req-30ff7824-65c2-4a82-981e-07bbc18faa7a None None] database.max_pool_size = 5 {{(pid=91233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:06 devstack cinder-volume[91233]: DEBUG oslo_service.backend._eventlet.service [None req-30ff7824-65c2-4a82-981e-07bbc18faa7a None None] database.max_retries = 10 {{(pid=91233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:06 devstack cinder-volume[91233]: DEBUG oslo_service.backend._eventlet.service [None req-30ff7824-65c2-4a82-981e-07bbc18faa7a None None] database.mysql_sql_mode = TRADITIONAL {{(pid=91233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:06 devstack cinder-volume[91233]: DEBUG oslo_service.backend._eventlet.service [None req-30ff7824-65c2-4a82-981e-07bbc18faa7a None None] database.mysql_wsrep_sync_wait = None {{(pid=91233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:06 devstack cinder-volume[91233]: DEBUG oslo_service.backend._eventlet.service [None req-30ff7824-65c2-4a82-981e-07bbc18faa7a None None] database.pool_timeout = None {{(pid=91233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:06 devstack cinder-volume[91233]: DEBUG oslo_service.backend._eventlet.service [None req-30ff7824-65c2-4a82-981e-07bbc18faa7a None None] database.retry_interval = 10 {{(pid=91233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:06 devstack cinder-volume[91233]: DEBUG oslo_service.backend._eventlet.service [None req-30ff7824-65c2-4a82-981e-07bbc18faa7a None None] database.slave_connection = **** {{(pid=91233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:06 devstack cinder-volume[91233]: DEBUG oslo_service.backend._eventlet.service [None req-30ff7824-65c2-4a82-981e-07bbc18faa7a None None] database.sqlite_synchronous = True {{(pid=91233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:06 devstack cinder-volume[91233]: DEBUG oslo_service.backend._eventlet.service [None req-30ff7824-65c2-4a82-981e-07bbc18faa7a None None] database.synchronous_reader = True {{(pid=91233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:06 devstack sudo[91450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a -c /etc/quobyte/client-cinder.cfg Jun 17 04:34:06 devstack cinder-volume[91233]: DEBUG oslo_service.backend._eventlet.service [None req-30ff7824-65c2-4a82-981e-07bbc18faa7a None None] database.use_db_reconnect = False {{(pid=91233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:06 devstack cinder-volume[91233]: DEBUG oslo_service.backend._eventlet.service [None req-30ff7824-65c2-4a82-981e-07bbc18faa7a None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=91233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:06 devstack cinder-volume[91233]: DEBUG oslo_service.backend._eventlet.service [None req-30ff7824-65c2-4a82-981e-07bbc18faa7a None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=91233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:06 devstack cinder-volume[91233]: DEBUG oslo_service.backend._eventlet.service [None req-30ff7824-65c2-4a82-981e-07bbc18faa7a None None] oslo_messaging_metrics.metrics_process_name = {{(pid=91233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:06 devstack cinder-volume[91233]: DEBUG oslo_service.backend._eventlet.service [None req-30ff7824-65c2-4a82-981e-07bbc18faa7a None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=91233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:06 devstack cinder-volume[91233]: DEBUG oslo_service.backend._eventlet.service [None req-30ff7824-65c2-4a82-981e-07bbc18faa7a None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=91233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:06 devstack sudo[91450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:34:06 devstack cinder-volume[91233]: DEBUG oslo_service.backend._eventlet.service [None req-30ff7824-65c2-4a82-981e-07bbc18faa7a None None] profiler.connection_string = messaging:// {{(pid=91233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:06 devstack cinder-volume[91233]: DEBUG oslo_service.backend._eventlet.service [None req-30ff7824-65c2-4a82-981e-07bbc18faa7a None None] profiler.enabled = False {{(pid=91233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:06 devstack cinder-volume[91233]: DEBUG oslo_service.backend._eventlet.service [None req-30ff7824-65c2-4a82-981e-07bbc18faa7a None None] profiler.es_doc_type = notification {{(pid=91233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:06 devstack cinder-volume[91233]: DEBUG oslo_service.backend._eventlet.service [None req-30ff7824-65c2-4a82-981e-07bbc18faa7a None None] profiler.es_scroll_size = 10000 {{(pid=91233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:06 devstack cinder-volume[91233]: DEBUG oslo_service.backend._eventlet.service [None req-30ff7824-65c2-4a82-981e-07bbc18faa7a None None] profiler.es_scroll_time = 2m {{(pid=91233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:06 devstack cinder-volume[91233]: DEBUG oslo_service.backend._eventlet.service [None req-30ff7824-65c2-4a82-981e-07bbc18faa7a None None] profiler.filter_error_trace = False {{(pid=91233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:06 devstack cinder-volume[91233]: DEBUG oslo_service.backend._eventlet.service [None req-30ff7824-65c2-4a82-981e-07bbc18faa7a None None] profiler.hmac_keys = **** {{(pid=91233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:06 devstack cinder-volume[91233]: DEBUG oslo_service.backend._eventlet.service [None req-30ff7824-65c2-4a82-981e-07bbc18faa7a None None] profiler.sentinel_service_name = mymaster {{(pid=91233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:06 devstack cinder-volume[91233]: DEBUG oslo_service.backend._eventlet.service [None req-30ff7824-65c2-4a82-981e-07bbc18faa7a None None] profiler.socket_timeout = 0.1 {{(pid=91233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:06 devstack cinder-volume[91233]: DEBUG oslo_service.backend._eventlet.service [None req-30ff7824-65c2-4a82-981e-07bbc18faa7a None None] profiler.trace_requests = False {{(pid=91233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:06 devstack cinder-volume[91233]: DEBUG oslo_service.backend._eventlet.service [None req-30ff7824-65c2-4a82-981e-07bbc18faa7a None None] profiler.trace_sqlalchemy = False {{(pid=91233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:06 devstack cinder-volume[91233]: DEBUG oslo_service.backend._eventlet.service [None req-30ff7824-65c2-4a82-981e-07bbc18faa7a None None] profiler_jaeger.process_tags = {} {{(pid=91233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:06 devstack cinder-volume[91233]: DEBUG oslo_service.backend._eventlet.service [None req-30ff7824-65c2-4a82-981e-07bbc18faa7a None None] profiler_jaeger.service_name_prefix = None {{(pid=91233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:06 devstack cinder-volume[91233]: DEBUG oslo_service.backend._eventlet.service [None req-30ff7824-65c2-4a82-981e-07bbc18faa7a None None] profiler_otlp.service_name_prefix = None {{(pid=91233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:06 devstack cinder-volume[91233]: DEBUG oslo_service.backend._eventlet.service [None req-30ff7824-65c2-4a82-981e-07bbc18faa7a None None] oslo_policy.enforce_new_defaults = False {{(pid=91233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:06 devstack cinder-volume[91233]: WARNING oslo_config.cfg [None req-30ff7824-65c2-4a82-981e-07bbc18faa7a None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.). Its value may be silently ignored in the future. Jun 17 04:34:06 devstack cinder-volume[91233]: DEBUG oslo_service.backend._eventlet.service [None req-30ff7824-65c2-4a82-981e-07bbc18faa7a None None] oslo_policy.enforce_scope = False {{(pid=91233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:06 devstack cinder-volume[91233]: DEBUG oslo_service.backend._eventlet.service [None req-30ff7824-65c2-4a82-981e-07bbc18faa7a None None] oslo_policy.policy_default_rule = default {{(pid=91233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:06 devstack cinder-volume[91233]: DEBUG oslo_service.backend._eventlet.service [None req-30ff7824-65c2-4a82-981e-07bbc18faa7a None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=91233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:06 devstack cinder-volume[91233]: DEBUG oslo_service.backend._eventlet.service [None req-30ff7824-65c2-4a82-981e-07bbc18faa7a None None] oslo_policy.policy_file = policy.yaml {{(pid=91233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:06 devstack cinder-volume[91233]: DEBUG oslo_service.backend._eventlet.service [None req-30ff7824-65c2-4a82-981e-07bbc18faa7a None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=91233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:06 devstack cinder-volume[91233]: DEBUG oslo_service.backend._eventlet.service [None req-30ff7824-65c2-4a82-981e-07bbc18faa7a None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=91233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:06 devstack cinder-volume[91233]: DEBUG oslo_service.backend._eventlet.service [None req-30ff7824-65c2-4a82-981e-07bbc18faa7a None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=91233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:06 devstack cinder-volume[91233]: DEBUG oslo_service.backend._eventlet.service [None req-30ff7824-65c2-4a82-981e-07bbc18faa7a None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=91233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:06 devstack cinder-volume[91233]: DEBUG oslo_service.backend._eventlet.service [None req-30ff7824-65c2-4a82-981e-07bbc18faa7a None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=91233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:06 devstack cinder-volume[91233]: DEBUG oslo_service.backend._eventlet.service [None req-30ff7824-65c2-4a82-981e-07bbc18faa7a None None] oslo_policy.remote_timeout = 60.0 {{(pid=91233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:06 devstack cinder-volume[91233]: DEBUG oslo_service.backend._eventlet.service [None req-30ff7824-65c2-4a82-981e-07bbc18faa7a None None] coordination.backend_url = **** {{(pid=91233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:06 devstack cinder-volume[91233]: DEBUG oslo_service.backend._eventlet.service [None req-30ff7824-65c2-4a82-981e-07bbc18faa7a None None] privsep_osbrick.capabilities = [21, 2] {{(pid=91233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:06 devstack cinder-volume[91233]: DEBUG oslo_service.backend._eventlet.service [None req-30ff7824-65c2-4a82-981e-07bbc18faa7a None None] privsep_osbrick.group = None {{(pid=91233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:06 devstack cinder-volume[91233]: DEBUG oslo_service.backend._eventlet.service [None req-30ff7824-65c2-4a82-981e-07bbc18faa7a None None] privsep_osbrick.helper_command = None {{(pid=91233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:06 devstack cinder-volume[91233]: DEBUG oslo_service.backend._eventlet.service [None req-30ff7824-65c2-4a82-981e-07bbc18faa7a None None] privsep_osbrick.log_daemon_traceback = False {{(pid=91233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:06 devstack cinder-volume[91233]: DEBUG oslo_service.backend._eventlet.service [None req-30ff7824-65c2-4a82-981e-07bbc18faa7a None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=91233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:06 devstack cinder-volume[91233]: DEBUG oslo_service.backend._eventlet.service [None req-30ff7824-65c2-4a82-981e-07bbc18faa7a None None] privsep_osbrick.thread_pool_size = 4 {{(pid=91233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:06 devstack cinder-volume[91233]: DEBUG oslo_service.backend._eventlet.service [None req-30ff7824-65c2-4a82-981e-07bbc18faa7a None None] privsep_osbrick.user = None {{(pid=91233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:06 devstack cinder-volume[91233]: DEBUG oslo_service.backend._eventlet.service [None req-30ff7824-65c2-4a82-981e-07bbc18faa7a None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=91233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:06 devstack cinder-volume[91233]: DEBUG oslo_service.backend._eventlet.service [None req-30ff7824-65c2-4a82-981e-07bbc18faa7a None None] cinder_sys_admin.group = None {{(pid=91233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:06 devstack cinder-volume[91233]: DEBUG oslo_service.backend._eventlet.service [None req-30ff7824-65c2-4a82-981e-07bbc18faa7a None None] cinder_sys_admin.helper_command = None {{(pid=91233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:06 devstack cinder-volume[91233]: DEBUG oslo_service.backend._eventlet.service [None req-30ff7824-65c2-4a82-981e-07bbc18faa7a None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=91233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:06 devstack cinder-volume[91233]: DEBUG oslo_service.backend._eventlet.service [None req-30ff7824-65c2-4a82-981e-07bbc18faa7a None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=91233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:06 devstack cinder-volume[91233]: DEBUG oslo_service.backend._eventlet.service [None req-30ff7824-65c2-4a82-981e-07bbc18faa7a None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=91233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:06 devstack cinder-volume[91233]: DEBUG oslo_service.backend._eventlet.service [None req-30ff7824-65c2-4a82-981e-07bbc18faa7a None None] cinder_sys_admin.user = None {{(pid=91233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:06 devstack cinder-volume[91233]: DEBUG oslo_service.backend._eventlet.service [None req-30ff7824-65c2-4a82-981e-07bbc18faa7a None None] service_user.auth_section = None {{(pid=91233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:06 devstack cinder-volume[91233]: DEBUG oslo_service.backend._eventlet.service [None req-30ff7824-65c2-4a82-981e-07bbc18faa7a None None] service_user.auth_type = password {{(pid=91233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:06 devstack cinder-volume[91233]: DEBUG oslo_service.backend._eventlet.service [None req-30ff7824-65c2-4a82-981e-07bbc18faa7a None None] service_user.cafile = None {{(pid=91233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:06 devstack cinder-volume[91233]: DEBUG oslo_service.backend._eventlet.service [None req-30ff7824-65c2-4a82-981e-07bbc18faa7a None None] service_user.certfile = None {{(pid=91233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:06 devstack cinder-volume[91233]: DEBUG oslo_service.backend._eventlet.service [None req-30ff7824-65c2-4a82-981e-07bbc18faa7a None None] service_user.collect_timing = False {{(pid=91233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:06 devstack cinder-volume[91233]: DEBUG oslo_service.backend._eventlet.service [None req-30ff7824-65c2-4a82-981e-07bbc18faa7a None None] service_user.insecure = False {{(pid=91233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:06 devstack cinder-volume[91233]: DEBUG oslo_service.backend._eventlet.service [None req-30ff7824-65c2-4a82-981e-07bbc18faa7a None None] service_user.keyfile = None {{(pid=91233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:06 devstack cinder-volume[91233]: DEBUG oslo_service.backend._eventlet.service [None req-30ff7824-65c2-4a82-981e-07bbc18faa7a None None] service_user.send_service_user_token = True {{(pid=91233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:06 devstack cinder-volume[91233]: DEBUG oslo_service.backend._eventlet.service [None req-30ff7824-65c2-4a82-981e-07bbc18faa7a None None] service_user.split_loggers = False {{(pid=91233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:06 devstack cinder-volume[91233]: DEBUG oslo_service.backend._eventlet.service [None req-30ff7824-65c2-4a82-981e-07bbc18faa7a None None] service_user.timeout = None {{(pid=91233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:06 devstack cinder-volume[91233]: DEBUG oslo_service.backend._eventlet.service [None req-30ff7824-65c2-4a82-981e-07bbc18faa7a None None] glance.auth_section = None {{(pid=91233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:06 devstack cinder-volume[91233]: DEBUG oslo_service.backend._eventlet.service [None req-30ff7824-65c2-4a82-981e-07bbc18faa7a None None] glance.auth_type = password {{(pid=91233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:06 devstack cinder-volume[91233]: DEBUG oslo_service.backend._eventlet.service [None req-30ff7824-65c2-4a82-981e-07bbc18faa7a None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=91233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:06 devstack cinder-volume[91233]: DEBUG oslo_service.backend._eventlet.service [None req-30ff7824-65c2-4a82-981e-07bbc18faa7a None None] glance.certfile = None {{(pid=91233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:06 devstack cinder-volume[91233]: DEBUG oslo_service.backend._eventlet.service [None req-30ff7824-65c2-4a82-981e-07bbc18faa7a None None] glance.collect_timing = False {{(pid=91233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:06 devstack cinder-volume[91233]: DEBUG oslo_service.backend._eventlet.service [None req-30ff7824-65c2-4a82-981e-07bbc18faa7a None None] glance.insecure = False {{(pid=91233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:06 devstack cinder-volume[91233]: DEBUG oslo_service.backend._eventlet.service [None req-30ff7824-65c2-4a82-981e-07bbc18faa7a None None] glance.keyfile = None {{(pid=91233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:06 devstack cinder-volume[91233]: DEBUG oslo_service.backend._eventlet.service [None req-30ff7824-65c2-4a82-981e-07bbc18faa7a None None] glance.region_name = None {{(pid=91233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:06 devstack cinder-volume[91233]: DEBUG oslo_service.backend._eventlet.service [None req-30ff7824-65c2-4a82-981e-07bbc18faa7a None None] glance.split_loggers = False {{(pid=91233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:06 devstack cinder-volume[91233]: DEBUG oslo_service.backend._eventlet.service [None req-30ff7824-65c2-4a82-981e-07bbc18faa7a None None] glance.timeout = None {{(pid=91233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:06 devstack cinder-volume[91233]: DEBUG oslo_service.backend._eventlet.service [None req-30ff7824-65c2-4a82-981e-07bbc18faa7a None None] backend_defaults.backend_availability_zone = None {{(pid=91233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:06 devstack cinder-volume[91233]: DEBUG oslo_service.backend._eventlet.service [None req-30ff7824-65c2-4a82-981e-07bbc18faa7a None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=91233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:06 devstack cinder-volume[91233]: DEBUG oslo_service.backend._eventlet.service [None req-30ff7824-65c2-4a82-981e-07bbc18faa7a None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=91233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:06 devstack cinder-volume[91233]: DEBUG oslo_service.backend._eventlet.service [None req-30ff7824-65c2-4a82-981e-07bbc18faa7a None None] backend_defaults.chap_password = **** {{(pid=91233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:06 devstack cinder-volume[91233]: DEBUG oslo_service.backend._eventlet.service [None req-30ff7824-65c2-4a82-981e-07bbc18faa7a None None] backend_defaults.chap_username = {{(pid=91233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:06 devstack cinder-volume[91233]: DEBUG oslo_service.backend._eventlet.service [None req-30ff7824-65c2-4a82-981e-07bbc18faa7a None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=91233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:06 devstack cinder-volume[91233]: DEBUG oslo_service.backend._eventlet.service [None req-30ff7824-65c2-4a82-981e-07bbc18faa7a None None] backend_defaults.disk_geometry = None {{(pid=91233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:06 devstack cinder-volume[91233]: DEBUG oslo_service.backend._eventlet.service [None req-30ff7824-65c2-4a82-981e-07bbc18faa7a None None] backend_defaults.driver_client_cert = None {{(pid=91233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:06 devstack cinder-volume[91233]: DEBUG oslo_service.backend._eventlet.service [None req-30ff7824-65c2-4a82-981e-07bbc18faa7a None None] backend_defaults.driver_client_cert_key = None {{(pid=91233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:06 devstack cinder-volume[91233]: DEBUG oslo_service.backend._eventlet.service [None req-30ff7824-65c2-4a82-981e-07bbc18faa7a None None] backend_defaults.driver_data_namespace = None {{(pid=91233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:06 devstack cinder-volume[91233]: DEBUG oslo_service.backend._eventlet.service [None req-30ff7824-65c2-4a82-981e-07bbc18faa7a None None] backend_defaults.driver_ssl_cert_path = None {{(pid=91233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:06 devstack cinder-volume[91233]: DEBUG oslo_service.backend._eventlet.service [None req-30ff7824-65c2-4a82-981e-07bbc18faa7a None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=91233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:06 devstack cinder-volume[91233]: DEBUG oslo_service.backend._eventlet.service [None req-30ff7824-65c2-4a82-981e-07bbc18faa7a None None] backend_defaults.driver_use_ssl = False {{(pid=91233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:06 devstack cinder-volume[91233]: DEBUG oslo_service.backend._eventlet.service [None req-30ff7824-65c2-4a82-981e-07bbc18faa7a None None] backend_defaults.enable_unsupported_driver = False {{(pid=91233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:06 devstack cinder-volume[91233]: DEBUG oslo_service.backend._eventlet.service [None req-30ff7824-65c2-4a82-981e-07bbc18faa7a None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=91233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:06 devstack cinder-volume[91233]: DEBUG oslo_service.backend._eventlet.service [None req-30ff7824-65c2-4a82-981e-07bbc18faa7a None None] backend_defaults.extra_capabilities = {} {{(pid=91233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:06 devstack cinder-volume[91233]: DEBUG oslo_service.backend._eventlet.service [None req-30ff7824-65c2-4a82-981e-07bbc18faa7a None None] backend_defaults.filter_function = None {{(pid=91233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:06 devstack cinder-volume[91233]: DEBUG oslo_service.backend._eventlet.service [None req-30ff7824-65c2-4a82-981e-07bbc18faa7a None None] backend_defaults.goodness_function = None {{(pid=91233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:06 devstack cinder-volume[91369]: DEBUG oslo_concurrency.processutils [None req-29357396-8c95-483b-87bf-705f38b47246 None None] CMD "mount.quobyte" returned: 1 in 0.156s {{(pid=91369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:34:06 devstack cinder-volume[91233]: DEBUG oslo_service.backend._eventlet.service [None req-30ff7824-65c2-4a82-981e-07bbc18faa7a None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=91233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:06 devstack cinder-volume[91233]: DEBUG oslo_service.backend._eventlet.service [None req-30ff7824-65c2-4a82-981e-07bbc18faa7a None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=91233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:06 devstack cinder-volume[91369]: DEBUG oslo_concurrency.lockutils [None req-29357396-8c95-483b-87bf-705f38b47246 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 04:34:06 devstack cinder-volume[91233]: DEBUG oslo_service.backend._eventlet.service [None req-30ff7824-65c2-4a82-981e-07bbc18faa7a None None] backend_defaults.image_volume_cache_enabled = False {{(pid=91233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:06 devstack cinder-volume[91369]: DEBUG oslo_concurrency.lockutils [None req-29357396-8c95-483b-87bf-705f38b47246 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=91369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 04:34:06 devstack cinder-volume[91233]: DEBUG oslo_service.backend._eventlet.service [None req-30ff7824-65c2-4a82-981e-07bbc18faa7a None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=91233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:06 devstack cinder-volume[91369]: DEBUG cinder.volume.drivers.quobyte [None req-29357396-8c95-483b-87bf-705f38b47246 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588': None} {{(pid=91369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 17 04:34:06 devstack cinder-volume[91233]: DEBUG oslo_service.backend._eventlet.service [None req-30ff7824-65c2-4a82-981e-07bbc18faa7a None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=91233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:06 devstack cinder-volume[91233]: DEBUG oslo_service.backend._eventlet.service [None req-30ff7824-65c2-4a82-981e-07bbc18faa7a None None] backend_defaults.iscsi_target_flags = {{(pid=91233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:06 devstack cinder-volume[91369]: INFO cinder.volume.drivers.quobyte [None req-29357396-8c95-483b-87bf-705f38b47246 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588 ... Jun 17 04:34:06 devstack cinder-volume[91233]: DEBUG oslo_service.backend._eventlet.service [None req-30ff7824-65c2-4a82-981e-07bbc18faa7a None None] backend_defaults.iscsi_write_cache = on {{(pid=91233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:06 devstack cinder-volume[91233]: DEBUG oslo_service.backend._eventlet.service [None req-30ff7824-65c2-4a82-981e-07bbc18faa7a None None] backend_defaults.iser_helper = tgtadm {{(pid=91233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:06 devstack cinder-volume[91369]: DEBUG oslo_concurrency.processutils [None req-29357396-8c95-483b-87bf-705f38b47246 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a -c /etc/quobyte/client-cinder.cfg {{(pid=91369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:34:06 devstack cinder-volume[91233]: DEBUG oslo_service.backend._eventlet.service [None req-30ff7824-65c2-4a82-981e-07bbc18faa7a None None] backend_defaults.iser_ip_address = 192.168.122.240 {{(pid=91233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:06 devstack cinder-volume[91233]: DEBUG oslo_service.backend._eventlet.service [None req-30ff7824-65c2-4a82-981e-07bbc18faa7a None None] backend_defaults.iser_port = 3260 {{(pid=91233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:06 devstack cinder-volume[91233]: DEBUG oslo_service.backend._eventlet.service [None req-30ff7824-65c2-4a82-981e-07bbc18faa7a None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=91233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:06 devstack cinder-volume[91233]: DEBUG oslo_service.backend._eventlet.service [None req-30ff7824-65c2-4a82-981e-07bbc18faa7a None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=91233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:06 devstack cinder-volume[91233]: DEBUG oslo_service.backend._eventlet.service [None req-30ff7824-65c2-4a82-981e-07bbc18faa7a None None] backend_defaults.nas_host = {{(pid=91233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:06 devstack cinder-volume[91233]: DEBUG oslo_service.backend._eventlet.service [None req-30ff7824-65c2-4a82-981e-07bbc18faa7a None None] backend_defaults.nas_login = admin {{(pid=91233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:06 devstack cinder-volume[91233]: DEBUG oslo_service.backend._eventlet.service [None req-30ff7824-65c2-4a82-981e-07bbc18faa7a None None] backend_defaults.nas_mount_options = None {{(pid=91233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:06 devstack cinder-volume[91233]: DEBUG oslo_service.backend._eventlet.service [None req-30ff7824-65c2-4a82-981e-07bbc18faa7a None None] backend_defaults.nas_password = **** {{(pid=91233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:06 devstack cinder-volume[91233]: DEBUG oslo_service.backend._eventlet.service [None req-30ff7824-65c2-4a82-981e-07bbc18faa7a None None] backend_defaults.nas_private_key = {{(pid=91233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:06 devstack cinder-volume[91233]: DEBUG oslo_service.backend._eventlet.service [None req-30ff7824-65c2-4a82-981e-07bbc18faa7a None None] backend_defaults.nas_secure_file_operations = auto {{(pid=91233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:06 devstack cinder-volume[91233]: DEBUG oslo_service.backend._eventlet.service [None req-30ff7824-65c2-4a82-981e-07bbc18faa7a None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=91233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:06 devstack cinder-volume[91233]: DEBUG oslo_service.backend._eventlet.service [None req-30ff7824-65c2-4a82-981e-07bbc18faa7a None None] backend_defaults.nas_share_path = {{(pid=91233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:06 devstack cinder-volume[91233]: DEBUG oslo_service.backend._eventlet.service [None req-30ff7824-65c2-4a82-981e-07bbc18faa7a None None] backend_defaults.nas_ssh_port = 22 {{(pid=91233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:06 devstack cinder-volume[91233]: DEBUG oslo_service.backend._eventlet.service [None req-30ff7824-65c2-4a82-981e-07bbc18faa7a None None] backend_defaults.nas_volume_prov_type = thin {{(pid=91233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:06 devstack cinder-volume[91233]: DEBUG oslo_service.backend._eventlet.service [None req-30ff7824-65c2-4a82-981e-07bbc18faa7a None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=91233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:06 devstack cinder-volume[91233]: DEBUG oslo_service.backend._eventlet.service [None req-30ff7824-65c2-4a82-981e-07bbc18faa7a None None] backend_defaults.num_shell_tries = 3 {{(pid=91233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:06 devstack cinder-volume[91233]: DEBUG oslo_service.backend._eventlet.service [None req-30ff7824-65c2-4a82-981e-07bbc18faa7a None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=91233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:06 devstack cinder-volume[91233]: DEBUG oslo_service.backend._eventlet.service [None req-30ff7824-65c2-4a82-981e-07bbc18faa7a None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=91233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:06 devstack cinder-volume[91233]: DEBUG oslo_service.backend._eventlet.service [None req-30ff7824-65c2-4a82-981e-07bbc18faa7a None None] backend_defaults.nvmet_ns_id = 10 {{(pid=91233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:06 devstack cinder-volume[91233]: DEBUG oslo_service.backend._eventlet.service [None req-30ff7824-65c2-4a82-981e-07bbc18faa7a None None] backend_defaults.nvmet_port_id = 1 {{(pid=91233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:06 devstack cinder-volume[91233]: DEBUG oslo_service.backend._eventlet.service [None req-30ff7824-65c2-4a82-981e-07bbc18faa7a None None] backend_defaults.quobyte_client_cfg = None {{(pid=91233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:06 devstack cinder-volume[91233]: DEBUG oslo_service.backend._eventlet.service [None req-30ff7824-65c2-4a82-981e-07bbc18faa7a None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=91233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:06 devstack cinder-volume[91233]: DEBUG oslo_service.backend._eventlet.service [None req-30ff7824-65c2-4a82-981e-07bbc18faa7a None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=91233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:06 devstack cinder-volume[91233]: DEBUG oslo_service.backend._eventlet.service [None req-30ff7824-65c2-4a82-981e-07bbc18faa7a None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=91233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:06 devstack cinder-volume[91233]: DEBUG oslo_service.backend._eventlet.service [None req-30ff7824-65c2-4a82-981e-07bbc18faa7a None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=91233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:06 devstack cinder-volume[91233]: DEBUG oslo_service.backend._eventlet.service [None req-30ff7824-65c2-4a82-981e-07bbc18faa7a None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=91233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:06 devstack cinder-volume[91233]: DEBUG oslo_service.backend._eventlet.service [None req-30ff7824-65c2-4a82-981e-07bbc18faa7a None None] backend_defaults.quobyte_volume_url = None {{(pid=91233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:06 devstack cinder-volume[91233]: DEBUG oslo_service.backend._eventlet.service [None req-30ff7824-65c2-4a82-981e-07bbc18faa7a None None] backend_defaults.replication_device = **** {{(pid=91233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:06 devstack cinder-volume[91233]: DEBUG oslo_service.backend._eventlet.service [None req-30ff7824-65c2-4a82-981e-07bbc18faa7a None None] backend_defaults.report_discard_supported = False {{(pid=91233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:06 devstack cinder-volume[91233]: DEBUG oslo_service.backend._eventlet.service [None req-30ff7824-65c2-4a82-981e-07bbc18faa7a None None] backend_defaults.reserved_percentage = 0 {{(pid=91233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:06 devstack cinder-volume[91233]: DEBUG oslo_service.backend._eventlet.service [None req-30ff7824-65c2-4a82-981e-07bbc18faa7a None None] backend_defaults.scst_target_driver = iscsi {{(pid=91233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:06 devstack cinder-volume[91233]: DEBUG oslo_service.backend._eventlet.service [None req-30ff7824-65c2-4a82-981e-07bbc18faa7a None None] backend_defaults.scst_target_iqn_name = None {{(pid=91233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:06 devstack cinder-volume[91233]: DEBUG oslo_service.backend._eventlet.service [None req-30ff7824-65c2-4a82-981e-07bbc18faa7a None None] backend_defaults.storage_protocol = iSCSI {{(pid=91233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:06 devstack cinder-volume[91233]: DEBUG oslo_service.backend._eventlet.service [None req-30ff7824-65c2-4a82-981e-07bbc18faa7a None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=91233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:06 devstack cinder-volume[91233]: DEBUG oslo_service.backend._eventlet.service [None req-30ff7824-65c2-4a82-981e-07bbc18faa7a None None] backend_defaults.target_helper = tgtadm {{(pid=91233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:06 devstack cinder-volume[91233]: DEBUG oslo_service.backend._eventlet.service [None req-30ff7824-65c2-4a82-981e-07bbc18faa7a None None] backend_defaults.target_ip_address = 192.168.122.240 {{(pid=91233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:06 devstack cinder-volume[91233]: DEBUG oslo_service.backend._eventlet.service [None req-30ff7824-65c2-4a82-981e-07bbc18faa7a None None] backend_defaults.target_port = 3260 {{(pid=91233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:06 devstack cinder-volume[91233]: DEBUG oslo_service.backend._eventlet.service [None req-30ff7824-65c2-4a82-981e-07bbc18faa7a None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=91233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:06 devstack cinder-volume[91233]: DEBUG oslo_service.backend._eventlet.service [None req-30ff7824-65c2-4a82-981e-07bbc18faa7a None None] backend_defaults.target_protocol = iscsi {{(pid=91233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:06 devstack cinder-volume[91233]: DEBUG oslo_service.backend._eventlet.service [None req-30ff7824-65c2-4a82-981e-07bbc18faa7a None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=91233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:06 devstack cinder-volume[91233]: DEBUG oslo_service.backend._eventlet.service [None req-30ff7824-65c2-4a82-981e-07bbc18faa7a None None] backend_defaults.trace_flags = None {{(pid=91233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:06 devstack cinder-volume[91233]: DEBUG oslo_service.backend._eventlet.service [None req-30ff7824-65c2-4a82-981e-07bbc18faa7a None None] backend_defaults.unique_fqdn_network = True {{(pid=91233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:06 devstack cinder-volume[91233]: DEBUG oslo_service.backend._eventlet.service [None req-30ff7824-65c2-4a82-981e-07bbc18faa7a None None] backend_defaults.use_chap_auth = False {{(pid=91233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:06 devstack cinder-volume[91233]: DEBUG oslo_service.backend._eventlet.service [None req-30ff7824-65c2-4a82-981e-07bbc18faa7a None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=91233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:06 devstack cinder-volume[91233]: DEBUG oslo_service.backend._eventlet.service [None req-30ff7824-65c2-4a82-981e-07bbc18faa7a None None] backend_defaults.volume_backend_name = None {{(pid=91233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:06 devstack cinder-volume[91233]: DEBUG oslo_service.backend._eventlet.service [None req-30ff7824-65c2-4a82-981e-07bbc18faa7a None None] backend_defaults.volume_clear = zero {{(pid=91233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:06 devstack cinder-volume[91233]: DEBUG oslo_service.backend._eventlet.service [None req-30ff7824-65c2-4a82-981e-07bbc18faa7a None None] backend_defaults.volume_clear_ionice = None {{(pid=91233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:06 devstack cinder-volume[91233]: DEBUG oslo_service.backend._eventlet.service [None req-30ff7824-65c2-4a82-981e-07bbc18faa7a None None] backend_defaults.volume_clear_size = 0 {{(pid=91233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:06 devstack cinder-volume[91233]: DEBUG oslo_service.backend._eventlet.service [None req-30ff7824-65c2-4a82-981e-07bbc18faa7a None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=91233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:06 devstack cinder-volume[91233]: DEBUG oslo_service.backend._eventlet.service [None req-30ff7824-65c2-4a82-981e-07bbc18faa7a None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=91233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:06 devstack cinder-volume[91233]: DEBUG oslo_service.backend._eventlet.service [None req-30ff7824-65c2-4a82-981e-07bbc18faa7a None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=91233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:06 devstack cinder-volume[91233]: DEBUG oslo_service.backend._eventlet.service [None req-30ff7824-65c2-4a82-981e-07bbc18faa7a None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=91233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:06 devstack cinder-volume[91233]: DEBUG oslo_service.backend._eventlet.service [None req-30ff7824-65c2-4a82-981e-07bbc18faa7a None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=91233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:06 devstack cinder-volume[91233]: DEBUG oslo_service.backend._eventlet.service [None req-30ff7824-65c2-4a82-981e-07bbc18faa7a None None] oslo_reports.file_event_handler = None {{(pid=91233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:06 devstack cinder-volume[91233]: DEBUG oslo_service.backend._eventlet.service [None req-30ff7824-65c2-4a82-981e-07bbc18faa7a None None] oslo_reports.file_event_handler_interval = 1 {{(pid=91233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:06 devstack cinder-volume[91233]: DEBUG oslo_service.backend._eventlet.service [None req-30ff7824-65c2-4a82-981e-07bbc18faa7a None None] oslo_reports.log_dir = None {{(pid=91233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:06 devstack cinder-volume[91233]: DEBUG oslo_service.backend._eventlet.service [None req-30ff7824-65c2-4a82-981e-07bbc18faa7a None None] QuobyteHD.backend_availability_zone = None {{(pid=91233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:06 devstack cinder-volume[91233]: DEBUG oslo_service.backend._eventlet.service [None req-30ff7824-65c2-4a82-981e-07bbc18faa7a None None] QuobyteHD.backend_host = None {{(pid=91233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:06 devstack cinder-volume[91233]: DEBUG oslo_service.backend._eventlet.service [None req-30ff7824-65c2-4a82-981e-07bbc18faa7a None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=91233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:06 devstack cinder-volume[91233]: DEBUG oslo_service.backend._eventlet.service [None req-30ff7824-65c2-4a82-981e-07bbc18faa7a None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=91233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:06 devstack cinder-volume[91233]: DEBUG oslo_service.backend._eventlet.service [None req-30ff7824-65c2-4a82-981e-07bbc18faa7a None None] QuobyteHD.chap_password = **** {{(pid=91233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:06 devstack cinder-volume[91233]: DEBUG oslo_service.backend._eventlet.service [None req-30ff7824-65c2-4a82-981e-07bbc18faa7a None None] QuobyteHD.chap_username = None {{(pid=91233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:06 devstack cinder-volume[91233]: DEBUG oslo_service.backend._eventlet.service [None req-30ff7824-65c2-4a82-981e-07bbc18faa7a None None] QuobyteHD.chiscsi_conf = None {{(pid=91233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:06 devstack cinder-volume[91233]: DEBUG oslo_service.backend._eventlet.service [None req-30ff7824-65c2-4a82-981e-07bbc18faa7a None None] QuobyteHD.disk_geometry = None {{(pid=91233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:06 devstack cinder-volume[91233]: DEBUG oslo_service.backend._eventlet.service [None req-30ff7824-65c2-4a82-981e-07bbc18faa7a None None] QuobyteHD.driver_client_cert = None {{(pid=91233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:06 devstack cinder-volume[91233]: DEBUG oslo_service.backend._eventlet.service [None req-30ff7824-65c2-4a82-981e-07bbc18faa7a None None] QuobyteHD.driver_client_cert_key = None {{(pid=91233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:06 devstack cinder-volume[91233]: DEBUG oslo_service.backend._eventlet.service [None req-30ff7824-65c2-4a82-981e-07bbc18faa7a None None] QuobyteHD.driver_data_namespace = None {{(pid=91233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:06 devstack cinder-volume[91233]: DEBUG oslo_service.backend._eventlet.service [None req-30ff7824-65c2-4a82-981e-07bbc18faa7a None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=91233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:06 devstack cinder-volume[91233]: DEBUG oslo_service.backend._eventlet.service [None req-30ff7824-65c2-4a82-981e-07bbc18faa7a None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=91233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:06 devstack cinder-volume[91233]: DEBUG oslo_service.backend._eventlet.service [None req-30ff7824-65c2-4a82-981e-07bbc18faa7a None None] QuobyteHD.driver_use_ssl = None {{(pid=91233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:06 devstack cinder-volume[91233]: DEBUG oslo_service.backend._eventlet.service [None req-30ff7824-65c2-4a82-981e-07bbc18faa7a None None] QuobyteHD.enable_unsupported_driver = True {{(pid=91233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:06 devstack cinder-volume[91233]: DEBUG oslo_service.backend._eventlet.service [None req-30ff7824-65c2-4a82-981e-07bbc18faa7a None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=91233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:06 devstack cinder-volume[91233]: DEBUG oslo_service.backend._eventlet.service [None req-30ff7824-65c2-4a82-981e-07bbc18faa7a None None] QuobyteHD.extra_capabilities = None {{(pid=91233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:06 devstack cinder-volume[91233]: DEBUG oslo_service.backend._eventlet.service [None req-30ff7824-65c2-4a82-981e-07bbc18faa7a None None] QuobyteHD.filter_function = None {{(pid=91233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:06 devstack cinder-volume[91233]: DEBUG oslo_service.backend._eventlet.service [None req-30ff7824-65c2-4a82-981e-07bbc18faa7a None None] QuobyteHD.goodness_function = None {{(pid=91233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:06 devstack cinder-volume[91233]: DEBUG oslo_service.backend._eventlet.service [None req-30ff7824-65c2-4a82-981e-07bbc18faa7a None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=91233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:06 devstack cinder-volume[91233]: DEBUG oslo_service.backend._eventlet.service [None req-30ff7824-65c2-4a82-981e-07bbc18faa7a None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=91233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:06 devstack cinder-volume[91233]: DEBUG oslo_service.backend._eventlet.service [None req-30ff7824-65c2-4a82-981e-07bbc18faa7a None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=91233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:06 devstack cinder-volume[91233]: DEBUG oslo_service.backend._eventlet.service [None req-30ff7824-65c2-4a82-981e-07bbc18faa7a None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=91233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:06 devstack cinder-volume[91233]: DEBUG oslo_service.backend._eventlet.service [None req-30ff7824-65c2-4a82-981e-07bbc18faa7a None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=91233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:06 devstack cinder-volume[91233]: DEBUG oslo_service.backend._eventlet.service [None req-30ff7824-65c2-4a82-981e-07bbc18faa7a None None] QuobyteHD.iscsi_target_flags = None {{(pid=91233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:06 devstack cinder-volume[91233]: DEBUG oslo_service.backend._eventlet.service [None req-30ff7824-65c2-4a82-981e-07bbc18faa7a None None] QuobyteHD.iscsi_write_cache = None {{(pid=91233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:06 devstack cinder-volume[91233]: DEBUG oslo_service.backend._eventlet.service [None req-30ff7824-65c2-4a82-981e-07bbc18faa7a None None] QuobyteHD.iser_helper = None {{(pid=91233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:06 devstack cinder-volume[91233]: DEBUG oslo_service.backend._eventlet.service [None req-30ff7824-65c2-4a82-981e-07bbc18faa7a None None] QuobyteHD.iser_ip_address = None {{(pid=91233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:06 devstack cinder-volume[91233]: DEBUG oslo_service.backend._eventlet.service [None req-30ff7824-65c2-4a82-981e-07bbc18faa7a None None] QuobyteHD.iser_port = None {{(pid=91233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:06 devstack cinder-volume[91233]: DEBUG oslo_service.backend._eventlet.service [None req-30ff7824-65c2-4a82-981e-07bbc18faa7a None None] QuobyteHD.iser_target_prefix = None {{(pid=91233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:06 devstack cinder-volume[91233]: DEBUG oslo_service.backend._eventlet.service [None req-30ff7824-65c2-4a82-981e-07bbc18faa7a None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=91233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:06 devstack cinder-volume[91233]: DEBUG oslo_service.backend._eventlet.service [None req-30ff7824-65c2-4a82-981e-07bbc18faa7a None None] QuobyteHD.nas_host = None {{(pid=91233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:06 devstack cinder-volume[91233]: DEBUG oslo_service.backend._eventlet.service [None req-30ff7824-65c2-4a82-981e-07bbc18faa7a None None] QuobyteHD.nas_login = None {{(pid=91233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:06 devstack cinder-volume[91233]: DEBUG oslo_service.backend._eventlet.service [None req-30ff7824-65c2-4a82-981e-07bbc18faa7a None None] QuobyteHD.nas_mount_options = None {{(pid=91233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:06 devstack cinder-volume[91233]: DEBUG oslo_service.backend._eventlet.service [None req-30ff7824-65c2-4a82-981e-07bbc18faa7a None None] QuobyteHD.nas_password = **** {{(pid=91233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:06 devstack cinder-volume[91233]: DEBUG oslo_service.backend._eventlet.service [None req-30ff7824-65c2-4a82-981e-07bbc18faa7a None None] QuobyteHD.nas_private_key = None {{(pid=91233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:06 devstack cinder-volume[91233]: DEBUG oslo_service.backend._eventlet.service [None req-30ff7824-65c2-4a82-981e-07bbc18faa7a None None] QuobyteHD.nas_secure_file_operations = false {{(pid=91233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:06 devstack cinder-volume[91233]: DEBUG oslo_service.backend._eventlet.service [None req-30ff7824-65c2-4a82-981e-07bbc18faa7a None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=91233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:06 devstack cinder-volume[91233]: DEBUG oslo_service.backend._eventlet.service [None req-30ff7824-65c2-4a82-981e-07bbc18faa7a None None] QuobyteHD.nas_share_path = None {{(pid=91233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:06 devstack cinder-volume[91233]: DEBUG oslo_service.backend._eventlet.service [None req-30ff7824-65c2-4a82-981e-07bbc18faa7a None None] QuobyteHD.nas_ssh_port = None {{(pid=91233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:06 devstack cinder-volume[91233]: DEBUG oslo_service.backend._eventlet.service [None req-30ff7824-65c2-4a82-981e-07bbc18faa7a None None] QuobyteHD.nas_volume_prov_type = None {{(pid=91233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:06 devstack cinder-volume[91233]: DEBUG oslo_service.backend._eventlet.service [None req-30ff7824-65c2-4a82-981e-07bbc18faa7a None None] QuobyteHD.num_iser_scan_tries = None {{(pid=91233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:06 devstack cinder-volume[91233]: DEBUG oslo_service.backend._eventlet.service [None req-30ff7824-65c2-4a82-981e-07bbc18faa7a None None] QuobyteHD.num_shell_tries = None {{(pid=91233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:06 devstack cinder-volume[91233]: DEBUG oslo_service.backend._eventlet.service [None req-30ff7824-65c2-4a82-981e-07bbc18faa7a None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=91233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:06 devstack cinder-volume[91233]: DEBUG oslo_service.backend._eventlet.service [None req-30ff7824-65c2-4a82-981e-07bbc18faa7a None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=91233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:06 devstack cinder-volume[91233]: DEBUG oslo_service.backend._eventlet.service [None req-30ff7824-65c2-4a82-981e-07bbc18faa7a None None] QuobyteHD.nvmet_ns_id = None {{(pid=91233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:06 devstack cinder-volume[91233]: DEBUG oslo_service.backend._eventlet.service [None req-30ff7824-65c2-4a82-981e-07bbc18faa7a None None] QuobyteHD.nvmet_port_id = None {{(pid=91233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:06 devstack cinder-volume[91233]: DEBUG oslo_service.backend._eventlet.service [None req-30ff7824-65c2-4a82-981e-07bbc18faa7a None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=91233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:06 devstack cinder-volume[91233]: DEBUG oslo_service.backend._eventlet.service [None req-30ff7824-65c2-4a82-981e-07bbc18faa7a None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=91233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:06 devstack cinder-volume[91233]: DEBUG oslo_service.backend._eventlet.service [None req-30ff7824-65c2-4a82-981e-07bbc18faa7a None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=91233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:06 devstack cinder-volume[91233]: DEBUG oslo_service.backend._eventlet.service [None req-30ff7824-65c2-4a82-981e-07bbc18faa7a None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=91233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:06 devstack cinder-volume[91233]: DEBUG oslo_service.backend._eventlet.service [None req-30ff7824-65c2-4a82-981e-07bbc18faa7a None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=91233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:06 devstack cinder-volume[91233]: DEBUG oslo_service.backend._eventlet.service [None req-30ff7824-65c2-4a82-981e-07bbc18faa7a None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=91233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:06 devstack cinder-volume[91233]: DEBUG oslo_service.backend._eventlet.service [None req-30ff7824-65c2-4a82-981e-07bbc18faa7a None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588 {{(pid=91233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:06 devstack cinder-volume[91233]: DEBUG oslo_service.backend._eventlet.service [None req-30ff7824-65c2-4a82-981e-07bbc18faa7a None None] QuobyteHD.replication_device = **** {{(pid=91233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:06 devstack cinder-volume[91233]: DEBUG oslo_service.backend._eventlet.service [None req-30ff7824-65c2-4a82-981e-07bbc18faa7a None None] QuobyteHD.report_discard_supported = None {{(pid=91233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:06 devstack cinder-volume[91233]: DEBUG oslo_service.backend._eventlet.service [None req-30ff7824-65c2-4a82-981e-07bbc18faa7a None None] QuobyteHD.reserved_percentage = None {{(pid=91233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:06 devstack cinder-volume[91233]: DEBUG oslo_service.backend._eventlet.service [None req-30ff7824-65c2-4a82-981e-07bbc18faa7a None None] QuobyteHD.scst_target_driver = None {{(pid=91233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:06 devstack cinder-volume[91233]: DEBUG oslo_service.backend._eventlet.service [None req-30ff7824-65c2-4a82-981e-07bbc18faa7a None None] QuobyteHD.scst_target_iqn_name = None {{(pid=91233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:06 devstack cinder-volume[91233]: DEBUG oslo_service.backend._eventlet.service [None req-30ff7824-65c2-4a82-981e-07bbc18faa7a None None] QuobyteHD.storage_protocol = None {{(pid=91233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:06 devstack cinder-volume[91233]: DEBUG oslo_service.backend._eventlet.service [None req-30ff7824-65c2-4a82-981e-07bbc18faa7a None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=91233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:06 devstack cinder-volume[91233]: DEBUG oslo_service.backend._eventlet.service [None req-30ff7824-65c2-4a82-981e-07bbc18faa7a None None] QuobyteHD.target_helper = None {{(pid=91233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:06 devstack cinder-volume[91233]: DEBUG oslo_service.backend._eventlet.service [None req-30ff7824-65c2-4a82-981e-07bbc18faa7a None None] QuobyteHD.target_ip_address = None {{(pid=91233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:06 devstack cinder-volume[91233]: DEBUG oslo_service.backend._eventlet.service [None req-30ff7824-65c2-4a82-981e-07bbc18faa7a None None] QuobyteHD.target_port = None {{(pid=91233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:06 devstack cinder-volume[91233]: DEBUG oslo_service.backend._eventlet.service [None req-30ff7824-65c2-4a82-981e-07bbc18faa7a None None] QuobyteHD.target_prefix = None {{(pid=91233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:06 devstack cinder-volume[91233]: DEBUG oslo_service.backend._eventlet.service [None req-30ff7824-65c2-4a82-981e-07bbc18faa7a None None] QuobyteHD.target_protocol = None {{(pid=91233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:06 devstack cinder-volume[91233]: DEBUG oslo_service.backend._eventlet.service [None req-30ff7824-65c2-4a82-981e-07bbc18faa7a None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=91233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:06 devstack cinder-volume[91233]: DEBUG oslo_service.backend._eventlet.service [None req-30ff7824-65c2-4a82-981e-07bbc18faa7a None None] QuobyteHD.trace_flags = None {{(pid=91233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:06 devstack cinder-volume[91233]: DEBUG oslo_service.backend._eventlet.service [None req-30ff7824-65c2-4a82-981e-07bbc18faa7a None None] QuobyteHD.unique_fqdn_network = None {{(pid=91233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:06 devstack cinder-volume[91233]: DEBUG oslo_service.backend._eventlet.service [None req-30ff7824-65c2-4a82-981e-07bbc18faa7a None None] QuobyteHD.use_chap_auth = None {{(pid=91233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:06 devstack cinder-volume[91233]: DEBUG oslo_service.backend._eventlet.service [None req-30ff7824-65c2-4a82-981e-07bbc18faa7a None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=91233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:06 devstack cinder-volume[91233]: DEBUG oslo_service.backend._eventlet.service [None req-30ff7824-65c2-4a82-981e-07bbc18faa7a None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=91233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:06 devstack cinder-volume[91233]: DEBUG oslo_service.backend._eventlet.service [None req-30ff7824-65c2-4a82-981e-07bbc18faa7a None None] QuobyteHD.volume_clear = None {{(pid=91233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:06 devstack cinder-volume[91233]: DEBUG oslo_service.backend._eventlet.service [None req-30ff7824-65c2-4a82-981e-07bbc18faa7a None None] QuobyteHD.volume_clear_ionice = None {{(pid=91233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:06 devstack cinder-volume[91233]: DEBUG oslo_service.backend._eventlet.service [None req-30ff7824-65c2-4a82-981e-07bbc18faa7a None None] QuobyteHD.volume_clear_size = None {{(pid=91233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:06 devstack cinder-volume[91233]: DEBUG oslo_service.backend._eventlet.service [None req-30ff7824-65c2-4a82-981e-07bbc18faa7a None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=91233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:06 devstack cinder-volume[91233]: DEBUG oslo_service.backend._eventlet.service [None req-30ff7824-65c2-4a82-981e-07bbc18faa7a None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=91233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:06 devstack cinder-volume[91233]: DEBUG oslo_service.backend._eventlet.service [None req-30ff7824-65c2-4a82-981e-07bbc18faa7a None None] QuobyteHD.volume_dd_blocksize = None {{(pid=91233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:06 devstack cinder-volume[91233]: DEBUG oslo_service.backend._eventlet.service [None req-30ff7824-65c2-4a82-981e-07bbc18faa7a None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=91233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:06 devstack cinder-volume[91233]: DEBUG oslo_service.backend._eventlet.service [None req-30ff7824-65c2-4a82-981e-07bbc18faa7a None None] QuobyteHD.volumes_dir = None {{(pid=91233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:06 devstack cinder-volume[91233]: DEBUG oslo_service.backend._eventlet.service [None req-30ff7824-65c2-4a82-981e-07bbc18faa7a None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=91233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:06 devstack cinder-volume[91233]: DEBUG oslo_service.backend._eventlet.service [None req-30ff7824-65c2-4a82-981e-07bbc18faa7a None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=91233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:06 devstack cinder-volume[91233]: DEBUG oslo_service.backend._eventlet.service [None req-30ff7824-65c2-4a82-981e-07bbc18faa7a None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=91233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:06 devstack cinder-volume[91233]: DEBUG oslo_service.backend._eventlet.service [None req-30ff7824-65c2-4a82-981e-07bbc18faa7a None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=91233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:06 devstack cinder-volume[91233]: DEBUG oslo_service.backend._eventlet.service [None req-30ff7824-65c2-4a82-981e-07bbc18faa7a None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=91233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:06 devstack cinder-volume[91233]: DEBUG oslo_service.backend._eventlet.service [None req-30ff7824-65c2-4a82-981e-07bbc18faa7a None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=91233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:06 devstack cinder-volume[91233]: DEBUG oslo_service.backend._eventlet.service [None req-30ff7824-65c2-4a82-981e-07bbc18faa7a None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=91233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:06 devstack cinder-volume[91233]: DEBUG oslo_service.backend._eventlet.service [None req-30ff7824-65c2-4a82-981e-07bbc18faa7a None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=91233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:06 devstack cinder-volume[91233]: DEBUG oslo_service.backend._eventlet.service [None req-30ff7824-65c2-4a82-981e-07bbc18faa7a None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=91233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:06 devstack cinder-volume[91233]: DEBUG oslo_service.backend._eventlet.service [None req-30ff7824-65c2-4a82-981e-07bbc18faa7a None None] oslo_messaging_rabbit.hostname = devstack {{(pid=91233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:06 devstack cinder-volume[91233]: DEBUG oslo_service.backend._eventlet.service [None req-30ff7824-65c2-4a82-981e-07bbc18faa7a None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=91233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:06 devstack cinder-volume[91233]: DEBUG oslo_service.backend._eventlet.service [None req-30ff7824-65c2-4a82-981e-07bbc18faa7a None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=91233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:06 devstack cinder-volume[91233]: DEBUG oslo_service.backend._eventlet.service [None req-30ff7824-65c2-4a82-981e-07bbc18faa7a None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=91233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:06 devstack cinder-volume[91233]: DEBUG oslo_service.backend._eventlet.service [None req-30ff7824-65c2-4a82-981e-07bbc18faa7a None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=91233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:06 devstack cinder-volume[91233]: DEBUG oslo_service.backend._eventlet.service [None req-30ff7824-65c2-4a82-981e-07bbc18faa7a None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=91233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:06 devstack cinder-volume[91233]: DEBUG oslo_service.backend._eventlet.service [None req-30ff7824-65c2-4a82-981e-07bbc18faa7a None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=91233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:06 devstack cinder-volume[91233]: DEBUG oslo_service.backend._eventlet.service [None req-30ff7824-65c2-4a82-981e-07bbc18faa7a None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=91233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:06 devstack cinder-volume[91233]: DEBUG oslo_service.backend._eventlet.service [None req-30ff7824-65c2-4a82-981e-07bbc18faa7a None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=91233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:06 devstack cinder-volume[91233]: DEBUG oslo_service.backend._eventlet.service [None req-30ff7824-65c2-4a82-981e-07bbc18faa7a None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=91233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:06 devstack cinder-volume[91233]: DEBUG oslo_service.backend._eventlet.service [None req-30ff7824-65c2-4a82-981e-07bbc18faa7a None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=91233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:06 devstack cinder-volume[91233]: DEBUG oslo_service.backend._eventlet.service [None req-30ff7824-65c2-4a82-981e-07bbc18faa7a None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=91233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:06 devstack cinder-volume[91233]: DEBUG oslo_service.backend._eventlet.service [None req-30ff7824-65c2-4a82-981e-07bbc18faa7a None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=91233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:06 devstack cinder-volume[91233]: DEBUG oslo_service.backend._eventlet.service [None req-30ff7824-65c2-4a82-981e-07bbc18faa7a None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=91233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:06 devstack cinder-volume[91233]: DEBUG oslo_service.backend._eventlet.service [None req-30ff7824-65c2-4a82-981e-07bbc18faa7a None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=91233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:06 devstack cinder-volume[91233]: DEBUG oslo_service.backend._eventlet.service [None req-30ff7824-65c2-4a82-981e-07bbc18faa7a None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=91233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:06 devstack cinder-volume[91233]: DEBUG oslo_service.backend._eventlet.service [None req-30ff7824-65c2-4a82-981e-07bbc18faa7a None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=91233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:06 devstack cinder-volume[91233]: DEBUG oslo_service.backend._eventlet.service [None req-30ff7824-65c2-4a82-981e-07bbc18faa7a None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=91233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:06 devstack cinder-volume[91233]: DEBUG oslo_service.backend._eventlet.service [None req-30ff7824-65c2-4a82-981e-07bbc18faa7a None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=91233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:06 devstack cinder-volume[91233]: DEBUG oslo_service.backend._eventlet.service [None req-30ff7824-65c2-4a82-981e-07bbc18faa7a None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=91233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:06 devstack cinder-volume[91233]: DEBUG oslo_service.backend._eventlet.service [None req-30ff7824-65c2-4a82-981e-07bbc18faa7a None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=91233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:06 devstack cinder-volume[91233]: DEBUG oslo_service.backend._eventlet.service [None req-30ff7824-65c2-4a82-981e-07bbc18faa7a None None] oslo_messaging_rabbit.ssl = False {{(pid=91233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:06 devstack cinder-volume[91233]: DEBUG oslo_service.backend._eventlet.service [None req-30ff7824-65c2-4a82-981e-07bbc18faa7a None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=91233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:06 devstack cinder-volume[91233]: DEBUG oslo_service.backend._eventlet.service [None req-30ff7824-65c2-4a82-981e-07bbc18faa7a None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=91233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:06 devstack cinder-volume[91233]: DEBUG oslo_service.backend._eventlet.service [None req-30ff7824-65c2-4a82-981e-07bbc18faa7a None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=91233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:06 devstack cinder-volume[91233]: DEBUG oslo_service.backend._eventlet.service [None req-30ff7824-65c2-4a82-981e-07bbc18faa7a None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=91233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:06 devstack cinder-volume[91233]: DEBUG oslo_service.backend._eventlet.service [None req-30ff7824-65c2-4a82-981e-07bbc18faa7a None None] oslo_messaging_rabbit.ssl_version = {{(pid=91233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:06 devstack cinder-volume[91233]: DEBUG oslo_service.backend._eventlet.service [None req-30ff7824-65c2-4a82-981e-07bbc18faa7a None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=91233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:06 devstack cinder-volume[91233]: DEBUG oslo_service.backend._eventlet.service [None req-30ff7824-65c2-4a82-981e-07bbc18faa7a None None] oslo_messaging_notifications.driver = [] {{(pid=91233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:06 devstack cinder-volume[91233]: DEBUG oslo_service.backend._eventlet.service [None req-30ff7824-65c2-4a82-981e-07bbc18faa7a None None] oslo_messaging_notifications.retry = -1 {{(pid=91233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:06 devstack cinder-volume[91233]: DEBUG oslo_service.backend._eventlet.service [None req-30ff7824-65c2-4a82-981e-07bbc18faa7a None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=91233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:06 devstack cinder-volume[91233]: DEBUG oslo_service.backend._eventlet.service [None req-30ff7824-65c2-4a82-981e-07bbc18faa7a None None] oslo_messaging_notifications.transport_url = **** {{(pid=91233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:06 devstack cinder-volume[91233]: DEBUG oslo_service.backend._eventlet.service [None req-30ff7824-65c2-4a82-981e-07bbc18faa7a None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=91233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:06 devstack cinder-volume[91233]: DEBUG oslo_service.backend._eventlet.service [None req-30ff7824-65c2-4a82-981e-07bbc18faa7a None None] key_manager.fixed_key = **** {{(pid=91233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:06 devstack cinder-volume[91233]: DEBUG oslo_service.backend._eventlet.service [None req-30ff7824-65c2-4a82-981e-07bbc18faa7a None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=91233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:06 devstack cinder-volume[91233]: DEBUG oslo_service.backend._eventlet.service [None req-30ff7824-65c2-4a82-981e-07bbc18faa7a None None] barbican.barbican_api_version = None {{(pid=91233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:06 devstack cinder-volume[91233]: DEBUG oslo_service.backend._eventlet.service [None req-30ff7824-65c2-4a82-981e-07bbc18faa7a None None] barbican.barbican_endpoint = None {{(pid=91233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:06 devstack cinder-volume[91233]: DEBUG oslo_service.backend._eventlet.service [None req-30ff7824-65c2-4a82-981e-07bbc18faa7a None None] barbican.barbican_endpoint_type = public {{(pid=91233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:06 devstack cinder-volume[91233]: DEBUG oslo_service.backend._eventlet.service [None req-30ff7824-65c2-4a82-981e-07bbc18faa7a None None] barbican.barbican_region_name = None {{(pid=91233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:06 devstack cinder-volume[91233]: DEBUG oslo_service.backend._eventlet.service [None req-30ff7824-65c2-4a82-981e-07bbc18faa7a None None] barbican.cafile = None {{(pid=91233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:06 devstack cinder-volume[91233]: DEBUG oslo_service.backend._eventlet.service [None req-30ff7824-65c2-4a82-981e-07bbc18faa7a None None] barbican.certfile = None {{(pid=91233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:06 devstack cinder-volume[91233]: DEBUG oslo_service.backend._eventlet.service [None req-30ff7824-65c2-4a82-981e-07bbc18faa7a None None] barbican.collect_timing = False {{(pid=91233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:06 devstack cinder-volume[91233]: DEBUG oslo_service.backend._eventlet.service [None req-30ff7824-65c2-4a82-981e-07bbc18faa7a None None] barbican.insecure = False {{(pid=91233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:06 devstack cinder-volume[91233]: DEBUG oslo_service.backend._eventlet.service [None req-30ff7824-65c2-4a82-981e-07bbc18faa7a None None] barbican.keyfile = None {{(pid=91233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:06 devstack cinder-volume[91233]: DEBUG oslo_service.backend._eventlet.service [None req-30ff7824-65c2-4a82-981e-07bbc18faa7a None None] barbican.number_of_retries = 60 {{(pid=91233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:06 devstack cinder-volume[91233]: DEBUG oslo_service.backend._eventlet.service [None req-30ff7824-65c2-4a82-981e-07bbc18faa7a None None] barbican.retry_delay = 1 {{(pid=91233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:06 devstack cinder-volume[91233]: DEBUG oslo_service.backend._eventlet.service [None req-30ff7824-65c2-4a82-981e-07bbc18faa7a None None] barbican.send_service_user_token = False {{(pid=91233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:06 devstack cinder-volume[91233]: DEBUG oslo_service.backend._eventlet.service [None req-30ff7824-65c2-4a82-981e-07bbc18faa7a None None] barbican.split_loggers = False {{(pid=91233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:06 devstack cinder-volume[91233]: DEBUG oslo_service.backend._eventlet.service [None req-30ff7824-65c2-4a82-981e-07bbc18faa7a None None] barbican.timeout = None {{(pid=91233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:06 devstack cinder-volume[91233]: DEBUG oslo_service.backend._eventlet.service [None req-30ff7824-65c2-4a82-981e-07bbc18faa7a None None] barbican.verify_ssl = True {{(pid=91233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:06 devstack cinder-volume[91233]: DEBUG oslo_service.backend._eventlet.service [None req-30ff7824-65c2-4a82-981e-07bbc18faa7a None None] barbican.verify_ssl_path = None {{(pid=91233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:06 devstack cinder-volume[91233]: DEBUG oslo_service.backend._eventlet.service [None req-30ff7824-65c2-4a82-981e-07bbc18faa7a None None] barbican_service_user.auth_section = None {{(pid=91233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:06 devstack cinder-volume[91233]: DEBUG oslo_service.backend._eventlet.service [None req-30ff7824-65c2-4a82-981e-07bbc18faa7a None None] barbican_service_user.auth_type = None {{(pid=91233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:06 devstack cinder-volume[91233]: DEBUG oslo_service.backend._eventlet.service [None req-30ff7824-65c2-4a82-981e-07bbc18faa7a None None] barbican_service_user.cafile = None {{(pid=91233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:06 devstack cinder-volume[91233]: DEBUG oslo_service.backend._eventlet.service [None req-30ff7824-65c2-4a82-981e-07bbc18faa7a None None] barbican_service_user.certfile = None {{(pid=91233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:06 devstack cinder-volume[91233]: DEBUG oslo_service.backend._eventlet.service [None req-30ff7824-65c2-4a82-981e-07bbc18faa7a None None] barbican_service_user.collect_timing = False {{(pid=91233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:06 devstack cinder-volume[91233]: DEBUG oslo_service.backend._eventlet.service [None req-30ff7824-65c2-4a82-981e-07bbc18faa7a None None] barbican_service_user.insecure = False {{(pid=91233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:06 devstack cinder-volume[91233]: DEBUG oslo_service.backend._eventlet.service [None req-30ff7824-65c2-4a82-981e-07bbc18faa7a None None] barbican_service_user.keyfile = None {{(pid=91233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:06 devstack cinder-volume[91233]: DEBUG oslo_service.backend._eventlet.service [None req-30ff7824-65c2-4a82-981e-07bbc18faa7a None None] barbican_service_user.split_loggers = False {{(pid=91233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:06 devstack cinder-volume[91233]: DEBUG oslo_service.backend._eventlet.service [None req-30ff7824-65c2-4a82-981e-07bbc18faa7a None None] barbican_service_user.timeout = None {{(pid=91233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:06 devstack cinder-volume[91233]: DEBUG oslo_service.backend._eventlet.service [None req-30ff7824-65c2-4a82-981e-07bbc18faa7a None None] vault.approle_role_id = **** {{(pid=91233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:06 devstack cinder-volume[91233]: DEBUG oslo_service.backend._eventlet.service [None req-30ff7824-65c2-4a82-981e-07bbc18faa7a None None] vault.approle_secret_id = **** {{(pid=91233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:06 devstack cinder-volume[91233]: DEBUG oslo_service.backend._eventlet.service [None req-30ff7824-65c2-4a82-981e-07bbc18faa7a None None] vault.kv_mountpoint = secret {{(pid=91233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:06 devstack cinder-volume[91233]: DEBUG oslo_service.backend._eventlet.service [None req-30ff7824-65c2-4a82-981e-07bbc18faa7a None None] vault.kv_path = None {{(pid=91233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:06 devstack cinder-volume[91233]: DEBUG oslo_service.backend._eventlet.service [None req-30ff7824-65c2-4a82-981e-07bbc18faa7a None None] vault.kv_version = 2 {{(pid=91233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:06 devstack cinder-volume[91233]: DEBUG oslo_service.backend._eventlet.service [None req-30ff7824-65c2-4a82-981e-07bbc18faa7a None None] vault.namespace = None {{(pid=91233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:06 devstack cinder-volume[91233]: DEBUG oslo_service.backend._eventlet.service [None req-30ff7824-65c2-4a82-981e-07bbc18faa7a None None] vault.root_token_id = **** {{(pid=91233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:06 devstack cinder-volume[91233]: DEBUG oslo_service.backend._eventlet.service [None req-30ff7824-65c2-4a82-981e-07bbc18faa7a None None] vault.ssl_ca_crt_file = None {{(pid=91233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:06 devstack cinder-volume[91233]: DEBUG oslo_service.backend._eventlet.service [None req-30ff7824-65c2-4a82-981e-07bbc18faa7a None None] vault.timeout = 60.0 {{(pid=91233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:06 devstack cinder-volume[91233]: DEBUG oslo_service.backend._eventlet.service [None req-30ff7824-65c2-4a82-981e-07bbc18faa7a None None] vault.use_ssl = False {{(pid=91233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:06 devstack cinder-volume[91233]: DEBUG oslo_service.backend._eventlet.service [None req-30ff7824-65c2-4a82-981e-07bbc18faa7a None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=91233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:06 devstack cinder-volume[91233]: DEBUG oslo_service.backend._eventlet.service [None req-30ff7824-65c2-4a82-981e-07bbc18faa7a None None] ******************************************************************************** {{(pid=91233) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3013}} Jun 17 04:34:07 devstack sudo[91450]: pam_unix(sudo:session): session closed for user root Jun 17 04:34:07 devstack cinder-volume[91369]: DEBUG oslo_concurrency.processutils [None req-29357396-8c95-483b-87bf-705f38b47246 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a -c /etc/quobyte/client-cinder.cfg" returned: 0 in 0.856s {{(pid=91369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:34:07 devstack cinder-volume[91369]: INFO cinder.volume.drivers.quobyte [None req-29357396-8c95-483b-87bf-705f38b47246 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588 succeeded Jun 17 04:34:07 devstack cinder-volume[91369]: DEBUG cinder.volume.drivers.quobyte [None req-29357396-8c95-483b-87bf-705f38b47246 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588'] {{(pid=91369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 17 04:34:07 devstack cinder-volume[91369]: DEBUG oslo_concurrency.lockutils [None req-29357396-8c95-483b-87bf-705f38b47246 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.867s {{(pid=91369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 04:34:07 devstack cinder-volume[91369]: DEBUG oslo_concurrency.processutils [None req-29357396-8c95-483b-87bf-705f38b47246 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a {{(pid=91369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:34:07 devstack sudo[91529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a Jun 17 04:34:07 devstack sudo[91529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:34:07 devstack sudo[91529]: pam_unix(sudo:session): session closed for user root Jun 17 04:34:07 devstack cinder-volume[91369]: DEBUG oslo_concurrency.processutils [None req-29357396-8c95-483b-87bf-705f38b47246 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a" returned: 0 in 0.623s {{(pid=91369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:34:07 devstack cinder-volume[91369]: INFO cinder.volume.driver [None req-29357396-8c95-483b-87bf-705f38b47246 None None] Driver hasn't implemented _init_vendor_properties() Jun 17 04:34:07 devstack cinder-volume[91369]: DEBUG cinder.volume.driver [None req-29357396-8c95-483b-87bf-705f38b47246 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7578468322754, 'free_capacity_gb': 1775.7578468322754, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=91369) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Jun 17 04:34:07 devstack cinder-volume[91369]: DEBUG oslo_db.sqlalchemy.engines [None req-29357396-8c95-483b-87bf-705f38b47246 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=91369) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jun 17 04:34:07 devstack cinder-volume[91369]: DEBUG dbcounter [-] [91369] Writer thread running {{(pid=91369) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jun 17 04:34:07 devstack cinder-volume[91369]: DEBUG cinder.db.sqlalchemy.api [None req-29357396-8c95-483b-87bf-705f38b47246 None None] Building query based on filter {{(pid=91369) _process_snaps_filters /opt/stack/cinder/cinder/db/sqlalchemy/api.py:3979}} Jun 17 04:34:07 devstack cinder-volume[91369]: DEBUG cinder.image.image_utils [None req-29357396-8c95-483b-87bf-705f38b47246 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=91369) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Jun 17 04:34:07 devstack cinder-volume[91369]: INFO cinder.keymgr.migration [None req-1c1580db-cce9-4bff-8ef4-07e1010b3748 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Jun 17 04:34:07 devstack cinder-volume[91369]: DEBUG oslo_concurrency.lockutils [None req-29357396-8c95-483b-87bf-705f38b47246 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 04:34:07 devstack cinder-volume[91369]: DEBUG oslo_concurrency.lockutils [None req-29357396-8c95-483b-87bf-705f38b47246 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 04:34:07 devstack cinder-volume[91369]: DEBUG cinder.volume.drivers.quobyte [None req-29357396-8c95-483b-87bf-705f38b47246 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588': None} {{(pid=91369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 17 04:34:07 devstack cinder-volume[91369]: DEBUG cinder.volume.drivers.quobyte [None req-29357396-8c95-483b-87bf-705f38b47246 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588'] {{(pid=91369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 17 04:34:07 devstack cinder-volume[91369]: DEBUG oslo_concurrency.lockutils [None req-29357396-8c95-483b-87bf-705f38b47246 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=91369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 04:34:07 devstack cinder-volume[91369]: DEBUG oslo_concurrency.processutils [None req-29357396-8c95-483b-87bf-705f38b47246 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a {{(pid=91369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:34:07 devstack sudo[91534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a Jun 17 04:34:07 devstack sudo[91534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:34:08 devstack sudo[91534]: pam_unix(sudo:session): session closed for user root Jun 17 04:34:08 devstack cinder-volume[91369]: DEBUG oslo_concurrency.processutils [None req-29357396-8c95-483b-87bf-705f38b47246 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a" returned: 0 in 0.605s {{(pid=91369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:34:08 devstack cinder-volume[91369]: DEBUG cinder.manager [None req-29357396-8c95-483b-87bf-705f38b47246 None None] Notifying Schedulers of capabilities ... {{(pid=91369) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 17 04:34:08 devstack cinder-volume[91369]: INFO cinder.volume.manager [None req-29357396-8c95-483b-87bf-705f38b47246 None None] Driver initialization completed successfully. Jun 17 04:34:08 devstack cinder-volume[91369]: INFO cinder.manager [None req-29357396-8c95-483b-87bf-705f38b47246 None None] Initiating service 3 cleanup Jun 17 04:34:08 devstack cinder-volume[91369]: INFO cinder.manager [None req-29357396-8c95-483b-87bf-705f38b47246 None None] Service 3 cleanup completed. Jun 17 04:34:08 devstack cinder-volume[91369]: DEBUG cinder.service [None req-29357396-8c95-483b-87bf-705f38b47246 None None] Creating RPC server for service cinder-volume {{(pid=91369) start /opt/stack/cinder/cinder/service.py:231}} Jun 17 04:34:08 devstack cinder-volume[91369]: DEBUG cinder.service [None req-29357396-8c95-483b-87bf-705f38b47246 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=91369) start /opt/stack/cinder/cinder/service.py:237}} Jun 17 04:34:08 devstack cinder-volume[91369]: INFO cinder.volume.manager [None req-29357396-8c95-483b-87bf-705f38b47246 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.1.14) Jun 17 04:34:08 devstack cinder-volume[91369]: DEBUG oslo_concurrency.lockutils [None req-29357396-8c95-483b-87bf-705f38b47246 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 04:34:08 devstack cinder-volume[91369]: DEBUG oslo_concurrency.lockutils [None req-29357396-8c95-483b-87bf-705f38b47246 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=91369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 04:34:08 devstack cinder-volume[91369]: DEBUG cinder.volume.drivers.quobyte [None req-29357396-8c95-483b-87bf-705f38b47246 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588': None} {{(pid=91369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 17 04:34:08 devstack cinder-volume[91369]: DEBUG cinder.volume.drivers.quobyte [None req-29357396-8c95-483b-87bf-705f38b47246 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588'] {{(pid=91369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 17 04:34:08 devstack cinder-volume[91369]: DEBUG oslo_concurrency.lockutils [None req-29357396-8c95-483b-87bf-705f38b47246 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=91369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 04:34:08 devstack cinder-volume[91369]: DEBUG oslo_concurrency.processutils [None req-29357396-8c95-483b-87bf-705f38b47246 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a {{(pid=91369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:34:08 devstack sudo[91574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a Jun 17 04:34:08 devstack sudo[91574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:34:09 devstack sudo[91574]: pam_unix(sudo:session): session closed for user root Jun 17 04:34:09 devstack cinder-volume[91369]: DEBUG oslo_concurrency.processutils [None req-29357396-8c95-483b-87bf-705f38b47246 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a" returned: 0 in 0.767s {{(pid=91369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:34:09 devstack cinder-volume[91369]: INFO cinder.volume.manager [None req-29357396-8c95-483b-87bf-705f38b47246 None None] Driver post RPC initialization completed successfully. Jun 17 04:34:13 devstack cinder-volume[91369]: DEBUG oslo_concurrency.lockutils [None req-eb52459a-3d97-4bba-8c61-f56034e8996a None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=91369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 04:34:13 devstack cinder-volume[91369]: DEBUG oslo_concurrency.lockutils [None req-eb52459a-3d97-4bba-8c61-f56034e8996a None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=91369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 04:34:13 devstack cinder-volume[91369]: DEBUG cinder.volume.drivers.quobyte [None req-eb52459a-3d97-4bba-8c61-f56034e8996a None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588': None} {{(pid=91369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 17 04:34:13 devstack cinder-volume[91369]: DEBUG cinder.volume.drivers.quobyte [None req-eb52459a-3d97-4bba-8c61-f56034e8996a None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588'] {{(pid=91369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 17 04:34:13 devstack cinder-volume[91369]: DEBUG oslo_concurrency.lockutils [None req-eb52459a-3d97-4bba-8c61-f56034e8996a None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=91369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 04:34:13 devstack cinder-volume[91369]: DEBUG oslo_concurrency.processutils [None req-eb52459a-3d97-4bba-8c61-f56034e8996a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a {{(pid=91369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:34:13 devstack sudo[91693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a Jun 17 04:34:13 devstack sudo[91693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:34:13 devstack cinder-volume[91369]: DEBUG oslo_service.periodic_task [None req-244f87d2-1f5f-4b82-9a2c-3aea7a271a3f None None] Running periodic task VolumeManager._thread_info {{(pid=91369) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 17 04:34:13 devstack cinder-volume[91369]: DEBUG cinder.volume.manager [None req-244f87d2-1f5f-4b82-9a2c-3aea7a271a3f None None] thread count: 6 {{(pid=91369) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 17 04:34:13 devstack cinder-volume[91369]: DEBUG cinder.volume.manager [None req-244f87d2-1f5f-4b82-9a2c-3aea7a271a3f None None] thread info: [<_MainThread(MainThread, started 124974190583936)>, , , , , ] {{(pid=91369) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 17 04:34:13 devstack sudo[91693]: pam_unix(sudo:session): session closed for user root Jun 17 04:34:13 devstack cinder-volume[91369]: DEBUG oslo_concurrency.processutils [None req-eb52459a-3d97-4bba-8c61-f56034e8996a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a" returned: 0 in 0.579s {{(pid=91369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:34:13 devstack cinder-volume[91369]: DEBUG cinder.manager [None req-eb52459a-3d97-4bba-8c61-f56034e8996a None None] Notifying Schedulers of capabilities ... {{(pid=91369) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 17 04:34:15 devstack cinder-volume[91233]: DEBUG dbcounter [-] [91233] Writing DB stats cinder:SELECT=6,cinder:INSERT=1,cinder:UPDATE=2 {{(pid=91233) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 17 04:34:17 devstack cinder-volume[91233]: INFO oslo_service.backend._eventlet.service [None req-30ff7824-65c2-4a82-981e-07bbc18faa7a None None] Caught SIGTERM, stopping children Jun 17 04:34:17 devstack cinder-volume[91233]: DEBUG oslo_concurrency.lockutils [None req-30ff7824-65c2-4a82-981e-07bbc18faa7a None None] Acquiring lock "singleton_lock" {{(pid=91233) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}} Jun 17 04:34:17 devstack cinder-volume[91233]: DEBUG oslo_concurrency.lockutils [None req-30ff7824-65c2-4a82-981e-07bbc18faa7a None None] Acquired lock "singleton_lock" {{(pid=91233) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}} Jun 17 04:34:17 devstack cinder-volume[91233]: DEBUG oslo_concurrency.lockutils [None req-30ff7824-65c2-4a82-981e-07bbc18faa7a None None] Releasing lock "singleton_lock" {{(pid=91233) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}} Jun 17 04:34:17 devstack cinder-volume[91233]: DEBUG oslo_service.backend._eventlet.service [None req-30ff7824-65c2-4a82-981e-07bbc18faa7a None None] Stop services. {{(pid=91233) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Jun 17 04:34:17 devstack cinder-volume[91233]: DEBUG oslo_service.backend._eventlet.service [None req-30ff7824-65c2-4a82-981e-07bbc18faa7a None None] Killing children. {{(pid=91233) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Jun 17 04:34:17 devstack cinder-volume[91233]: INFO oslo_service.backend._eventlet.service [None req-30ff7824-65c2-4a82-981e-07bbc18faa7a None None] Waiting on 1 children to exit Jun 17 04:34:19 devstack cinder-volume[91369]: DEBUG dbcounter [-] [91369] Writing DB stats cinder:SELECT=3 {{(pid=91369) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 17 04:34:19 devstack cinder-volume[91369]: DEBUG dbcounter [-] [91369] Writing DB stats cinder:SELECT=9,cinder:INSERT=1,cinder:UPDATE=3 {{(pid=91369) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 17 04:34:21 devstack cinder-volume[91369]: DEBUG oslo_concurrency.lockutils [None req-30ff7824-65c2-4a82-981e-07bbc18faa7a None None] Acquiring lock "singleton_lock" {{(pid=91369) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}} Jun 17 04:34:21 devstack cinder-volume[91369]: DEBUG oslo_concurrency.lockutils [None req-30ff7824-65c2-4a82-981e-07bbc18faa7a None None] Acquired lock "singleton_lock" {{(pid=91369) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}} Jun 17 04:34:21 devstack cinder-volume[91369]: DEBUG oslo_concurrency.lockutils [None req-30ff7824-65c2-4a82-981e-07bbc18faa7a None None] Releasing lock "singleton_lock" {{(pid=91369) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}} Jun 17 04:34:21 devstack cinder-volume[91369]: WARNING amqp [None req-30ff7824-65c2-4a82-981e-07bbc18faa7a None None] Received method (60, 30) during closing channel 1. This method will be ignored Jun 17 04:34:21 devstack cinder-volume[91369]: WARNING amqp [None req-30ff7824-65c2-4a82-981e-07bbc18faa7a None None] Received method (60, 30) during closing channel 1. This method will be ignored Jun 17 04:34:21 devstack cinder-volume[91233]: INFO oslo_service.backend._eventlet.service [None req-30ff7824-65c2-4a82-981e-07bbc18faa7a None None] Child 91369 exited with status 0 Jun 17 04:34:24 devstack cinder-volume[91786]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=91786) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}} Jun 17 04:34:24 devstack cinder-volume[91786]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=91786) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}} Jun 17 04:34:24 devstack cinder-volume[91786]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=91786) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}} Jun 17 04:34:25 devstack cinder-volume[91786]: INFO dbcounter [None req-11315ded-d4a8-4268-a61d-0d56934e6b85 None None] Registered counter for database cinder Jun 17 04:34:25 devstack cinder-volume[91786]: DEBUG oslo_db.sqlalchemy.engines [None req-11315ded-d4a8-4268-a61d-0d56934e6b85 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=91786) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jun 17 04:34:25 devstack cinder-volume[91786]: DEBUG dbcounter [-] [91786] Writer thread running {{(pid=91786) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jun 17 04:34:25 devstack cinder-volume[91786]: INFO cinder.rpc [None req-11315ded-d4a8-4268-a61d-0d56934e6b85 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Jun 17 04:34:25 devstack cinder-volume[91786]: INFO cinder.rpc [None req-11315ded-d4a8-4268-a61d-0d56934e6b85 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Jun 17 04:34:25 devstack cinder-volume[91786]: DEBUG oslo_db.sqlalchemy.engines [None req-11315ded-d4a8-4268-a61d-0d56934e6b85 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=91786) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jun 17 04:34:25 devstack cinder-volume[91786]: INFO cinder.volume.manager [None req-11315ded-d4a8-4268-a61d-0d56934e6b85 None None] Determined volume DB was empty at startup. Jun 17 04:34:25 devstack cinder-volume[91786]: DEBUG cinder.volume.manager [None req-11315ded-d4a8-4268-a61d-0d56934e6b85 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=91786) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Jun 17 04:34:25 devstack cinder-volume[91786]: WARNING stevedore.named [None req-11315ded-d4a8-4268-a61d-0d56934e6b85 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jun 17 04:34:25 devstack cinder-volume[91786]: WARNING castellan.key_manager [None req-11315ded-d4a8-4268-a61d-0d56934e6b85 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jun 17 04:34:25 devstack cinder-volume[91786]: WARNING cinder.keymgr.conf_key_mgr [None req-11315ded-d4a8-4268-a61d-0d56934e6b85 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jun 17 04:34:25 devstack cinder-volume[91786]: INFO cinder.volume.manager [None req-11315ded-d4a8-4268-a61d-0d56934e6b85 None None] Image-volume cache disabled for host devstack@QuobyteHD. Jun 17 04:34:25 devstack cinder-volume[91786]: DEBUG oslo_db.sqlalchemy.engines [None req-11315ded-d4a8-4268-a61d-0d56934e6b85 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=91786) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jun 17 04:34:25 devstack cinder-volume[91786]: INFO oslo_service.backend._eventlet.service [None req-11315ded-d4a8-4268-a61d-0d56934e6b85 None None] Starting 1 workers Jun 17 04:34:25 devstack cinder-volume[91786]: DEBUG oslo_service.backend._eventlet.service [None req-11315ded-d4a8-4268-a61d-0d56934e6b85 None None] Started child 92060 {{(pid=91786) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Jun 17 04:34:25 devstack cinder-volume[91786]: DEBUG oslo_service.backend._eventlet.service [None req-11315ded-d4a8-4268-a61d-0d56934e6b85 None None] Full set of CONF: {{(pid=91786) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Jun 17 04:34:25 devstack cinder-volume[91786]: DEBUG oslo_service.backend._eventlet.service [None req-11315ded-d4a8-4268-a61d-0d56934e6b85 None None] ******************************************************************************** {{(pid=91786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2979}} Jun 17 04:34:25 devstack cinder-volume[91786]: DEBUG oslo_service.backend._eventlet.service [None req-11315ded-d4a8-4268-a61d-0d56934e6b85 None None] Configuration options gathered from: {{(pid=91786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2980}} Jun 17 04:34:25 devstack cinder-volume[91786]: DEBUG oslo_service.backend._eventlet.service [None req-11315ded-d4a8-4268-a61d-0d56934e6b85 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=91786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2981}} Jun 17 04:34:25 devstack cinder-volume[91786]: DEBUG oslo_service.backend._eventlet.service [None req-11315ded-d4a8-4268-a61d-0d56934e6b85 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=91786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2982}} Jun 17 04:34:25 devstack cinder-volume[91786]: DEBUG oslo_service.backend._eventlet.service [None req-11315ded-d4a8-4268-a61d-0d56934e6b85 None None] ================================================================================ {{(pid=91786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2987}} Jun 17 04:34:25 devstack cinder-volume[91786]: DEBUG oslo_service.backend._eventlet.service [None req-11315ded-d4a8-4268-a61d-0d56934e6b85 None None] allow_availability_zone_fallback = False {{(pid=91786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 04:34:25 devstack cinder-volume[91786]: DEBUG oslo_service.backend._eventlet.service [None req-11315ded-d4a8-4268-a61d-0d56934e6b85 None None] allow_compression_on_image_upload = False {{(pid=91786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 04:34:25 devstack cinder-volume[91786]: DEBUG oslo_service.backend._eventlet.service [None req-11315ded-d4a8-4268-a61d-0d56934e6b85 None None] allowed_direct_url_schemes = [] {{(pid=91786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 04:34:25 devstack cinder-volume[91786]: DEBUG oslo_service.backend._eventlet.service [None req-11315ded-d4a8-4268-a61d-0d56934e6b85 None None] api_rate_limit = True {{(pid=91786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 04:34:25 devstack cinder-volume[91786]: DEBUG oslo_service.backend._eventlet.service [None req-11315ded-d4a8-4268-a61d-0d56934e6b85 None None] auth_strategy = keystone {{(pid=91786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 04:34:25 devstack cinder-volume[91786]: DEBUG oslo_service.backend._eventlet.service [None req-11315ded-d4a8-4268-a61d-0d56934e6b85 None None] backend_availability_zone = None {{(pid=91786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 04:34:25 devstack cinder-volume[91786]: DEBUG oslo_service.backend._eventlet.service [None req-11315ded-d4a8-4268-a61d-0d56934e6b85 None None] backend_host = None {{(pid=91786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 04:34:25 devstack cinder-volume[91786]: DEBUG oslo_service.backend._eventlet.service [None req-11315ded-d4a8-4268-a61d-0d56934e6b85 None None] backend_name = None {{(pid=91786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 04:34:25 devstack cinder-volume[91786]: DEBUG oslo_service.backend._eventlet.service [None req-11315ded-d4a8-4268-a61d-0d56934e6b85 None None] backend_stats_polling_interval = 60 {{(pid=91786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 04:34:25 devstack cinder-volume[91786]: DEBUG oslo_service.backend._eventlet.service [None req-11315ded-d4a8-4268-a61d-0d56934e6b85 None None] backup_api_class = cinder.backup.api.API {{(pid=91786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 04:34:25 devstack cinder-volume[91786]: DEBUG oslo_service.backend._eventlet.service [None req-11315ded-d4a8-4268-a61d-0d56934e6b85 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=91786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 04:34:25 devstack cinder-volume[91786]: DEBUG oslo_service.backend._eventlet.service [None req-11315ded-d4a8-4268-a61d-0d56934e6b85 None None] backup_name_template = backup-%s {{(pid=91786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 04:34:25 devstack cinder-volume[91786]: DEBUG oslo_service.backend._eventlet.service [None req-11315ded-d4a8-4268-a61d-0d56934e6b85 None None] backup_use_same_host = False {{(pid=91786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 04:34:25 devstack cinder-volume[91786]: DEBUG oslo_service.backend._eventlet.service [None req-11315ded-d4a8-4268-a61d-0d56934e6b85 None None] backup_use_temp_snapshot = False {{(pid=91786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 04:34:25 devstack cinder-volume[91786]: DEBUG oslo_service.backend._eventlet.service [None req-11315ded-d4a8-4268-a61d-0d56934e6b85 None None] chap_password = **** {{(pid=91786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 04:34:25 devstack cinder-volume[91786]: DEBUG oslo_service.backend._eventlet.service [None req-11315ded-d4a8-4268-a61d-0d56934e6b85 None None] chap_username = {{(pid=91786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 04:34:25 devstack cinder-volume[91786]: DEBUG oslo_service.backend._eventlet.service [None req-11315ded-d4a8-4268-a61d-0d56934e6b85 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=91786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 04:34:25 devstack cinder-volume[91786]: DEBUG oslo_service.backend._eventlet.service [None req-11315ded-d4a8-4268-a61d-0d56934e6b85 None None] cinder_internal_tenant_project_id = 8c9bda5796214d61aae41e9608b9310f {{(pid=91786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 04:34:25 devstack cinder-volume[91786]: DEBUG oslo_service.backend._eventlet.service [None req-11315ded-d4a8-4268-a61d-0d56934e6b85 None None] cinder_internal_tenant_user_id = 89053059899d48acb687e042d0af46df {{(pid=91786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 04:34:25 devstack cinder-volume[91786]: DEBUG oslo_service.backend._eventlet.service [None req-11315ded-d4a8-4268-a61d-0d56934e6b85 None None] cluster = None {{(pid=91786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 04:34:25 devstack cinder-volume[91786]: DEBUG oslo_service.backend._eventlet.service [None req-11315ded-d4a8-4268-a61d-0d56934e6b85 None None] compression_format = gzip {{(pid=91786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 04:34:25 devstack cinder-volume[91786]: DEBUG oslo_service.backend._eventlet.service [None req-11315ded-d4a8-4268-a61d-0d56934e6b85 None None] compute_api_class = cinder.compute.nova.API {{(pid=91786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 04:34:25 devstack cinder-volume[91786]: DEBUG oslo_service.backend._eventlet.service [None req-11315ded-d4a8-4268-a61d-0d56934e6b85 None None] config_dir = [] {{(pid=91786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 04:34:25 devstack cinder-volume[91786]: DEBUG oslo_service.backend._eventlet.service [None req-11315ded-d4a8-4268-a61d-0d56934e6b85 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=91786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 04:34:25 devstack cinder-volume[92060]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Jun 17 04:34:25 devstack cinder-volume[91786]: DEBUG oslo_service.backend._eventlet.service [None req-11315ded-d4a8-4268-a61d-0d56934e6b85 None None] config_source = [] {{(pid=91786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 04:34:25 devstack cinder-volume[91786]: DEBUG oslo_service.backend._eventlet.service [None req-11315ded-d4a8-4268-a61d-0d56934e6b85 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=91786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 04:34:25 devstack cinder-volume[91786]: DEBUG oslo_service.backend._eventlet.service [None req-11315ded-d4a8-4268-a61d-0d56934e6b85 None None] control_exchange = openstack {{(pid=91786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 04:34:25 devstack cinder-volume[91786]: DEBUG oslo_service.backend._eventlet.service [None req-11315ded-d4a8-4268-a61d-0d56934e6b85 None None] debug = True {{(pid=91786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 04:34:25 devstack cinder-volume[91786]: DEBUG oslo_service.backend._eventlet.service [None req-11315ded-d4a8-4268-a61d-0d56934e6b85 None None] default_availability_zone = None {{(pid=91786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 04:34:25 devstack cinder-volume[91786]: DEBUG oslo_service.backend._eventlet.service [None req-11315ded-d4a8-4268-a61d-0d56934e6b85 None None] default_group_type = None {{(pid=91786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 04:34:25 devstack cinder-volume[91786]: DEBUG oslo_service.backend._eventlet.service [None req-11315ded-d4a8-4268-a61d-0d56934e6b85 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=91786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 04:34:25 devstack cinder-volume[91786]: DEBUG oslo_service.backend._eventlet.service [None req-11315ded-d4a8-4268-a61d-0d56934e6b85 None None] default_volume_type = QuobyteHD {{(pid=91786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 04:34:25 devstack cinder-volume[91786]: DEBUG oslo_service.backend._eventlet.service [None req-11315ded-d4a8-4268-a61d-0d56934e6b85 None None] disk_geometry = None {{(pid=91786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 04:34:25 devstack cinder-volume[91786]: DEBUG oslo_service.backend._eventlet.service [None req-11315ded-d4a8-4268-a61d-0d56934e6b85 None None] driver_client_cert = None {{(pid=91786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 04:34:25 devstack cinder-volume[91786]: DEBUG oslo_service.backend._eventlet.service [None req-11315ded-d4a8-4268-a61d-0d56934e6b85 None None] driver_client_cert_key = None {{(pid=91786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 04:34:25 devstack cinder-volume[91786]: DEBUG oslo_service.backend._eventlet.service [None req-11315ded-d4a8-4268-a61d-0d56934e6b85 None None] driver_data_namespace = None {{(pid=91786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 04:34:25 devstack cinder-volume[91786]: DEBUG oslo_service.backend._eventlet.service [None req-11315ded-d4a8-4268-a61d-0d56934e6b85 None None] driver_ssl_cert_path = None {{(pid=91786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 04:34:25 devstack cinder-volume[91786]: DEBUG oslo_service.backend._eventlet.service [None req-11315ded-d4a8-4268-a61d-0d56934e6b85 None None] driver_ssl_cert_verify = False {{(pid=91786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 04:34:25 devstack cinder-volume[91786]: DEBUG oslo_service.backend._eventlet.service [None req-11315ded-d4a8-4268-a61d-0d56934e6b85 None None] driver_use_ssl = False {{(pid=91786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 04:34:25 devstack cinder-volume[91786]: DEBUG oslo_service.backend._eventlet.service [None req-11315ded-d4a8-4268-a61d-0d56934e6b85 None None] enable_new_services = True {{(pid=91786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 04:34:25 devstack cinder-volume[91786]: DEBUG oslo_service.backend._eventlet.service [None req-11315ded-d4a8-4268-a61d-0d56934e6b85 None None] enable_unsupported_driver = False {{(pid=91786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 04:34:25 devstack cinder-volume[91786]: DEBUG oslo_service.backend._eventlet.service [None req-11315ded-d4a8-4268-a61d-0d56934e6b85 None None] enabled_backends = ['QuobyteHD'] {{(pid=91786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 04:34:25 devstack cinder-volume[91786]: DEBUG oslo_service.backend._eventlet.service [None req-11315ded-d4a8-4268-a61d-0d56934e6b85 None None] enforce_multipath_for_image_xfer = False {{(pid=91786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 04:34:25 devstack cinder-volume[91786]: DEBUG oslo_service.backend._eventlet.service [None req-11315ded-d4a8-4268-a61d-0d56934e6b85 None None] filter_function = None {{(pid=91786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 04:34:25 devstack cinder-volume[91786]: DEBUG oslo_service.backend._eventlet.service [None req-11315ded-d4a8-4268-a61d-0d56934e6b85 None None] glance_api_insecure = False {{(pid=91786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 04:34:25 devstack cinder-volume[91786]: DEBUG oslo_service.backend._eventlet.service [None req-11315ded-d4a8-4268-a61d-0d56934e6b85 None None] glance_api_servers = ['http://192.168.122.240/image'] {{(pid=91786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 04:34:25 devstack cinder-volume[91786]: DEBUG oslo_service.backend._eventlet.service [None req-11315ded-d4a8-4268-a61d-0d56934e6b85 None None] glance_api_ssl_compression = False {{(pid=91786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 04:34:25 devstack cinder-volume[91786]: DEBUG oslo_service.backend._eventlet.service [None req-11315ded-d4a8-4268-a61d-0d56934e6b85 None None] glance_ca_certificates_file = None {{(pid=91786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 04:34:25 devstack cinder-volume[91786]: DEBUG oslo_service.backend._eventlet.service [None req-11315ded-d4a8-4268-a61d-0d56934e6b85 None None] glance_catalog_info = image:glance:publicURL {{(pid=91786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 04:34:25 devstack cinder-volume[91786]: DEBUG oslo_service.backend._eventlet.service [None req-11315ded-d4a8-4268-a61d-0d56934e6b85 None None] glance_certfile = None {{(pid=91786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 04:34:25 devstack cinder-volume[91786]: DEBUG oslo_service.backend._eventlet.service [None req-11315ded-d4a8-4268-a61d-0d56934e6b85 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=91786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 04:34:25 devstack cinder-volume[91786]: DEBUG oslo_service.backend._eventlet.service [None req-11315ded-d4a8-4268-a61d-0d56934e6b85 None None] glance_keyfile = None {{(pid=91786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 04:34:25 devstack cinder-volume[91786]: DEBUG oslo_service.backend._eventlet.service [None req-11315ded-d4a8-4268-a61d-0d56934e6b85 None None] glance_num_retries = 3 {{(pid=91786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 04:34:25 devstack cinder-volume[91786]: DEBUG oslo_service.backend._eventlet.service [None req-11315ded-d4a8-4268-a61d-0d56934e6b85 None None] glance_request_timeout = None {{(pid=91786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 04:34:25 devstack cinder-volume[91786]: DEBUG oslo_service.backend._eventlet.service [None req-11315ded-d4a8-4268-a61d-0d56934e6b85 None None] goodness_function = None {{(pid=91786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 04:34:25 devstack cinder-volume[91786]: DEBUG oslo_service.backend._eventlet.service [None req-11315ded-d4a8-4268-a61d-0d56934e6b85 None None] graceful_shutdown_timeout = 5 {{(pid=91786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 04:34:25 devstack cinder-volume[91786]: DEBUG oslo_service.backend._eventlet.service [None req-11315ded-d4a8-4268-a61d-0d56934e6b85 None None] group_api_class = cinder.group.api.API {{(pid=91786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 04:34:25 devstack cinder-volume[91786]: DEBUG oslo_service.backend._eventlet.service [None req-11315ded-d4a8-4268-a61d-0d56934e6b85 None None] host = devstack {{(pid=91786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 04:34:25 devstack cinder-volume[91786]: DEBUG oslo_service.backend._eventlet.service [None req-11315ded-d4a8-4268-a61d-0d56934e6b85 None None] image_compress_on_upload = True {{(pid=91786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 04:34:25 devstack cinder-volume[91786]: DEBUG oslo_service.backend._eventlet.service [None req-11315ded-d4a8-4268-a61d-0d56934e6b85 None None] image_conversion_address_space_limit = 1 {{(pid=91786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 04:34:25 devstack cinder-volume[91786]: DEBUG oslo_service.backend._eventlet.service [None req-11315ded-d4a8-4268-a61d-0d56934e6b85 None None] image_conversion_cpu_limit = 60 {{(pid=91786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 04:34:25 devstack cinder-volume[91786]: DEBUG oslo_service.backend._eventlet.service [None req-11315ded-d4a8-4268-a61d-0d56934e6b85 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=91786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 04:34:25 devstack cinder-volume[91786]: DEBUG oslo_service.backend._eventlet.service [None req-11315ded-d4a8-4268-a61d-0d56934e6b85 None None] image_conversion_disable = False {{(pid=91786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 04:34:25 devstack cinder-volume[91786]: DEBUG oslo_service.backend._eventlet.service [None req-11315ded-d4a8-4268-a61d-0d56934e6b85 None None] image_upload_use_cinder_backend = False {{(pid=91786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 04:34:25 devstack cinder-volume[91786]: DEBUG oslo_service.backend._eventlet.service [None req-11315ded-d4a8-4268-a61d-0d56934e6b85 None None] image_upload_use_internal_tenant = False {{(pid=91786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 04:34:25 devstack cinder-volume[91786]: DEBUG oslo_service.backend._eventlet.service [None req-11315ded-d4a8-4268-a61d-0d56934e6b85 None None] image_volume_cache_enabled = False {{(pid=91786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 04:34:25 devstack cinder-volume[91786]: DEBUG oslo_service.backend._eventlet.service [None req-11315ded-d4a8-4268-a61d-0d56934e6b85 None None] image_volume_cache_max_count = 0 {{(pid=91786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 04:34:25 devstack cinder-volume[91786]: DEBUG oslo_service.backend._eventlet.service [None req-11315ded-d4a8-4268-a61d-0d56934e6b85 None None] image_volume_cache_max_size_gb = 0 {{(pid=91786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 04:34:25 devstack cinder-volume[91786]: DEBUG oslo_service.backend._eventlet.service [None req-11315ded-d4a8-4268-a61d-0d56934e6b85 None None] init_host_max_objects_retrieval = 0 {{(pid=91786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 04:34:25 devstack cinder-volume[91786]: DEBUG oslo_service.backend._eventlet.service [None req-11315ded-d4a8-4268-a61d-0d56934e6b85 None None] instance_format = [instance: %(uuid)s] {{(pid=91786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 04:34:25 devstack cinder-volume[91786]: DEBUG oslo_service.backend._eventlet.service [None req-11315ded-d4a8-4268-a61d-0d56934e6b85 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=91786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 04:34:25 devstack cinder-volume[91786]: DEBUG oslo_service.backend._eventlet.service [None req-11315ded-d4a8-4268-a61d-0d56934e6b85 None None] iscsi_target_flags = {{(pid=91786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 04:34:25 devstack cinder-volume[91786]: DEBUG oslo_service.backend._eventlet.service [None req-11315ded-d4a8-4268-a61d-0d56934e6b85 None None] iscsi_write_cache = on {{(pid=91786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 04:34:25 devstack cinder-volume[91786]: DEBUG oslo_service.backend._eventlet.service [None req-11315ded-d4a8-4268-a61d-0d56934e6b85 None None] iser_helper = tgtadm {{(pid=91786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 04:34:25 devstack cinder-volume[91786]: DEBUG oslo_service.backend._eventlet.service [None req-11315ded-d4a8-4268-a61d-0d56934e6b85 None None] iser_ip_address = 192.168.122.240 {{(pid=91786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 04:34:25 devstack cinder-volume[91786]: DEBUG oslo_service.backend._eventlet.service [None req-11315ded-d4a8-4268-a61d-0d56934e6b85 None None] iser_port = 3260 {{(pid=91786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 04:34:25 devstack cinder-volume[91786]: DEBUG oslo_service.backend._eventlet.service [None req-11315ded-d4a8-4268-a61d-0d56934e6b85 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=91786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 04:34:25 devstack cinder-volume[91786]: DEBUG oslo_service.backend._eventlet.service [None req-11315ded-d4a8-4268-a61d-0d56934e6b85 None None] log_color = False {{(pid=91786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 04:34:25 devstack cinder-volume[91786]: DEBUG oslo_service.backend._eventlet.service [None req-11315ded-d4a8-4268-a61d-0d56934e6b85 None None] log_config_append = None {{(pid=91786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 04:34:25 devstack cinder-volume[91786]: DEBUG oslo_service.backend._eventlet.service [None req-11315ded-d4a8-4268-a61d-0d56934e6b85 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=91786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 04:34:25 devstack cinder-volume[91786]: DEBUG oslo_service.backend._eventlet.service [None req-11315ded-d4a8-4268-a61d-0d56934e6b85 None None] log_dir = None {{(pid=91786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 04:34:25 devstack cinder-volume[91786]: DEBUG oslo_service.backend._eventlet.service [None req-11315ded-d4a8-4268-a61d-0d56934e6b85 None None] log_file = None {{(pid=91786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 04:34:25 devstack cinder-volume[91786]: DEBUG oslo_service.backend._eventlet.service [None req-11315ded-d4a8-4268-a61d-0d56934e6b85 None None] log_options = True {{(pid=91786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 04:34:25 devstack cinder-volume[91786]: DEBUG oslo_service.backend._eventlet.service [None req-11315ded-d4a8-4268-a61d-0d56934e6b85 None None] log_rotate_interval = 1 {{(pid=91786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 04:34:25 devstack cinder-volume[91786]: DEBUG oslo_service.backend._eventlet.service [None req-11315ded-d4a8-4268-a61d-0d56934e6b85 None None] log_rotate_interval_type = days {{(pid=91786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 04:34:25 devstack cinder-volume[91786]: DEBUG oslo_service.backend._eventlet.service [None req-11315ded-d4a8-4268-a61d-0d56934e6b85 None None] log_rotation_type = none {{(pid=91786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 04:34:25 devstack cinder-volume[91786]: DEBUG oslo_service.backend._eventlet.service [None req-11315ded-d4a8-4268-a61d-0d56934e6b85 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=91786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 04:34:25 devstack cinder-volume[91786]: DEBUG oslo_service.backend._eventlet.service [None req-11315ded-d4a8-4268-a61d-0d56934e6b85 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=91786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 04:34:25 devstack cinder-volume[91786]: DEBUG oslo_service.backend._eventlet.service [None req-11315ded-d4a8-4268-a61d-0d56934e6b85 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=91786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 04:34:25 devstack cinder-volume[91786]: DEBUG oslo_service.backend._eventlet.service [None req-11315ded-d4a8-4268-a61d-0d56934e6b85 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=91786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 04:34:25 devstack cinder-volume[91786]: DEBUG oslo_service.backend._eventlet.service [None req-11315ded-d4a8-4268-a61d-0d56934e6b85 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=91786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 04:34:25 devstack cinder-volume[91786]: DEBUG oslo_service.backend._eventlet.service [None req-11315ded-d4a8-4268-a61d-0d56934e6b85 None None] max_age = 0 {{(pid=91786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 04:34:25 devstack cinder-volume[91786]: DEBUG oslo_service.backend._eventlet.service [None req-11315ded-d4a8-4268-a61d-0d56934e6b85 None None] max_logfile_count = 30 {{(pid=91786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 04:34:25 devstack cinder-volume[91786]: DEBUG oslo_service.backend._eventlet.service [None req-11315ded-d4a8-4268-a61d-0d56934e6b85 None None] max_logfile_size_mb = 200 {{(pid=91786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 04:34:25 devstack cinder-volume[91786]: DEBUG oslo_service.backend._eventlet.service [None req-11315ded-d4a8-4268-a61d-0d56934e6b85 None None] max_over_subscription_ratio = 20.0 {{(pid=91786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 04:34:25 devstack cinder-volume[91786]: DEBUG oslo_service.backend._eventlet.service [None req-11315ded-d4a8-4268-a61d-0d56934e6b85 None None] message_reap_interval = 86400 {{(pid=91786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 04:34:25 devstack cinder-volume[91786]: DEBUG oslo_service.backend._eventlet.service [None req-11315ded-d4a8-4268-a61d-0d56934e6b85 None None] message_ttl = 2592000 {{(pid=91786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 04:34:25 devstack cinder-volume[91786]: DEBUG oslo_service.backend._eventlet.service [None req-11315ded-d4a8-4268-a61d-0d56934e6b85 None None] migration_create_volume_timeout_secs = 300 {{(pid=91786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 04:34:25 devstack cinder-volume[91786]: DEBUG oslo_service.backend._eventlet.service [None req-11315ded-d4a8-4268-a61d-0d56934e6b85 None None] monkey_patch = False {{(pid=91786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 04:34:25 devstack cinder-volume[91786]: DEBUG oslo_service.backend._eventlet.service [None req-11315ded-d4a8-4268-a61d-0d56934e6b85 None None] monkey_patch_modules = [] {{(pid=91786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 04:34:25 devstack cinder-volume[91786]: DEBUG oslo_service.backend._eventlet.service [None req-11315ded-d4a8-4268-a61d-0d56934e6b85 None None] my_ip = 192.168.122.240 {{(pid=91786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 04:34:25 devstack cinder-volume[91786]: DEBUG oslo_service.backend._eventlet.service [None req-11315ded-d4a8-4268-a61d-0d56934e6b85 None None] no_snapshot_gb_quota = False {{(pid=91786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 04:34:25 devstack cinder-volume[91786]: DEBUG oslo_service.backend._eventlet.service [None req-11315ded-d4a8-4268-a61d-0d56934e6b85 None None] num_iser_scan_tries = 3 {{(pid=91786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 04:34:25 devstack cinder-volume[91786]: DEBUG oslo_service.backend._eventlet.service [None req-11315ded-d4a8-4268-a61d-0d56934e6b85 None None] num_shell_tries = 3 {{(pid=91786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 04:34:25 devstack cinder-volume[91786]: DEBUG oslo_service.backend._eventlet.service [None req-11315ded-d4a8-4268-a61d-0d56934e6b85 None None] num_volume_device_scan_tries = 3 {{(pid=91786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 04:34:25 devstack cinder-volume[91786]: DEBUG oslo_service.backend._eventlet.service [None req-11315ded-d4a8-4268-a61d-0d56934e6b85 None None] nvmeof_conn_info_version = 1 {{(pid=91786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 04:34:25 devstack cinder-volume[91786]: DEBUG oslo_service.backend._eventlet.service [None req-11315ded-d4a8-4268-a61d-0d56934e6b85 None None] nvmet_ns_id = 10 {{(pid=91786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 04:34:25 devstack cinder-volume[92060]: INFO cinder.volume.manager [None req-1c716dff-48f1-4574-9314-02d3d9dae629 None None] Starting volume driver QuobyteDriver (1.1.14) Jun 17 04:34:25 devstack cinder-volume[91786]: DEBUG oslo_service.backend._eventlet.service [None req-11315ded-d4a8-4268-a61d-0d56934e6b85 None None] nvmet_port_id = 1 {{(pid=91786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 04:34:25 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.remotefs [None req-1c716dff-48f1-4574-9314-02d3d9dae629 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=92060) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Jun 17 04:34:25 devstack cinder-volume[91786]: DEBUG oslo_service.backend._eventlet.service [None req-11315ded-d4a8-4268-a61d-0d56934e6b85 None None] osapi_max_limit = 1000 {{(pid=91786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 04:34:25 devstack cinder-volume[91786]: DEBUG oslo_service.backend._eventlet.service [None req-11315ded-d4a8-4268-a61d-0d56934e6b85 None None] osapi_volume_ext_list = [] {{(pid=91786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 04:34:25 devstack cinder-volume[91786]: DEBUG oslo_service.backend._eventlet.service [None req-11315ded-d4a8-4268-a61d-0d56934e6b85 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=91786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 04:34:25 devstack cinder-volume[91786]: DEBUG oslo_service.backend._eventlet.service [None req-11315ded-d4a8-4268-a61d-0d56934e6b85 None None] osapi_volume_listen = 0.0.0.0 {{(pid=91786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 04:34:25 devstack cinder-volume[91786]: DEBUG oslo_service.backend._eventlet.service [None req-11315ded-d4a8-4268-a61d-0d56934e6b85 None None] osapi_volume_listen_port = 8776 {{(pid=91786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 04:34:25 devstack cinder-volume[91786]: DEBUG oslo_service.backend._eventlet.service [None req-11315ded-d4a8-4268-a61d-0d56934e6b85 None None] osapi_volume_use_ssl = False {{(pid=91786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 04:34:25 devstack cinder-volume[91786]: DEBUG oslo_service.backend._eventlet.service [None req-11315ded-d4a8-4268-a61d-0d56934e6b85 None None] osapi_volume_workers = 2 {{(pid=91786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 04:34:25 devstack cinder-volume[91786]: DEBUG oslo_service.backend._eventlet.service [None req-11315ded-d4a8-4268-a61d-0d56934e6b85 None None] per_volume_size_limit = -1 {{(pid=91786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 04:34:25 devstack cinder-volume[91786]: DEBUG oslo_service.backend._eventlet.service [None req-11315ded-d4a8-4268-a61d-0d56934e6b85 None None] periodic_fuzzy_delay = 60 {{(pid=91786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 04:34:25 devstack cinder-volume[91786]: DEBUG oslo_service.backend._eventlet.service [None req-11315ded-d4a8-4268-a61d-0d56934e6b85 None None] periodic_interval = 60 {{(pid=91786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 04:34:25 devstack cinder-volume[91786]: DEBUG oslo_service.backend._eventlet.service [None req-11315ded-d4a8-4268-a61d-0d56934e6b85 None None] project_id_regex = [0-9a-f\-]+ {{(pid=91786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 04:34:25 devstack cinder-volume[91786]: DEBUG oslo_service.backend._eventlet.service [None req-11315ded-d4a8-4268-a61d-0d56934e6b85 None None] public_endpoint = None {{(pid=91786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 04:34:25 devstack cinder-volume[91786]: DEBUG oslo_service.backend._eventlet.service [None req-11315ded-d4a8-4268-a61d-0d56934e6b85 None None] publish_errors = False {{(pid=91786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 04:34:25 devstack cinder-volume[91786]: DEBUG oslo_service.backend._eventlet.service [None req-11315ded-d4a8-4268-a61d-0d56934e6b85 None None] quota_backup_gigabytes = 1000 {{(pid=91786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 04:34:25 devstack cinder-volume[91786]: DEBUG oslo_service.backend._eventlet.service [None req-11315ded-d4a8-4268-a61d-0d56934e6b85 None None] quota_backups = 10 {{(pid=91786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 04:34:25 devstack cinder-volume[91786]: DEBUG oslo_service.backend._eventlet.service [None req-11315ded-d4a8-4268-a61d-0d56934e6b85 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=91786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 04:34:25 devstack cinder-volume[91786]: DEBUG oslo_service.backend._eventlet.service [None req-11315ded-d4a8-4268-a61d-0d56934e6b85 None None] quota_gigabytes = 1000 {{(pid=91786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 04:34:25 devstack cinder-volume[91786]: DEBUG oslo_service.backend._eventlet.service [None req-11315ded-d4a8-4268-a61d-0d56934e6b85 None None] quota_groups = 10 {{(pid=91786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 04:34:25 devstack cinder-volume[91786]: DEBUG oslo_service.backend._eventlet.service [None req-11315ded-d4a8-4268-a61d-0d56934e6b85 None None] quota_snapshots = 10 {{(pid=91786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 04:34:25 devstack cinder-volume[91786]: DEBUG oslo_service.backend._eventlet.service [None req-11315ded-d4a8-4268-a61d-0d56934e6b85 None None] quota_volumes = 10 {{(pid=91786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 04:34:25 devstack cinder-volume[91786]: DEBUG oslo_service.backend._eventlet.service [None req-11315ded-d4a8-4268-a61d-0d56934e6b85 None None] rate_limit_burst = 0 {{(pid=91786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 04:34:25 devstack cinder-volume[91786]: DEBUG oslo_service.backend._eventlet.service [None req-11315ded-d4a8-4268-a61d-0d56934e6b85 None None] rate_limit_except_level = CRITICAL {{(pid=91786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 04:34:25 devstack cinder-volume[91786]: DEBUG oslo_service.backend._eventlet.service [None req-11315ded-d4a8-4268-a61d-0d56934e6b85 None None] rate_limit_interval = 0 {{(pid=91786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 04:34:25 devstack cinder-volume[91786]: DEBUG oslo_service.backend._eventlet.service [None req-11315ded-d4a8-4268-a61d-0d56934e6b85 None None] reinit_driver_count = 3 {{(pid=91786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 04:34:25 devstack cinder-volume[91786]: DEBUG oslo_service.backend._eventlet.service [None req-11315ded-d4a8-4268-a61d-0d56934e6b85 None None] replication_device = **** {{(pid=91786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 04:34:25 devstack cinder-volume[91786]: DEBUG oslo_service.backend._eventlet.service [None req-11315ded-d4a8-4268-a61d-0d56934e6b85 None None] report_discard_supported = False {{(pid=91786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 04:34:25 devstack cinder-volume[91786]: DEBUG oslo_service.backend._eventlet.service [None req-11315ded-d4a8-4268-a61d-0d56934e6b85 None None] report_interval = 120 {{(pid=91786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 04:34:25 devstack cinder-volume[91786]: DEBUG oslo_service.backend._eventlet.service [None req-11315ded-d4a8-4268-a61d-0d56934e6b85 None None] reservation_clean_interval = 86400 {{(pid=91786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 04:34:25 devstack cinder-volume[91786]: DEBUG oslo_service.backend._eventlet.service [None req-11315ded-d4a8-4268-a61d-0d56934e6b85 None None] reservation_expire = 86400 {{(pid=91786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 04:34:25 devstack cinder-volume[91786]: DEBUG oslo_service.backend._eventlet.service [None req-11315ded-d4a8-4268-a61d-0d56934e6b85 None None] reserved_image_namespaces = [] {{(pid=91786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 04:34:25 devstack cinder-volume[91786]: DEBUG oslo_service.backend._eventlet.service [None req-11315ded-d4a8-4268-a61d-0d56934e6b85 None None] reserved_percentage = 0 {{(pid=91786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 04:34:25 devstack cinder-volume[91786]: DEBUG oslo_service.backend._eventlet.service [None req-11315ded-d4a8-4268-a61d-0d56934e6b85 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=91786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 04:34:25 devstack cinder-volume[91786]: DEBUG oslo_service.backend._eventlet.service [None req-11315ded-d4a8-4268-a61d-0d56934e6b85 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=91786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 04:34:25 devstack cinder-volume[91786]: DEBUG oslo_service.backend._eventlet.service [None req-11315ded-d4a8-4268-a61d-0d56934e6b85 None None] rpc_response_timeout = 120 {{(pid=91786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 04:34:25 devstack cinder-volume[91786]: DEBUG oslo_service.backend._eventlet.service [None req-11315ded-d4a8-4268-a61d-0d56934e6b85 None None] run_external_periodic_tasks = True {{(pid=91786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 04:34:25 devstack cinder-volume[91786]: DEBUG oslo_service.backend._eventlet.service [None req-11315ded-d4a8-4268-a61d-0d56934e6b85 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=91786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 04:34:25 devstack cinder-volume[91786]: DEBUG oslo_service.backend._eventlet.service [None req-11315ded-d4a8-4268-a61d-0d56934e6b85 None None] scst_target_driver = iscsi {{(pid=91786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 04:34:25 devstack cinder-volume[91786]: DEBUG oslo_service.backend._eventlet.service [None req-11315ded-d4a8-4268-a61d-0d56934e6b85 None None] scst_target_iqn_name = None {{(pid=91786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 04:34:25 devstack cinder-volume[91786]: DEBUG oslo_service.backend._eventlet.service [None req-11315ded-d4a8-4268-a61d-0d56934e6b85 None None] service_down_time = 720 {{(pid=91786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 04:34:25 devstack cinder-volume[91786]: DEBUG oslo_service.backend._eventlet.service [None req-11315ded-d4a8-4268-a61d-0d56934e6b85 None None] shell_completion = None {{(pid=91786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 04:34:25 devstack cinder-volume[91786]: DEBUG oslo_service.backend._eventlet.service [None req-11315ded-d4a8-4268-a61d-0d56934e6b85 None None] snapshot_name_template = snapshot-%s {{(pid=91786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 04:34:25 devstack cinder-volume[91786]: DEBUG oslo_service.backend._eventlet.service [None req-11315ded-d4a8-4268-a61d-0d56934e6b85 None None] split_loggers = False {{(pid=91786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 04:34:25 devstack cinder-volume[91786]: DEBUG oslo_service.backend._eventlet.service [None req-11315ded-d4a8-4268-a61d-0d56934e6b85 None None] state_path = /opt/stack/data/cinder {{(pid=91786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 04:34:25 devstack cinder-volume[91786]: DEBUG oslo_service.backend._eventlet.service [None req-11315ded-d4a8-4268-a61d-0d56934e6b85 None None] storage_availability_zone = nova {{(pid=91786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 04:34:25 devstack cinder-volume[91786]: DEBUG oslo_service.backend._eventlet.service [None req-11315ded-d4a8-4268-a61d-0d56934e6b85 None None] storage_protocol = iSCSI {{(pid=91786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 04:34:25 devstack cinder-volume[91786]: DEBUG oslo_service.backend._eventlet.service [None req-11315ded-d4a8-4268-a61d-0d56934e6b85 None None] syslog_log_facility = LOG_USER {{(pid=91786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 04:34:25 devstack cinder-volume[91786]: DEBUG oslo_service.backend._eventlet.service [None req-11315ded-d4a8-4268-a61d-0d56934e6b85 None None] target_helper = lioadm {{(pid=91786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 04:34:25 devstack cinder-volume[91786]: DEBUG oslo_service.backend._eventlet.service [None req-11315ded-d4a8-4268-a61d-0d56934e6b85 None None] target_ip_address = 192.168.122.240 {{(pid=91786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 04:34:25 devstack cinder-volume[91786]: DEBUG oslo_service.backend._eventlet.service [None req-11315ded-d4a8-4268-a61d-0d56934e6b85 None None] target_port = 3260 {{(pid=91786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 04:34:25 devstack cinder-volume[91786]: DEBUG oslo_service.backend._eventlet.service [None req-11315ded-d4a8-4268-a61d-0d56934e6b85 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=91786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 04:34:25 devstack cinder-volume[91786]: DEBUG oslo_service.backend._eventlet.service [None req-11315ded-d4a8-4268-a61d-0d56934e6b85 None None] target_protocol = iscsi {{(pid=91786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 04:34:25 devstack cinder-volume[91786]: DEBUG oslo_service.backend._eventlet.service [None req-11315ded-d4a8-4268-a61d-0d56934e6b85 None None] target_secondary_ip_addresses = [] {{(pid=91786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 04:34:25 devstack cinder-volume[91786]: DEBUG oslo_service.backend._eventlet.service [None req-11315ded-d4a8-4268-a61d-0d56934e6b85 None None] trace_flags = None {{(pid=91786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 04:34:25 devstack cinder-volume[91786]: DEBUG oslo_service.backend._eventlet.service [None req-11315ded-d4a8-4268-a61d-0d56934e6b85 None None] transfer_api_class = cinder.transfer.api.API {{(pid=91786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 04:34:25 devstack cinder-volume[91786]: DEBUG oslo_service.backend._eventlet.service [None req-11315ded-d4a8-4268-a61d-0d56934e6b85 None None] transport_url = **** {{(pid=91786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 04:34:25 devstack cinder-volume[91786]: DEBUG oslo_service.backend._eventlet.service [None req-11315ded-d4a8-4268-a61d-0d56934e6b85 None None] until_refresh = 0 {{(pid=91786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 04:34:25 devstack cinder-volume[91786]: DEBUG oslo_service.backend._eventlet.service [None req-11315ded-d4a8-4268-a61d-0d56934e6b85 None None] use_chap_auth = False {{(pid=91786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 04:34:25 devstack cinder-volume[91786]: DEBUG oslo_service.backend._eventlet.service [None req-11315ded-d4a8-4268-a61d-0d56934e6b85 None None] use_default_quota_class = True {{(pid=91786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 04:34:25 devstack cinder-volume[91786]: DEBUG oslo_service.backend._eventlet.service [None req-11315ded-d4a8-4268-a61d-0d56934e6b85 None None] use_journal = False {{(pid=91786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 04:34:25 devstack cinder-volume[91786]: DEBUG oslo_service.backend._eventlet.service [None req-11315ded-d4a8-4268-a61d-0d56934e6b85 None None] use_json = False {{(pid=91786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 04:34:25 devstack cinder-volume[91786]: DEBUG oslo_service.backend._eventlet.service [None req-11315ded-d4a8-4268-a61d-0d56934e6b85 None None] use_multipath_for_image_xfer = False {{(pid=91786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 04:34:25 devstack cinder-volume[91786]: DEBUG oslo_service.backend._eventlet.service [None req-11315ded-d4a8-4268-a61d-0d56934e6b85 None None] use_stderr = False {{(pid=91786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 04:34:25 devstack cinder-volume[91786]: DEBUG oslo_service.backend._eventlet.service [None req-11315ded-d4a8-4268-a61d-0d56934e6b85 None None] use_syslog = False {{(pid=91786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 04:34:25 devstack cinder-volume[91786]: DEBUG oslo_service.backend._eventlet.service [None req-11315ded-d4a8-4268-a61d-0d56934e6b85 None None] verify_glance_signatures = enabled {{(pid=91786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 04:34:25 devstack cinder-volume[91786]: DEBUG oslo_service.backend._eventlet.service [None req-11315ded-d4a8-4268-a61d-0d56934e6b85 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=91786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 04:34:25 devstack cinder-volume[91786]: DEBUG oslo_service.backend._eventlet.service [None req-11315ded-d4a8-4268-a61d-0d56934e6b85 None None] volume_api_class = cinder.volume.api.API {{(pid=91786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 04:34:25 devstack cinder-volume[91786]: DEBUG oslo_service.backend._eventlet.service [None req-11315ded-d4a8-4268-a61d-0d56934e6b85 None None] volume_backend_name = None {{(pid=91786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 04:34:25 devstack cinder-volume[91786]: DEBUG oslo_service.backend._eventlet.service [None req-11315ded-d4a8-4268-a61d-0d56934e6b85 None None] volume_clear = zero {{(pid=91786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 04:34:25 devstack cinder-volume[91786]: DEBUG oslo_service.backend._eventlet.service [None req-11315ded-d4a8-4268-a61d-0d56934e6b85 None None] volume_clear_ionice = None {{(pid=91786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 04:34:25 devstack cinder-volume[91786]: DEBUG oslo_service.backend._eventlet.service [None req-11315ded-d4a8-4268-a61d-0d56934e6b85 None None] volume_clear_size = 0 {{(pid=91786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 04:34:25 devstack cinder-volume[91786]: DEBUG oslo_service.backend._eventlet.service [None req-11315ded-d4a8-4268-a61d-0d56934e6b85 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=91786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 04:34:25 devstack cinder-volume[91786]: DEBUG oslo_service.backend._eventlet.service [None req-11315ded-d4a8-4268-a61d-0d56934e6b85 None None] volume_copy_bps_limit = 0 {{(pid=91786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 04:34:25 devstack cinder-volume[91786]: DEBUG oslo_service.backend._eventlet.service [None req-11315ded-d4a8-4268-a61d-0d56934e6b85 None None] volume_dd_blocksize = 1M {{(pid=91786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 04:34:25 devstack cinder-volume[91786]: DEBUG oslo_service.backend._eventlet.service [None req-11315ded-d4a8-4268-a61d-0d56934e6b85 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=91786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 04:34:25 devstack cinder-volume[91786]: DEBUG oslo_service.backend._eventlet.service [None req-11315ded-d4a8-4268-a61d-0d56934e6b85 None None] volume_name_template = volume-%s {{(pid=91786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 04:34:25 devstack cinder-volume[91786]: DEBUG oslo_service.backend._eventlet.service [None req-11315ded-d4a8-4268-a61d-0d56934e6b85 None None] volume_service_inithost_offload = False {{(pid=91786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 04:34:25 devstack cinder-volume[91786]: DEBUG oslo_service.backend._eventlet.service [None req-11315ded-d4a8-4268-a61d-0d56934e6b85 None None] volume_usage_audit_period = month {{(pid=91786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 04:34:25 devstack cinder-volume[91786]: DEBUG oslo_service.backend._eventlet.service [None req-11315ded-d4a8-4268-a61d-0d56934e6b85 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=91786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 04:34:25 devstack cinder-volume[91786]: DEBUG oslo_service.backend._eventlet.service [None req-11315ded-d4a8-4268-a61d-0d56934e6b85 None None] zoning_mode = None {{(pid=91786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Jun 17 04:34:25 devstack cinder-volume[91786]: DEBUG oslo_service.backend._eventlet.service [None req-11315ded-d4a8-4268-a61d-0d56934e6b85 None None] oslo_concurrency.disable_process_locking = False {{(pid=91786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:25 devstack cinder-volume[91786]: DEBUG oslo_service.backend._eventlet.service [None req-11315ded-d4a8-4268-a61d-0d56934e6b85 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=91786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:25 devstack cinder-volume[91786]: DEBUG oslo_service.backend._eventlet.service [None req-11315ded-d4a8-4268-a61d-0d56934e6b85 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=91786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:25 devstack cinder-volume[91786]: DEBUG oslo_service.backend._eventlet.service [None req-11315ded-d4a8-4268-a61d-0d56934e6b85 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=91786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:25 devstack cinder-volume[91786]: DEBUG oslo_service.backend._eventlet.service [None req-11315ded-d4a8-4268-a61d-0d56934e6b85 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=91786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:25 devstack cinder-volume[91786]: DEBUG oslo_service.backend._eventlet.service [None req-11315ded-d4a8-4268-a61d-0d56934e6b85 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=91786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:25 devstack cinder-volume[91786]: DEBUG oslo_service.backend._eventlet.service [None req-11315ded-d4a8-4268-a61d-0d56934e6b85 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=91786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:25 devstack cinder-volume[91786]: DEBUG oslo_service.backend._eventlet.service [None req-11315ded-d4a8-4268-a61d-0d56934e6b85 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=91786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:25 devstack cinder-volume[91786]: DEBUG oslo_service.backend._eventlet.service [None req-11315ded-d4a8-4268-a61d-0d56934e6b85 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=91786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:25 devstack cinder-volume[91786]: DEBUG oslo_service.backend._eventlet.service [None req-11315ded-d4a8-4268-a61d-0d56934e6b85 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=91786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:25 devstack cinder-volume[91786]: DEBUG oslo_service.backend._eventlet.service [None req-11315ded-d4a8-4268-a61d-0d56934e6b85 None None] keystone_authtoken.admin_password = **** {{(pid=91786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:25 devstack cinder-volume[91786]: DEBUG oslo_service.backend._eventlet.service [None req-11315ded-d4a8-4268-a61d-0d56934e6b85 None None] keystone_authtoken.admin_tenant_name = admin {{(pid=91786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:25 devstack cinder-volume[91786]: DEBUG oslo_service.backend._eventlet.service [None req-11315ded-d4a8-4268-a61d-0d56934e6b85 None None] keystone_authtoken.admin_token = **** {{(pid=91786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:25 devstack cinder-volume[91786]: DEBUG oslo_service.backend._eventlet.service [None req-11315ded-d4a8-4268-a61d-0d56934e6b85 None None] keystone_authtoken.admin_user = None {{(pid=91786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:25 devstack cinder-volume[91786]: DEBUG oslo_service.backend._eventlet.service [None req-11315ded-d4a8-4268-a61d-0d56934e6b85 None None] keystone_authtoken.auth_admin_prefix = {{(pid=91786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:25 devstack cinder-volume[91786]: DEBUG oslo_service.backend._eventlet.service [None req-11315ded-d4a8-4268-a61d-0d56934e6b85 None None] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=91786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:25 devstack cinder-volume[91786]: DEBUG oslo_service.backend._eventlet.service [None req-11315ded-d4a8-4268-a61d-0d56934e6b85 None None] keystone_authtoken.auth_port = 35357 {{(pid=91786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:25 devstack cinder-volume[91786]: DEBUG oslo_service.backend._eventlet.service [None req-11315ded-d4a8-4268-a61d-0d56934e6b85 None None] keystone_authtoken.auth_protocol = https {{(pid=91786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:25 devstack cinder-volume[91786]: DEBUG oslo_service.backend._eventlet.service [None req-11315ded-d4a8-4268-a61d-0d56934e6b85 None None] keystone_authtoken.auth_section = None {{(pid=91786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:25 devstack cinder-volume[91786]: DEBUG oslo_service.backend._eventlet.service [None req-11315ded-d4a8-4268-a61d-0d56934e6b85 None None] keystone_authtoken.auth_type = password {{(pid=91786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:25 devstack cinder-volume[91786]: DEBUG oslo_service.backend._eventlet.service [None req-11315ded-d4a8-4268-a61d-0d56934e6b85 None None] keystone_authtoken.auth_uri = None {{(pid=91786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:25 devstack cinder-volume[91786]: DEBUG oslo_service.backend._eventlet.service [None req-11315ded-d4a8-4268-a61d-0d56934e6b85 None None] keystone_authtoken.auth_version = None {{(pid=91786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:25 devstack cinder-volume[91786]: DEBUG oslo_service.backend._eventlet.service [None req-11315ded-d4a8-4268-a61d-0d56934e6b85 None None] keystone_authtoken.cache = None {{(pid=91786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:25 devstack cinder-volume[91786]: DEBUG oslo_service.backend._eventlet.service [None req-11315ded-d4a8-4268-a61d-0d56934e6b85 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=91786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:25 devstack cinder-volume[91786]: DEBUG oslo_service.backend._eventlet.service [None req-11315ded-d4a8-4268-a61d-0d56934e6b85 None None] keystone_authtoken.certfile = None {{(pid=91786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:25 devstack cinder-volume[91786]: DEBUG oslo_service.backend._eventlet.service [None req-11315ded-d4a8-4268-a61d-0d56934e6b85 None None] keystone_authtoken.delay_auth_decision = False {{(pid=91786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:25 devstack cinder-volume[91786]: DEBUG oslo_service.backend._eventlet.service [None req-11315ded-d4a8-4268-a61d-0d56934e6b85 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=91786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:25 devstack cinder-volume[91786]: DEBUG oslo_service.backend._eventlet.service [None req-11315ded-d4a8-4268-a61d-0d56934e6b85 None None] keystone_authtoken.http_connect_timeout = None {{(pid=91786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:25 devstack cinder-volume[91786]: DEBUG oslo_service.backend._eventlet.service [None req-11315ded-d4a8-4268-a61d-0d56934e6b85 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=91786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:25 devstack cinder-volume[91786]: DEBUG oslo_service.backend._eventlet.service [None req-11315ded-d4a8-4268-a61d-0d56934e6b85 None None] keystone_authtoken.identity_uri = None {{(pid=91786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:25 devstack cinder-volume[91786]: DEBUG oslo_service.backend._eventlet.service [None req-11315ded-d4a8-4268-a61d-0d56934e6b85 None None] keystone_authtoken.include_service_catalog = True {{(pid=91786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:25 devstack cinder-volume[91786]: DEBUG oslo_service.backend._eventlet.service [None req-11315ded-d4a8-4268-a61d-0d56934e6b85 None None] keystone_authtoken.insecure = False {{(pid=91786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:25 devstack cinder-volume[91786]: DEBUG oslo_service.backend._eventlet.service [None req-11315ded-d4a8-4268-a61d-0d56934e6b85 None None] keystone_authtoken.interface = public {{(pid=91786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:25 devstack cinder-volume[91786]: DEBUG oslo_service.backend._eventlet.service [None req-11315ded-d4a8-4268-a61d-0d56934e6b85 None None] keystone_authtoken.keyfile = None {{(pid=91786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:25 devstack cinder-volume[91786]: DEBUG oslo_service.backend._eventlet.service [None req-11315ded-d4a8-4268-a61d-0d56934e6b85 None None] keystone_authtoken.memcache_password = {{(pid=91786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:25 devstack cinder-volume[91786]: DEBUG oslo_service.backend._eventlet.service [None req-11315ded-d4a8-4268-a61d-0d56934e6b85 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=91786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:25 devstack cinder-volume[91786]: DEBUG oslo_service.backend._eventlet.service [None req-11315ded-d4a8-4268-a61d-0d56934e6b85 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=91786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:25 devstack cinder-volume[91786]: DEBUG oslo_service.backend._eventlet.service [None req-11315ded-d4a8-4268-a61d-0d56934e6b85 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=91786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:25 devstack cinder-volume[91786]: DEBUG oslo_service.backend._eventlet.service [None req-11315ded-d4a8-4268-a61d-0d56934e6b85 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=91786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:25 devstack cinder-volume[91786]: DEBUG oslo_service.backend._eventlet.service [None req-11315ded-d4a8-4268-a61d-0d56934e6b85 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=91786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:25 devstack cinder-volume[91786]: DEBUG oslo_service.backend._eventlet.service [None req-11315ded-d4a8-4268-a61d-0d56934e6b85 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=91786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:25 devstack cinder-volume[91786]: DEBUG oslo_service.backend._eventlet.service [None req-11315ded-d4a8-4268-a61d-0d56934e6b85 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=91786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:25 devstack cinder-volume[91786]: DEBUG oslo_service.backend._eventlet.service [None req-11315ded-d4a8-4268-a61d-0d56934e6b85 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=91786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:25 devstack cinder-volume[91786]: DEBUG oslo_service.backend._eventlet.service [None req-11315ded-d4a8-4268-a61d-0d56934e6b85 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=91786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:25 devstack cinder-volume[91786]: DEBUG oslo_service.backend._eventlet.service [None req-11315ded-d4a8-4268-a61d-0d56934e6b85 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=91786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:25 devstack cinder-volume[91786]: DEBUG oslo_service.backend._eventlet.service [None req-11315ded-d4a8-4268-a61d-0d56934e6b85 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=91786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:25 devstack cinder-volume[91786]: DEBUG oslo_service.backend._eventlet.service [None req-11315ded-d4a8-4268-a61d-0d56934e6b85 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=91786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:25 devstack cinder-volume[91786]: DEBUG oslo_service.backend._eventlet.service [None req-11315ded-d4a8-4268-a61d-0d56934e6b85 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=91786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:25 devstack cinder-volume[91786]: DEBUG oslo_service.backend._eventlet.service [None req-11315ded-d4a8-4268-a61d-0d56934e6b85 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=91786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:25 devstack cinder-volume[91786]: DEBUG oslo_service.backend._eventlet.service [None req-11315ded-d4a8-4268-a61d-0d56934e6b85 None None] keystone_authtoken.memcache_username = {{(pid=91786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:25 devstack cinder-volume[91786]: DEBUG oslo_service.backend._eventlet.service [None req-11315ded-d4a8-4268-a61d-0d56934e6b85 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=91786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:25 devstack cinder-volume[91786]: DEBUG oslo_service.backend._eventlet.service [None req-11315ded-d4a8-4268-a61d-0d56934e6b85 None None] keystone_authtoken.region_name = None {{(pid=91786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:25 devstack cinder-volume[91786]: DEBUG oslo_service.backend._eventlet.service [None req-11315ded-d4a8-4268-a61d-0d56934e6b85 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=91786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:25 devstack cinder-volume[91786]: DEBUG oslo_service.backend._eventlet.service [None req-11315ded-d4a8-4268-a61d-0d56934e6b85 None None] keystone_authtoken.service_token_roles_required = False {{(pid=91786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:25 devstack cinder-volume[91786]: DEBUG oslo_service.backend._eventlet.service [None req-11315ded-d4a8-4268-a61d-0d56934e6b85 None None] keystone_authtoken.service_type = None {{(pid=91786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:25 devstack cinder-volume[91786]: DEBUG oslo_service.backend._eventlet.service [None req-11315ded-d4a8-4268-a61d-0d56934e6b85 None None] keystone_authtoken.token_cache_time = 300 {{(pid=91786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:25 devstack cinder-volume[91786]: DEBUG oslo_service.backend._eventlet.service [None req-11315ded-d4a8-4268-a61d-0d56934e6b85 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.240/identity {{(pid=91786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:25 devstack cinder-volume[91786]: DEBUG oslo_service.backend._eventlet.service [None req-11315ded-d4a8-4268-a61d-0d56934e6b85 None None] cache.backend = dogpile.cache.null {{(pid=91786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:25 devstack cinder-volume[91786]: DEBUG oslo_service.backend._eventlet.service [None req-11315ded-d4a8-4268-a61d-0d56934e6b85 None None] cache.backend_argument = **** {{(pid=91786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:25 devstack cinder-volume[91786]: DEBUG oslo_service.backend._eventlet.service [None req-11315ded-d4a8-4268-a61d-0d56934e6b85 None None] cache.backend_expiration_time = None {{(pid=91786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:25 devstack cinder-volume[91786]: DEBUG oslo_service.backend._eventlet.service [None req-11315ded-d4a8-4268-a61d-0d56934e6b85 None None] cache.config_prefix = cache.oslo {{(pid=91786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:25 devstack cinder-volume[91786]: DEBUG oslo_service.backend._eventlet.service [None req-11315ded-d4a8-4268-a61d-0d56934e6b85 None None] cache.debug_cache_backend = False {{(pid=91786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:25 devstack cinder-volume[91786]: DEBUG oslo_service.backend._eventlet.service [None req-11315ded-d4a8-4268-a61d-0d56934e6b85 None None] cache.enable_retry_client = False {{(pid=91786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:25 devstack cinder-volume[91786]: DEBUG oslo_service.backend._eventlet.service [None req-11315ded-d4a8-4268-a61d-0d56934e6b85 None None] cache.enable_socket_keepalive = False {{(pid=91786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:25 devstack cinder-volume[91786]: DEBUG oslo_service.backend._eventlet.service [None req-11315ded-d4a8-4268-a61d-0d56934e6b85 None None] cache.enabled = False {{(pid=91786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:25 devstack cinder-volume[91786]: DEBUG oslo_service.backend._eventlet.service [None req-11315ded-d4a8-4268-a61d-0d56934e6b85 None None] cache.enforce_fips_mode = False {{(pid=91786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:25 devstack cinder-volume[91786]: DEBUG oslo_service.backend._eventlet.service [None req-11315ded-d4a8-4268-a61d-0d56934e6b85 None None] cache.expiration_time = 600 {{(pid=91786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:25 devstack cinder-volume[91786]: DEBUG oslo_service.backend._eventlet.service [None req-11315ded-d4a8-4268-a61d-0d56934e6b85 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=91786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:25 devstack cinder-volume[91786]: DEBUG oslo_service.backend._eventlet.service [None req-11315ded-d4a8-4268-a61d-0d56934e6b85 None None] cache.hashclient_retry_attempts = 2 {{(pid=91786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:25 devstack cinder-volume[91786]: DEBUG oslo_service.backend._eventlet.service [None req-11315ded-d4a8-4268-a61d-0d56934e6b85 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=91786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:25 devstack cinder-volume[91786]: DEBUG oslo_service.backend._eventlet.service [None req-11315ded-d4a8-4268-a61d-0d56934e6b85 None None] cache.memcache_dead_retry = 300 {{(pid=91786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:25 devstack cinder-volume[91786]: DEBUG oslo_service.backend._eventlet.service [None req-11315ded-d4a8-4268-a61d-0d56934e6b85 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=91786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:25 devstack cinder-volume[91786]: DEBUG oslo_service.backend._eventlet.service [None req-11315ded-d4a8-4268-a61d-0d56934e6b85 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=91786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:25 devstack cinder-volume[91786]: DEBUG oslo_service.backend._eventlet.service [None req-11315ded-d4a8-4268-a61d-0d56934e6b85 None None] cache.memcache_pool_maxsize = 10 {{(pid=91786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:25 devstack cinder-volume[91786]: DEBUG oslo_service.backend._eventlet.service [None req-11315ded-d4a8-4268-a61d-0d56934e6b85 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=91786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:25 devstack cinder-volume[91786]: DEBUG oslo_service.backend._eventlet.service [None req-11315ded-d4a8-4268-a61d-0d56934e6b85 None None] cache.memcache_sasl_enabled = False {{(pid=91786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:25 devstack cinder-volume[91786]: DEBUG oslo_service.backend._eventlet.service [None req-11315ded-d4a8-4268-a61d-0d56934e6b85 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=91786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:25 devstack cinder-volume[91786]: DEBUG oslo_service.backend._eventlet.service [None req-11315ded-d4a8-4268-a61d-0d56934e6b85 None None] cache.password = **** {{(pid=91786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:25 devstack cinder-volume[91786]: DEBUG oslo_service.backend._eventlet.service [None req-11315ded-d4a8-4268-a61d-0d56934e6b85 None None] cache.proxies = [] {{(pid=91786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:25 devstack cinder-volume[91786]: DEBUG oslo_service.backend._eventlet.service [None req-11315ded-d4a8-4268-a61d-0d56934e6b85 None None] cache.redis_db = 0 {{(pid=91786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:25 devstack cinder-volume[91786]: DEBUG oslo_service.backend._eventlet.service [None req-11315ded-d4a8-4268-a61d-0d56934e6b85 None None] cache.redis_sentinel_service_name = mymaster {{(pid=91786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:25 devstack cinder-volume[91786]: DEBUG oslo_service.backend._eventlet.service [None req-11315ded-d4a8-4268-a61d-0d56934e6b85 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=91786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:25 devstack cinder-volume[91786]: DEBUG oslo_service.backend._eventlet.service [None req-11315ded-d4a8-4268-a61d-0d56934e6b85 None None] cache.redis_server = localhost:6379 {{(pid=91786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:25 devstack cinder-volume[91786]: DEBUG oslo_service.backend._eventlet.service [None req-11315ded-d4a8-4268-a61d-0d56934e6b85 None None] cache.retry_attempts = 2 {{(pid=91786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:25 devstack cinder-volume[91786]: DEBUG oslo_service.backend._eventlet.service [None req-11315ded-d4a8-4268-a61d-0d56934e6b85 None None] cache.retry_delay = 0.0 {{(pid=91786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:25 devstack cinder-volume[91786]: DEBUG oslo_service.backend._eventlet.service [None req-11315ded-d4a8-4268-a61d-0d56934e6b85 None None] cache.socket_keepalive_count = 1 {{(pid=91786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:25 devstack cinder-volume[91786]: DEBUG oslo_service.backend._eventlet.service [None req-11315ded-d4a8-4268-a61d-0d56934e6b85 None None] cache.socket_keepalive_idle = 1 {{(pid=91786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:25 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-1c716dff-48f1-4574-9314-02d3d9dae629 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=92060) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:305}} Jun 17 04:34:25 devstack cinder-volume[92060]: WARNING cinder.volume.drivers.quobyte [None req-1c716dff-48f1-4574-9314-02d3d9dae629 None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Jun 17 04:34:25 devstack cinder-volume[91786]: DEBUG oslo_service.backend._eventlet.service [None req-11315ded-d4a8-4268-a61d-0d56934e6b85 None None] cache.socket_keepalive_interval = 1 {{(pid=91786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:25 devstack cinder-volume[91786]: DEBUG oslo_service.backend._eventlet.service [None req-11315ded-d4a8-4268-a61d-0d56934e6b85 None None] cache.socket_timeout = 1.0 {{(pid=91786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:25 devstack cinder-volume[91786]: DEBUG oslo_service.backend._eventlet.service [None req-11315ded-d4a8-4268-a61d-0d56934e6b85 None None] cache.tls_allowed_ciphers = None {{(pid=91786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:25 devstack cinder-volume[92060]: WARNING cinder.volume.drivers.quobyte [None req-1c716dff-48f1-4574-9314-02d3d9dae629 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Jun 17 04:34:25 devstack cinder-volume[91786]: DEBUG oslo_service.backend._eventlet.service [None req-11315ded-d4a8-4268-a61d-0d56934e6b85 None None] cache.tls_cafile = None {{(pid=91786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:25 devstack cinder-volume[91786]: DEBUG oslo_service.backend._eventlet.service [None req-11315ded-d4a8-4268-a61d-0d56934e6b85 None None] cache.tls_certfile = None {{(pid=91786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:25 devstack cinder-volume[91786]: DEBUG oslo_service.backend._eventlet.service [None req-11315ded-d4a8-4268-a61d-0d56934e6b85 None None] cache.tls_enabled = False {{(pid=91786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:25 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-1c716dff-48f1-4574-9314-02d3d9dae629 None None] Running cmd (subprocess): mount.quobyte {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:34:25 devstack cinder-volume[91786]: DEBUG oslo_service.backend._eventlet.service [None req-11315ded-d4a8-4268-a61d-0d56934e6b85 None None] cache.tls_keyfile = None {{(pid=91786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:25 devstack cinder-volume[91786]: DEBUG oslo_service.backend._eventlet.service [None req-11315ded-d4a8-4268-a61d-0d56934e6b85 None None] cache.username = None {{(pid=91786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:25 devstack cinder-volume[91786]: DEBUG oslo_service.backend._eventlet.service [None req-11315ded-d4a8-4268-a61d-0d56934e6b85 None None] database.asyncio_connection = **** {{(pid=91786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:25 devstack cinder-volume[91786]: DEBUG oslo_service.backend._eventlet.service [None req-11315ded-d4a8-4268-a61d-0d56934e6b85 None None] database.asyncio_slave_connection = **** {{(pid=91786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:25 devstack cinder-volume[91786]: DEBUG oslo_service.backend._eventlet.service [None req-11315ded-d4a8-4268-a61d-0d56934e6b85 None None] database.backend = sqlalchemy {{(pid=91786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:25 devstack cinder-volume[91786]: DEBUG oslo_service.backend._eventlet.service [None req-11315ded-d4a8-4268-a61d-0d56934e6b85 None None] database.connection = **** {{(pid=91786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:25 devstack cinder-volume[91786]: DEBUG oslo_service.backend._eventlet.service [None req-11315ded-d4a8-4268-a61d-0d56934e6b85 None None] database.connection_debug = 0 {{(pid=91786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:25 devstack cinder-volume[91786]: DEBUG oslo_service.backend._eventlet.service [None req-11315ded-d4a8-4268-a61d-0d56934e6b85 None None] database.connection_parameters = {{(pid=91786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:25 devstack cinder-volume[91786]: DEBUG oslo_service.backend._eventlet.service [None req-11315ded-d4a8-4268-a61d-0d56934e6b85 None None] database.connection_recycle_time = 3600 {{(pid=91786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:25 devstack cinder-volume[91786]: DEBUG oslo_service.backend._eventlet.service [None req-11315ded-d4a8-4268-a61d-0d56934e6b85 None None] database.connection_trace = False {{(pid=91786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:25 devstack cinder-volume[91786]: DEBUG oslo_service.backend._eventlet.service [None req-11315ded-d4a8-4268-a61d-0d56934e6b85 None None] database.db_inc_retry_interval = True {{(pid=91786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:25 devstack cinder-volume[91786]: DEBUG oslo_service.backend._eventlet.service [None req-11315ded-d4a8-4268-a61d-0d56934e6b85 None None] database.db_max_retries = 20 {{(pid=91786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:25 devstack cinder-volume[91786]: DEBUG oslo_service.backend._eventlet.service [None req-11315ded-d4a8-4268-a61d-0d56934e6b85 None None] database.db_max_retry_interval = 10 {{(pid=91786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:25 devstack cinder-volume[91786]: DEBUG oslo_service.backend._eventlet.service [None req-11315ded-d4a8-4268-a61d-0d56934e6b85 None None] database.db_retry_interval = 1 {{(pid=91786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:25 devstack cinder-volume[91786]: DEBUG oslo_service.backend._eventlet.service [None req-11315ded-d4a8-4268-a61d-0d56934e6b85 None None] database.max_overflow = 50 {{(pid=91786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:25 devstack cinder-volume[91786]: DEBUG oslo_service.backend._eventlet.service [None req-11315ded-d4a8-4268-a61d-0d56934e6b85 None None] database.max_pool_size = 5 {{(pid=91786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:25 devstack cinder-volume[91786]: DEBUG oslo_service.backend._eventlet.service [None req-11315ded-d4a8-4268-a61d-0d56934e6b85 None None] database.max_retries = 10 {{(pid=91786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:25 devstack cinder-volume[91786]: DEBUG oslo_service.backend._eventlet.service [None req-11315ded-d4a8-4268-a61d-0d56934e6b85 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=91786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:25 devstack cinder-volume[91786]: DEBUG oslo_service.backend._eventlet.service [None req-11315ded-d4a8-4268-a61d-0d56934e6b85 None None] database.mysql_wsrep_sync_wait = None {{(pid=91786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:25 devstack cinder-volume[91786]: DEBUG oslo_service.backend._eventlet.service [None req-11315ded-d4a8-4268-a61d-0d56934e6b85 None None] database.pool_timeout = None {{(pid=91786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:25 devstack cinder-volume[91786]: DEBUG oslo_service.backend._eventlet.service [None req-11315ded-d4a8-4268-a61d-0d56934e6b85 None None] database.retry_interval = 10 {{(pid=91786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:25 devstack cinder-volume[91786]: DEBUG oslo_service.backend._eventlet.service [None req-11315ded-d4a8-4268-a61d-0d56934e6b85 None None] database.slave_connection = **** {{(pid=91786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:25 devstack cinder-volume[91786]: DEBUG oslo_service.backend._eventlet.service [None req-11315ded-d4a8-4268-a61d-0d56934e6b85 None None] database.sqlite_synchronous = True {{(pid=91786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:25 devstack cinder-volume[91786]: DEBUG oslo_service.backend._eventlet.service [None req-11315ded-d4a8-4268-a61d-0d56934e6b85 None None] database.synchronous_reader = True {{(pid=91786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:25 devstack cinder-volume[91786]: DEBUG oslo_service.backend._eventlet.service [None req-11315ded-d4a8-4268-a61d-0d56934e6b85 None None] database.use_db_reconnect = False {{(pid=91786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:25 devstack cinder-volume[91786]: DEBUG oslo_service.backend._eventlet.service [None req-11315ded-d4a8-4268-a61d-0d56934e6b85 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=91786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:25 devstack cinder-volume[91786]: DEBUG oslo_service.backend._eventlet.service [None req-11315ded-d4a8-4268-a61d-0d56934e6b85 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=91786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:25 devstack cinder-volume[91786]: DEBUG oslo_service.backend._eventlet.service [None req-11315ded-d4a8-4268-a61d-0d56934e6b85 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=91786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:25 devstack cinder-volume[91786]: DEBUG oslo_service.backend._eventlet.service [None req-11315ded-d4a8-4268-a61d-0d56934e6b85 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=91786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:25 devstack cinder-volume[91786]: DEBUG oslo_service.backend._eventlet.service [None req-11315ded-d4a8-4268-a61d-0d56934e6b85 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=91786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:25 devstack cinder-volume[91786]: DEBUG oslo_service.backend._eventlet.service [None req-11315ded-d4a8-4268-a61d-0d56934e6b85 None None] profiler.connection_string = messaging:// {{(pid=91786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:25 devstack cinder-volume[91786]: DEBUG oslo_service.backend._eventlet.service [None req-11315ded-d4a8-4268-a61d-0d56934e6b85 None None] profiler.enabled = False {{(pid=91786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:25 devstack cinder-volume[91786]: DEBUG oslo_service.backend._eventlet.service [None req-11315ded-d4a8-4268-a61d-0d56934e6b85 None None] profiler.es_doc_type = notification {{(pid=91786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:25 devstack cinder-volume[91786]: DEBUG oslo_service.backend._eventlet.service [None req-11315ded-d4a8-4268-a61d-0d56934e6b85 None None] profiler.es_scroll_size = 10000 {{(pid=91786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:25 devstack cinder-volume[91786]: DEBUG oslo_service.backend._eventlet.service [None req-11315ded-d4a8-4268-a61d-0d56934e6b85 None None] profiler.es_scroll_time = 2m {{(pid=91786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:25 devstack cinder-volume[91786]: DEBUG oslo_service.backend._eventlet.service [None req-11315ded-d4a8-4268-a61d-0d56934e6b85 None None] profiler.filter_error_trace = False {{(pid=91786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:25 devstack cinder-volume[91786]: DEBUG oslo_service.backend._eventlet.service [None req-11315ded-d4a8-4268-a61d-0d56934e6b85 None None] profiler.hmac_keys = **** {{(pid=91786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:25 devstack cinder-volume[91786]: DEBUG oslo_service.backend._eventlet.service [None req-11315ded-d4a8-4268-a61d-0d56934e6b85 None None] profiler.sentinel_service_name = mymaster {{(pid=91786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:25 devstack cinder-volume[91786]: DEBUG oslo_service.backend._eventlet.service [None req-11315ded-d4a8-4268-a61d-0d56934e6b85 None None] profiler.socket_timeout = 0.1 {{(pid=91786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:25 devstack cinder-volume[91786]: DEBUG oslo_service.backend._eventlet.service [None req-11315ded-d4a8-4268-a61d-0d56934e6b85 None None] profiler.trace_requests = False {{(pid=91786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:25 devstack cinder-volume[91786]: DEBUG oslo_service.backend._eventlet.service [None req-11315ded-d4a8-4268-a61d-0d56934e6b85 None None] profiler.trace_sqlalchemy = False {{(pid=91786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:25 devstack cinder-volume[91786]: DEBUG oslo_service.backend._eventlet.service [None req-11315ded-d4a8-4268-a61d-0d56934e6b85 None None] profiler_jaeger.process_tags = {} {{(pid=91786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:25 devstack cinder-volume[91786]: DEBUG oslo_service.backend._eventlet.service [None req-11315ded-d4a8-4268-a61d-0d56934e6b85 None None] profiler_jaeger.service_name_prefix = None {{(pid=91786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:25 devstack cinder-volume[91786]: DEBUG oslo_service.backend._eventlet.service [None req-11315ded-d4a8-4268-a61d-0d56934e6b85 None None] profiler_otlp.service_name_prefix = None {{(pid=91786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:25 devstack cinder-volume[91786]: DEBUG oslo_service.backend._eventlet.service [None req-11315ded-d4a8-4268-a61d-0d56934e6b85 None None] oslo_policy.enforce_new_defaults = False {{(pid=91786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:25 devstack cinder-volume[91786]: WARNING oslo_config.cfg [None req-11315ded-d4a8-4268-a61d-0d56934e6b85 None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.). Its value may be silently ignored in the future. Jun 17 04:34:25 devstack cinder-volume[91786]: DEBUG oslo_service.backend._eventlet.service [None req-11315ded-d4a8-4268-a61d-0d56934e6b85 None None] oslo_policy.enforce_scope = False {{(pid=91786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:25 devstack cinder-volume[91786]: DEBUG oslo_service.backend._eventlet.service [None req-11315ded-d4a8-4268-a61d-0d56934e6b85 None None] oslo_policy.policy_default_rule = default {{(pid=91786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:25 devstack cinder-volume[91786]: DEBUG oslo_service.backend._eventlet.service [None req-11315ded-d4a8-4268-a61d-0d56934e6b85 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=91786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:25 devstack cinder-volume[91786]: DEBUG oslo_service.backend._eventlet.service [None req-11315ded-d4a8-4268-a61d-0d56934e6b85 None None] oslo_policy.policy_file = policy.yaml {{(pid=91786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:25 devstack cinder-volume[91786]: DEBUG oslo_service.backend._eventlet.service [None req-11315ded-d4a8-4268-a61d-0d56934e6b85 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=91786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:25 devstack cinder-volume[91786]: DEBUG oslo_service.backend._eventlet.service [None req-11315ded-d4a8-4268-a61d-0d56934e6b85 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=91786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:25 devstack cinder-volume[91786]: DEBUG oslo_service.backend._eventlet.service [None req-11315ded-d4a8-4268-a61d-0d56934e6b85 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=91786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:25 devstack cinder-volume[91786]: DEBUG oslo_service.backend._eventlet.service [None req-11315ded-d4a8-4268-a61d-0d56934e6b85 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=91786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:25 devstack cinder-volume[91786]: DEBUG oslo_service.backend._eventlet.service [None req-11315ded-d4a8-4268-a61d-0d56934e6b85 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=91786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:25 devstack cinder-volume[91786]: DEBUG oslo_service.backend._eventlet.service [None req-11315ded-d4a8-4268-a61d-0d56934e6b85 None None] oslo_policy.remote_timeout = 60.0 {{(pid=91786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:25 devstack cinder-volume[91786]: DEBUG oslo_service.backend._eventlet.service [None req-11315ded-d4a8-4268-a61d-0d56934e6b85 None None] coordination.backend_url = **** {{(pid=91786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:25 devstack cinder-volume[91786]: DEBUG oslo_service.backend._eventlet.service [None req-11315ded-d4a8-4268-a61d-0d56934e6b85 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=91786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:25 devstack cinder-volume[91786]: DEBUG oslo_service.backend._eventlet.service [None req-11315ded-d4a8-4268-a61d-0d56934e6b85 None None] privsep_osbrick.group = None {{(pid=91786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:25 devstack cinder-volume[91786]: DEBUG oslo_service.backend._eventlet.service [None req-11315ded-d4a8-4268-a61d-0d56934e6b85 None None] privsep_osbrick.helper_command = None {{(pid=91786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:25 devstack cinder-volume[91786]: DEBUG oslo_service.backend._eventlet.service [None req-11315ded-d4a8-4268-a61d-0d56934e6b85 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=91786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:25 devstack cinder-volume[91786]: DEBUG oslo_service.backend._eventlet.service [None req-11315ded-d4a8-4268-a61d-0d56934e6b85 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=91786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:25 devstack cinder-volume[91786]: DEBUG oslo_service.backend._eventlet.service [None req-11315ded-d4a8-4268-a61d-0d56934e6b85 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=91786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:25 devstack cinder-volume[91786]: DEBUG oslo_service.backend._eventlet.service [None req-11315ded-d4a8-4268-a61d-0d56934e6b85 None None] privsep_osbrick.user = None {{(pid=91786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:25 devstack cinder-volume[91786]: DEBUG oslo_service.backend._eventlet.service [None req-11315ded-d4a8-4268-a61d-0d56934e6b85 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=91786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:25 devstack cinder-volume[91786]: DEBUG oslo_service.backend._eventlet.service [None req-11315ded-d4a8-4268-a61d-0d56934e6b85 None None] cinder_sys_admin.group = None {{(pid=91786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:25 devstack cinder-volume[91786]: DEBUG oslo_service.backend._eventlet.service [None req-11315ded-d4a8-4268-a61d-0d56934e6b85 None None] cinder_sys_admin.helper_command = None {{(pid=91786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:25 devstack cinder-volume[91786]: DEBUG oslo_service.backend._eventlet.service [None req-11315ded-d4a8-4268-a61d-0d56934e6b85 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=91786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:25 devstack cinder-volume[91786]: DEBUG oslo_service.backend._eventlet.service [None req-11315ded-d4a8-4268-a61d-0d56934e6b85 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=91786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:25 devstack cinder-volume[91786]: DEBUG oslo_service.backend._eventlet.service [None req-11315ded-d4a8-4268-a61d-0d56934e6b85 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=91786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:25 devstack cinder-volume[91786]: DEBUG oslo_service.backend._eventlet.service [None req-11315ded-d4a8-4268-a61d-0d56934e6b85 None None] cinder_sys_admin.user = None {{(pid=91786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:25 devstack cinder-volume[91786]: DEBUG oslo_service.backend._eventlet.service [None req-11315ded-d4a8-4268-a61d-0d56934e6b85 None None] service_user.auth_section = None {{(pid=91786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:25 devstack cinder-volume[91786]: DEBUG oslo_service.backend._eventlet.service [None req-11315ded-d4a8-4268-a61d-0d56934e6b85 None None] service_user.auth_type = password {{(pid=91786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:25 devstack cinder-volume[91786]: DEBUG oslo_service.backend._eventlet.service [None req-11315ded-d4a8-4268-a61d-0d56934e6b85 None None] service_user.cafile = None {{(pid=91786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:25 devstack cinder-volume[91786]: DEBUG oslo_service.backend._eventlet.service [None req-11315ded-d4a8-4268-a61d-0d56934e6b85 None None] service_user.certfile = None {{(pid=91786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:25 devstack cinder-volume[91786]: DEBUG oslo_service.backend._eventlet.service [None req-11315ded-d4a8-4268-a61d-0d56934e6b85 None None] service_user.collect_timing = False {{(pid=91786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:25 devstack cinder-volume[91786]: DEBUG oslo_service.backend._eventlet.service [None req-11315ded-d4a8-4268-a61d-0d56934e6b85 None None] service_user.insecure = False {{(pid=91786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:25 devstack cinder-volume[91786]: DEBUG oslo_service.backend._eventlet.service [None req-11315ded-d4a8-4268-a61d-0d56934e6b85 None None] service_user.keyfile = None {{(pid=91786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:25 devstack cinder-volume[91786]: DEBUG oslo_service.backend._eventlet.service [None req-11315ded-d4a8-4268-a61d-0d56934e6b85 None None] service_user.send_service_user_token = True {{(pid=91786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:25 devstack cinder-volume[91786]: DEBUG oslo_service.backend._eventlet.service [None req-11315ded-d4a8-4268-a61d-0d56934e6b85 None None] service_user.split_loggers = False {{(pid=91786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:25 devstack cinder-volume[91786]: DEBUG oslo_service.backend._eventlet.service [None req-11315ded-d4a8-4268-a61d-0d56934e6b85 None None] service_user.timeout = None {{(pid=91786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:25 devstack cinder-volume[91786]: DEBUG oslo_service.backend._eventlet.service [None req-11315ded-d4a8-4268-a61d-0d56934e6b85 None None] glance.auth_section = None {{(pid=91786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:25 devstack cinder-volume[91786]: DEBUG oslo_service.backend._eventlet.service [None req-11315ded-d4a8-4268-a61d-0d56934e6b85 None None] glance.auth_type = password {{(pid=91786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:25 devstack cinder-volume[91786]: DEBUG oslo_service.backend._eventlet.service [None req-11315ded-d4a8-4268-a61d-0d56934e6b85 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=91786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:25 devstack cinder-volume[91786]: DEBUG oslo_service.backend._eventlet.service [None req-11315ded-d4a8-4268-a61d-0d56934e6b85 None None] glance.certfile = None {{(pid=91786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:25 devstack cinder-volume[91786]: DEBUG oslo_service.backend._eventlet.service [None req-11315ded-d4a8-4268-a61d-0d56934e6b85 None None] glance.collect_timing = False {{(pid=91786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:25 devstack cinder-volume[91786]: DEBUG oslo_service.backend._eventlet.service [None req-11315ded-d4a8-4268-a61d-0d56934e6b85 None None] glance.insecure = False {{(pid=91786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:25 devstack cinder-volume[91786]: DEBUG oslo_service.backend._eventlet.service [None req-11315ded-d4a8-4268-a61d-0d56934e6b85 None None] glance.keyfile = None {{(pid=91786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:25 devstack cinder-volume[91786]: DEBUG oslo_service.backend._eventlet.service [None req-11315ded-d4a8-4268-a61d-0d56934e6b85 None None] glance.region_name = None {{(pid=91786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:25 devstack cinder-volume[91786]: DEBUG oslo_service.backend._eventlet.service [None req-11315ded-d4a8-4268-a61d-0d56934e6b85 None None] glance.split_loggers = False {{(pid=91786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:25 devstack cinder-volume[91786]: DEBUG oslo_service.backend._eventlet.service [None req-11315ded-d4a8-4268-a61d-0d56934e6b85 None None] glance.timeout = None {{(pid=91786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:25 devstack cinder-volume[91786]: DEBUG oslo_service.backend._eventlet.service [None req-11315ded-d4a8-4268-a61d-0d56934e6b85 None None] backend_defaults.backend_availability_zone = None {{(pid=91786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:25 devstack cinder-volume[91786]: DEBUG oslo_service.backend._eventlet.service [None req-11315ded-d4a8-4268-a61d-0d56934e6b85 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=91786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:25 devstack cinder-volume[91786]: DEBUG oslo_service.backend._eventlet.service [None req-11315ded-d4a8-4268-a61d-0d56934e6b85 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=91786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:25 devstack cinder-volume[91786]: DEBUG oslo_service.backend._eventlet.service [None req-11315ded-d4a8-4268-a61d-0d56934e6b85 None None] backend_defaults.chap_password = **** {{(pid=91786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:25 devstack cinder-volume[91786]: DEBUG oslo_service.backend._eventlet.service [None req-11315ded-d4a8-4268-a61d-0d56934e6b85 None None] backend_defaults.chap_username = {{(pid=91786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:25 devstack cinder-volume[91786]: DEBUG oslo_service.backend._eventlet.service [None req-11315ded-d4a8-4268-a61d-0d56934e6b85 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=91786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:25 devstack cinder-volume[91786]: DEBUG oslo_service.backend._eventlet.service [None req-11315ded-d4a8-4268-a61d-0d56934e6b85 None None] backend_defaults.disk_geometry = None {{(pid=91786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:25 devstack cinder-volume[91786]: DEBUG oslo_service.backend._eventlet.service [None req-11315ded-d4a8-4268-a61d-0d56934e6b85 None None] backend_defaults.driver_client_cert = None {{(pid=91786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:25 devstack cinder-volume[91786]: DEBUG oslo_service.backend._eventlet.service [None req-11315ded-d4a8-4268-a61d-0d56934e6b85 None None] backend_defaults.driver_client_cert_key = None {{(pid=91786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:25 devstack cinder-volume[91786]: DEBUG oslo_service.backend._eventlet.service [None req-11315ded-d4a8-4268-a61d-0d56934e6b85 None None] backend_defaults.driver_data_namespace = None {{(pid=91786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:25 devstack cinder-volume[91786]: DEBUG oslo_service.backend._eventlet.service [None req-11315ded-d4a8-4268-a61d-0d56934e6b85 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=91786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:25 devstack cinder-volume[91786]: DEBUG oslo_service.backend._eventlet.service [None req-11315ded-d4a8-4268-a61d-0d56934e6b85 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=91786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:25 devstack cinder-volume[91786]: DEBUG oslo_service.backend._eventlet.service [None req-11315ded-d4a8-4268-a61d-0d56934e6b85 None None] backend_defaults.driver_use_ssl = False {{(pid=91786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:25 devstack cinder-volume[91786]: DEBUG oslo_service.backend._eventlet.service [None req-11315ded-d4a8-4268-a61d-0d56934e6b85 None None] backend_defaults.enable_unsupported_driver = False {{(pid=91786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:25 devstack cinder-volume[91786]: DEBUG oslo_service.backend._eventlet.service [None req-11315ded-d4a8-4268-a61d-0d56934e6b85 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=91786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:25 devstack cinder-volume[91786]: DEBUG oslo_service.backend._eventlet.service [None req-11315ded-d4a8-4268-a61d-0d56934e6b85 None None] backend_defaults.extra_capabilities = {} {{(pid=91786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:25 devstack cinder-volume[91786]: DEBUG oslo_service.backend._eventlet.service [None req-11315ded-d4a8-4268-a61d-0d56934e6b85 None None] backend_defaults.filter_function = None {{(pid=91786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:25 devstack cinder-volume[91786]: DEBUG oslo_service.backend._eventlet.service [None req-11315ded-d4a8-4268-a61d-0d56934e6b85 None None] backend_defaults.goodness_function = None {{(pid=91786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:25 devstack cinder-volume[91786]: DEBUG oslo_service.backend._eventlet.service [None req-11315ded-d4a8-4268-a61d-0d56934e6b85 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=91786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:25 devstack cinder-volume[91786]: DEBUG oslo_service.backend._eventlet.service [None req-11315ded-d4a8-4268-a61d-0d56934e6b85 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=91786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:25 devstack cinder-volume[91786]: DEBUG oslo_service.backend._eventlet.service [None req-11315ded-d4a8-4268-a61d-0d56934e6b85 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=91786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:25 devstack cinder-volume[91786]: DEBUG oslo_service.backend._eventlet.service [None req-11315ded-d4a8-4268-a61d-0d56934e6b85 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=91786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:25 devstack cinder-volume[91786]: DEBUG oslo_service.backend._eventlet.service [None req-11315ded-d4a8-4268-a61d-0d56934e6b85 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=91786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:25 devstack cinder-volume[91786]: DEBUG oslo_service.backend._eventlet.service [None req-11315ded-d4a8-4268-a61d-0d56934e6b85 None None] backend_defaults.iscsi_target_flags = {{(pid=91786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:25 devstack cinder-volume[91786]: DEBUG oslo_service.backend._eventlet.service [None req-11315ded-d4a8-4268-a61d-0d56934e6b85 None None] backend_defaults.iscsi_write_cache = on {{(pid=91786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:25 devstack cinder-volume[91786]: DEBUG oslo_service.backend._eventlet.service [None req-11315ded-d4a8-4268-a61d-0d56934e6b85 None None] backend_defaults.iser_helper = tgtadm {{(pid=91786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:25 devstack cinder-volume[91786]: DEBUG oslo_service.backend._eventlet.service [None req-11315ded-d4a8-4268-a61d-0d56934e6b85 None None] backend_defaults.iser_ip_address = 192.168.122.240 {{(pid=91786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:25 devstack cinder-volume[91786]: DEBUG oslo_service.backend._eventlet.service [None req-11315ded-d4a8-4268-a61d-0d56934e6b85 None None] backend_defaults.iser_port = 3260 {{(pid=91786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:25 devstack cinder-volume[91786]: DEBUG oslo_service.backend._eventlet.service [None req-11315ded-d4a8-4268-a61d-0d56934e6b85 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=91786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:25 devstack cinder-volume[91786]: DEBUG oslo_service.backend._eventlet.service [None req-11315ded-d4a8-4268-a61d-0d56934e6b85 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=91786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:25 devstack cinder-volume[91786]: DEBUG oslo_service.backend._eventlet.service [None req-11315ded-d4a8-4268-a61d-0d56934e6b85 None None] backend_defaults.nas_host = {{(pid=91786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:25 devstack cinder-volume[91786]: DEBUG oslo_service.backend._eventlet.service [None req-11315ded-d4a8-4268-a61d-0d56934e6b85 None None] backend_defaults.nas_login = admin {{(pid=91786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:25 devstack cinder-volume[91786]: DEBUG oslo_service.backend._eventlet.service [None req-11315ded-d4a8-4268-a61d-0d56934e6b85 None None] backend_defaults.nas_mount_options = None {{(pid=91786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:25 devstack cinder-volume[91786]: DEBUG oslo_service.backend._eventlet.service [None req-11315ded-d4a8-4268-a61d-0d56934e6b85 None None] backend_defaults.nas_password = **** {{(pid=91786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:25 devstack cinder-volume[91786]: DEBUG oslo_service.backend._eventlet.service [None req-11315ded-d4a8-4268-a61d-0d56934e6b85 None None] backend_defaults.nas_private_key = {{(pid=91786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:25 devstack cinder-volume[91786]: DEBUG oslo_service.backend._eventlet.service [None req-11315ded-d4a8-4268-a61d-0d56934e6b85 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=91786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:25 devstack cinder-volume[91786]: DEBUG oslo_service.backend._eventlet.service [None req-11315ded-d4a8-4268-a61d-0d56934e6b85 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=91786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:25 devstack cinder-volume[91786]: DEBUG oslo_service.backend._eventlet.service [None req-11315ded-d4a8-4268-a61d-0d56934e6b85 None None] backend_defaults.nas_share_path = {{(pid=91786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:25 devstack cinder-volume[91786]: DEBUG oslo_service.backend._eventlet.service [None req-11315ded-d4a8-4268-a61d-0d56934e6b85 None None] backend_defaults.nas_ssh_port = 22 {{(pid=91786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:25 devstack cinder-volume[91786]: DEBUG oslo_service.backend._eventlet.service [None req-11315ded-d4a8-4268-a61d-0d56934e6b85 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=91786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:25 devstack cinder-volume[91786]: DEBUG oslo_service.backend._eventlet.service [None req-11315ded-d4a8-4268-a61d-0d56934e6b85 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=91786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:25 devstack cinder-volume[91786]: DEBUG oslo_service.backend._eventlet.service [None req-11315ded-d4a8-4268-a61d-0d56934e6b85 None None] backend_defaults.num_shell_tries = 3 {{(pid=91786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:25 devstack cinder-volume[91786]: DEBUG oslo_service.backend._eventlet.service [None req-11315ded-d4a8-4268-a61d-0d56934e6b85 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=91786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:25 devstack cinder-volume[91786]: DEBUG oslo_service.backend._eventlet.service [None req-11315ded-d4a8-4268-a61d-0d56934e6b85 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=91786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:25 devstack cinder-volume[91786]: DEBUG oslo_service.backend._eventlet.service [None req-11315ded-d4a8-4268-a61d-0d56934e6b85 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=91786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:25 devstack cinder-volume[91786]: DEBUG oslo_service.backend._eventlet.service [None req-11315ded-d4a8-4268-a61d-0d56934e6b85 None None] backend_defaults.nvmet_port_id = 1 {{(pid=91786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:25 devstack cinder-volume[91786]: DEBUG oslo_service.backend._eventlet.service [None req-11315ded-d4a8-4268-a61d-0d56934e6b85 None None] backend_defaults.quobyte_client_cfg = None {{(pid=91786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:25 devstack cinder-volume[91786]: DEBUG oslo_service.backend._eventlet.service [None req-11315ded-d4a8-4268-a61d-0d56934e6b85 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=91786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:25 devstack cinder-volume[91786]: DEBUG oslo_service.backend._eventlet.service [None req-11315ded-d4a8-4268-a61d-0d56934e6b85 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=91786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:25 devstack cinder-volume[91786]: DEBUG oslo_service.backend._eventlet.service [None req-11315ded-d4a8-4268-a61d-0d56934e6b85 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=91786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:25 devstack cinder-volume[91786]: DEBUG oslo_service.backend._eventlet.service [None req-11315ded-d4a8-4268-a61d-0d56934e6b85 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=91786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:25 devstack cinder-volume[91786]: DEBUG oslo_service.backend._eventlet.service [None req-11315ded-d4a8-4268-a61d-0d56934e6b85 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=91786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:25 devstack cinder-volume[91786]: DEBUG oslo_service.backend._eventlet.service [None req-11315ded-d4a8-4268-a61d-0d56934e6b85 None None] backend_defaults.quobyte_volume_url = None {{(pid=91786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:25 devstack cinder-volume[91786]: DEBUG oslo_service.backend._eventlet.service [None req-11315ded-d4a8-4268-a61d-0d56934e6b85 None None] backend_defaults.replication_device = **** {{(pid=91786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:25 devstack cinder-volume[91786]: DEBUG oslo_service.backend._eventlet.service [None req-11315ded-d4a8-4268-a61d-0d56934e6b85 None None] backend_defaults.report_discard_supported = False {{(pid=91786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:25 devstack cinder-volume[91786]: DEBUG oslo_service.backend._eventlet.service [None req-11315ded-d4a8-4268-a61d-0d56934e6b85 None None] backend_defaults.reserved_percentage = 0 {{(pid=91786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:25 devstack cinder-volume[91786]: DEBUG oslo_service.backend._eventlet.service [None req-11315ded-d4a8-4268-a61d-0d56934e6b85 None None] backend_defaults.scst_target_driver = iscsi {{(pid=91786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:25 devstack cinder-volume[91786]: DEBUG oslo_service.backend._eventlet.service [None req-11315ded-d4a8-4268-a61d-0d56934e6b85 None None] backend_defaults.scst_target_iqn_name = None {{(pid=91786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:25 devstack cinder-volume[91786]: DEBUG oslo_service.backend._eventlet.service [None req-11315ded-d4a8-4268-a61d-0d56934e6b85 None None] backend_defaults.storage_protocol = iSCSI {{(pid=91786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:25 devstack cinder-volume[91786]: DEBUG oslo_service.backend._eventlet.service [None req-11315ded-d4a8-4268-a61d-0d56934e6b85 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=91786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:25 devstack cinder-volume[91786]: DEBUG oslo_service.backend._eventlet.service [None req-11315ded-d4a8-4268-a61d-0d56934e6b85 None None] backend_defaults.target_helper = tgtadm {{(pid=91786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:25 devstack cinder-volume[91786]: DEBUG oslo_service.backend._eventlet.service [None req-11315ded-d4a8-4268-a61d-0d56934e6b85 None None] backend_defaults.target_ip_address = 192.168.122.240 {{(pid=91786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:25 devstack cinder-volume[91786]: DEBUG oslo_service.backend._eventlet.service [None req-11315ded-d4a8-4268-a61d-0d56934e6b85 None None] backend_defaults.target_port = 3260 {{(pid=91786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:25 devstack cinder-volume[91786]: DEBUG oslo_service.backend._eventlet.service [None req-11315ded-d4a8-4268-a61d-0d56934e6b85 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=91786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:25 devstack quobyte-client[92068]: Reading configuration file: /etc/quobyte/client.cfg Jun 17 04:34:25 devstack cinder-volume[91786]: DEBUG oslo_service.backend._eventlet.service [None req-11315ded-d4a8-4268-a61d-0d56934e6b85 None None] backend_defaults.target_protocol = iscsi {{(pid=91786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:25 devstack cinder-volume[91786]: DEBUG oslo_service.backend._eventlet.service [None req-11315ded-d4a8-4268-a61d-0d56934e6b85 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=91786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:25 devstack cinder-volume[91786]: DEBUG oslo_service.backend._eventlet.service [None req-11315ded-d4a8-4268-a61d-0d56934e6b85 None None] backend_defaults.trace_flags = None {{(pid=91786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:25 devstack cinder-volume[91786]: DEBUG oslo_service.backend._eventlet.service [None req-11315ded-d4a8-4268-a61d-0d56934e6b85 None None] backend_defaults.unique_fqdn_network = True {{(pid=91786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:25 devstack quobyte-client[92068]: Invalid parameters found, error: missing mount point. Jun 17 04:34:25 devstack cinder-volume[91786]: DEBUG oslo_service.backend._eventlet.service [None req-11315ded-d4a8-4268-a61d-0d56934e6b85 None None] backend_defaults.use_chap_auth = False {{(pid=91786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:25 devstack quobyte-client[92068]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Jun 17 04:34:25 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-1c716dff-48f1-4574-9314-02d3d9dae629 None None] CMD "mount.quobyte" returned: 1 in 0.061s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:34:25 devstack quobyte-client[92068]: Failed to parse all commandline parameters, please use -h/--help to see available options. Jun 17 04:34:25 devstack cinder-volume[91786]: DEBUG oslo_service.backend._eventlet.service [None req-11315ded-d4a8-4268-a61d-0d56934e6b85 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=91786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:25 devstack cinder-volume[91786]: DEBUG oslo_service.backend._eventlet.service [None req-11315ded-d4a8-4268-a61d-0d56934e6b85 None None] backend_defaults.volume_backend_name = None {{(pid=91786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:25 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-1c716dff-48f1-4574-9314-02d3d9dae629 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 04:34:25 devstack cinder-volume[91786]: DEBUG oslo_service.backend._eventlet.service [None req-11315ded-d4a8-4268-a61d-0d56934e6b85 None None] backend_defaults.volume_clear = zero {{(pid=91786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:25 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-1c716dff-48f1-4574-9314-02d3d9dae629 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 04:34:25 devstack cinder-volume[91786]: DEBUG oslo_service.backend._eventlet.service [None req-11315ded-d4a8-4268-a61d-0d56934e6b85 None None] backend_defaults.volume_clear_ionice = None {{(pid=91786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:25 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-1c716dff-48f1-4574-9314-02d3d9dae629 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588': None} {{(pid=92060) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 17 04:34:25 devstack cinder-volume[91786]: DEBUG oslo_service.backend._eventlet.service [None req-11315ded-d4a8-4268-a61d-0d56934e6b85 None None] backend_defaults.volume_clear_size = 0 {{(pid=91786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:25 devstack cinder-volume[91786]: DEBUG oslo_service.backend._eventlet.service [None req-11315ded-d4a8-4268-a61d-0d56934e6b85 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=91786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:25 devstack cinder-volume[91786]: DEBUG oslo_service.backend._eventlet.service [None req-11315ded-d4a8-4268-a61d-0d56934e6b85 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=91786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:25 devstack cinder-volume[91786]: DEBUG oslo_service.backend._eventlet.service [None req-11315ded-d4a8-4268-a61d-0d56934e6b85 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=91786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:25 devstack cinder-volume[91786]: DEBUG oslo_service.backend._eventlet.service [None req-11315ded-d4a8-4268-a61d-0d56934e6b85 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=91786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:25 devstack cinder-volume[91786]: DEBUG oslo_service.backend._eventlet.service [None req-11315ded-d4a8-4268-a61d-0d56934e6b85 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=91786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:25 devstack cinder-volume[91786]: DEBUG oslo_service.backend._eventlet.service [None req-11315ded-d4a8-4268-a61d-0d56934e6b85 None None] oslo_reports.file_event_handler = None {{(pid=91786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:25 devstack cinder-volume[91786]: DEBUG oslo_service.backend._eventlet.service [None req-11315ded-d4a8-4268-a61d-0d56934e6b85 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=91786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:25 devstack cinder-volume[91786]: DEBUG oslo_service.backend._eventlet.service [None req-11315ded-d4a8-4268-a61d-0d56934e6b85 None None] oslo_reports.log_dir = None {{(pid=91786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:25 devstack cinder-volume[91786]: DEBUG oslo_service.backend._eventlet.service [None req-11315ded-d4a8-4268-a61d-0d56934e6b85 None None] QuobyteHD.backend_availability_zone = None {{(pid=91786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:25 devstack cinder-volume[91786]: DEBUG oslo_service.backend._eventlet.service [None req-11315ded-d4a8-4268-a61d-0d56934e6b85 None None] QuobyteHD.backend_host = None {{(pid=91786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:25 devstack cinder-volume[91786]: DEBUG oslo_service.backend._eventlet.service [None req-11315ded-d4a8-4268-a61d-0d56934e6b85 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=91786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:25 devstack cinder-volume[91786]: DEBUG oslo_service.backend._eventlet.service [None req-11315ded-d4a8-4268-a61d-0d56934e6b85 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=91786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:25 devstack cinder-volume[91786]: DEBUG oslo_service.backend._eventlet.service [None req-11315ded-d4a8-4268-a61d-0d56934e6b85 None None] QuobyteHD.chap_password = **** {{(pid=91786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:25 devstack cinder-volume[91786]: DEBUG oslo_service.backend._eventlet.service [None req-11315ded-d4a8-4268-a61d-0d56934e6b85 None None] QuobyteHD.chap_username = None {{(pid=91786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:25 devstack cinder-volume[91786]: DEBUG oslo_service.backend._eventlet.service [None req-11315ded-d4a8-4268-a61d-0d56934e6b85 None None] QuobyteHD.chiscsi_conf = None {{(pid=91786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:25 devstack cinder-volume[91786]: DEBUG oslo_service.backend._eventlet.service [None req-11315ded-d4a8-4268-a61d-0d56934e6b85 None None] QuobyteHD.disk_geometry = None {{(pid=91786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:25 devstack cinder-volume[91786]: DEBUG oslo_service.backend._eventlet.service [None req-11315ded-d4a8-4268-a61d-0d56934e6b85 None None] QuobyteHD.driver_client_cert = None {{(pid=91786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:25 devstack cinder-volume[91786]: DEBUG oslo_service.backend._eventlet.service [None req-11315ded-d4a8-4268-a61d-0d56934e6b85 None None] QuobyteHD.driver_client_cert_key = None {{(pid=91786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:25 devstack cinder-volume[91786]: DEBUG oslo_service.backend._eventlet.service [None req-11315ded-d4a8-4268-a61d-0d56934e6b85 None None] QuobyteHD.driver_data_namespace = None {{(pid=91786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:25 devstack cinder-volume[91786]: DEBUG oslo_service.backend._eventlet.service [None req-11315ded-d4a8-4268-a61d-0d56934e6b85 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=91786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:25 devstack cinder-volume[91786]: DEBUG oslo_service.backend._eventlet.service [None req-11315ded-d4a8-4268-a61d-0d56934e6b85 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=91786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:25 devstack cinder-volume[91786]: DEBUG oslo_service.backend._eventlet.service [None req-11315ded-d4a8-4268-a61d-0d56934e6b85 None None] QuobyteHD.driver_use_ssl = None {{(pid=91786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:25 devstack cinder-volume[91786]: DEBUG oslo_service.backend._eventlet.service [None req-11315ded-d4a8-4268-a61d-0d56934e6b85 None None] QuobyteHD.enable_unsupported_driver = True {{(pid=91786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:25 devstack cinder-volume[91786]: DEBUG oslo_service.backend._eventlet.service [None req-11315ded-d4a8-4268-a61d-0d56934e6b85 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=91786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:25 devstack cinder-volume[91786]: DEBUG oslo_service.backend._eventlet.service [None req-11315ded-d4a8-4268-a61d-0d56934e6b85 None None] QuobyteHD.extra_capabilities = None {{(pid=91786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:25 devstack cinder-volume[91786]: DEBUG oslo_service.backend._eventlet.service [None req-11315ded-d4a8-4268-a61d-0d56934e6b85 None None] QuobyteHD.filter_function = None {{(pid=91786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:25 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-1c716dff-48f1-4574-9314-02d3d9dae629 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588'] {{(pid=92060) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 17 04:34:25 devstack cinder-volume[91786]: DEBUG oslo_service.backend._eventlet.service [None req-11315ded-d4a8-4268-a61d-0d56934e6b85 None None] QuobyteHD.goodness_function = None {{(pid=91786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:25 devstack cinder-volume[91786]: DEBUG oslo_service.backend._eventlet.service [None req-11315ded-d4a8-4268-a61d-0d56934e6b85 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=91786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:25 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-1c716dff-48f1-4574-9314-02d3d9dae629 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 04:34:25 devstack cinder-volume[91786]: DEBUG oslo_service.backend._eventlet.service [None req-11315ded-d4a8-4268-a61d-0d56934e6b85 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=91786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:25 devstack cinder-volume[91786]: DEBUG oslo_service.backend._eventlet.service [None req-11315ded-d4a8-4268-a61d-0d56934e6b85 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=91786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:25 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-1c716dff-48f1-4574-9314-02d3d9dae629 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:34:25 devstack cinder-volume[91786]: DEBUG oslo_service.backend._eventlet.service [None req-11315ded-d4a8-4268-a61d-0d56934e6b85 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=91786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:25 devstack cinder-volume[91786]: DEBUG oslo_service.backend._eventlet.service [None req-11315ded-d4a8-4268-a61d-0d56934e6b85 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=91786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:25 devstack cinder-volume[91786]: DEBUG oslo_service.backend._eventlet.service [None req-11315ded-d4a8-4268-a61d-0d56934e6b85 None None] QuobyteHD.iscsi_target_flags = None {{(pid=91786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:25 devstack cinder-volume[91786]: DEBUG oslo_service.backend._eventlet.service [None req-11315ded-d4a8-4268-a61d-0d56934e6b85 None None] QuobyteHD.iscsi_write_cache = None {{(pid=91786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:25 devstack cinder-volume[91786]: DEBUG oslo_service.backend._eventlet.service [None req-11315ded-d4a8-4268-a61d-0d56934e6b85 None None] QuobyteHD.iser_helper = None {{(pid=91786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:25 devstack cinder-volume[91786]: DEBUG oslo_service.backend._eventlet.service [None req-11315ded-d4a8-4268-a61d-0d56934e6b85 None None] QuobyteHD.iser_ip_address = None {{(pid=91786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:25 devstack cinder-volume[91786]: DEBUG oslo_service.backend._eventlet.service [None req-11315ded-d4a8-4268-a61d-0d56934e6b85 None None] QuobyteHD.iser_port = None {{(pid=91786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:25 devstack cinder-volume[91786]: DEBUG oslo_service.backend._eventlet.service [None req-11315ded-d4a8-4268-a61d-0d56934e6b85 None None] QuobyteHD.iser_target_prefix = None {{(pid=91786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:25 devstack cinder-volume[91786]: DEBUG oslo_service.backend._eventlet.service [None req-11315ded-d4a8-4268-a61d-0d56934e6b85 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=91786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:25 devstack cinder-volume[91786]: DEBUG oslo_service.backend._eventlet.service [None req-11315ded-d4a8-4268-a61d-0d56934e6b85 None None] QuobyteHD.nas_host = None {{(pid=91786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:25 devstack cinder-volume[91786]: DEBUG oslo_service.backend._eventlet.service [None req-11315ded-d4a8-4268-a61d-0d56934e6b85 None None] QuobyteHD.nas_login = None {{(pid=91786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:25 devstack cinder-volume[91786]: DEBUG oslo_service.backend._eventlet.service [None req-11315ded-d4a8-4268-a61d-0d56934e6b85 None None] QuobyteHD.nas_mount_options = None {{(pid=91786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:25 devstack cinder-volume[91786]: DEBUG oslo_service.backend._eventlet.service [None req-11315ded-d4a8-4268-a61d-0d56934e6b85 None None] QuobyteHD.nas_password = **** {{(pid=91786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:25 devstack cinder-volume[91786]: DEBUG oslo_service.backend._eventlet.service [None req-11315ded-d4a8-4268-a61d-0d56934e6b85 None None] QuobyteHD.nas_private_key = None {{(pid=91786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:25 devstack cinder-volume[91786]: DEBUG oslo_service.backend._eventlet.service [None req-11315ded-d4a8-4268-a61d-0d56934e6b85 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=91786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:25 devstack cinder-volume[91786]: DEBUG oslo_service.backend._eventlet.service [None req-11315ded-d4a8-4268-a61d-0d56934e6b85 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=91786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:25 devstack cinder-volume[91786]: DEBUG oslo_service.backend._eventlet.service [None req-11315ded-d4a8-4268-a61d-0d56934e6b85 None None] QuobyteHD.nas_share_path = None {{(pid=91786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:25 devstack cinder-volume[91786]: DEBUG oslo_service.backend._eventlet.service [None req-11315ded-d4a8-4268-a61d-0d56934e6b85 None None] QuobyteHD.nas_ssh_port = None {{(pid=91786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:25 devstack cinder-volume[91786]: DEBUG oslo_service.backend._eventlet.service [None req-11315ded-d4a8-4268-a61d-0d56934e6b85 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=91786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:25 devstack cinder-volume[91786]: DEBUG oslo_service.backend._eventlet.service [None req-11315ded-d4a8-4268-a61d-0d56934e6b85 None None] QuobyteHD.num_iser_scan_tries = None {{(pid=91786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:25 devstack cinder-volume[91786]: DEBUG oslo_service.backend._eventlet.service [None req-11315ded-d4a8-4268-a61d-0d56934e6b85 None None] QuobyteHD.num_shell_tries = None {{(pid=91786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:25 devstack cinder-volume[91786]: DEBUG oslo_service.backend._eventlet.service [None req-11315ded-d4a8-4268-a61d-0d56934e6b85 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=91786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:25 devstack cinder-volume[91786]: DEBUG oslo_service.backend._eventlet.service [None req-11315ded-d4a8-4268-a61d-0d56934e6b85 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=91786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:25 devstack cinder-volume[91786]: DEBUG oslo_service.backend._eventlet.service [None req-11315ded-d4a8-4268-a61d-0d56934e6b85 None None] QuobyteHD.nvmet_ns_id = None {{(pid=91786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:25 devstack cinder-volume[91786]: DEBUG oslo_service.backend._eventlet.service [None req-11315ded-d4a8-4268-a61d-0d56934e6b85 None None] QuobyteHD.nvmet_port_id = None {{(pid=91786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:25 devstack cinder-volume[91786]: DEBUG oslo_service.backend._eventlet.service [None req-11315ded-d4a8-4268-a61d-0d56934e6b85 None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=91786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:25 devstack cinder-volume[91786]: DEBUG oslo_service.backend._eventlet.service [None req-11315ded-d4a8-4268-a61d-0d56934e6b85 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=91786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:25 devstack cinder-volume[91786]: DEBUG oslo_service.backend._eventlet.service [None req-11315ded-d4a8-4268-a61d-0d56934e6b85 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=91786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:25 devstack cinder-volume[91786]: DEBUG oslo_service.backend._eventlet.service [None req-11315ded-d4a8-4268-a61d-0d56934e6b85 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=91786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:25 devstack cinder-volume[91786]: DEBUG oslo_service.backend._eventlet.service [None req-11315ded-d4a8-4268-a61d-0d56934e6b85 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=91786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:25 devstack cinder-volume[91786]: DEBUG oslo_service.backend._eventlet.service [None req-11315ded-d4a8-4268-a61d-0d56934e6b85 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=91786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:25 devstack cinder-volume[91786]: DEBUG oslo_service.backend._eventlet.service [None req-11315ded-d4a8-4268-a61d-0d56934e6b85 None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588 {{(pid=91786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:25 devstack cinder-volume[91786]: DEBUG oslo_service.backend._eventlet.service [None req-11315ded-d4a8-4268-a61d-0d56934e6b85 None None] QuobyteHD.replication_device = **** {{(pid=91786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:25 devstack cinder-volume[91786]: DEBUG oslo_service.backend._eventlet.service [None req-11315ded-d4a8-4268-a61d-0d56934e6b85 None None] QuobyteHD.report_discard_supported = None {{(pid=91786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:25 devstack cinder-volume[91786]: DEBUG oslo_service.backend._eventlet.service [None req-11315ded-d4a8-4268-a61d-0d56934e6b85 None None] QuobyteHD.reserved_percentage = None {{(pid=91786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:25 devstack cinder-volume[91786]: DEBUG oslo_service.backend._eventlet.service [None req-11315ded-d4a8-4268-a61d-0d56934e6b85 None None] QuobyteHD.scst_target_driver = None {{(pid=91786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:25 devstack cinder-volume[91786]: DEBUG oslo_service.backend._eventlet.service [None req-11315ded-d4a8-4268-a61d-0d56934e6b85 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=91786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:25 devstack cinder-volume[91786]: DEBUG oslo_service.backend._eventlet.service [None req-11315ded-d4a8-4268-a61d-0d56934e6b85 None None] QuobyteHD.storage_protocol = None {{(pid=91786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:25 devstack cinder-volume[91786]: DEBUG oslo_service.backend._eventlet.service [None req-11315ded-d4a8-4268-a61d-0d56934e6b85 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=91786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:25 devstack cinder-volume[91786]: DEBUG oslo_service.backend._eventlet.service [None req-11315ded-d4a8-4268-a61d-0d56934e6b85 None None] QuobyteHD.target_helper = None {{(pid=91786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:25 devstack cinder-volume[91786]: DEBUG oslo_service.backend._eventlet.service [None req-11315ded-d4a8-4268-a61d-0d56934e6b85 None None] QuobyteHD.target_ip_address = None {{(pid=91786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:25 devstack cinder-volume[91786]: DEBUG oslo_service.backend._eventlet.service [None req-11315ded-d4a8-4268-a61d-0d56934e6b85 None None] QuobyteHD.target_port = None {{(pid=91786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:25 devstack cinder-volume[91786]: DEBUG oslo_service.backend._eventlet.service [None req-11315ded-d4a8-4268-a61d-0d56934e6b85 None None] QuobyteHD.target_prefix = None {{(pid=91786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:25 devstack cinder-volume[91786]: DEBUG oslo_service.backend._eventlet.service [None req-11315ded-d4a8-4268-a61d-0d56934e6b85 None None] QuobyteHD.target_protocol = None {{(pid=91786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:25 devstack cinder-volume[91786]: DEBUG oslo_service.backend._eventlet.service [None req-11315ded-d4a8-4268-a61d-0d56934e6b85 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=91786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:25 devstack cinder-volume[91786]: DEBUG oslo_service.backend._eventlet.service [None req-11315ded-d4a8-4268-a61d-0d56934e6b85 None None] QuobyteHD.trace_flags = None {{(pid=91786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:25 devstack cinder-volume[91786]: DEBUG oslo_service.backend._eventlet.service [None req-11315ded-d4a8-4268-a61d-0d56934e6b85 None None] QuobyteHD.unique_fqdn_network = None {{(pid=91786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:25 devstack cinder-volume[91786]: DEBUG oslo_service.backend._eventlet.service [None req-11315ded-d4a8-4268-a61d-0d56934e6b85 None None] QuobyteHD.use_chap_auth = None {{(pid=91786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:25 devstack cinder-volume[91786]: DEBUG oslo_service.backend._eventlet.service [None req-11315ded-d4a8-4268-a61d-0d56934e6b85 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=91786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:25 devstack cinder-volume[91786]: DEBUG oslo_service.backend._eventlet.service [None req-11315ded-d4a8-4268-a61d-0d56934e6b85 None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=91786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:25 devstack cinder-volume[91786]: DEBUG oslo_service.backend._eventlet.service [None req-11315ded-d4a8-4268-a61d-0d56934e6b85 None None] QuobyteHD.volume_clear = None {{(pid=91786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:25 devstack cinder-volume[91786]: DEBUG oslo_service.backend._eventlet.service [None req-11315ded-d4a8-4268-a61d-0d56934e6b85 None None] QuobyteHD.volume_clear_ionice = None {{(pid=91786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:25 devstack cinder-volume[91786]: DEBUG oslo_service.backend._eventlet.service [None req-11315ded-d4a8-4268-a61d-0d56934e6b85 None None] QuobyteHD.volume_clear_size = None {{(pid=91786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:25 devstack cinder-volume[91786]: DEBUG oslo_service.backend._eventlet.service [None req-11315ded-d4a8-4268-a61d-0d56934e6b85 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=91786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:25 devstack cinder-volume[91786]: DEBUG oslo_service.backend._eventlet.service [None req-11315ded-d4a8-4268-a61d-0d56934e6b85 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=91786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:25 devstack cinder-volume[91786]: DEBUG oslo_service.backend._eventlet.service [None req-11315ded-d4a8-4268-a61d-0d56934e6b85 None None] QuobyteHD.volume_dd_blocksize = None {{(pid=91786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:25 devstack cinder-volume[91786]: DEBUG oslo_service.backend._eventlet.service [None req-11315ded-d4a8-4268-a61d-0d56934e6b85 None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=91786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:25 devstack cinder-volume[91786]: DEBUG oslo_service.backend._eventlet.service [None req-11315ded-d4a8-4268-a61d-0d56934e6b85 None None] QuobyteHD.volumes_dir = None {{(pid=91786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:25 devstack cinder-volume[91786]: DEBUG oslo_service.backend._eventlet.service [None req-11315ded-d4a8-4268-a61d-0d56934e6b85 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=91786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:25 devstack cinder-volume[91786]: DEBUG oslo_service.backend._eventlet.service [None req-11315ded-d4a8-4268-a61d-0d56934e6b85 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=91786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:25 devstack cinder-volume[91786]: DEBUG oslo_service.backend._eventlet.service [None req-11315ded-d4a8-4268-a61d-0d56934e6b85 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=91786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:25 devstack cinder-volume[91786]: DEBUG oslo_service.backend._eventlet.service [None req-11315ded-d4a8-4268-a61d-0d56934e6b85 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=91786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:25 devstack cinder-volume[91786]: DEBUG oslo_service.backend._eventlet.service [None req-11315ded-d4a8-4268-a61d-0d56934e6b85 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=91786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:25 devstack cinder-volume[91786]: DEBUG oslo_service.backend._eventlet.service [None req-11315ded-d4a8-4268-a61d-0d56934e6b85 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=91786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:25 devstack cinder-volume[91786]: DEBUG oslo_service.backend._eventlet.service [None req-11315ded-d4a8-4268-a61d-0d56934e6b85 None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=91786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:25 devstack cinder-volume[91786]: DEBUG oslo_service.backend._eventlet.service [None req-11315ded-d4a8-4268-a61d-0d56934e6b85 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=91786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:25 devstack cinder-volume[91786]: DEBUG oslo_service.backend._eventlet.service [None req-11315ded-d4a8-4268-a61d-0d56934e6b85 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=91786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:25 devstack sudo[92069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a Jun 17 04:34:25 devstack cinder-volume[91786]: DEBUG oslo_service.backend._eventlet.service [None req-11315ded-d4a8-4268-a61d-0d56934e6b85 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=91786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:25 devstack cinder-volume[91786]: DEBUG oslo_service.backend._eventlet.service [None req-11315ded-d4a8-4268-a61d-0d56934e6b85 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=91786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:25 devstack cinder-volume[91786]: DEBUG oslo_service.backend._eventlet.service [None req-11315ded-d4a8-4268-a61d-0d56934e6b85 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=91786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:25 devstack cinder-volume[91786]: DEBUG oslo_service.backend._eventlet.service [None req-11315ded-d4a8-4268-a61d-0d56934e6b85 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=91786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:25 devstack sudo[92069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:34:25 devstack cinder-volume[91786]: DEBUG oslo_service.backend._eventlet.service [None req-11315ded-d4a8-4268-a61d-0d56934e6b85 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=91786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:25 devstack cinder-volume[91786]: DEBUG oslo_service.backend._eventlet.service [None req-11315ded-d4a8-4268-a61d-0d56934e6b85 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=91786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:25 devstack cinder-volume[91786]: DEBUG oslo_service.backend._eventlet.service [None req-11315ded-d4a8-4268-a61d-0d56934e6b85 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=91786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:25 devstack cinder-volume[91786]: DEBUG oslo_service.backend._eventlet.service [None req-11315ded-d4a8-4268-a61d-0d56934e6b85 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=91786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:25 devstack cinder-volume[91786]: DEBUG oslo_service.backend._eventlet.service [None req-11315ded-d4a8-4268-a61d-0d56934e6b85 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=91786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:25 devstack cinder-volume[91786]: DEBUG oslo_service.backend._eventlet.service [None req-11315ded-d4a8-4268-a61d-0d56934e6b85 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=91786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:25 devstack cinder-volume[91786]: DEBUG oslo_service.backend._eventlet.service [None req-11315ded-d4a8-4268-a61d-0d56934e6b85 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=91786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:25 devstack cinder-volume[91786]: DEBUG oslo_service.backend._eventlet.service [None req-11315ded-d4a8-4268-a61d-0d56934e6b85 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=91786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:25 devstack cinder-volume[91786]: DEBUG oslo_service.backend._eventlet.service [None req-11315ded-d4a8-4268-a61d-0d56934e6b85 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=91786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:25 devstack cinder-volume[91786]: DEBUG oslo_service.backend._eventlet.service [None req-11315ded-d4a8-4268-a61d-0d56934e6b85 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=91786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:25 devstack cinder-volume[91786]: DEBUG oslo_service.backend._eventlet.service [None req-11315ded-d4a8-4268-a61d-0d56934e6b85 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=91786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:25 devstack cinder-volume[91786]: DEBUG oslo_service.backend._eventlet.service [None req-11315ded-d4a8-4268-a61d-0d56934e6b85 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=91786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:25 devstack cinder-volume[91786]: DEBUG oslo_service.backend._eventlet.service [None req-11315ded-d4a8-4268-a61d-0d56934e6b85 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=91786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:25 devstack cinder-volume[91786]: DEBUG oslo_service.backend._eventlet.service [None req-11315ded-d4a8-4268-a61d-0d56934e6b85 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=91786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:25 devstack cinder-volume[91786]: DEBUG oslo_service.backend._eventlet.service [None req-11315ded-d4a8-4268-a61d-0d56934e6b85 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=91786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:25 devstack cinder-volume[91786]: DEBUG oslo_service.backend._eventlet.service [None req-11315ded-d4a8-4268-a61d-0d56934e6b85 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=91786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:25 devstack cinder-volume[91786]: DEBUG oslo_service.backend._eventlet.service [None req-11315ded-d4a8-4268-a61d-0d56934e6b85 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=91786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:25 devstack cinder-volume[91786]: DEBUG oslo_service.backend._eventlet.service [None req-11315ded-d4a8-4268-a61d-0d56934e6b85 None None] oslo_messaging_rabbit.ssl = False {{(pid=91786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:25 devstack cinder-volume[91786]: DEBUG oslo_service.backend._eventlet.service [None req-11315ded-d4a8-4268-a61d-0d56934e6b85 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=91786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:25 devstack cinder-volume[91786]: DEBUG oslo_service.backend._eventlet.service [None req-11315ded-d4a8-4268-a61d-0d56934e6b85 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=91786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:25 devstack cinder-volume[91786]: DEBUG oslo_service.backend._eventlet.service [None req-11315ded-d4a8-4268-a61d-0d56934e6b85 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=91786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:25 devstack cinder-volume[91786]: DEBUG oslo_service.backend._eventlet.service [None req-11315ded-d4a8-4268-a61d-0d56934e6b85 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=91786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:25 devstack cinder-volume[91786]: DEBUG oslo_service.backend._eventlet.service [None req-11315ded-d4a8-4268-a61d-0d56934e6b85 None None] oslo_messaging_rabbit.ssl_version = {{(pid=91786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:25 devstack cinder-volume[91786]: DEBUG oslo_service.backend._eventlet.service [None req-11315ded-d4a8-4268-a61d-0d56934e6b85 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=91786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:25 devstack cinder-volume[91786]: DEBUG oslo_service.backend._eventlet.service [None req-11315ded-d4a8-4268-a61d-0d56934e6b85 None None] oslo_messaging_notifications.driver = [] {{(pid=91786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:25 devstack cinder-volume[91786]: DEBUG oslo_service.backend._eventlet.service [None req-11315ded-d4a8-4268-a61d-0d56934e6b85 None None] oslo_messaging_notifications.retry = -1 {{(pid=91786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:25 devstack cinder-volume[91786]: DEBUG oslo_service.backend._eventlet.service [None req-11315ded-d4a8-4268-a61d-0d56934e6b85 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=91786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:25 devstack cinder-volume[91786]: DEBUG oslo_service.backend._eventlet.service [None req-11315ded-d4a8-4268-a61d-0d56934e6b85 None None] oslo_messaging_notifications.transport_url = **** {{(pid=91786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:25 devstack cinder-volume[91786]: DEBUG oslo_service.backend._eventlet.service [None req-11315ded-d4a8-4268-a61d-0d56934e6b85 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=91786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:25 devstack cinder-volume[91786]: DEBUG oslo_service.backend._eventlet.service [None req-11315ded-d4a8-4268-a61d-0d56934e6b85 None None] key_manager.fixed_key = **** {{(pid=91786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:25 devstack cinder-volume[91786]: DEBUG oslo_service.backend._eventlet.service [None req-11315ded-d4a8-4268-a61d-0d56934e6b85 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=91786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:25 devstack cinder-volume[91786]: DEBUG oslo_service.backend._eventlet.service [None req-11315ded-d4a8-4268-a61d-0d56934e6b85 None None] barbican.barbican_api_version = None {{(pid=91786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:25 devstack cinder-volume[91786]: DEBUG oslo_service.backend._eventlet.service [None req-11315ded-d4a8-4268-a61d-0d56934e6b85 None None] barbican.barbican_endpoint = None {{(pid=91786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:25 devstack cinder-volume[91786]: DEBUG oslo_service.backend._eventlet.service [None req-11315ded-d4a8-4268-a61d-0d56934e6b85 None None] barbican.barbican_endpoint_type = public {{(pid=91786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:25 devstack cinder-volume[91786]: DEBUG oslo_service.backend._eventlet.service [None req-11315ded-d4a8-4268-a61d-0d56934e6b85 None None] barbican.barbican_region_name = None {{(pid=91786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:25 devstack cinder-volume[91786]: DEBUG oslo_service.backend._eventlet.service [None req-11315ded-d4a8-4268-a61d-0d56934e6b85 None None] barbican.cafile = None {{(pid=91786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:25 devstack cinder-volume[91786]: DEBUG oslo_service.backend._eventlet.service [None req-11315ded-d4a8-4268-a61d-0d56934e6b85 None None] barbican.certfile = None {{(pid=91786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:25 devstack cinder-volume[91786]: DEBUG oslo_service.backend._eventlet.service [None req-11315ded-d4a8-4268-a61d-0d56934e6b85 None None] barbican.collect_timing = False {{(pid=91786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:25 devstack cinder-volume[91786]: DEBUG oslo_service.backend._eventlet.service [None req-11315ded-d4a8-4268-a61d-0d56934e6b85 None None] barbican.insecure = False {{(pid=91786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:25 devstack cinder-volume[91786]: DEBUG oslo_service.backend._eventlet.service [None req-11315ded-d4a8-4268-a61d-0d56934e6b85 None None] barbican.keyfile = None {{(pid=91786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:25 devstack cinder-volume[91786]: DEBUG oslo_service.backend._eventlet.service [None req-11315ded-d4a8-4268-a61d-0d56934e6b85 None None] barbican.number_of_retries = 60 {{(pid=91786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:25 devstack cinder-volume[91786]: DEBUG oslo_service.backend._eventlet.service [None req-11315ded-d4a8-4268-a61d-0d56934e6b85 None None] barbican.retry_delay = 1 {{(pid=91786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:25 devstack cinder-volume[91786]: DEBUG oslo_service.backend._eventlet.service [None req-11315ded-d4a8-4268-a61d-0d56934e6b85 None None] barbican.send_service_user_token = False {{(pid=91786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:25 devstack cinder-volume[91786]: DEBUG oslo_service.backend._eventlet.service [None req-11315ded-d4a8-4268-a61d-0d56934e6b85 None None] barbican.split_loggers = False {{(pid=91786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:25 devstack cinder-volume[91786]: DEBUG oslo_service.backend._eventlet.service [None req-11315ded-d4a8-4268-a61d-0d56934e6b85 None None] barbican.timeout = None {{(pid=91786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:25 devstack cinder-volume[91786]: DEBUG oslo_service.backend._eventlet.service [None req-11315ded-d4a8-4268-a61d-0d56934e6b85 None None] barbican.verify_ssl = True {{(pid=91786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:25 devstack cinder-volume[91786]: DEBUG oslo_service.backend._eventlet.service [None req-11315ded-d4a8-4268-a61d-0d56934e6b85 None None] barbican.verify_ssl_path = None {{(pid=91786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:25 devstack cinder-volume[91786]: DEBUG oslo_service.backend._eventlet.service [None req-11315ded-d4a8-4268-a61d-0d56934e6b85 None None] barbican_service_user.auth_section = None {{(pid=91786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:25 devstack cinder-volume[91786]: DEBUG oslo_service.backend._eventlet.service [None req-11315ded-d4a8-4268-a61d-0d56934e6b85 None None] barbican_service_user.auth_type = None {{(pid=91786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:25 devstack cinder-volume[91786]: DEBUG oslo_service.backend._eventlet.service [None req-11315ded-d4a8-4268-a61d-0d56934e6b85 None None] barbican_service_user.cafile = None {{(pid=91786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:25 devstack cinder-volume[91786]: DEBUG oslo_service.backend._eventlet.service [None req-11315ded-d4a8-4268-a61d-0d56934e6b85 None None] barbican_service_user.certfile = None {{(pid=91786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:25 devstack cinder-volume[91786]: DEBUG oslo_service.backend._eventlet.service [None req-11315ded-d4a8-4268-a61d-0d56934e6b85 None None] barbican_service_user.collect_timing = False {{(pid=91786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:25 devstack cinder-volume[91786]: DEBUG oslo_service.backend._eventlet.service [None req-11315ded-d4a8-4268-a61d-0d56934e6b85 None None] barbican_service_user.insecure = False {{(pid=91786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:25 devstack cinder-volume[91786]: DEBUG oslo_service.backend._eventlet.service [None req-11315ded-d4a8-4268-a61d-0d56934e6b85 None None] barbican_service_user.keyfile = None {{(pid=91786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:25 devstack cinder-volume[91786]: DEBUG oslo_service.backend._eventlet.service [None req-11315ded-d4a8-4268-a61d-0d56934e6b85 None None] barbican_service_user.split_loggers = False {{(pid=91786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:25 devstack cinder-volume[91786]: DEBUG oslo_service.backend._eventlet.service [None req-11315ded-d4a8-4268-a61d-0d56934e6b85 None None] barbican_service_user.timeout = None {{(pid=91786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:25 devstack cinder-volume[91786]: DEBUG oslo_service.backend._eventlet.service [None req-11315ded-d4a8-4268-a61d-0d56934e6b85 None None] vault.approle_role_id = **** {{(pid=91786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:25 devstack cinder-volume[91786]: DEBUG oslo_service.backend._eventlet.service [None req-11315ded-d4a8-4268-a61d-0d56934e6b85 None None] vault.approle_secret_id = **** {{(pid=91786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:25 devstack cinder-volume[91786]: DEBUG oslo_service.backend._eventlet.service [None req-11315ded-d4a8-4268-a61d-0d56934e6b85 None None] vault.kv_mountpoint = secret {{(pid=91786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:25 devstack cinder-volume[91786]: DEBUG oslo_service.backend._eventlet.service [None req-11315ded-d4a8-4268-a61d-0d56934e6b85 None None] vault.kv_path = None {{(pid=91786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:25 devstack cinder-volume[91786]: DEBUG oslo_service.backend._eventlet.service [None req-11315ded-d4a8-4268-a61d-0d56934e6b85 None None] vault.kv_version = 2 {{(pid=91786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:25 devstack cinder-volume[91786]: DEBUG oslo_service.backend._eventlet.service [None req-11315ded-d4a8-4268-a61d-0d56934e6b85 None None] vault.namespace = None {{(pid=91786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:25 devstack cinder-volume[91786]: DEBUG oslo_service.backend._eventlet.service [None req-11315ded-d4a8-4268-a61d-0d56934e6b85 None None] vault.root_token_id = **** {{(pid=91786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:25 devstack cinder-volume[91786]: DEBUG oslo_service.backend._eventlet.service [None req-11315ded-d4a8-4268-a61d-0d56934e6b85 None None] vault.ssl_ca_crt_file = None {{(pid=91786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:25 devstack cinder-volume[91786]: DEBUG oslo_service.backend._eventlet.service [None req-11315ded-d4a8-4268-a61d-0d56934e6b85 None None] vault.timeout = 60.0 {{(pid=91786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:25 devstack cinder-volume[91786]: DEBUG oslo_service.backend._eventlet.service [None req-11315ded-d4a8-4268-a61d-0d56934e6b85 None None] vault.use_ssl = False {{(pid=91786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:25 devstack cinder-volume[91786]: DEBUG oslo_service.backend._eventlet.service [None req-11315ded-d4a8-4268-a61d-0d56934e6b85 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=91786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Jun 17 04:34:25 devstack cinder-volume[91786]: DEBUG oslo_service.backend._eventlet.service [None req-11315ded-d4a8-4268-a61d-0d56934e6b85 None None] ******************************************************************************** {{(pid=91786) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3013}} Jun 17 04:34:26 devstack sudo[92069]: pam_unix(sudo:session): session closed for user root Jun 17 04:34:26 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-1c716dff-48f1-4574-9314-02d3d9dae629 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a" returned: 0 in 0.565s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:34:26 devstack cinder-volume[92060]: INFO cinder.volume.driver [None req-1c716dff-48f1-4574-9314-02d3d9dae629 None None] Driver hasn't implemented _init_vendor_properties() Jun 17 04:34:26 devstack cinder-volume[92060]: DEBUG cinder.volume.driver [None req-1c716dff-48f1-4574-9314-02d3d9dae629 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7578468322754, 'free_capacity_gb': 1775.7578468322754, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=92060) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Jun 17 04:34:26 devstack cinder-volume[92060]: DEBUG oslo_db.sqlalchemy.engines [None req-1c716dff-48f1-4574-9314-02d3d9dae629 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=92060) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jun 17 04:34:26 devstack cinder-volume[92060]: DEBUG dbcounter [-] [92060] Writer thread running {{(pid=92060) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jun 17 04:34:26 devstack cinder-volume[92060]: DEBUG cinder.db.sqlalchemy.api [None req-1c716dff-48f1-4574-9314-02d3d9dae629 None None] Building query based on filter {{(pid=92060) _process_snaps_filters /opt/stack/cinder/cinder/db/sqlalchemy/api.py:3979}} Jun 17 04:34:26 devstack cinder-volume[92060]: DEBUG cinder.image.image_utils [None req-1c716dff-48f1-4574-9314-02d3d9dae629 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=92060) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Jun 17 04:34:26 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-1c716dff-48f1-4574-9314-02d3d9dae629 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 04:34:26 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-1c716dff-48f1-4574-9314-02d3d9dae629 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 04:34:26 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-1c716dff-48f1-4574-9314-02d3d9dae629 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588': None} {{(pid=92060) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 17 04:34:26 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-1c716dff-48f1-4574-9314-02d3d9dae629 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588'] {{(pid=92060) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 17 04:34:26 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-1c716dff-48f1-4574-9314-02d3d9dae629 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 04:34:26 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-1c716dff-48f1-4574-9314-02d3d9dae629 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:34:26 devstack cinder-volume[92060]: INFO cinder.keymgr.migration [None req-cc59030f-e71c-4877-9bba-f72f75757920 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Jun 17 04:34:26 devstack sudo[92091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a Jun 17 04:34:26 devstack sudo[92091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:34:27 devstack sudo[92091]: pam_unix(sudo:session): session closed for user root Jun 17 04:34:27 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-1c716dff-48f1-4574-9314-02d3d9dae629 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a" returned: 0 in 0.555s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:34:27 devstack cinder-volume[92060]: DEBUG cinder.manager [None req-1c716dff-48f1-4574-9314-02d3d9dae629 None None] Notifying Schedulers of capabilities ... {{(pid=92060) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 17 04:34:27 devstack cinder-volume[92060]: INFO cinder.volume.manager [None req-1c716dff-48f1-4574-9314-02d3d9dae629 None None] Driver initialization completed successfully. Jun 17 04:34:27 devstack cinder-volume[92060]: INFO cinder.manager [None req-1c716dff-48f1-4574-9314-02d3d9dae629 None None] Initiating service 3 cleanup Jun 17 04:34:27 devstack cinder-volume[92060]: INFO cinder.manager [None req-1c716dff-48f1-4574-9314-02d3d9dae629 None None] Service 3 cleanup completed. Jun 17 04:34:27 devstack cinder-volume[92060]: DEBUG cinder.service [None req-1c716dff-48f1-4574-9314-02d3d9dae629 None None] Creating RPC server for service cinder-volume {{(pid=92060) start /opt/stack/cinder/cinder/service.py:231}} Jun 17 04:34:27 devstack cinder-volume[92060]: DEBUG cinder.service [None req-1c716dff-48f1-4574-9314-02d3d9dae629 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=92060) start /opt/stack/cinder/cinder/service.py:237}} Jun 17 04:34:27 devstack cinder-volume[92060]: INFO cinder.volume.manager [None req-1c716dff-48f1-4574-9314-02d3d9dae629 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.1.14) Jun 17 04:34:27 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-1c716dff-48f1-4574-9314-02d3d9dae629 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 04:34:27 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-1c716dff-48f1-4574-9314-02d3d9dae629 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 04:34:27 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-1c716dff-48f1-4574-9314-02d3d9dae629 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588': None} {{(pid=92060) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 17 04:34:27 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-1c716dff-48f1-4574-9314-02d3d9dae629 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588'] {{(pid=92060) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 17 04:34:27 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-1c716dff-48f1-4574-9314-02d3d9dae629 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 04:34:27 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-1c716dff-48f1-4574-9314-02d3d9dae629 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:34:27 devstack sudo[92136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a Jun 17 04:34:27 devstack sudo[92136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:34:27 devstack sudo[92136]: pam_unix(sudo:session): session closed for user root Jun 17 04:34:27 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-1c716dff-48f1-4574-9314-02d3d9dae629 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a" returned: 0 in 0.599s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:34:27 devstack cinder-volume[92060]: INFO cinder.volume.manager [None req-1c716dff-48f1-4574-9314-02d3d9dae629 None None] Driver post RPC initialization completed successfully. Jun 17 04:34:35 devstack cinder-volume[91786]: DEBUG dbcounter [-] [91786] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=91786) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 17 04:34:37 devstack cinder-volume[92060]: DEBUG dbcounter [-] [92060] Writing DB stats cinder:SELECT=7,cinder:UPDATE=1 {{(pid=92060) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 17 04:34:37 devstack cinder-volume[92060]: DEBUG dbcounter [-] [92060] Writing DB stats cinder:SELECT=3 {{(pid=92060) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 17 04:34:44 devstack cinder-volume[92060]: DEBUG oslo_service.periodic_task [None req-60d279ad-ad8c-4d36-a4b8-f593e74fb922 None None] Running periodic task VolumeManager._thread_info {{(pid=92060) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 17 04:34:44 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-60d279ad-ad8c-4d36-a4b8-f593e74fb922 None None] thread count: 6 {{(pid=92060) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 17 04:34:44 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-60d279ad-ad8c-4d36-a4b8-f593e74fb922 None None] thread info: [<_MainThread(MainThread, started 130061806440576)>, , , , , ] {{(pid=92060) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 17 04:35:41 devstack cinder-volume[92060]: DEBUG cinder.volume.flows.manager.create_volume [None req-07c5f62f-52ee-4269-a8a3-ded0bb352c48 tempest-DeleteServersTestJSON-1963481796 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92060) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 17 04:35:41 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-07c5f62f-52ee-4269-a8a3-ded0bb352c48 tempest-DeleteServersTestJSON-1963481796 None] Flow 'volume_create_manager' (477e0e4e-d5cc-4416-befc-f7ae59e47ba1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 17 04:35:41 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-07c5f62f-52ee-4269-a8a3-ded0bb352c48 tempest-DeleteServersTestJSON-1963481796 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (849a4f2d-87c5-4e89-8de6-5c6875165d36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:35:41 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-07c5f62f-52ee-4269-a8a3-ded0bb352c48 tempest-DeleteServersTestJSON-1963481796 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (849a4f2d-87c5-4e89-8de6-5c6875165d36) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-17T02:35:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-589952871',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a6cde7b2-62d7-4be5-96bf-def8b0872c9c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3f72293a5d2a40f3ba2297d0550b4b74',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T02:35:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T02:35:41Z,use_quota=True,user_id='f66d8e51e0674a3f8958aa15a545b73f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aad9ce24-93f9-41a6-baa1-5125964f96d1),volume_type_id=aad9ce24-93f9-41a6-baa1-5125964f96d1)' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:35:41 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-07c5f62f-52ee-4269-a8a3-ded0bb352c48 tempest-DeleteServersTestJSON-1963481796 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6caca32c-a878-47b7-8dd6-13e539112874) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:35:41 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-07c5f62f-52ee-4269-a8a3-ded0bb352c48 tempest-DeleteServersTestJSON-1963481796 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6caca32c-a878-47b7-8dd6-13e539112874) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:35:41 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-07c5f62f-52ee-4269-a8a3-ded0bb352c48 tempest-DeleteServersTestJSON-1963481796 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (251be02b-1d73-4f41-a8e9-6e28add36ec1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:35:41 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-07c5f62f-52ee-4269-a8a3-ded0bb352c48 tempest-DeleteServersTestJSON-1963481796 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (251be02b-1d73-4f41-a8e9-6e28add36ec1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a6cde7b2-62d7-4be5-96bf-def8b0872c9c', 'volume_name': 'volume-a6cde7b2-62d7-4be5-96bf-def8b0872c9c', 'volume_size': 1}' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:35:41 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-07c5f62f-52ee-4269-a8a3-ded0bb352c48 tempest-DeleteServersTestJSON-1963481796 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f652c7fa-4d79-4cdd-aa96-6001d3ba379a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:35:41 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-07c5f62f-52ee-4269-a8a3-ded0bb352c48 tempest-DeleteServersTestJSON-1963481796 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f652c7fa-4d79-4cdd-aa96-6001d3ba379a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:35:41 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-07c5f62f-52ee-4269-a8a3-ded0bb352c48 tempest-DeleteServersTestJSON-1963481796 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2a54c59b-56ec-458c-a4ad-34b1933d953c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:35:41 devstack cinder-volume[92060]: INFO cinder.volume.flows.manager.create_volume [None req-07c5f62f-52ee-4269-a8a3-ded0bb352c48 tempest-DeleteServersTestJSON-1963481796 None] Volume a6cde7b2-62d7-4be5-96bf-def8b0872c9c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a6cde7b2-62d7-4be5-96bf-def8b0872c9c', 'volume_size': 1} Jun 17 04:35:41 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-07c5f62f-52ee-4269-a8a3-ded0bb352c48 tempest-DeleteServersTestJSON-1963481796 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 04:35:41 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-07c5f62f-52ee-4269-a8a3-ded0bb352c48 tempest-DeleteServersTestJSON-1963481796 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 04:35:41 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-07c5f62f-52ee-4269-a8a3-ded0bb352c48 tempest-DeleteServersTestJSON-1963481796 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-17T02:35:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-589952871',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a6cde7b2-62d7-4be5-96bf-def8b0872c9c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3f72293a5d2a40f3ba2297d0550b4b74',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T02:35:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T02:35:41Z,use_quota=True,user_id='f66d8e51e0674a3f8958aa15a545b73f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aad9ce24-93f9-41a6-baa1-5125964f96d1),volume_type_id=aad9ce24-93f9-41a6-baa1-5125964f96d1)}" {{(pid=92060) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 17 04:35:41 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.remotefs [None req-07c5f62f-52ee-4269-a8a3-ded0bb352c48 tempest-DeleteServersTestJSON-1963481796 None] Creating volume a6cde7b2-62d7-4be5-96bf-def8b0872c9c {{(pid=92060) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 17 04:35:41 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-07c5f62f-52ee-4269-a8a3-ded0bb352c48 tempest-DeleteServersTestJSON-1963481796 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 04:35:41 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-07c5f62f-52ee-4269-a8a3-ded0bb352c48 tempest-DeleteServersTestJSON-1963481796 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 04:35:41 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-07c5f62f-52ee-4269-a8a3-ded0bb352c48 tempest-DeleteServersTestJSON-1963481796 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588': None} {{(pid=92060) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 17 04:35:41 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-07c5f62f-52ee-4269-a8a3-ded0bb352c48 tempest-DeleteServersTestJSON-1963481796 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588'] {{(pid=92060) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 17 04:35:41 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-07c5f62f-52ee-4269-a8a3-ded0bb352c48 tempest-DeleteServersTestJSON-1963481796 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 04:35:41 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-07c5f62f-52ee-4269-a8a3-ded0bb352c48 tempest-DeleteServersTestJSON-1963481796 None] Selected osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588 as target Quobyte volume. {{(pid=92060) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 17 04:35:41 devstack cinder-volume[92060]: INFO cinder.volume.drivers.remotefs [None req-07c5f62f-52ee-4269-a8a3-ded0bb352c48 tempest-DeleteServersTestJSON-1963481796 None] casted to osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588 Jun 17 04:35:41 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-07c5f62f-52ee-4269-a8a3-ded0bb352c48 tempest-DeleteServersTestJSON-1963481796 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-a6cde7b2-62d7-4be5-96bf-def8b0872c9c 1073741824 {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:35:41 devstack sudo[92672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-a6cde7b2-62d7-4be5-96bf-def8b0872c9c 1073741824 Jun 17 04:35:41 devstack sudo[92672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:35:42 devstack sudo[92672]: pam_unix(sudo:session): session closed for user root Jun 17 04:35:42 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-07c5f62f-52ee-4269-a8a3-ded0bb352c48 tempest-DeleteServersTestJSON-1963481796 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-a6cde7b2-62d7-4be5-96bf-def8b0872c9c 1073741824" returned: 0 in 1.113s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:35:42 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-07c5f62f-52ee-4269-a8a3-ded0bb352c48 tempest-DeleteServersTestJSON-1963481796 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-a6cde7b2-62d7-4be5-96bf-def8b0872c9c {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:35:42 devstack sudo[92991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-a6cde7b2-62d7-4be5-96bf-def8b0872c9c Jun 17 04:35:42 devstack sudo[92991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:35:43 devstack sudo[92991]: pam_unix(sudo:session): session closed for user root Jun 17 04:35:43 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-07c5f62f-52ee-4269-a8a3-ded0bb352c48 tempest-DeleteServersTestJSON-1963481796 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-a6cde7b2-62d7-4be5-96bf-def8b0872c9c" returned: 0 in 0.795s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:35:43 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-07c5f62f-52ee-4269-a8a3-ded0bb352c48 tempest-DeleteServersTestJSON-1963481796 None] <== create_volume: return (1983ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588'} {{(pid=92060) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 17 04:35:43 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-07c5f62f-52ee-4269-a8a3-ded0bb352c48 tempest-DeleteServersTestJSON-1963481796 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.989s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 04:35:43 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-07c5f62f-52ee-4269-a8a3-ded0bb352c48 tempest-DeleteServersTestJSON-1963481796 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2a54c59b-56ec-458c-a4ad-34b1933d953c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a6cde7b2-62d7-4be5-96bf-def8b0872c9c', 'volume_size': 1}' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:35:43 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-07c5f62f-52ee-4269-a8a3-ded0bb352c48 tempest-DeleteServersTestJSON-1963481796 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0bb3ce6d-ecff-4a36-b7b0-969ca8560d35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:35:43 devstack cinder-volume[92060]: INFO cinder.volume.flows.manager.create_volume [None req-07c5f62f-52ee-4269-a8a3-ded0bb352c48 tempest-DeleteServersTestJSON-1963481796 None] Volume volume-a6cde7b2-62d7-4be5-96bf-def8b0872c9c (a6cde7b2-62d7-4be5-96bf-def8b0872c9c): created successfully Jun 17 04:35:43 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-07c5f62f-52ee-4269-a8a3-ded0bb352c48 tempest-DeleteServersTestJSON-1963481796 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0bb3ce6d-ecff-4a36-b7b0-969ca8560d35) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:35:43 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-07c5f62f-52ee-4269-a8a3-ded0bb352c48 tempest-DeleteServersTestJSON-1963481796 None] Flow 'volume_create_manager' (477e0e4e-d5cc-4416-befc-f7ae59e47ba1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92060) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 17 04:35:43 devstack cinder-volume[92060]: INFO cinder.volume.manager [None req-07c5f62f-52ee-4269-a8a3-ded0bb352c48 tempest-DeleteServersTestJSON-1963481796 None] Created volume successfully. Jun 17 04:35:44 devstack cinder-volume[92060]: DEBUG oslo_service.periodic_task [None req-60d279ad-ad8c-4d36-a4b8-f593e74fb922 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=92060) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 17 04:35:44 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-60d279ad-ad8c-4d36-a4b8-f593e74fb922 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 04:35:44 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-60d279ad-ad8c-4d36-a4b8-f593e74fb922 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 04:35:44 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-60d279ad-ad8c-4d36-a4b8-f593e74fb922 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588': None} {{(pid=92060) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 17 04:35:44 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-60d279ad-ad8c-4d36-a4b8-f593e74fb922 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588'] {{(pid=92060) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 17 04:35:44 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-60d279ad-ad8c-4d36-a4b8-f593e74fb922 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.031s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 04:35:44 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-60d279ad-ad8c-4d36-a4b8-f593e74fb922 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:35:45 devstack sudo[93002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a Jun 17 04:35:45 devstack sudo[93002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:35:46 devstack sudo[93002]: pam_unix(sudo:session): session closed for user root Jun 17 04:35:46 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-60d279ad-ad8c-4d36-a4b8-f593e74fb922 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a" returned: 0 in 1.246s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:35:46 devstack cinder-volume[92060]: DEBUG cinder.manager [None req-60d279ad-ad8c-4d36-a4b8-f593e74fb922 None None] Notifying Schedulers of capabilities ... {{(pid=92060) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 17 04:35:46 devstack cinder-volume[92060]: DEBUG oslo_service.periodic_task [None req-60d279ad-ad8c-4d36-a4b8-f593e74fb922 None None] Running periodic task VolumeManager._thread_info {{(pid=92060) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 17 04:35:46 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-60d279ad-ad8c-4d36-a4b8-f593e74fb922 None None] thread count: 6 {{(pid=92060) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 17 04:35:46 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-60d279ad-ad8c-4d36-a4b8-f593e74fb922 None None] thread info: [<_MainThread(MainThread, started 130061806440576)>, , , , , ] {{(pid=92060) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 17 04:35:53 devstack cinder-volume[92060]: WARNING py.warnings [req-c795ead8-d224-4e0d-9b55-61ac2672590f req-49ed1933-b7fb-436d-b1e8-678c7c3bcfc5 tempest-DeleteServersTestJSON-1963481796 None] /opt/stack/cinder/cinder/db/sqlalchemy/api.py:2505: SAWarning: SELECT statement has a cartesian product between FROM element(s) "volumes" and FROM element "volumes_1". Apply join condition(s) between each element to resolve. Jun 17 04:35:53 devstack cinder-volume[92060]: .first() Jun 17 04:35:53 devstack cinder-volume[92060]: Jun 17 04:35:53 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [req-c795ead8-d224-4e0d-9b55-61ac2672590f req-49ed1933-b7fb-436d-b1e8-678c7c3bcfc5 tempest-DeleteServersTestJSON-1963481796 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 04:35:53 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [req-c795ead8-d224-4e0d-9b55-61ac2672590f req-49ed1933-b7fb-436d-b1e8-678c7c3bcfc5 tempest-DeleteServersTestJSON-1963481796 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.004s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 04:35:53 devstack cinder-volume[92060]: INFO oslo.privsep.daemon [req-c795ead8-d224-4e0d-9b55-61ac2672590f req-49ed1933-b7fb-436d-b1e8-678c7c3bcfc5 tempest-DeleteServersTestJSON-1963481796 None] Running privsep helper: ['sudo', 'cinder-rootwrap', '/etc/cinder/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/cinder/cinder.conf', '--privsep_context', 'cinder.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmphp6_na_f/privsep.sock'] Jun 17 04:35:53 devstack sudo[93095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf privsep-helper --config-file /etc/cinder/cinder.conf --privsep_context cinder.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmphp6_na_f/privsep.sock Jun 17 04:35:53 devstack sudo[93095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:35:53 devstack cinder-volume[92060]: DEBUG dbcounter [-] [92060] Writing DB stats cinder:SELECT=2,cinder:UPDATE=4,cinder:DELETE=1 {{(pid=92060) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 17 04:35:54 devstack cinder-volume[92060]: DEBUG cinder.volume.flows.manager.create_volume [None req-13c115bb-89ac-4e07-834b-ff2b2beeac2d tempest-VolumesAdminNegativeTest-106967526 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92060) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 17 04:35:54 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-13c115bb-89ac-4e07-834b-ff2b2beeac2d tempest-VolumesAdminNegativeTest-106967526 None] Flow 'volume_create_manager' (0a96762b-8832-4f8e-817d-e455f43fedb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 17 04:35:54 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-13c115bb-89ac-4e07-834b-ff2b2beeac2d tempest-VolumesAdminNegativeTest-106967526 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (10eedc58-c32d-4423-bf97-d28f8c162259) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:35:54 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-13c115bb-89ac-4e07-834b-ff2b2beeac2d tempest-VolumesAdminNegativeTest-106967526 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (10eedc58-c32d-4423-bf97-d28f8c162259) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-17T02:35:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-74831534',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=82985f20-023f-4d4c-a6f6-e9d8daa7bc06,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9c44f9f4473a494287ce10163c8a6a97',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T02:35:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T02:35:54Z,use_quota=True,user_id='99bdbecaf65541c491e0940cd21f580e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aad9ce24-93f9-41a6-baa1-5125964f96d1),volume_type_id=aad9ce24-93f9-41a6-baa1-5125964f96d1)' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:35:54 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-13c115bb-89ac-4e07-834b-ff2b2beeac2d tempest-VolumesAdminNegativeTest-106967526 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7340af27-efd1-4a8f-afb2-e7da2a9089b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:35:54 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-13c115bb-89ac-4e07-834b-ff2b2beeac2d tempest-VolumesAdminNegativeTest-106967526 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7340af27-efd1-4a8f-afb2-e7da2a9089b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:35:54 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-13c115bb-89ac-4e07-834b-ff2b2beeac2d tempest-VolumesAdminNegativeTest-106967526 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b4d23def-e344-4e8b-b684-5e1980cbd134) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:35:54 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-13c115bb-89ac-4e07-834b-ff2b2beeac2d tempest-VolumesAdminNegativeTest-106967526 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b4d23def-e344-4e8b-b684-5e1980cbd134) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '82985f20-023f-4d4c-a6f6-e9d8daa7bc06', 'volume_name': 'volume-82985f20-023f-4d4c-a6f6-e9d8daa7bc06', 'volume_size': 1}' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:35:54 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-13c115bb-89ac-4e07-834b-ff2b2beeac2d tempest-VolumesAdminNegativeTest-106967526 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c19d0dcf-4ab0-49e6-9925-95f12bc8bc49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:35:54 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-13c115bb-89ac-4e07-834b-ff2b2beeac2d tempest-VolumesAdminNegativeTest-106967526 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c19d0dcf-4ab0-49e6-9925-95f12bc8bc49) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:35:54 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-13c115bb-89ac-4e07-834b-ff2b2beeac2d tempest-VolumesAdminNegativeTest-106967526 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (47e486a8-3761-4406-b389-c445d3a401b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:35:54 devstack cinder-volume[92060]: INFO cinder.volume.flows.manager.create_volume [None req-13c115bb-89ac-4e07-834b-ff2b2beeac2d tempest-VolumesAdminNegativeTest-106967526 None] Volume 82985f20-023f-4d4c-a6f6-e9d8daa7bc06: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-82985f20-023f-4d4c-a6f6-e9d8daa7bc06', 'volume_size': 1} Jun 17 04:35:54 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-13c115bb-89ac-4e07-834b-ff2b2beeac2d tempest-VolumesAdminNegativeTest-106967526 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 04:35:55 devstack sudo[93095]: pam_unix(sudo:session): session closed for user root Jun 17 04:35:55 devstack cinder-volume[92060]: INFO oslo.privsep.daemon [req-c795ead8-d224-4e0d-9b55-61ac2672590f req-49ed1933-b7fb-436d-b1e8-678c7c3bcfc5 tempest-DeleteServersTestJSON-1963481796 None] Spawned new privsep daemon via rootwrap Jun 17 04:35:55 devstack cinder-volume[92060]: DEBUG oslo.privsep.daemon [req-c795ead8-d224-4e0d-9b55-61ac2672590f req-49ed1933-b7fb-436d-b1e8-678c7c3bcfc5 tempest-DeleteServersTestJSON-1963481796 None] Accepted privsep connection to /tmp/tmphp6_na_f/privsep.sock {{(pid=92060) __init__ /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:418}} Jun 17 04:35:55 devstack cinder-volume[92060]: INFO oslo.privsep.daemon [-] privsep daemon starting Jun 17 04:35:55 devstack cinder-volume[92060]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0 Jun 17 04:35:55 devstack cinder-volume[92060]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none Jun 17 04:35:55 devstack cinder-volume[92060]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 93130 Jun 17 04:35:55 devstack cinder-volume[92060]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e6c1272-24a7-43c6-b0b8-d37866b88720]: (2,) {{(pid=93130) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 04:35:55 devstack cinder-volume[92060]: DEBUG oslo.privsep.daemon [-] privsep: reply[d36f95c4-1779-4501-85ee-08eda789376d]: (4, 'qcow2') {{(pid=93130) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 04:35:55 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [req-c795ead8-d224-4e0d-9b55-61ac2672590f req-49ed1933-b7fb-436d-b1e8-678c7c3bcfc5 tempest-DeleteServersTestJSON-1963481796 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-a6cde7b2-62d7-4be5-96bf-def8b0872c9c {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:35:56 devstack sudo[93132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-a6cde7b2-62d7-4be5-96bf-def8b0872c9c Jun 17 04:35:56 devstack sudo[93132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:35:57 devstack sudo[93132]: pam_unix(sudo:session): session closed for user root Jun 17 04:35:57 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [req-c795ead8-d224-4e0d-9b55-61ac2672590f req-49ed1933-b7fb-436d-b1e8-678c7c3bcfc5 tempest-DeleteServersTestJSON-1963481796 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-a6cde7b2-62d7-4be5-96bf-def8b0872c9c" returned: 0 in 1.838s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:35:57 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [req-c795ead8-d224-4e0d-9b55-61ac2672590f req-49ed1933-b7fb-436d-b1e8-678c7c3bcfc5 tempest-DeleteServersTestJSON-1963481796 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 4.717s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 04:35:57 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-13c115bb-89ac-4e07-834b-ff2b2beeac2d tempest-VolumesAdminNegativeTest-106967526 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.506s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 04:35:57 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-13c115bb-89ac-4e07-834b-ff2b2beeac2d tempest-VolumesAdminNegativeTest-106967526 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-17T02:35:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-74831534',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=82985f20-023f-4d4c-a6f6-e9d8daa7bc06,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9c44f9f4473a494287ce10163c8a6a97',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T02:35:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T02:35:54Z,use_quota=True,user_id='99bdbecaf65541c491e0940cd21f580e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aad9ce24-93f9-41a6-baa1-5125964f96d1),volume_type_id=aad9ce24-93f9-41a6-baa1-5125964f96d1)}" {{(pid=92060) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 17 04:35:57 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.remotefs [None req-13c115bb-89ac-4e07-834b-ff2b2beeac2d tempest-VolumesAdminNegativeTest-106967526 None] Creating volume 82985f20-023f-4d4c-a6f6-e9d8daa7bc06 {{(pid=92060) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 17 04:35:57 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-13c115bb-89ac-4e07-834b-ff2b2beeac2d tempest-VolumesAdminNegativeTest-106967526 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 04:35:57 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-13c115bb-89ac-4e07-834b-ff2b2beeac2d tempest-VolumesAdminNegativeTest-106967526 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 04:35:57 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-13c115bb-89ac-4e07-834b-ff2b2beeac2d tempest-VolumesAdminNegativeTest-106967526 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588': None} {{(pid=92060) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 17 04:35:57 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-13c115bb-89ac-4e07-834b-ff2b2beeac2d tempest-VolumesAdminNegativeTest-106967526 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588'] {{(pid=92060) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 17 04:35:57 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-13c115bb-89ac-4e07-834b-ff2b2beeac2d tempest-VolumesAdminNegativeTest-106967526 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 04:35:57 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-13c115bb-89ac-4e07-834b-ff2b2beeac2d tempest-VolumesAdminNegativeTest-106967526 None] Selected osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588 as target Quobyte volume. {{(pid=92060) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 17 04:35:57 devstack cinder-volume[92060]: INFO cinder.volume.drivers.remotefs [None req-13c115bb-89ac-4e07-834b-ff2b2beeac2d tempest-VolumesAdminNegativeTest-106967526 None] casted to osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588 Jun 17 04:35:57 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-13c115bb-89ac-4e07-834b-ff2b2beeac2d tempest-VolumesAdminNegativeTest-106967526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-82985f20-023f-4d4c-a6f6-e9d8daa7bc06 1073741824 {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:35:57 devstack sudo[93147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-82985f20-023f-4d4c-a6f6-e9d8daa7bc06 1073741824 Jun 17 04:35:57 devstack sudo[93147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:35:58 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [req-c795ead8-d224-4e0d-9b55-61ac2672590f req-49ed1933-b7fb-436d-b1e8-678c7c3bcfc5 tempest-DeleteServersTestJSON-1963481796 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588', 'name': 'volume-a6cde7b2-62d7-4be5-96bf-def8b0872c9c', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '87260eed-b454-435b-870d-5a9b9cd222e8', 'enforce_multipath': True} {{(pid=92060) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 17 04:35:58 devstack cinder-volume[92060]: INFO cinder.volume.manager [req-c795ead8-d224-4e0d-9b55-61ac2672590f req-49ed1933-b7fb-436d-b1e8-678c7c3bcfc5 tempest-DeleteServersTestJSON-1963481796 None] attachment_update completed successfully. Jun 17 04:36:00 devstack sudo[93147]: pam_unix(sudo:session): session closed for user root Jun 17 04:36:00 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-13c115bb-89ac-4e07-834b-ff2b2beeac2d tempest-VolumesAdminNegativeTest-106967526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-82985f20-023f-4d4c-a6f6-e9d8daa7bc06 1073741824" returned: 0 in 2.318s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:36:00 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-13c115bb-89ac-4e07-834b-ff2b2beeac2d tempest-VolumesAdminNegativeTest-106967526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-82985f20-023f-4d4c-a6f6-e9d8daa7bc06 {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:36:00 devstack sudo[93546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-82985f20-023f-4d4c-a6f6-e9d8daa7bc06 Jun 17 04:36:00 devstack sudo[93546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:36:01 devstack sudo[93546]: pam_unix(sudo:session): session closed for user root Jun 17 04:36:01 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-13c115bb-89ac-4e07-834b-ff2b2beeac2d tempest-VolumesAdminNegativeTest-106967526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-82985f20-023f-4d4c-a6f6-e9d8daa7bc06" returned: 0 in 1.558s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:36:01 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-13c115bb-89ac-4e07-834b-ff2b2beeac2d tempest-VolumesAdminNegativeTest-106967526 None] <== create_volume: return (4021ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588'} {{(pid=92060) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 17 04:36:01 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-13c115bb-89ac-4e07-834b-ff2b2beeac2d tempest-VolumesAdminNegativeTest-106967526 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 4.025s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 04:36:01 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-13c115bb-89ac-4e07-834b-ff2b2beeac2d tempest-VolumesAdminNegativeTest-106967526 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (47e486a8-3761-4406-b389-c445d3a401b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-82985f20-023f-4d4c-a6f6-e9d8daa7bc06', 'volume_size': 1}' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:36:01 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-13c115bb-89ac-4e07-834b-ff2b2beeac2d tempest-VolumesAdminNegativeTest-106967526 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5f0c0407-5239-4284-ab75-96e37485dcbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:36:01 devstack cinder-volume[92060]: INFO cinder.volume.flows.manager.create_volume [None req-13c115bb-89ac-4e07-834b-ff2b2beeac2d tempest-VolumesAdminNegativeTest-106967526 None] Volume volume-82985f20-023f-4d4c-a6f6-e9d8daa7bc06 (82985f20-023f-4d4c-a6f6-e9d8daa7bc06): created successfully Jun 17 04:36:01 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-13c115bb-89ac-4e07-834b-ff2b2beeac2d tempest-VolumesAdminNegativeTest-106967526 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5f0c0407-5239-4284-ab75-96e37485dcbb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:36:01 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-13c115bb-89ac-4e07-834b-ff2b2beeac2d tempest-VolumesAdminNegativeTest-106967526 None] Flow 'volume_create_manager' (0a96762b-8832-4f8e-817d-e455f43fedb0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92060) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 17 04:36:02 devstack cinder-volume[92060]: INFO cinder.volume.manager [None req-13c115bb-89ac-4e07-834b-ff2b2beeac2d tempest-VolumesAdminNegativeTest-106967526 None] Created volume successfully. Jun 17 04:36:03 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-b4f1f52c-c09a-420a-8234-cfe10aa52247 tempest-VolumesAdminNegativeTest-106967526 None] Acquiring lock "cinder-82985f20-023f-4d4c-a6f6-e9d8daa7bc06-delete_volume" by "delete_volume" {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 04:36:03 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-b4f1f52c-c09a-420a-8234-cfe10aa52247 tempest-VolumesAdminNegativeTest-106967526 None] Lock "cinder-82985f20-023f-4d4c-a6f6-e9d8daa7bc06-delete_volume" acquired by "delete_volume" :: waited 0.074s {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 04:36:03 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-b4f1f52c-c09a-420a-8234-cfe10aa52247 tempest-VolumesAdminNegativeTest-106967526 None] Acquiring lock "cinder-quobyte-82985f20-023f-4d4c-a6f6-e9d8daa7bc06" by "delete_volume" {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 04:36:03 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-b4f1f52c-c09a-420a-8234-cfe10aa52247 tempest-VolumesAdminNegativeTest-106967526 None] Lock "cinder-quobyte-82985f20-023f-4d4c-a6f6-e9d8daa7bc06" acquired by "delete_volume" :: waited 0.041s {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 04:36:03 devstack cinder-volume[92060]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ce185d7-a1f0-4567-b82e-07e077752f9d]: (4, 'qcow2') {{(pid=93130) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 04:36:03 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-b4f1f52c-c09a-420a-8234-cfe10aa52247 tempest-VolumesAdminNegativeTest-106967526 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-82985f20-023f-4d4c-a6f6-e9d8daa7bc06 {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:36:03 devstack sudo[93597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-82985f20-023f-4d4c-a6f6-e9d8daa7bc06 Jun 17 04:36:03 devstack sudo[93597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:36:05 devstack sudo[93597]: pam_unix(sudo:session): session closed for user root Jun 17 04:36:05 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-b4f1f52c-c09a-420a-8234-cfe10aa52247 tempest-VolumesAdminNegativeTest-106967526 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-82985f20-023f-4d4c-a6f6-e9d8daa7bc06" returned: 0 in 1.665s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:36:05 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-b4f1f52c-c09a-420a-8234-cfe10aa52247 tempest-VolumesAdminNegativeTest-106967526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-82985f20-023f-4d4c-a6f6-e9d8daa7bc06 {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:36:05 devstack sudo[93602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-82985f20-023f-4d4c-a6f6-e9d8daa7bc06 Jun 17 04:36:05 devstack sudo[93602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:36:06 devstack sudo[93602]: pam_unix(sudo:session): session closed for user root Jun 17 04:36:06 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-b4f1f52c-c09a-420a-8234-cfe10aa52247 tempest-VolumesAdminNegativeTest-106967526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-82985f20-023f-4d4c-a6f6-e9d8daa7bc06" returned: 0 in 1.430s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:36:06 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-b4f1f52c-c09a-420a-8234-cfe10aa52247 tempest-VolumesAdminNegativeTest-106967526 None] Lock "cinder-quobyte-82985f20-023f-4d4c-a6f6-e9d8daa7bc06" released by "delete_volume" :: held 3.192s {{(pid=92060) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 04:36:06 devstack cinder-volume[92060]: WARNING cinder.quota [None req-b4f1f52c-c09a-420a-8234-cfe10aa52247 tempest-VolumesAdminNegativeTest-106967526 None] Deprecated: Default quota for resource: volumes_QuobyteHD is set by the default quota flag: quota_volumes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Jun 17 04:36:06 devstack cinder-volume[92060]: WARNING cinder.quota [None req-b4f1f52c-c09a-420a-8234-cfe10aa52247 tempest-VolumesAdminNegativeTest-106967526 None] Deprecated: Default quota for resource: gigabytes_QuobyteHD is set by the default quota flag: quota_gigabytes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Jun 17 04:36:06 devstack cinder-volume[92060]: DEBUG cinder.quota [None req-b4f1f52c-c09a-420a-8234-cfe10aa52247 tempest-VolumesAdminNegativeTest-106967526 None] Created reservations ['76735fbe-4ce6-4c05-85d1-499e665788d1', '1e08b61e-c0df-498a-b637-514bedcb1e1f', '2b985b21-049e-4e73-99d2-3e9807d4fbfe', 'c079af3e-2bcb-485e-884c-62223fb43b34'] {{(pid=92060) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 17 04:36:06 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-b4f1f52c-c09a-420a-8234-cfe10aa52247 tempest-VolumesAdminNegativeTest-106967526 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 04:36:06 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-b4f1f52c-c09a-420a-8234-cfe10aa52247 tempest-VolumesAdminNegativeTest-106967526 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 04:36:06 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-b4f1f52c-c09a-420a-8234-cfe10aa52247 tempest-VolumesAdminNegativeTest-106967526 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588': None} {{(pid=92060) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 17 04:36:06 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-b4f1f52c-c09a-420a-8234-cfe10aa52247 tempest-VolumesAdminNegativeTest-106967526 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588'] {{(pid=92060) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 17 04:36:06 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-b4f1f52c-c09a-420a-8234-cfe10aa52247 tempest-VolumesAdminNegativeTest-106967526 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 04:36:06 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-b4f1f52c-c09a-420a-8234-cfe10aa52247 tempest-VolumesAdminNegativeTest-106967526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:36:06 devstack sudo[93671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a Jun 17 04:36:06 devstack sudo[93671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:36:07 devstack sudo[93671]: pam_unix(sudo:session): session closed for user root Jun 17 04:36:07 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-b4f1f52c-c09a-420a-8234-cfe10aa52247 tempest-VolumesAdminNegativeTest-106967526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a" returned: 0 in 1.009s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:36:07 devstack cinder-volume[92060]: DEBUG cinder.manager [None req-b4f1f52c-c09a-420a-8234-cfe10aa52247 tempest-VolumesAdminNegativeTest-106967526 None] Notifying Schedulers of capabilities ... {{(pid=92060) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 17 04:36:07 devstack cinder-volume[92060]: INFO cinder.volume.manager [None req-b4f1f52c-c09a-420a-8234-cfe10aa52247 tempest-VolumesAdminNegativeTest-106967526 None] Deleted volume successfully. Jun 17 04:36:08 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-b4f1f52c-c09a-420a-8234-cfe10aa52247 tempest-VolumesAdminNegativeTest-106967526 None] Lock "cinder-82985f20-023f-4d4c-a6f6-e9d8daa7bc06-delete_volume" released by "delete_volume" :: held 4.768s {{(pid=92060) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 04:36:09 devstack cinder-volume[92060]: INFO cinder.volume.manager [req-2c47b221-2e96-42f2-807f-34a5b70ed90f req-a519e65b-9ecb-4db3-8803-832588c91b5c tempest-DeleteServersTestJSON-1963481796 None] Terminate volume connection completed successfully. Jun 17 04:36:09 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [req-2c47b221-2e96-42f2-807f-34a5b70ed90f req-a519e65b-9ecb-4db3-8803-832588c91b5c tempest-DeleteServersTestJSON-1963481796 None] Deleting attachment 87260eed-b454-435b-870d-5a9b9cd222e8. {{(pid=92060) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 17 04:36:14 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-92edd500-a853-4b1e-aa6f-abf2958a73a0 tempest-DeleteServersTestJSON-1963481796 None] Acquiring lock "cinder-a6cde7b2-62d7-4be5-96bf-def8b0872c9c-delete_volume" by "delete_volume" {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 04:36:14 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-92edd500-a853-4b1e-aa6f-abf2958a73a0 tempest-DeleteServersTestJSON-1963481796 None] Lock "cinder-a6cde7b2-62d7-4be5-96bf-def8b0872c9c-delete_volume" acquired by "delete_volume" :: waited 0.052s {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 04:36:14 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-92edd500-a853-4b1e-aa6f-abf2958a73a0 tempest-DeleteServersTestJSON-1963481796 None] Acquiring lock "cinder-quobyte-a6cde7b2-62d7-4be5-96bf-def8b0872c9c" by "delete_volume" {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 04:36:14 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-92edd500-a853-4b1e-aa6f-abf2958a73a0 tempest-DeleteServersTestJSON-1963481796 None] Lock "cinder-quobyte-a6cde7b2-62d7-4be5-96bf-def8b0872c9c" acquired by "delete_volume" :: waited 0.024s {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 04:36:14 devstack cinder-volume[92060]: DEBUG oslo.privsep.daemon [-] privsep: reply[97bc58b8-1655-4211-998f-5eab6b3af0c2]: (4, 'qcow2') {{(pid=93130) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 04:36:14 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-92edd500-a853-4b1e-aa6f-abf2958a73a0 tempest-DeleteServersTestJSON-1963481796 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-a6cde7b2-62d7-4be5-96bf-def8b0872c9c {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:36:14 devstack sudo[93876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-a6cde7b2-62d7-4be5-96bf-def8b0872c9c Jun 17 04:36:14 devstack sudo[93876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:36:15 devstack sudo[93876]: pam_unix(sudo:session): session closed for user root Jun 17 04:36:15 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-92edd500-a853-4b1e-aa6f-abf2958a73a0 tempest-DeleteServersTestJSON-1963481796 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-a6cde7b2-62d7-4be5-96bf-def8b0872c9c" returned: 0 in 0.780s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:36:15 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-92edd500-a853-4b1e-aa6f-abf2958a73a0 tempest-DeleteServersTestJSON-1963481796 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-a6cde7b2-62d7-4be5-96bf-def8b0872c9c {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:36:15 devstack sudo[93886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-a6cde7b2-62d7-4be5-96bf-def8b0872c9c Jun 17 04:36:15 devstack sudo[93886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:36:16 devstack sudo[93886]: pam_unix(sudo:session): session closed for user root Jun 17 04:36:16 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-92edd500-a853-4b1e-aa6f-abf2958a73a0 tempest-DeleteServersTestJSON-1963481796 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-a6cde7b2-62d7-4be5-96bf-def8b0872c9c" returned: 0 in 0.670s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:36:16 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-92edd500-a853-4b1e-aa6f-abf2958a73a0 tempest-DeleteServersTestJSON-1963481796 None] Lock "cinder-quobyte-a6cde7b2-62d7-4be5-96bf-def8b0872c9c" released by "delete_volume" :: held 1.526s {{(pid=92060) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 04:36:16 devstack cinder-volume[92060]: DEBUG cinder.quota [None req-92edd500-a853-4b1e-aa6f-abf2958a73a0 tempest-DeleteServersTestJSON-1963481796 None] Created reservations ['ef8e9f57-2117-40bd-a925-320c195463e3', 'f11a2b88-5561-4789-931b-1833956d65e3', 'e562b539-f2ae-4c11-8bd2-9099834a0383', 'ecceeb76-e20a-4c7d-839f-7f4c4b312d0c'] {{(pid=92060) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 17 04:36:16 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-92edd500-a853-4b1e-aa6f-abf2958a73a0 tempest-DeleteServersTestJSON-1963481796 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 04:36:16 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-92edd500-a853-4b1e-aa6f-abf2958a73a0 tempest-DeleteServersTestJSON-1963481796 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 04:36:16 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-92edd500-a853-4b1e-aa6f-abf2958a73a0 tempest-DeleteServersTestJSON-1963481796 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588': None} {{(pid=92060) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 17 04:36:16 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-92edd500-a853-4b1e-aa6f-abf2958a73a0 tempest-DeleteServersTestJSON-1963481796 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588'] {{(pid=92060) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 17 04:36:16 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-92edd500-a853-4b1e-aa6f-abf2958a73a0 tempest-DeleteServersTestJSON-1963481796 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 04:36:16 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-92edd500-a853-4b1e-aa6f-abf2958a73a0 tempest-DeleteServersTestJSON-1963481796 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:36:16 devstack sudo[93891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a Jun 17 04:36:16 devstack sudo[93891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:36:17 devstack sudo[93891]: pam_unix(sudo:session): session closed for user root Jun 17 04:36:17 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-92edd500-a853-4b1e-aa6f-abf2958a73a0 tempest-DeleteServersTestJSON-1963481796 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a" returned: 0 in 0.814s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:36:17 devstack cinder-volume[92060]: DEBUG cinder.manager [None req-92edd500-a853-4b1e-aa6f-abf2958a73a0 tempest-DeleteServersTestJSON-1963481796 None] Notifying Schedulers of capabilities ... {{(pid=92060) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 17 04:36:17 devstack cinder-volume[92060]: INFO cinder.volume.manager [None req-92edd500-a853-4b1e-aa6f-abf2958a73a0 tempest-DeleteServersTestJSON-1963481796 None] Deleted volume successfully. Jun 17 04:36:17 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-92edd500-a853-4b1e-aa6f-abf2958a73a0 tempest-DeleteServersTestJSON-1963481796 None] Lock "cinder-a6cde7b2-62d7-4be5-96bf-def8b0872c9c-delete_volume" released by "delete_volume" :: held 2.650s {{(pid=92060) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 04:36:24 devstack cinder-volume[92060]: DEBUG cinder.volume.flows.manager.create_volume [None req-635237d3-1d7c-4e0e-ab80-823697e11019 tempest-ServersNegativeTestJSON-1959109690 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92060) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 17 04:36:24 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-635237d3-1d7c-4e0e-ab80-823697e11019 tempest-ServersNegativeTestJSON-1959109690 None] Flow 'volume_create_manager' (e09da6a1-5df5-415e-aacb-fd80f7758f8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 17 04:36:24 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-635237d3-1d7c-4e0e-ab80-823697e11019 tempest-ServersNegativeTestJSON-1959109690 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (81cb2d62-073f-4f03-872b-ca9e0cbbc7aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:36:24 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-635237d3-1d7c-4e0e-ab80-823697e11019 tempest-ServersNegativeTestJSON-1959109690 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (81cb2d62-073f-4f03-872b-ca9e0cbbc7aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-17T02:36:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-444104273',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=915bd0f3-db2e-48c0-ad56-f7cd22bdbfc3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='288ea04c38ce43c1ae6be20ca0506901',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T02:36:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T02:36:24Z,use_quota=True,user_id='7827aab7059441a78e08b112566cbee9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aad9ce24-93f9-41a6-baa1-5125964f96d1),volume_type_id=aad9ce24-93f9-41a6-baa1-5125964f96d1)' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:36:24 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-635237d3-1d7c-4e0e-ab80-823697e11019 tempest-ServersNegativeTestJSON-1959109690 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e5c70e2f-cb29-4451-9426-b490e7693517) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:36:24 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-635237d3-1d7c-4e0e-ab80-823697e11019 tempest-ServersNegativeTestJSON-1959109690 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e5c70e2f-cb29-4451-9426-b490e7693517) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:36:24 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-635237d3-1d7c-4e0e-ab80-823697e11019 tempest-ServersNegativeTestJSON-1959109690 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (865aca4b-3b3e-4eb0-a37d-d981ea29fac4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:36:24 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-635237d3-1d7c-4e0e-ab80-823697e11019 tempest-ServersNegativeTestJSON-1959109690 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (865aca4b-3b3e-4eb0-a37d-d981ea29fac4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '915bd0f3-db2e-48c0-ad56-f7cd22bdbfc3', 'volume_name': 'volume-915bd0f3-db2e-48c0-ad56-f7cd22bdbfc3', 'volume_size': 1}' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:36:24 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-635237d3-1d7c-4e0e-ab80-823697e11019 tempest-ServersNegativeTestJSON-1959109690 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6cac04e1-bf0b-450a-877d-fbfebf79eef8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:36:24 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-635237d3-1d7c-4e0e-ab80-823697e11019 tempest-ServersNegativeTestJSON-1959109690 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6cac04e1-bf0b-450a-877d-fbfebf79eef8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:36:24 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-635237d3-1d7c-4e0e-ab80-823697e11019 tempest-ServersNegativeTestJSON-1959109690 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (be16d647-1824-49ac-bd01-b8d5e452e84e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:36:24 devstack cinder-volume[92060]: INFO cinder.volume.flows.manager.create_volume [None req-635237d3-1d7c-4e0e-ab80-823697e11019 tempest-ServersNegativeTestJSON-1959109690 None] Volume 915bd0f3-db2e-48c0-ad56-f7cd22bdbfc3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-915bd0f3-db2e-48c0-ad56-f7cd22bdbfc3', 'volume_size': 1} Jun 17 04:36:24 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-635237d3-1d7c-4e0e-ab80-823697e11019 tempest-ServersNegativeTestJSON-1959109690 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 04:36:24 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-635237d3-1d7c-4e0e-ab80-823697e11019 tempest-ServersNegativeTestJSON-1959109690 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 04:36:24 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-635237d3-1d7c-4e0e-ab80-823697e11019 tempest-ServersNegativeTestJSON-1959109690 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-17T02:36:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-444104273',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=915bd0f3-db2e-48c0-ad56-f7cd22bdbfc3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='288ea04c38ce43c1ae6be20ca0506901',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T02:36:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T02:36:24Z,use_quota=True,user_id='7827aab7059441a78e08b112566cbee9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aad9ce24-93f9-41a6-baa1-5125964f96d1),volume_type_id=aad9ce24-93f9-41a6-baa1-5125964f96d1)}" {{(pid=92060) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 17 04:36:24 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.remotefs [None req-635237d3-1d7c-4e0e-ab80-823697e11019 tempest-ServersNegativeTestJSON-1959109690 None] Creating volume 915bd0f3-db2e-48c0-ad56-f7cd22bdbfc3 {{(pid=92060) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 17 04:36:24 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-635237d3-1d7c-4e0e-ab80-823697e11019 tempest-ServersNegativeTestJSON-1959109690 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 04:36:24 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-635237d3-1d7c-4e0e-ab80-823697e11019 tempest-ServersNegativeTestJSON-1959109690 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 04:36:24 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-635237d3-1d7c-4e0e-ab80-823697e11019 tempest-ServersNegativeTestJSON-1959109690 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588': None} {{(pid=92060) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 17 04:36:24 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-635237d3-1d7c-4e0e-ab80-823697e11019 tempest-ServersNegativeTestJSON-1959109690 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588'] {{(pid=92060) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 17 04:36:24 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-635237d3-1d7c-4e0e-ab80-823697e11019 tempest-ServersNegativeTestJSON-1959109690 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 04:36:24 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-635237d3-1d7c-4e0e-ab80-823697e11019 tempest-ServersNegativeTestJSON-1959109690 None] Selected osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588 as target Quobyte volume. {{(pid=92060) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 17 04:36:24 devstack cinder-volume[92060]: INFO cinder.volume.drivers.remotefs [None req-635237d3-1d7c-4e0e-ab80-823697e11019 tempest-ServersNegativeTestJSON-1959109690 None] casted to osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588 Jun 17 04:36:24 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-635237d3-1d7c-4e0e-ab80-823697e11019 tempest-ServersNegativeTestJSON-1959109690 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-915bd0f3-db2e-48c0-ad56-f7cd22bdbfc3 1073741824 {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:36:24 devstack sudo[93902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-915bd0f3-db2e-48c0-ad56-f7cd22bdbfc3 1073741824 Jun 17 04:36:24 devstack sudo[93902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:36:25 devstack sudo[93902]: pam_unix(sudo:session): session closed for user root Jun 17 04:36:25 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-635237d3-1d7c-4e0e-ab80-823697e11019 tempest-ServersNegativeTestJSON-1959109690 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-915bd0f3-db2e-48c0-ad56-f7cd22bdbfc3 1073741824" returned: 0 in 1.093s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:36:25 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-635237d3-1d7c-4e0e-ab80-823697e11019 tempest-ServersNegativeTestJSON-1959109690 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-915bd0f3-db2e-48c0-ad56-f7cd22bdbfc3 {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:36:25 devstack sudo[93908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-915bd0f3-db2e-48c0-ad56-f7cd22bdbfc3 Jun 17 04:36:25 devstack sudo[93908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:36:26 devstack sudo[93908]: pam_unix(sudo:session): session closed for user root Jun 17 04:36:26 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-635237d3-1d7c-4e0e-ab80-823697e11019 tempest-ServersNegativeTestJSON-1959109690 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-915bd0f3-db2e-48c0-ad56-f7cd22bdbfc3" returned: 0 in 0.650s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:36:26 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-635237d3-1d7c-4e0e-ab80-823697e11019 tempest-ServersNegativeTestJSON-1959109690 None] <== create_volume: return (1787ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588'} {{(pid=92060) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 17 04:36:26 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-635237d3-1d7c-4e0e-ab80-823697e11019 tempest-ServersNegativeTestJSON-1959109690 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.790s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 04:36:26 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-635237d3-1d7c-4e0e-ab80-823697e11019 tempest-ServersNegativeTestJSON-1959109690 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (be16d647-1824-49ac-bd01-b8d5e452e84e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-915bd0f3-db2e-48c0-ad56-f7cd22bdbfc3', 'volume_size': 1}' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:36:26 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-635237d3-1d7c-4e0e-ab80-823697e11019 tempest-ServersNegativeTestJSON-1959109690 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2908e5ac-955d-4396-9c14-3780a56a074f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:36:26 devstack cinder-volume[92060]: INFO cinder.volume.flows.manager.create_volume [None req-635237d3-1d7c-4e0e-ab80-823697e11019 tempest-ServersNegativeTestJSON-1959109690 None] Volume volume-915bd0f3-db2e-48c0-ad56-f7cd22bdbfc3 (915bd0f3-db2e-48c0-ad56-f7cd22bdbfc3): created successfully Jun 17 04:36:26 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-635237d3-1d7c-4e0e-ab80-823697e11019 tempest-ServersNegativeTestJSON-1959109690 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2908e5ac-955d-4396-9c14-3780a56a074f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:36:26 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-635237d3-1d7c-4e0e-ab80-823697e11019 tempest-ServersNegativeTestJSON-1959109690 None] Flow 'volume_create_manager' (e09da6a1-5df5-415e-aacb-fd80f7758f8f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92060) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 17 04:36:26 devstack cinder-volume[92060]: INFO cinder.volume.manager [None req-635237d3-1d7c-4e0e-ab80-823697e11019 tempest-ServersNegativeTestJSON-1959109690 None] Created volume successfully. Jun 17 04:36:32 devstack cinder-volume[92060]: DEBUG cinder.volume.flows.manager.create_volume [None req-b686a913-edc2-457a-b491-4258fcf827b3 tempest-ServersNegativeTestJSON-1959109690 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92060) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 17 04:36:32 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-b686a913-edc2-457a-b491-4258fcf827b3 tempest-ServersNegativeTestJSON-1959109690 None] Flow 'volume_create_manager' (35dc4dc1-4617-4f57-a79e-a20e439e321d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 17 04:36:32 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-b686a913-edc2-457a-b491-4258fcf827b3 tempest-ServersNegativeTestJSON-1959109690 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d3311aba-a147-4d42-9ee5-01ea01b31c71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:36:32 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-b686a913-edc2-457a-b491-4258fcf827b3 tempest-ServersNegativeTestJSON-1959109690 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d3311aba-a147-4d42-9ee5-01ea01b31c71) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-17T02:36:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-335567721',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=267bca2b-a8bf-4604-8f9d-088ddaface01,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='288ea04c38ce43c1ae6be20ca0506901',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T02:36:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T02:36:33Z,use_quota=True,user_id='7827aab7059441a78e08b112566cbee9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aad9ce24-93f9-41a6-baa1-5125964f96d1),volume_type_id=aad9ce24-93f9-41a6-baa1-5125964f96d1)' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:36:32 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-b686a913-edc2-457a-b491-4258fcf827b3 tempest-ServersNegativeTestJSON-1959109690 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ede528c1-c50b-40ed-8e57-2e41912a895e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:36:32 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-b686a913-edc2-457a-b491-4258fcf827b3 tempest-ServersNegativeTestJSON-1959109690 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ede528c1-c50b-40ed-8e57-2e41912a895e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:36:32 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-b686a913-edc2-457a-b491-4258fcf827b3 tempest-ServersNegativeTestJSON-1959109690 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f3059360-2177-49c0-a17e-903ce7e6c9e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:36:32 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-b686a913-edc2-457a-b491-4258fcf827b3 tempest-ServersNegativeTestJSON-1959109690 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f3059360-2177-49c0-a17e-903ce7e6c9e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '267bca2b-a8bf-4604-8f9d-088ddaface01', 'volume_name': 'volume-267bca2b-a8bf-4604-8f9d-088ddaface01', 'volume_size': 1}' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:36:32 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-b686a913-edc2-457a-b491-4258fcf827b3 tempest-ServersNegativeTestJSON-1959109690 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2f616a0d-f3ce-4d52-baff-049bb48922fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:36:32 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-b686a913-edc2-457a-b491-4258fcf827b3 tempest-ServersNegativeTestJSON-1959109690 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2f616a0d-f3ce-4d52-baff-049bb48922fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:36:32 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-b686a913-edc2-457a-b491-4258fcf827b3 tempest-ServersNegativeTestJSON-1959109690 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3790074e-a8c1-4099-b14a-f09312c87507) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:36:32 devstack cinder-volume[92060]: INFO cinder.volume.flows.manager.create_volume [None req-b686a913-edc2-457a-b491-4258fcf827b3 tempest-ServersNegativeTestJSON-1959109690 None] Volume 267bca2b-a8bf-4604-8f9d-088ddaface01: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-267bca2b-a8bf-4604-8f9d-088ddaface01', 'volume_size': 1} Jun 17 04:36:32 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-b686a913-edc2-457a-b491-4258fcf827b3 tempest-ServersNegativeTestJSON-1959109690 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 04:36:32 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-b686a913-edc2-457a-b491-4258fcf827b3 tempest-ServersNegativeTestJSON-1959109690 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 04:36:32 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-b686a913-edc2-457a-b491-4258fcf827b3 tempest-ServersNegativeTestJSON-1959109690 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-17T02:36:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-335567721',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=267bca2b-a8bf-4604-8f9d-088ddaface01,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='288ea04c38ce43c1ae6be20ca0506901',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T02:36:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T02:36:33Z,use_quota=True,user_id='7827aab7059441a78e08b112566cbee9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aad9ce24-93f9-41a6-baa1-5125964f96d1),volume_type_id=aad9ce24-93f9-41a6-baa1-5125964f96d1)}" {{(pid=92060) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 17 04:36:32 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.remotefs [None req-b686a913-edc2-457a-b491-4258fcf827b3 tempest-ServersNegativeTestJSON-1959109690 None] Creating volume 267bca2b-a8bf-4604-8f9d-088ddaface01 {{(pid=92060) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 17 04:36:32 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-b686a913-edc2-457a-b491-4258fcf827b3 tempest-ServersNegativeTestJSON-1959109690 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 04:36:32 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-b686a913-edc2-457a-b491-4258fcf827b3 tempest-ServersNegativeTestJSON-1959109690 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 04:36:32 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-b686a913-edc2-457a-b491-4258fcf827b3 tempest-ServersNegativeTestJSON-1959109690 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588': None} {{(pid=92060) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 17 04:36:32 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-b686a913-edc2-457a-b491-4258fcf827b3 tempest-ServersNegativeTestJSON-1959109690 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588'] {{(pid=92060) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 17 04:36:32 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-b686a913-edc2-457a-b491-4258fcf827b3 tempest-ServersNegativeTestJSON-1959109690 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 04:36:32 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-b686a913-edc2-457a-b491-4258fcf827b3 tempest-ServersNegativeTestJSON-1959109690 None] Selected osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588 as target Quobyte volume. {{(pid=92060) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 17 04:36:32 devstack cinder-volume[92060]: INFO cinder.volume.drivers.remotefs [None req-b686a913-edc2-457a-b491-4258fcf827b3 tempest-ServersNegativeTestJSON-1959109690 None] casted to osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588 Jun 17 04:36:32 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-b686a913-edc2-457a-b491-4258fcf827b3 tempest-ServersNegativeTestJSON-1959109690 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-267bca2b-a8bf-4604-8f9d-088ddaface01 1073741824 {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:36:33 devstack sudo[93924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-267bca2b-a8bf-4604-8f9d-088ddaface01 1073741824 Jun 17 04:36:33 devstack sudo[93924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:36:34 devstack sudo[93924]: pam_unix(sudo:session): session closed for user root Jun 17 04:36:34 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-b686a913-edc2-457a-b491-4258fcf827b3 tempest-ServersNegativeTestJSON-1959109690 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-267bca2b-a8bf-4604-8f9d-088ddaface01 1073741824" returned: 0 in 1.129s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:36:34 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-b686a913-edc2-457a-b491-4258fcf827b3 tempest-ServersNegativeTestJSON-1959109690 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-267bca2b-a8bf-4604-8f9d-088ddaface01 {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:36:34 devstack sudo[93930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-267bca2b-a8bf-4604-8f9d-088ddaface01 Jun 17 04:36:34 devstack sudo[93930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:36:34 devstack sudo[93930]: pam_unix(sudo:session): session closed for user root Jun 17 04:36:34 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-b686a913-edc2-457a-b491-4258fcf827b3 tempest-ServersNegativeTestJSON-1959109690 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-267bca2b-a8bf-4604-8f9d-088ddaface01" returned: 0 in 0.622s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:36:34 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-b686a913-edc2-457a-b491-4258fcf827b3 tempest-ServersNegativeTestJSON-1959109690 None] <== create_volume: return (1806ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588'} {{(pid=92060) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 17 04:36:34 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-b686a913-edc2-457a-b491-4258fcf827b3 tempest-ServersNegativeTestJSON-1959109690 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.808s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 04:36:34 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-b686a913-edc2-457a-b491-4258fcf827b3 tempest-ServersNegativeTestJSON-1959109690 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3790074e-a8c1-4099-b14a-f09312c87507) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-267bca2b-a8bf-4604-8f9d-088ddaface01', 'volume_size': 1}' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:36:34 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-b686a913-edc2-457a-b491-4258fcf827b3 tempest-ServersNegativeTestJSON-1959109690 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2589d674-ab7d-4276-b9cf-5f886dd68c2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:36:34 devstack cinder-volume[92060]: INFO cinder.volume.flows.manager.create_volume [None req-b686a913-edc2-457a-b491-4258fcf827b3 tempest-ServersNegativeTestJSON-1959109690 None] Volume volume-267bca2b-a8bf-4604-8f9d-088ddaface01 (267bca2b-a8bf-4604-8f9d-088ddaface01): created successfully Jun 17 04:36:34 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-b686a913-edc2-457a-b491-4258fcf827b3 tempest-ServersNegativeTestJSON-1959109690 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2589d674-ab7d-4276-b9cf-5f886dd68c2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:36:34 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-b686a913-edc2-457a-b491-4258fcf827b3 tempest-ServersNegativeTestJSON-1959109690 None] Flow 'volume_create_manager' (35dc4dc1-4617-4f57-a79e-a20e439e321d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92060) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 17 04:36:34 devstack cinder-volume[92060]: INFO cinder.volume.manager [None req-b686a913-edc2-457a-b491-4258fcf827b3 tempest-ServersNegativeTestJSON-1959109690 None] Created volume successfully. Jun 17 04:36:39 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-8635e89d-2a1c-449e-883a-75b6d669e9f9 tempest-ServersNegativeTestJSON-1959109690 None] Acquiring lock "cinder-267bca2b-a8bf-4604-8f9d-088ddaface01-delete_volume" by "delete_volume" {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 04:36:39 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-8635e89d-2a1c-449e-883a-75b6d669e9f9 tempest-ServersNegativeTestJSON-1959109690 None] Lock "cinder-267bca2b-a8bf-4604-8f9d-088ddaface01-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 04:36:39 devstack cinder-volume[92060]: DEBUG dbcounter [-] [92060] Writing DB stats cinder:SELECT=26,cinder:INSERT=6,cinder:UPDATE=33,cinder:DELETE=2 {{(pid=92060) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 17 04:36:39 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-8635e89d-2a1c-449e-883a-75b6d669e9f9 tempest-ServersNegativeTestJSON-1959109690 None] Acquiring lock "cinder-quobyte-267bca2b-a8bf-4604-8f9d-088ddaface01" by "delete_volume" {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 04:36:39 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-8635e89d-2a1c-449e-883a-75b6d669e9f9 tempest-ServersNegativeTestJSON-1959109690 None] Lock "cinder-quobyte-267bca2b-a8bf-4604-8f9d-088ddaface01" acquired by "delete_volume" :: waited 0.026s {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 04:36:39 devstack cinder-volume[92060]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ca4ea4f-8d94-4341-b8e9-ac6695f8efcf]: (4, 'qcow2') {{(pid=93130) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 04:36:39 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-8635e89d-2a1c-449e-883a-75b6d669e9f9 tempest-ServersNegativeTestJSON-1959109690 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-267bca2b-a8bf-4604-8f9d-088ddaface01 {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:36:39 devstack sudo[93935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-267bca2b-a8bf-4604-8f9d-088ddaface01 Jun 17 04:36:39 devstack sudo[93935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:36:40 devstack sudo[93935]: pam_unix(sudo:session): session closed for user root Jun 17 04:36:40 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-8635e89d-2a1c-449e-883a-75b6d669e9f9 tempest-ServersNegativeTestJSON-1959109690 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-267bca2b-a8bf-4604-8f9d-088ddaface01" returned: 0 in 0.916s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:36:40 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-8635e89d-2a1c-449e-883a-75b6d669e9f9 tempest-ServersNegativeTestJSON-1959109690 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-267bca2b-a8bf-4604-8f9d-088ddaface01 {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:36:40 devstack sudo[93941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-267bca2b-a8bf-4604-8f9d-088ddaface01 Jun 17 04:36:40 devstack sudo[93941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:36:41 devstack sudo[93941]: pam_unix(sudo:session): session closed for user root Jun 17 04:36:41 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-8635e89d-2a1c-449e-883a-75b6d669e9f9 tempest-ServersNegativeTestJSON-1959109690 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-267bca2b-a8bf-4604-8f9d-088ddaface01" returned: 0 in 0.849s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:36:41 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-8635e89d-2a1c-449e-883a-75b6d669e9f9 tempest-ServersNegativeTestJSON-1959109690 None] Lock "cinder-quobyte-267bca2b-a8bf-4604-8f9d-088ddaface01" released by "delete_volume" :: held 1.814s {{(pid=92060) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 04:36:41 devstack cinder-volume[92060]: DEBUG cinder.quota [None req-8635e89d-2a1c-449e-883a-75b6d669e9f9 tempest-ServersNegativeTestJSON-1959109690 None] Created reservations ['fb6b715b-387c-4b8a-921c-8482118b0e6c', '238a0b94-29ae-4ac7-b96e-9c8876c66319', 'f96fa2b4-cb3f-4bc3-a704-c41b3d3d81bd', 'b14e6f0c-2441-44a1-8115-cd32664d1345'] {{(pid=92060) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 17 04:36:41 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-8635e89d-2a1c-449e-883a-75b6d669e9f9 tempest-ServersNegativeTestJSON-1959109690 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 04:36:41 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-8635e89d-2a1c-449e-883a-75b6d669e9f9 tempest-ServersNegativeTestJSON-1959109690 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 04:36:41 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-8635e89d-2a1c-449e-883a-75b6d669e9f9 tempest-ServersNegativeTestJSON-1959109690 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588': None} {{(pid=92060) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 17 04:36:41 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-8635e89d-2a1c-449e-883a-75b6d669e9f9 tempest-ServersNegativeTestJSON-1959109690 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588'] {{(pid=92060) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 17 04:36:41 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-8635e89d-2a1c-449e-883a-75b6d669e9f9 tempest-ServersNegativeTestJSON-1959109690 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 04:36:41 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-8635e89d-2a1c-449e-883a-75b6d669e9f9 tempest-ServersNegativeTestJSON-1959109690 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:36:41 devstack sudo[93945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a Jun 17 04:36:41 devstack sudo[93945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:36:41 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-be31091d-539c-47c1-ab54-8e8c2988e917 tempest-ServersNegativeTestJSON-1959109690 None] Acquiring lock "cinder-915bd0f3-db2e-48c0-ad56-f7cd22bdbfc3-delete_volume" by "delete_volume" {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 04:36:41 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-be31091d-539c-47c1-ab54-8e8c2988e917 tempest-ServersNegativeTestJSON-1959109690 None] Lock "cinder-915bd0f3-db2e-48c0-ad56-f7cd22bdbfc3-delete_volume" acquired by "delete_volume" :: waited 0.051s {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 04:36:41 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-be31091d-539c-47c1-ab54-8e8c2988e917 tempest-ServersNegativeTestJSON-1959109690 None] Acquiring lock "cinder-quobyte-915bd0f3-db2e-48c0-ad56-f7cd22bdbfc3" by "delete_volume" {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 04:36:41 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-be31091d-539c-47c1-ab54-8e8c2988e917 tempest-ServersNegativeTestJSON-1959109690 None] Lock "cinder-quobyte-915bd0f3-db2e-48c0-ad56-f7cd22bdbfc3" acquired by "delete_volume" :: waited 0.019s {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 04:36:41 devstack cinder-volume[92060]: DEBUG oslo.privsep.daemon [-] privsep: reply[a37722c8-450b-4833-b9f5-4e55b3df3ed4]: (4, 'qcow2') {{(pid=93130) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 04:36:41 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-be31091d-539c-47c1-ab54-8e8c2988e917 tempest-ServersNegativeTestJSON-1959109690 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-915bd0f3-db2e-48c0-ad56-f7cd22bdbfc3 {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:36:41 devstack sudo[93947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-915bd0f3-db2e-48c0-ad56-f7cd22bdbfc3 Jun 17 04:36:41 devstack sudo[93947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:36:42 devstack sudo[93945]: pam_unix(sudo:session): session closed for user root Jun 17 04:36:42 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-8635e89d-2a1c-449e-883a-75b6d669e9f9 tempest-ServersNegativeTestJSON-1959109690 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a" returned: 0 in 0.847s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:36:42 devstack cinder-volume[92060]: DEBUG cinder.manager [None req-8635e89d-2a1c-449e-883a-75b6d669e9f9 tempest-ServersNegativeTestJSON-1959109690 None] Notifying Schedulers of capabilities ... {{(pid=92060) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 17 04:36:42 devstack cinder-volume[92060]: INFO cinder.volume.manager [None req-8635e89d-2a1c-449e-883a-75b6d669e9f9 tempest-ServersNegativeTestJSON-1959109690 None] Deleted volume successfully. Jun 17 04:36:42 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-8635e89d-2a1c-449e-883a-75b6d669e9f9 tempest-ServersNegativeTestJSON-1959109690 None] Lock "cinder-267bca2b-a8bf-4604-8f9d-088ddaface01-delete_volume" released by "delete_volume" :: held 2.898s {{(pid=92060) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 04:36:42 devstack sudo[93947]: pam_unix(sudo:session): session closed for user root Jun 17 04:36:42 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-be31091d-539c-47c1-ab54-8e8c2988e917 tempest-ServersNegativeTestJSON-1959109690 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-915bd0f3-db2e-48c0-ad56-f7cd22bdbfc3" returned: 0 in 1.018s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:36:42 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-be31091d-539c-47c1-ab54-8e8c2988e917 tempest-ServersNegativeTestJSON-1959109690 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-915bd0f3-db2e-48c0-ad56-f7cd22bdbfc3 {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:36:42 devstack sudo[93953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-915bd0f3-db2e-48c0-ad56-f7cd22bdbfc3 Jun 17 04:36:42 devstack sudo[93953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:36:43 devstack cinder-volume[92060]: DEBUG cinder.volume.flows.manager.create_volume [None req-eddc5b1d-c9e0-4e0b-8433-eb2995ca069c tempest-TaggedAttachmentsTest-658082151 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92060) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 17 04:36:43 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-eddc5b1d-c9e0-4e0b-8433-eb2995ca069c tempest-TaggedAttachmentsTest-658082151 None] Flow 'volume_create_manager' (2660afc4-0879-42c1-be54-b07a6adfc895) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 17 04:36:43 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-eddc5b1d-c9e0-4e0b-8433-eb2995ca069c tempest-TaggedAttachmentsTest-658082151 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3ca9dd2e-81f7-4106-bb7f-a9f178cf8ab7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:36:43 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-eddc5b1d-c9e0-4e0b-8433-eb2995ca069c tempest-TaggedAttachmentsTest-658082151 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3ca9dd2e-81f7-4106-bb7f-a9f178cf8ab7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-17T02:36:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-2086282556',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=846d0cdb-7c70-4c34-97aa-f7bef6b0f570,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='87765d5831a2423f9d41abaee4c68b29',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T02:36:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T02:36:43Z,use_quota=True,user_id='10fc247d050e4ff6a4a21e5e0343561a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aad9ce24-93f9-41a6-baa1-5125964f96d1),volume_type_id=aad9ce24-93f9-41a6-baa1-5125964f96d1)' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:36:43 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-eddc5b1d-c9e0-4e0b-8433-eb2995ca069c tempest-TaggedAttachmentsTest-658082151 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ebbb9fc6-2b60-4b7b-9c72-a7712de178d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:36:43 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-eddc5b1d-c9e0-4e0b-8433-eb2995ca069c tempest-TaggedAttachmentsTest-658082151 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ebbb9fc6-2b60-4b7b-9c72-a7712de178d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:36:43 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-eddc5b1d-c9e0-4e0b-8433-eb2995ca069c tempest-TaggedAttachmentsTest-658082151 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9dea2ebf-f9e9-4b9a-82db-e1830277f8a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:36:43 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-eddc5b1d-c9e0-4e0b-8433-eb2995ca069c tempest-TaggedAttachmentsTest-658082151 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9dea2ebf-f9e9-4b9a-82db-e1830277f8a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '846d0cdb-7c70-4c34-97aa-f7bef6b0f570', 'volume_name': 'volume-846d0cdb-7c70-4c34-97aa-f7bef6b0f570', 'volume_size': 1}' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:36:43 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-eddc5b1d-c9e0-4e0b-8433-eb2995ca069c tempest-TaggedAttachmentsTest-658082151 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dd960e7f-2353-4db5-84fc-d02a28e7ce1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:36:43 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-eddc5b1d-c9e0-4e0b-8433-eb2995ca069c tempest-TaggedAttachmentsTest-658082151 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dd960e7f-2353-4db5-84fc-d02a28e7ce1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:36:43 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-eddc5b1d-c9e0-4e0b-8433-eb2995ca069c tempest-TaggedAttachmentsTest-658082151 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c11262e0-595e-4ead-b2fd-5f9f5e65f210) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:36:43 devstack cinder-volume[92060]: INFO cinder.volume.flows.manager.create_volume [None req-eddc5b1d-c9e0-4e0b-8433-eb2995ca069c tempest-TaggedAttachmentsTest-658082151 None] Volume 846d0cdb-7c70-4c34-97aa-f7bef6b0f570: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-846d0cdb-7c70-4c34-97aa-f7bef6b0f570', 'volume_size': 1} Jun 17 04:36:43 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-eddc5b1d-c9e0-4e0b-8433-eb2995ca069c tempest-TaggedAttachmentsTest-658082151 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 04:36:43 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-eddc5b1d-c9e0-4e0b-8433-eb2995ca069c tempest-TaggedAttachmentsTest-658082151 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 04:36:43 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-eddc5b1d-c9e0-4e0b-8433-eb2995ca069c tempest-TaggedAttachmentsTest-658082151 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-17T02:36:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-2086282556',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=846d0cdb-7c70-4c34-97aa-f7bef6b0f570,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='87765d5831a2423f9d41abaee4c68b29',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T02:36:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T02:36:43Z,use_quota=True,user_id='10fc247d050e4ff6a4a21e5e0343561a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aad9ce24-93f9-41a6-baa1-5125964f96d1),volume_type_id=aad9ce24-93f9-41a6-baa1-5125964f96d1)}" {{(pid=92060) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 17 04:36:43 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.remotefs [None req-eddc5b1d-c9e0-4e0b-8433-eb2995ca069c tempest-TaggedAttachmentsTest-658082151 None] Creating volume 846d0cdb-7c70-4c34-97aa-f7bef6b0f570 {{(pid=92060) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 17 04:36:43 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-eddc5b1d-c9e0-4e0b-8433-eb2995ca069c tempest-TaggedAttachmentsTest-658082151 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 04:36:43 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-eddc5b1d-c9e0-4e0b-8433-eb2995ca069c tempest-TaggedAttachmentsTest-658082151 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 04:36:43 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-eddc5b1d-c9e0-4e0b-8433-eb2995ca069c tempest-TaggedAttachmentsTest-658082151 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588': None} {{(pid=92060) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 17 04:36:43 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-eddc5b1d-c9e0-4e0b-8433-eb2995ca069c tempest-TaggedAttachmentsTest-658082151 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588'] {{(pid=92060) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 17 04:36:43 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-eddc5b1d-c9e0-4e0b-8433-eb2995ca069c tempest-TaggedAttachmentsTest-658082151 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 04:36:43 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-eddc5b1d-c9e0-4e0b-8433-eb2995ca069c tempest-TaggedAttachmentsTest-658082151 None] Selected osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588 as target Quobyte volume. {{(pid=92060) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 17 04:36:43 devstack cinder-volume[92060]: INFO cinder.volume.drivers.remotefs [None req-eddc5b1d-c9e0-4e0b-8433-eb2995ca069c tempest-TaggedAttachmentsTest-658082151 None] casted to osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588 Jun 17 04:36:43 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-eddc5b1d-c9e0-4e0b-8433-eb2995ca069c tempest-TaggedAttachmentsTest-658082151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-846d0cdb-7c70-4c34-97aa-f7bef6b0f570 1073741824 {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:36:43 devstack sudo[93955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-846d0cdb-7c70-4c34-97aa-f7bef6b0f570 1073741824 Jun 17 04:36:43 devstack sudo[93955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:36:43 devstack sudo[93953]: pam_unix(sudo:session): session closed for user root Jun 17 04:36:43 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-be31091d-539c-47c1-ab54-8e8c2988e917 tempest-ServersNegativeTestJSON-1959109690 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-915bd0f3-db2e-48c0-ad56-f7cd22bdbfc3" returned: 0 in 1.061s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:36:43 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-be31091d-539c-47c1-ab54-8e8c2988e917 tempest-ServersNegativeTestJSON-1959109690 None] Lock "cinder-quobyte-915bd0f3-db2e-48c0-ad56-f7cd22bdbfc3" released by "delete_volume" :: held 2.140s {{(pid=92060) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 04:36:43 devstack cinder-volume[92060]: DEBUG cinder.quota [None req-be31091d-539c-47c1-ab54-8e8c2988e917 tempest-ServersNegativeTestJSON-1959109690 None] Created reservations ['bc812116-9477-4961-b509-07ff358c1aa7', '2cabc518-dffc-4297-b7d9-185fa10f6830', '493d411b-ab88-49ec-bd40-a3e535d5d55b', '9b8a0b85-33a9-4652-b372-f75eaa96c748'] {{(pid=92060) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 17 04:36:44 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-be31091d-539c-47c1-ab54-8e8c2988e917 tempest-ServersNegativeTestJSON-1959109690 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 04:36:44 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-be31091d-539c-47c1-ab54-8e8c2988e917 tempest-ServersNegativeTestJSON-1959109690 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 04:36:44 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-be31091d-539c-47c1-ab54-8e8c2988e917 tempest-ServersNegativeTestJSON-1959109690 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588': None} {{(pid=92060) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 17 04:36:44 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-be31091d-539c-47c1-ab54-8e8c2988e917 tempest-ServersNegativeTestJSON-1959109690 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588'] {{(pid=92060) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 17 04:36:44 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-be31091d-539c-47c1-ab54-8e8c2988e917 tempest-ServersNegativeTestJSON-1959109690 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 04:36:44 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-be31091d-539c-47c1-ab54-8e8c2988e917 tempest-ServersNegativeTestJSON-1959109690 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:36:44 devstack sudo[93963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a Jun 17 04:36:44 devstack sudo[93963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:36:44 devstack sudo[93955]: pam_unix(sudo:session): session closed for user root Jun 17 04:36:44 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-eddc5b1d-c9e0-4e0b-8433-eb2995ca069c tempest-TaggedAttachmentsTest-658082151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-846d0cdb-7c70-4c34-97aa-f7bef6b0f570 1073741824" returned: 0 in 1.114s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:36:44 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-eddc5b1d-c9e0-4e0b-8433-eb2995ca069c tempest-TaggedAttachmentsTest-658082151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-846d0cdb-7c70-4c34-97aa-f7bef6b0f570 {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:36:44 devstack sudo[93965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-846d0cdb-7c70-4c34-97aa-f7bef6b0f570 Jun 17 04:36:44 devstack sudo[93965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:36:44 devstack sudo[93963]: pam_unix(sudo:session): session closed for user root Jun 17 04:36:44 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-be31091d-539c-47c1-ab54-8e8c2988e917 tempest-ServersNegativeTestJSON-1959109690 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a" returned: 0 in 0.722s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:36:44 devstack cinder-volume[92060]: DEBUG cinder.manager [None req-be31091d-539c-47c1-ab54-8e8c2988e917 tempest-ServersNegativeTestJSON-1959109690 None] Notifying Schedulers of capabilities ... {{(pid=92060) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 17 04:36:44 devstack cinder-volume[92060]: INFO cinder.volume.manager [None req-be31091d-539c-47c1-ab54-8e8c2988e917 tempest-ServersNegativeTestJSON-1959109690 None] Deleted volume successfully. Jun 17 04:36:44 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-be31091d-539c-47c1-ab54-8e8c2988e917 tempest-ServersNegativeTestJSON-1959109690 None] Lock "cinder-915bd0f3-db2e-48c0-ad56-f7cd22bdbfc3-delete_volume" released by "delete_volume" :: held 3.132s {{(pid=92060) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 04:36:44 devstack cinder-volume[92060]: DEBUG oslo_service.periodic_task [None req-60d279ad-ad8c-4d36-a4b8-f593e74fb922 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=92060) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 17 04:36:44 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-60d279ad-ad8c-4d36-a4b8-f593e74fb922 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 04:36:44 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-60d279ad-ad8c-4d36-a4b8-f593e74fb922 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 04:36:44 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-60d279ad-ad8c-4d36-a4b8-f593e74fb922 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588': None} {{(pid=92060) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 17 04:36:44 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-60d279ad-ad8c-4d36-a4b8-f593e74fb922 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588'] {{(pid=92060) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 17 04:36:44 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-60d279ad-ad8c-4d36-a4b8-f593e74fb922 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 04:36:44 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-60d279ad-ad8c-4d36-a4b8-f593e74fb922 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:36:44 devstack sudo[93968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a Jun 17 04:36:44 devstack sudo[93968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:36:45 devstack sudo[93965]: pam_unix(sudo:session): session closed for user root Jun 17 04:36:45 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-eddc5b1d-c9e0-4e0b-8433-eb2995ca069c tempest-TaggedAttachmentsTest-658082151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-846d0cdb-7c70-4c34-97aa-f7bef6b0f570" returned: 0 in 0.778s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:36:45 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-eddc5b1d-c9e0-4e0b-8433-eb2995ca069c tempest-TaggedAttachmentsTest-658082151 None] <== create_volume: return (1957ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588'} {{(pid=92060) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 17 04:36:45 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-eddc5b1d-c9e0-4e0b-8433-eb2995ca069c tempest-TaggedAttachmentsTest-658082151 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.959s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 04:36:45 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-eddc5b1d-c9e0-4e0b-8433-eb2995ca069c tempest-TaggedAttachmentsTest-658082151 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c11262e0-595e-4ead-b2fd-5f9f5e65f210) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-846d0cdb-7c70-4c34-97aa-f7bef6b0f570', 'volume_size': 1}' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:36:45 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-eddc5b1d-c9e0-4e0b-8433-eb2995ca069c tempest-TaggedAttachmentsTest-658082151 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (96e4e306-3916-4578-a705-8ec3295522b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:36:45 devstack cinder-volume[92060]: INFO cinder.volume.flows.manager.create_volume [None req-eddc5b1d-c9e0-4e0b-8433-eb2995ca069c tempest-TaggedAttachmentsTest-658082151 None] Volume volume-846d0cdb-7c70-4c34-97aa-f7bef6b0f570 (846d0cdb-7c70-4c34-97aa-f7bef6b0f570): created successfully Jun 17 04:36:45 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-eddc5b1d-c9e0-4e0b-8433-eb2995ca069c tempest-TaggedAttachmentsTest-658082151 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (96e4e306-3916-4578-a705-8ec3295522b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:36:45 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-eddc5b1d-c9e0-4e0b-8433-eb2995ca069c tempest-TaggedAttachmentsTest-658082151 None] Flow 'volume_create_manager' (2660afc4-0879-42c1-be54-b07a6adfc895) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92060) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 17 04:36:45 devstack cinder-volume[92060]: INFO cinder.volume.manager [None req-eddc5b1d-c9e0-4e0b-8433-eb2995ca069c tempest-TaggedAttachmentsTest-658082151 None] Created volume successfully. Jun 17 04:36:45 devstack sudo[93968]: pam_unix(sudo:session): session closed for user root Jun 17 04:36:45 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-60d279ad-ad8c-4d36-a4b8-f593e74fb922 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a" returned: 0 in 0.894s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:36:45 devstack cinder-volume[92060]: DEBUG cinder.manager [None req-60d279ad-ad8c-4d36-a4b8-f593e74fb922 None None] Notifying Schedulers of capabilities ... {{(pid=92060) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 17 04:36:55 devstack cinder-volume[92060]: DEBUG dbcounter [-] [92060] Writing DB stats cinder:SELECT=38,cinder:UPDATE=44,cinder:INSERT=9,cinder:DELETE=4 {{(pid=92060) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 17 04:36:55 devstack cinder-volume[92060]: DEBUG dbcounter [-] [92060] Writing DB stats cinder:SELECT=8,cinder:INSERT=6,cinder:UPDATE=17,cinder:DELETE=2 {{(pid=92060) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 17 04:37:04 devstack cinder-volume[92060]: DEBUG cinder.volume.flows.manager.create_volume [req-22980546-8e00-46f2-8aa8-1b8ed9747ad9 req-459f404b-49b7-441d-8faa-47d72245ffea tempest-VolumesSnapshotsTestJSON-996235156 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92060) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 17 04:37:04 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [req-22980546-8e00-46f2-8aa8-1b8ed9747ad9 req-459f404b-49b7-441d-8faa-47d72245ffea tempest-VolumesSnapshotsTestJSON-996235156 None] Flow 'volume_create_manager' (72ef98fa-2d82-4ace-8d9a-dd3326bfb6f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 17 04:37:04 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [req-22980546-8e00-46f2-8aa8-1b8ed9747ad9 req-459f404b-49b7-441d-8faa-47d72245ffea tempest-VolumesSnapshotsTestJSON-996235156 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4d84fc1a-d716-4bf1-8d61-dc3395515f2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:37:04 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [req-22980546-8e00-46f2-8aa8-1b8ed9747ad9 req-459f404b-49b7-441d-8faa-47d72245ffea tempest-VolumesSnapshotsTestJSON-996235156 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4d84fc1a-d716-4bf1-8d61-dc3395515f2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-17T02:37:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-1581396713',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2b79da52-77e6-4e69-89fc-262f78521102,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='14d5715590c24f20bb7a10eefcecff29',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T02:37:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T02:37:04Z,use_quota=True,user_id='d364b1402b2c4e1b8b37448dbe02c8bd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aad9ce24-93f9-41a6-baa1-5125964f96d1),volume_type_id=aad9ce24-93f9-41a6-baa1-5125964f96d1)' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:37:04 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [req-22980546-8e00-46f2-8aa8-1b8ed9747ad9 req-459f404b-49b7-441d-8faa-47d72245ffea tempest-VolumesSnapshotsTestJSON-996235156 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9df0b602-214c-4156-8a10-1b0c36a5e39a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:37:04 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [req-22980546-8e00-46f2-8aa8-1b8ed9747ad9 req-459f404b-49b7-441d-8faa-47d72245ffea tempest-VolumesSnapshotsTestJSON-996235156 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9df0b602-214c-4156-8a10-1b0c36a5e39a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:37:04 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [req-22980546-8e00-46f2-8aa8-1b8ed9747ad9 req-459f404b-49b7-441d-8faa-47d72245ffea tempest-VolumesSnapshotsTestJSON-996235156 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a1c74c33-f49b-4a29-8da1-2b569e882eca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:37:04 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [req-22980546-8e00-46f2-8aa8-1b8ed9747ad9 req-459f404b-49b7-441d-8faa-47d72245ffea tempest-VolumesSnapshotsTestJSON-996235156 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a1c74c33-f49b-4a29-8da1-2b569e882eca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2b79da52-77e6-4e69-89fc-262f78521102', 'volume_name': 'volume-2b79da52-77e6-4e69-89fc-262f78521102', 'volume_size': 1}' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:37:04 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [req-22980546-8e00-46f2-8aa8-1b8ed9747ad9 req-459f404b-49b7-441d-8faa-47d72245ffea tempest-VolumesSnapshotsTestJSON-996235156 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (83e27d0e-1b48-4363-8cdb-afd42a86e8af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:37:04 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [req-22980546-8e00-46f2-8aa8-1b8ed9747ad9 req-459f404b-49b7-441d-8faa-47d72245ffea tempest-VolumesSnapshotsTestJSON-996235156 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (83e27d0e-1b48-4363-8cdb-afd42a86e8af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:37:04 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [req-22980546-8e00-46f2-8aa8-1b8ed9747ad9 req-459f404b-49b7-441d-8faa-47d72245ffea tempest-VolumesSnapshotsTestJSON-996235156 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d3200058-3c38-45dc-8744-c09255d963e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:37:04 devstack cinder-volume[92060]: INFO cinder.volume.flows.manager.create_volume [req-22980546-8e00-46f2-8aa8-1b8ed9747ad9 req-459f404b-49b7-441d-8faa-47d72245ffea tempest-VolumesSnapshotsTestJSON-996235156 None] Volume 2b79da52-77e6-4e69-89fc-262f78521102: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2b79da52-77e6-4e69-89fc-262f78521102', 'volume_size': 1} Jun 17 04:37:04 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [req-22980546-8e00-46f2-8aa8-1b8ed9747ad9 req-459f404b-49b7-441d-8faa-47d72245ffea tempest-VolumesSnapshotsTestJSON-996235156 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 04:37:04 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [req-22980546-8e00-46f2-8aa8-1b8ed9747ad9 req-459f404b-49b7-441d-8faa-47d72245ffea tempest-VolumesSnapshotsTestJSON-996235156 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 04:37:04 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [req-22980546-8e00-46f2-8aa8-1b8ed9747ad9 req-459f404b-49b7-441d-8faa-47d72245ffea tempest-VolumesSnapshotsTestJSON-996235156 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-17T02:37:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-1581396713',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2b79da52-77e6-4e69-89fc-262f78521102,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='14d5715590c24f20bb7a10eefcecff29',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T02:37:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T02:37:04Z,use_quota=True,user_id='d364b1402b2c4e1b8b37448dbe02c8bd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aad9ce24-93f9-41a6-baa1-5125964f96d1),volume_type_id=aad9ce24-93f9-41a6-baa1-5125964f96d1)}" {{(pid=92060) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 17 04:37:04 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.remotefs [req-22980546-8e00-46f2-8aa8-1b8ed9747ad9 req-459f404b-49b7-441d-8faa-47d72245ffea tempest-VolumesSnapshotsTestJSON-996235156 None] Creating volume 2b79da52-77e6-4e69-89fc-262f78521102 {{(pid=92060) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 17 04:37:04 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [req-22980546-8e00-46f2-8aa8-1b8ed9747ad9 req-459f404b-49b7-441d-8faa-47d72245ffea tempest-VolumesSnapshotsTestJSON-996235156 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 04:37:04 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [req-22980546-8e00-46f2-8aa8-1b8ed9747ad9 req-459f404b-49b7-441d-8faa-47d72245ffea tempest-VolumesSnapshotsTestJSON-996235156 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 04:37:04 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [req-22980546-8e00-46f2-8aa8-1b8ed9747ad9 req-459f404b-49b7-441d-8faa-47d72245ffea tempest-VolumesSnapshotsTestJSON-996235156 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588': None} {{(pid=92060) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 17 04:37:04 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [req-22980546-8e00-46f2-8aa8-1b8ed9747ad9 req-459f404b-49b7-441d-8faa-47d72245ffea tempest-VolumesSnapshotsTestJSON-996235156 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588'] {{(pid=92060) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 17 04:37:04 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [req-22980546-8e00-46f2-8aa8-1b8ed9747ad9 req-459f404b-49b7-441d-8faa-47d72245ffea tempest-VolumesSnapshotsTestJSON-996235156 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 04:37:04 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [req-22980546-8e00-46f2-8aa8-1b8ed9747ad9 req-459f404b-49b7-441d-8faa-47d72245ffea tempest-VolumesSnapshotsTestJSON-996235156 None] Selected osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588 as target Quobyte volume. {{(pid=92060) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 17 04:37:04 devstack cinder-volume[92060]: INFO cinder.volume.drivers.remotefs [req-22980546-8e00-46f2-8aa8-1b8ed9747ad9 req-459f404b-49b7-441d-8faa-47d72245ffea tempest-VolumesSnapshotsTestJSON-996235156 None] casted to osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588 Jun 17 04:37:04 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [req-22980546-8e00-46f2-8aa8-1b8ed9747ad9 req-459f404b-49b7-441d-8faa-47d72245ffea tempest-VolumesSnapshotsTestJSON-996235156 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-2b79da52-77e6-4e69-89fc-262f78521102 1073741824 {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:37:04 devstack sudo[94066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-2b79da52-77e6-4e69-89fc-262f78521102 1073741824 Jun 17 04:37:04 devstack sudo[94066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:37:05 devstack sudo[94066]: pam_unix(sudo:session): session closed for user root Jun 17 04:37:05 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [req-22980546-8e00-46f2-8aa8-1b8ed9747ad9 req-459f404b-49b7-441d-8faa-47d72245ffea tempest-VolumesSnapshotsTestJSON-996235156 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-2b79da52-77e6-4e69-89fc-262f78521102 1073741824" returned: 0 in 1.197s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:37:05 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [req-22980546-8e00-46f2-8aa8-1b8ed9747ad9 req-459f404b-49b7-441d-8faa-47d72245ffea tempest-VolumesSnapshotsTestJSON-996235156 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-2b79da52-77e6-4e69-89fc-262f78521102 {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:37:05 devstack sudo[94153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-2b79da52-77e6-4e69-89fc-262f78521102 Jun 17 04:37:05 devstack sudo[94153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:37:06 devstack sudo[94153]: pam_unix(sudo:session): session closed for user root Jun 17 04:37:06 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [req-22980546-8e00-46f2-8aa8-1b8ed9747ad9 req-459f404b-49b7-441d-8faa-47d72245ffea tempest-VolumesSnapshotsTestJSON-996235156 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-2b79da52-77e6-4e69-89fc-262f78521102" returned: 0 in 0.609s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:37:06 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [req-22980546-8e00-46f2-8aa8-1b8ed9747ad9 req-459f404b-49b7-441d-8faa-47d72245ffea tempest-VolumesSnapshotsTestJSON-996235156 None] <== create_volume: return (1846ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588'} {{(pid=92060) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 17 04:37:06 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [req-22980546-8e00-46f2-8aa8-1b8ed9747ad9 req-459f404b-49b7-441d-8faa-47d72245ffea tempest-VolumesSnapshotsTestJSON-996235156 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.848s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 04:37:06 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [req-22980546-8e00-46f2-8aa8-1b8ed9747ad9 req-459f404b-49b7-441d-8faa-47d72245ffea tempest-VolumesSnapshotsTestJSON-996235156 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d3200058-3c38-45dc-8744-c09255d963e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2b79da52-77e6-4e69-89fc-262f78521102', 'volume_size': 1}' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:37:06 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [req-22980546-8e00-46f2-8aa8-1b8ed9747ad9 req-459f404b-49b7-441d-8faa-47d72245ffea tempest-VolumesSnapshotsTestJSON-996235156 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (137a05bb-c98f-4535-ae81-ac9f89d8d3e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:37:06 devstack cinder-volume[92060]: INFO cinder.volume.flows.manager.create_volume [req-22980546-8e00-46f2-8aa8-1b8ed9747ad9 req-459f404b-49b7-441d-8faa-47d72245ffea tempest-VolumesSnapshotsTestJSON-996235156 None] Volume volume-2b79da52-77e6-4e69-89fc-262f78521102 (2b79da52-77e6-4e69-89fc-262f78521102): created successfully Jun 17 04:37:06 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [req-22980546-8e00-46f2-8aa8-1b8ed9747ad9 req-459f404b-49b7-441d-8faa-47d72245ffea tempest-VolumesSnapshotsTestJSON-996235156 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (137a05bb-c98f-4535-ae81-ac9f89d8d3e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:37:06 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [req-22980546-8e00-46f2-8aa8-1b8ed9747ad9 req-459f404b-49b7-441d-8faa-47d72245ffea tempest-VolumesSnapshotsTestJSON-996235156 None] Flow 'volume_create_manager' (72ef98fa-2d82-4ace-8d9a-dd3326bfb6f0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92060) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 17 04:37:06 devstack cinder-volume[92060]: INFO cinder.volume.manager [req-22980546-8e00-46f2-8aa8-1b8ed9747ad9 req-459f404b-49b7-441d-8faa-47d72245ffea tempest-VolumesSnapshotsTestJSON-996235156 None] Created volume successfully. Jun 17 04:37:06 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [req-a6b2ff6e-f768-4b5e-ac35-064a04db023f req-61f5fbed-8222-4bc7-aae3-9b3e3bd0d3c0 tempest-VolumesSnapshotsTestJSON-996235156 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 04:37:06 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [req-a6b2ff6e-f768-4b5e-ac35-064a04db023f req-61f5fbed-8222-4bc7-aae3-9b3e3bd0d3c0 tempest-VolumesSnapshotsTestJSON-996235156 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 04:37:06 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.remotefs [req-a6b2ff6e-f768-4b5e-ac35-064a04db023f req-61f5fbed-8222-4bc7-aae3-9b3e3bd0d3c0 tempest-VolumesSnapshotsTestJSON-996235156 None] Creating offline snapshot 5c958396-e6a9-4b1f-961c-eb9e4d59ba59 of volume 2b79da52-77e6-4e69-89fc-262f78521102 {{(pid=92060) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 17 04:37:06 devstack cinder-volume[92060]: DEBUG oslo.privsep.daemon [-] privsep: reply[42763e08-209b-47d7-9c37-9407f4837863]: (4, 'qcow2') {{(pid=93130) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 04:37:06 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [req-a6b2ff6e-f768-4b5e-ac35-064a04db023f req-61f5fbed-8222-4bc7-aae3-9b3e3bd0d3c0 tempest-VolumesSnapshotsTestJSON-996235156 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-2b79da52-77e6-4e69-89fc-262f78521102 {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:37:06 devstack sudo[94158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-2b79da52-77e6-4e69-89fc-262f78521102 Jun 17 04:37:06 devstack sudo[94158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:37:08 devstack sudo[94158]: pam_unix(sudo:session): session closed for user root Jun 17 04:37:08 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [req-a6b2ff6e-f768-4b5e-ac35-064a04db023f req-61f5fbed-8222-4bc7-aae3-9b3e3bd0d3c0 tempest-VolumesSnapshotsTestJSON-996235156 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-2b79da52-77e6-4e69-89fc-262f78521102" returned: 0 in 1.214s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:37:08 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [req-a6b2ff6e-f768-4b5e-ac35-064a04db023f req-61f5fbed-8222-4bc7-aae3-9b3e3bd0d3c0 tempest-VolumesSnapshotsTestJSON-996235156 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-2b79da52-77e6-4e69-89fc-262f78521102,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-2b79da52-77e6-4e69-89fc-262f78521102.5c958396-e6a9-4b1f-961c-eb9e4d59ba59 1G {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:37:08 devstack sudo[94224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-2b79da52-77e6-4e69-89fc-262f78521102,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-2b79da52-77e6-4e69-89fc-262f78521102.5c958396-e6a9-4b1f-961c-eb9e4d59ba59 1G Jun 17 04:37:08 devstack sudo[94224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:37:09 devstack sudo[94224]: pam_unix(sudo:session): session closed for user root Jun 17 04:37:09 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [req-a6b2ff6e-f768-4b5e-ac35-064a04db023f req-61f5fbed-8222-4bc7-aae3-9b3e3bd0d3c0 tempest-VolumesSnapshotsTestJSON-996235156 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-2b79da52-77e6-4e69-89fc-262f78521102,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-2b79da52-77e6-4e69-89fc-262f78521102.5c958396-e6a9-4b1f-961c-eb9e4d59ba59 1G" returned: 0 in 1.628s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:37:09 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [req-a6b2ff6e-f768-4b5e-ac35-064a04db023f req-61f5fbed-8222-4bc7-aae3-9b3e3bd0d3c0 tempest-VolumesSnapshotsTestJSON-996235156 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2b79da52-77e6-4e69-89fc-262f78521102 -F qcow2 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-2b79da52-77e6-4e69-89fc-262f78521102.5c958396-e6a9-4b1f-961c-eb9e4d59ba59 {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:37:09 devstack sudo[94236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2b79da52-77e6-4e69-89fc-262f78521102 -F qcow2 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-2b79da52-77e6-4e69-89fc-262f78521102.5c958396-e6a9-4b1f-961c-eb9e4d59ba59 Jun 17 04:37:09 devstack sudo[94236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:37:11 devstack sudo[94236]: pam_unix(sudo:session): session closed for user root Jun 17 04:37:11 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [req-a6b2ff6e-f768-4b5e-ac35-064a04db023f req-61f5fbed-8222-4bc7-aae3-9b3e3bd0d3c0 tempest-VolumesSnapshotsTestJSON-996235156 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2b79da52-77e6-4e69-89fc-262f78521102 -F qcow2 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-2b79da52-77e6-4e69-89fc-262f78521102.5c958396-e6a9-4b1f-961c-eb9e4d59ba59" returned: 0 in 1.692s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:37:11 devstack cinder-volume[92060]: WARNING cinder.volume.drivers.remotefs [req-a6b2ff6e-f768-4b5e-ac35-064a04db023f req-61f5fbed-8222-4bc7-aae3-9b3e3bd0d3c0 tempest-VolumesSnapshotsTestJSON-996235156 None] /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-2b79da52-77e6-4e69-89fc-262f78521102.5c958396-e6a9-4b1f-961c-eb9e4d59ba59 is being set with open permissions: ugo+rw Jun 17 04:37:11 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [req-a6b2ff6e-f768-4b5e-ac35-064a04db023f req-61f5fbed-8222-4bc7-aae3-9b3e3bd0d3c0 tempest-VolumesSnapshotsTestJSON-996235156 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-2b79da52-77e6-4e69-89fc-262f78521102.5c958396-e6a9-4b1f-961c-eb9e4d59ba59 {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:37:11 devstack sudo[94256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-2b79da52-77e6-4e69-89fc-262f78521102.5c958396-e6a9-4b1f-961c-eb9e4d59ba59 Jun 17 04:37:11 devstack sudo[94256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:37:12 devstack sudo[94256]: pam_unix(sudo:session): session closed for user root Jun 17 04:37:12 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [req-a6b2ff6e-f768-4b5e-ac35-064a04db023f req-61f5fbed-8222-4bc7-aae3-9b3e3bd0d3c0 tempest-VolumesSnapshotsTestJSON-996235156 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-2b79da52-77e6-4e69-89fc-262f78521102.5c958396-e6a9-4b1f-961c-eb9e4d59ba59" returned: 0 in 1.552s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:37:13 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [req-a6b2ff6e-f768-4b5e-ac35-064a04db023f req-61f5fbed-8222-4bc7-aae3-9b3e3bd0d3c0 tempest-VolumesSnapshotsTestJSON-996235156 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-2b79da52-77e6-4e69-89fc-262f78521102.info {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:37:13 devstack sudo[94297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-2b79da52-77e6-4e69-89fc-262f78521102.info Jun 17 04:37:13 devstack sudo[94297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:37:14 devstack sudo[94297]: pam_unix(sudo:session): session closed for user root Jun 17 04:37:14 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [req-a6b2ff6e-f768-4b5e-ac35-064a04db023f req-61f5fbed-8222-4bc7-aae3-9b3e3bd0d3c0 tempest-VolumesSnapshotsTestJSON-996235156 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-2b79da52-77e6-4e69-89fc-262f78521102.info" returned: 0 in 1.254s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:37:14 devstack cinder-volume[92060]: WARNING cinder.volume.drivers.remotefs [req-a6b2ff6e-f768-4b5e-ac35-064a04db023f req-61f5fbed-8222-4bc7-aae3-9b3e3bd0d3c0 tempest-VolumesSnapshotsTestJSON-996235156 None] /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-2b79da52-77e6-4e69-89fc-262f78521102.info is being set with open permissions: ugo+rw Jun 17 04:37:14 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [req-a6b2ff6e-f768-4b5e-ac35-064a04db023f req-61f5fbed-8222-4bc7-aae3-9b3e3bd0d3c0 tempest-VolumesSnapshotsTestJSON-996235156 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-2b79da52-77e6-4e69-89fc-262f78521102.info {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:37:14 devstack sudo[94301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-2b79da52-77e6-4e69-89fc-262f78521102.info Jun 17 04:37:14 devstack sudo[94301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:37:15 devstack sudo[94301]: pam_unix(sudo:session): session closed for user root Jun 17 04:37:15 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [req-a6b2ff6e-f768-4b5e-ac35-064a04db023f req-61f5fbed-8222-4bc7-aae3-9b3e3bd0d3c0 tempest-VolumesSnapshotsTestJSON-996235156 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-2b79da52-77e6-4e69-89fc-262f78521102.info" returned: 0 in 1.206s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:37:15 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [req-a6b2ff6e-f768-4b5e-ac35-064a04db023f req-61f5fbed-8222-4bc7-aae3-9b3e3bd0d3c0 tempest-VolumesSnapshotsTestJSON-996235156 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 8.707s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 04:37:15 devstack cinder-volume[92060]: INFO cinder.volume.manager [req-a6b2ff6e-f768-4b5e-ac35-064a04db023f req-61f5fbed-8222-4bc7-aae3-9b3e3bd0d3c0 tempest-VolumesSnapshotsTestJSON-996235156 None] Create snapshot completed successfully Jun 17 04:37:16 devstack cinder-volume[92060]: DEBUG cinder.coordination [req-f480cd0c-4ab5-4208-a6e2-c3f9bb91bb9b req-d59e1292-9b29-43ff-b691-7b3740a65750 tempest-VolumesSnapshotsTestJSON-996235156 None] Acquiring lock "cinder-5c958396-e6a9-4b1f-961c-eb9e4d59ba59-delete_snapshot" by "delete_snapshot" {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 04:37:16 devstack cinder-volume[92060]: DEBUG cinder.coordination [req-f480cd0c-4ab5-4208-a6e2-c3f9bb91bb9b req-d59e1292-9b29-43ff-b691-7b3740a65750 tempest-VolumesSnapshotsTestJSON-996235156 None] Lock "cinder-5c958396-e6a9-4b1f-961c-eb9e4d59ba59-delete_snapshot" acquired by "delete_snapshot" :: waited 0.038s {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 04:37:16 devstack cinder-volume[92060]: DEBUG cinder.coordination [req-f480cd0c-4ab5-4208-a6e2-c3f9bb91bb9b req-d59e1292-9b29-43ff-b691-7b3740a65750 tempest-VolumesSnapshotsTestJSON-996235156 None] Acquiring lock "cinder-quobyte-2b79da52-77e6-4e69-89fc-262f78521102" by "delete_snapshot" {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 04:37:16 devstack cinder-volume[92060]: DEBUG cinder.coordination [req-f480cd0c-4ab5-4208-a6e2-c3f9bb91bb9b req-d59e1292-9b29-43ff-b691-7b3740a65750 tempest-VolumesSnapshotsTestJSON-996235156 None] Lock "cinder-quobyte-2b79da52-77e6-4e69-89fc-262f78521102" acquired by "delete_snapshot" :: waited 0.051s {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 04:37:16 devstack cinder-volume[92060]: DEBUG cinder.coordination [req-f480cd0c-4ab5-4208-a6e2-c3f9bb91bb9b req-d59e1292-9b29-43ff-b691-7b3740a65750 tempest-VolumesSnapshotsTestJSON-996235156 None] Acquiring lock "cinder-quobyte-5c958396-e6a9-4b1f-961c-eb9e4d59ba59" by "_delete_snapshot" {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 04:37:16 devstack cinder-volume[92060]: DEBUG cinder.coordination [req-f480cd0c-4ab5-4208-a6e2-c3f9bb91bb9b req-d59e1292-9b29-43ff-b691-7b3740a65750 tempest-VolumesSnapshotsTestJSON-996235156 None] Lock "cinder-quobyte-5c958396-e6a9-4b1f-961c-eb9e4d59ba59" acquired by "_delete_snapshot" :: waited 0.057s {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 04:37:16 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.remotefs [req-f480cd0c-4ab5-4208-a6e2-c3f9bb91bb9b req-d59e1292-9b29-43ff-b691-7b3740a65750 tempest-VolumesSnapshotsTestJSON-996235156 None] Deleting offline snapshot 5c958396-e6a9-4b1f-961c-eb9e4d59ba59 of volume 2b79da52-77e6-4e69-89fc-262f78521102 {{(pid=92060) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 17 04:37:16 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.remotefs [req-f480cd0c-4ab5-4208-a6e2-c3f9bb91bb9b req-d59e1292-9b29-43ff-b691-7b3740a65750 tempest-VolumesSnapshotsTestJSON-996235156 None] snapshot_file for this snap is: volume-2b79da52-77e6-4e69-89fc-262f78521102.5c958396-e6a9-4b1f-961c-eb9e4d59ba59 {{(pid=92060) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 17 04:37:16 devstack cinder-volume[92060]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ca742cf-43b1-4a2a-b4a7-bf4c12aa4f0d]: (4, 'qcow2') {{(pid=93130) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 04:37:16 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [req-f480cd0c-4ab5-4208-a6e2-c3f9bb91bb9b req-d59e1292-9b29-43ff-b691-7b3740a65750 tempest-VolumesSnapshotsTestJSON-996235156 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-2b79da52-77e6-4e69-89fc-262f78521102.5c958396-e6a9-4b1f-961c-eb9e4d59ba59 {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:37:16 devstack sudo[94307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-2b79da52-77e6-4e69-89fc-262f78521102.5c958396-e6a9-4b1f-961c-eb9e4d59ba59 Jun 17 04:37:16 devstack sudo[94307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:37:17 devstack sudo[94307]: pam_unix(sudo:session): session closed for user root Jun 17 04:37:17 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [req-f480cd0c-4ab5-4208-a6e2-c3f9bb91bb9b req-d59e1292-9b29-43ff-b691-7b3740a65750 tempest-VolumesSnapshotsTestJSON-996235156 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-2b79da52-77e6-4e69-89fc-262f78521102.5c958396-e6a9-4b1f-961c-eb9e4d59ba59" returned: 0 in 1.240s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:37:17 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.remotefs [req-f480cd0c-4ab5-4208-a6e2-c3f9bb91bb9b req-d59e1292-9b29-43ff-b691-7b3740a65750 tempest-VolumesSnapshotsTestJSON-996235156 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2b79da52-77e6-4e69-89fc-262f78521102(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=92060) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 17 04:37:17 devstack cinder-volume[92060]: DEBUG oslo.privsep.daemon [-] privsep: reply[87a20457-dd2a-4dff-9ff5-d57f83efabbe]: (4, 'qcow2') {{(pid=93130) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 04:37:17 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [req-f480cd0c-4ab5-4208-a6e2-c3f9bb91bb9b req-d59e1292-9b29-43ff-b691-7b3740a65750 tempest-VolumesSnapshotsTestJSON-996235156 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-2b79da52-77e6-4e69-89fc-262f78521102 {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:37:18 devstack sudo[94317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-2b79da52-77e6-4e69-89fc-262f78521102 Jun 17 04:37:18 devstack sudo[94317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:37:18 devstack sudo[94317]: pam_unix(sudo:session): session closed for user root Jun 17 04:37:18 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [req-f480cd0c-4ab5-4208-a6e2-c3f9bb91bb9b req-d59e1292-9b29-43ff-b691-7b3740a65750 tempest-VolumesSnapshotsTestJSON-996235156 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-2b79da52-77e6-4e69-89fc-262f78521102" returned: 0 in 0.988s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:37:18 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [req-f480cd0c-4ab5-4208-a6e2-c3f9bb91bb9b req-d59e1292-9b29-43ff-b691-7b3740a65750 tempest-VolumesSnapshotsTestJSON-996235156 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-2b79da52-77e6-4e69-89fc-262f78521102.5c958396-e6a9-4b1f-961c-eb9e4d59ba59 {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:37:18 devstack sudo[94323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-2b79da52-77e6-4e69-89fc-262f78521102.5c958396-e6a9-4b1f-961c-eb9e4d59ba59 Jun 17 04:37:18 devstack sudo[94323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:37:20 devstack sudo[94323]: pam_unix(sudo:session): session closed for user root Jun 17 04:37:20 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [req-f480cd0c-4ab5-4208-a6e2-c3f9bb91bb9b req-d59e1292-9b29-43ff-b691-7b3740a65750 tempest-VolumesSnapshotsTestJSON-996235156 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-2b79da52-77e6-4e69-89fc-262f78521102.5c958396-e6a9-4b1f-961c-eb9e4d59ba59" returned: 0 in 1.339s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:37:20 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [req-f480cd0c-4ab5-4208-a6e2-c3f9bb91bb9b req-d59e1292-9b29-43ff-b691-7b3740a65750 tempest-VolumesSnapshotsTestJSON-996235156 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-2b79da52-77e6-4e69-89fc-262f78521102.5c958396-e6a9-4b1f-961c-eb9e4d59ba59 {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:37:20 devstack sudo[94381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-2b79da52-77e6-4e69-89fc-262f78521102.5c958396-e6a9-4b1f-961c-eb9e4d59ba59 Jun 17 04:37:20 devstack sudo[94381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:37:21 devstack sudo[94381]: pam_unix(sudo:session): session closed for user root Jun 17 04:37:21 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [req-f480cd0c-4ab5-4208-a6e2-c3f9bb91bb9b req-d59e1292-9b29-43ff-b691-7b3740a65750 tempest-VolumesSnapshotsTestJSON-996235156 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-2b79da52-77e6-4e69-89fc-262f78521102.5c958396-e6a9-4b1f-961c-eb9e4d59ba59" returned: 0 in 1.018s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:37:21 devstack cinder-volume[92060]: DEBUG cinder.coordination [req-f480cd0c-4ab5-4208-a6e2-c3f9bb91bb9b req-d59e1292-9b29-43ff-b691-7b3740a65750 tempest-VolumesSnapshotsTestJSON-996235156 None] Lock "cinder-quobyte-5c958396-e6a9-4b1f-961c-eb9e4d59ba59" released by "_delete_snapshot" :: held 4.788s {{(pid=92060) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 04:37:21 devstack cinder-volume[92060]: DEBUG cinder.coordination [req-f480cd0c-4ab5-4208-a6e2-c3f9bb91bb9b req-d59e1292-9b29-43ff-b691-7b3740a65750 tempest-VolumesSnapshotsTestJSON-996235156 None] Lock "cinder-quobyte-2b79da52-77e6-4e69-89fc-262f78521102" released by "delete_snapshot" :: held 4.856s {{(pid=92060) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 04:37:21 devstack cinder-volume[92060]: WARNING cinder.quota [req-f480cd0c-4ab5-4208-a6e2-c3f9bb91bb9b req-d59e1292-9b29-43ff-b691-7b3740a65750 tempest-VolumesSnapshotsTestJSON-996235156 None] Deprecated: Default quota for resource: snapshots_QuobyteHD is set by the default quota flag: quota_snapshots_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Jun 17 04:37:21 devstack cinder-volume[92060]: DEBUG cinder.quota [req-f480cd0c-4ab5-4208-a6e2-c3f9bb91bb9b req-d59e1292-9b29-43ff-b691-7b3740a65750 tempest-VolumesSnapshotsTestJSON-996235156 None] Created reservations ['4e2c8230-b14d-46f7-b7cc-4fe5352e035f', '4d15b8da-df45-4c99-b79b-78b565b8e41f', 'ef14f652-636e-4228-8893-c3b150a8be27', '565c1535-76ee-4c71-9592-497b85f42747'] {{(pid=92060) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 17 04:37:21 devstack cinder-volume[92060]: INFO cinder.volume.manager [req-f480cd0c-4ab5-4208-a6e2-c3f9bb91bb9b req-d59e1292-9b29-43ff-b691-7b3740a65750 tempest-VolumesSnapshotsTestJSON-996235156 None] Delete snapshot completed successfully. Jun 17 04:37:21 devstack cinder-volume[92060]: DEBUG cinder.coordination [req-f480cd0c-4ab5-4208-a6e2-c3f9bb91bb9b req-d59e1292-9b29-43ff-b691-7b3740a65750 tempest-VolumesSnapshotsTestJSON-996235156 None] Lock "cinder-5c958396-e6a9-4b1f-961c-eb9e4d59ba59-delete_snapshot" released by "delete_snapshot" :: held 5.112s {{(pid=92060) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 04:37:22 devstack cinder-volume[92060]: DEBUG cinder.coordination [req-c9940794-6049-46f4-a4d1-1077ac9b5a14 req-c75dfefa-3fcf-41a8-91f0-be8002afaa17 tempest-VolumesSnapshotsTestJSON-996235156 None] Acquiring lock "cinder-2b79da52-77e6-4e69-89fc-262f78521102-delete_volume" by "delete_volume" {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 04:37:22 devstack cinder-volume[92060]: DEBUG cinder.coordination [req-c9940794-6049-46f4-a4d1-1077ac9b5a14 req-c75dfefa-3fcf-41a8-91f0-be8002afaa17 tempest-VolumesSnapshotsTestJSON-996235156 None] Lock "cinder-2b79da52-77e6-4e69-89fc-262f78521102-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 04:37:22 devstack cinder-volume[92060]: DEBUG cinder.coordination [req-c9940794-6049-46f4-a4d1-1077ac9b5a14 req-c75dfefa-3fcf-41a8-91f0-be8002afaa17 tempest-VolumesSnapshotsTestJSON-996235156 None] Acquiring lock "cinder-quobyte-2b79da52-77e6-4e69-89fc-262f78521102" by "delete_volume" {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 04:37:22 devstack cinder-volume[92060]: DEBUG cinder.coordination [req-c9940794-6049-46f4-a4d1-1077ac9b5a14 req-c75dfefa-3fcf-41a8-91f0-be8002afaa17 tempest-VolumesSnapshotsTestJSON-996235156 None] Lock "cinder-quobyte-2b79da52-77e6-4e69-89fc-262f78521102" acquired by "delete_volume" :: waited 0.040s {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 04:37:22 devstack cinder-volume[92060]: DEBUG oslo.privsep.daemon [-] privsep: reply[d289dc64-b596-49f3-bef1-b67253677010]: (4, 'qcow2') {{(pid=93130) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 04:37:22 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [req-c9940794-6049-46f4-a4d1-1077ac9b5a14 req-c75dfefa-3fcf-41a8-91f0-be8002afaa17 tempest-VolumesSnapshotsTestJSON-996235156 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-2b79da52-77e6-4e69-89fc-262f78521102 {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:37:22 devstack sudo[94398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-2b79da52-77e6-4e69-89fc-262f78521102 Jun 17 04:37:22 devstack sudo[94398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:37:23 devstack sudo[94398]: pam_unix(sudo:session): session closed for user root Jun 17 04:37:23 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [req-c9940794-6049-46f4-a4d1-1077ac9b5a14 req-c75dfefa-3fcf-41a8-91f0-be8002afaa17 tempest-VolumesSnapshotsTestJSON-996235156 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-2b79da52-77e6-4e69-89fc-262f78521102" returned: 0 in 1.025s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:37:23 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [req-c9940794-6049-46f4-a4d1-1077ac9b5a14 req-c75dfefa-3fcf-41a8-91f0-be8002afaa17 tempest-VolumesSnapshotsTestJSON-996235156 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-2b79da52-77e6-4e69-89fc-262f78521102 {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:37:23 devstack sudo[94422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-2b79da52-77e6-4e69-89fc-262f78521102 Jun 17 04:37:23 devstack sudo[94422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:37:24 devstack sudo[94422]: pam_unix(sudo:session): session closed for user root Jun 17 04:37:24 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [req-c9940794-6049-46f4-a4d1-1077ac9b5a14 req-c75dfefa-3fcf-41a8-91f0-be8002afaa17 tempest-VolumesSnapshotsTestJSON-996235156 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-2b79da52-77e6-4e69-89fc-262f78521102" returned: 0 in 0.785s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:37:24 devstack cinder-volume[92060]: DEBUG cinder.coordination [req-c9940794-6049-46f4-a4d1-1077ac9b5a14 req-c75dfefa-3fcf-41a8-91f0-be8002afaa17 tempest-VolumesSnapshotsTestJSON-996235156 None] Lock "cinder-quobyte-2b79da52-77e6-4e69-89fc-262f78521102" released by "delete_volume" :: held 1.898s {{(pid=92060) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 04:37:24 devstack cinder-volume[92060]: DEBUG cinder.quota [req-c9940794-6049-46f4-a4d1-1077ac9b5a14 req-c75dfefa-3fcf-41a8-91f0-be8002afaa17 tempest-VolumesSnapshotsTestJSON-996235156 None] Created reservations ['c5dc7478-8678-456c-88b8-7b1c9b483d53', '61eb165e-60ed-4f8b-9c75-0ec24fdf42f9', '852a2af4-5de4-4e13-989c-8d7ac856af83', '191bd282-f852-4d5e-a6d2-a8601e5fa0b7'] {{(pid=92060) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 17 04:37:24 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [req-c9940794-6049-46f4-a4d1-1077ac9b5a14 req-c75dfefa-3fcf-41a8-91f0-be8002afaa17 tempest-VolumesSnapshotsTestJSON-996235156 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 04:37:24 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [req-c9940794-6049-46f4-a4d1-1077ac9b5a14 req-c75dfefa-3fcf-41a8-91f0-be8002afaa17 tempest-VolumesSnapshotsTestJSON-996235156 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 04:37:24 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [req-c9940794-6049-46f4-a4d1-1077ac9b5a14 req-c75dfefa-3fcf-41a8-91f0-be8002afaa17 tempest-VolumesSnapshotsTestJSON-996235156 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588': None} {{(pid=92060) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 17 04:37:24 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [req-c9940794-6049-46f4-a4d1-1077ac9b5a14 req-c75dfefa-3fcf-41a8-91f0-be8002afaa17 tempest-VolumesSnapshotsTestJSON-996235156 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588'] {{(pid=92060) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 17 04:37:24 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [req-c9940794-6049-46f4-a4d1-1077ac9b5a14 req-c75dfefa-3fcf-41a8-91f0-be8002afaa17 tempest-VolumesSnapshotsTestJSON-996235156 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 04:37:24 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [req-c9940794-6049-46f4-a4d1-1077ac9b5a14 req-c75dfefa-3fcf-41a8-91f0-be8002afaa17 tempest-VolumesSnapshotsTestJSON-996235156 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:37:24 devstack sudo[94455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a Jun 17 04:37:24 devstack sudo[94455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:37:25 devstack sudo[94455]: pam_unix(sudo:session): session closed for user root Jun 17 04:37:25 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [req-c9940794-6049-46f4-a4d1-1077ac9b5a14 req-c75dfefa-3fcf-41a8-91f0-be8002afaa17 tempest-VolumesSnapshotsTestJSON-996235156 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a" returned: 0 in 0.888s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:37:25 devstack cinder-volume[92060]: DEBUG cinder.manager [req-c9940794-6049-46f4-a4d1-1077ac9b5a14 req-c75dfefa-3fcf-41a8-91f0-be8002afaa17 tempest-VolumesSnapshotsTestJSON-996235156 None] Notifying Schedulers of capabilities ... {{(pid=92060) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 17 04:37:25 devstack cinder-volume[92060]: INFO cinder.volume.manager [req-c9940794-6049-46f4-a4d1-1077ac9b5a14 req-c75dfefa-3fcf-41a8-91f0-be8002afaa17 tempest-VolumesSnapshotsTestJSON-996235156 None] Deleted volume successfully. Jun 17 04:37:25 devstack cinder-volume[92060]: DEBUG cinder.coordination [req-c9940794-6049-46f4-a4d1-1077ac9b5a14 req-c75dfefa-3fcf-41a8-91f0-be8002afaa17 tempest-VolumesSnapshotsTestJSON-996235156 None] Lock "cinder-2b79da52-77e6-4e69-89fc-262f78521102-delete_volume" released by "delete_volume" :: held 3.188s {{(pid=92060) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 04:37:29 devstack cinder-volume[92060]: INFO cinder.volume.manager [None req-b8816fb2-c450-4116-888e-681629a63866 tempest-GroupSnapshotsTest-2072112239 None] Group tempest-GroupSnapshotsTest-Group-1908644913: creating Jun 17 04:37:29 devstack cinder-volume[92060]: INFO cinder.volume.manager [None req-b8816fb2-c450-4116-888e-681629a63866 tempest-GroupSnapshotsTest-2072112239 None] Group tempest-GroupSnapshotsTest-Group-1908644913: created successfully Jun 17 04:37:29 devstack cinder-volume[92060]: INFO cinder.volume.manager [None req-b8816fb2-c450-4116-888e-681629a63866 tempest-GroupSnapshotsTest-2072112239 None] Create group completed successfully. Jun 17 04:37:30 devstack cinder-volume[92060]: DEBUG cinder.volume.flows.manager.create_volume [None req-8058ef99-5bbc-4869-be12-cb353a276935 tempest-GroupSnapshotsTest-2072112239 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92060) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 17 04:37:30 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-8058ef99-5bbc-4869-be12-cb353a276935 tempest-GroupSnapshotsTest-2072112239 None] Flow 'volume_create_manager' (1b82636e-d53d-43f1-a90e-46450a6d3f82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 17 04:37:30 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-8058ef99-5bbc-4869-be12-cb353a276935 tempest-GroupSnapshotsTest-2072112239 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (11f937d8-9a3c-4ef2-9b0e-777102b37728) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:37:30 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-8058ef99-5bbc-4869-be12-cb353a276935 tempest-GroupSnapshotsTest-2072112239 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (11f937d8-9a3c-4ef2-9b0e-777102b37728) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-17T02:37:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1674780010',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=1d627f8e-1cc4-48d8-9a3f-819b76678a03,host='devstack@QuobyteHD#QuobyteHD',id=7877b275-cef0-44bb-97f9-4500c5973de7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e16b050b2b1f4789a93c0fd072e157c7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T02:37:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T02:37:31Z,use_quota=True,user_id='e22a2c2c4660479797c6f7cb8a003c1f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9f5e1f8d-b552-4eb5-b8be-ab079efde791),volume_type_id=9f5e1f8d-b552-4eb5-b8be-ab079efde791)' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:37:30 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-8058ef99-5bbc-4869-be12-cb353a276935 tempest-GroupSnapshotsTest-2072112239 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c0740cc0-4542-467b-9ddb-7df5df59ce94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:37:30 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-8058ef99-5bbc-4869-be12-cb353a276935 tempest-GroupSnapshotsTest-2072112239 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c0740cc0-4542-467b-9ddb-7df5df59ce94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:37:30 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-8058ef99-5bbc-4869-be12-cb353a276935 tempest-GroupSnapshotsTest-2072112239 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f8a74736-2edf-4cac-8425-18f9f7632041) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:37:30 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-8058ef99-5bbc-4869-be12-cb353a276935 tempest-GroupSnapshotsTest-2072112239 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f8a74736-2edf-4cac-8425-18f9f7632041) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7877b275-cef0-44bb-97f9-4500c5973de7', 'volume_name': 'volume-7877b275-cef0-44bb-97f9-4500c5973de7', 'volume_size': 1}' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:37:30 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-8058ef99-5bbc-4869-be12-cb353a276935 tempest-GroupSnapshotsTest-2072112239 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (090d10fd-ca9d-4a8c-a09c-aa24a4c10cf4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:37:30 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-8058ef99-5bbc-4869-be12-cb353a276935 tempest-GroupSnapshotsTest-2072112239 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (090d10fd-ca9d-4a8c-a09c-aa24a4c10cf4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:37:30 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-8058ef99-5bbc-4869-be12-cb353a276935 tempest-GroupSnapshotsTest-2072112239 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f2daba87-8cd1-4016-8c1b-dcfb7b12bab3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:37:30 devstack cinder-volume[92060]: INFO cinder.volume.flows.manager.create_volume [None req-8058ef99-5bbc-4869-be12-cb353a276935 tempest-GroupSnapshotsTest-2072112239 None] Volume 7877b275-cef0-44bb-97f9-4500c5973de7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7877b275-cef0-44bb-97f9-4500c5973de7', 'volume_size': 1} Jun 17 04:37:30 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-8058ef99-5bbc-4869-be12-cb353a276935 tempest-GroupSnapshotsTest-2072112239 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 04:37:30 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-8058ef99-5bbc-4869-be12-cb353a276935 tempest-GroupSnapshotsTest-2072112239 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 04:37:30 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-8058ef99-5bbc-4869-be12-cb353a276935 tempest-GroupSnapshotsTest-2072112239 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=1d627f8e-1cc4-48d8-9a3f-819b76678a03,created_at=2026-06-17T02:37:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1674780010',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=1d627f8e-1cc4-48d8-9a3f-819b76678a03,host='devstack@QuobyteHD#QuobyteHD',id=7877b275-cef0-44bb-97f9-4500c5973de7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e16b050b2b1f4789a93c0fd072e157c7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T02:37:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T02:37:31Z,use_quota=True,user_id='e22a2c2c4660479797c6f7cb8a003c1f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9f5e1f8d-b552-4eb5-b8be-ab079efde791),volume_type_id=9f5e1f8d-b552-4eb5-b8be-ab079efde791)}" {{(pid=92060) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 17 04:37:30 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.remotefs [None req-8058ef99-5bbc-4869-be12-cb353a276935 tempest-GroupSnapshotsTest-2072112239 None] Creating volume 7877b275-cef0-44bb-97f9-4500c5973de7 {{(pid=92060) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 17 04:37:30 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-8058ef99-5bbc-4869-be12-cb353a276935 tempest-GroupSnapshotsTest-2072112239 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 04:37:30 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-8058ef99-5bbc-4869-be12-cb353a276935 tempest-GroupSnapshotsTest-2072112239 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 04:37:30 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-8058ef99-5bbc-4869-be12-cb353a276935 tempest-GroupSnapshotsTest-2072112239 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588': None} {{(pid=92060) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 17 04:37:31 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-8058ef99-5bbc-4869-be12-cb353a276935 tempest-GroupSnapshotsTest-2072112239 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588'] {{(pid=92060) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 17 04:37:31 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-8058ef99-5bbc-4869-be12-cb353a276935 tempest-GroupSnapshotsTest-2072112239 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 04:37:31 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-8058ef99-5bbc-4869-be12-cb353a276935 tempest-GroupSnapshotsTest-2072112239 None] Selected osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588 as target Quobyte volume. {{(pid=92060) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 17 04:37:31 devstack cinder-volume[92060]: INFO cinder.volume.drivers.remotefs [None req-8058ef99-5bbc-4869-be12-cb353a276935 tempest-GroupSnapshotsTest-2072112239 None] casted to osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588 Jun 17 04:37:31 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-8058ef99-5bbc-4869-be12-cb353a276935 tempest-GroupSnapshotsTest-2072112239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-7877b275-cef0-44bb-97f9-4500c5973de7 1073741824 {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:37:31 devstack sudo[94461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-7877b275-cef0-44bb-97f9-4500c5973de7 1073741824 Jun 17 04:37:31 devstack sudo[94461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:37:32 devstack sudo[94461]: pam_unix(sudo:session): session closed for user root Jun 17 04:37:32 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-8058ef99-5bbc-4869-be12-cb353a276935 tempest-GroupSnapshotsTest-2072112239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-7877b275-cef0-44bb-97f9-4500c5973de7 1073741824" returned: 0 in 1.199s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:37:32 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-8058ef99-5bbc-4869-be12-cb353a276935 tempest-GroupSnapshotsTest-2072112239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-7877b275-cef0-44bb-97f9-4500c5973de7 {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:37:32 devstack sudo[94472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-7877b275-cef0-44bb-97f9-4500c5973de7 Jun 17 04:37:32 devstack sudo[94472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:37:32 devstack sudo[94472]: pam_unix(sudo:session): session closed for user root Jun 17 04:37:32 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-8058ef99-5bbc-4869-be12-cb353a276935 tempest-GroupSnapshotsTest-2072112239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-7877b275-cef0-44bb-97f9-4500c5973de7" returned: 0 in 0.719s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:37:32 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-8058ef99-5bbc-4869-be12-cb353a276935 tempest-GroupSnapshotsTest-2072112239 None] <== create_volume: return (1992ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588'} {{(pid=92060) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 17 04:37:32 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-8058ef99-5bbc-4869-be12-cb353a276935 tempest-GroupSnapshotsTest-2072112239 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.995s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 04:37:33 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-8058ef99-5bbc-4869-be12-cb353a276935 tempest-GroupSnapshotsTest-2072112239 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f2daba87-8cd1-4016-8c1b-dcfb7b12bab3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7877b275-cef0-44bb-97f9-4500c5973de7', 'volume_size': 1}' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:37:33 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-8058ef99-5bbc-4869-be12-cb353a276935 tempest-GroupSnapshotsTest-2072112239 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1e3622e4-75f5-4e96-8ce7-df79c36cd66b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:37:33 devstack cinder-volume[92060]: INFO cinder.volume.flows.manager.create_volume [None req-8058ef99-5bbc-4869-be12-cb353a276935 tempest-GroupSnapshotsTest-2072112239 None] Volume volume-7877b275-cef0-44bb-97f9-4500c5973de7 (7877b275-cef0-44bb-97f9-4500c5973de7): created successfully Jun 17 04:37:33 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-8058ef99-5bbc-4869-be12-cb353a276935 tempest-GroupSnapshotsTest-2072112239 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1e3622e4-75f5-4e96-8ce7-df79c36cd66b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:37:33 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-8058ef99-5bbc-4869-be12-cb353a276935 tempest-GroupSnapshotsTest-2072112239 None] Flow 'volume_create_manager' (1b82636e-d53d-43f1-a90e-46450a6d3f82) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92060) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 17 04:37:33 devstack cinder-volume[92060]: INFO cinder.volume.manager [None req-8058ef99-5bbc-4869-be12-cb353a276935 tempest-GroupSnapshotsTest-2072112239 None] Created volume successfully. Jun 17 04:37:33 devstack cinder-volume[92060]: INFO cinder.volume.manager [None req-7ce41242-a2e9-4059-a84d-0c2d16fd4eea tempest-GroupSnapshotsTest-2072112239 None] GroupSnapshot 4bcdc1ef-23c9-4e0d-9e24-de5290ca47bb: creating. Jun 17 04:37:33 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-7ce41242-a2e9-4059-a84d-0c2d16fd4eea tempest-GroupSnapshotsTest-2072112239 None] Group snapshot 4bcdc1ef-23c9-4e0d-9e24-de5290ca47bb: creating. {{(pid=92060) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Jun 17 04:37:33 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-7ce41242-a2e9-4059-a84d-0c2d16fd4eea tempest-GroupSnapshotsTest-2072112239 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 04:37:33 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-7ce41242-a2e9-4059-a84d-0c2d16fd4eea tempest-GroupSnapshotsTest-2072112239 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 04:37:33 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.remotefs [None req-7ce41242-a2e9-4059-a84d-0c2d16fd4eea tempest-GroupSnapshotsTest-2072112239 None] Creating offline snapshot 4663a6de-8a4e-43df-94c9-8938197055b8 of volume 7877b275-cef0-44bb-97f9-4500c5973de7 {{(pid=92060) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 17 04:37:33 devstack cinder-volume[92060]: DEBUG oslo.privsep.daemon [-] privsep: reply[92feee97-6849-4699-9579-bc361fbd5e32]: (4, 'qcow2') {{(pid=93130) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 04:37:33 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-7ce41242-a2e9-4059-a84d-0c2d16fd4eea tempest-GroupSnapshotsTest-2072112239 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-7877b275-cef0-44bb-97f9-4500c5973de7 {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:37:34 devstack sudo[94492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-7877b275-cef0-44bb-97f9-4500c5973de7 Jun 17 04:37:34 devstack sudo[94492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:37:34 devstack sudo[94492]: pam_unix(sudo:session): session closed for user root Jun 17 04:37:34 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-7ce41242-a2e9-4059-a84d-0c2d16fd4eea tempest-GroupSnapshotsTest-2072112239 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-7877b275-cef0-44bb-97f9-4500c5973de7" returned: 0 in 0.728s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:37:34 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-7ce41242-a2e9-4059-a84d-0c2d16fd4eea tempest-GroupSnapshotsTest-2072112239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-7877b275-cef0-44bb-97f9-4500c5973de7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-7877b275-cef0-44bb-97f9-4500c5973de7.4663a6de-8a4e-43df-94c9-8938197055b8 1G {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:37:34 devstack sudo[94498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-7877b275-cef0-44bb-97f9-4500c5973de7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-7877b275-cef0-44bb-97f9-4500c5973de7.4663a6de-8a4e-43df-94c9-8938197055b8 1G Jun 17 04:37:34 devstack sudo[94498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:37:35 devstack sudo[94498]: pam_unix(sudo:session): session closed for user root Jun 17 04:37:35 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-7ce41242-a2e9-4059-a84d-0c2d16fd4eea tempest-GroupSnapshotsTest-2072112239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-7877b275-cef0-44bb-97f9-4500c5973de7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-7877b275-cef0-44bb-97f9-4500c5973de7.4663a6de-8a4e-43df-94c9-8938197055b8 1G" returned: 0 in 0.905s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:37:35 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-7ce41242-a2e9-4059-a84d-0c2d16fd4eea tempest-GroupSnapshotsTest-2072112239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7877b275-cef0-44bb-97f9-4500c5973de7 -F qcow2 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-7877b275-cef0-44bb-97f9-4500c5973de7.4663a6de-8a4e-43df-94c9-8938197055b8 {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:37:35 devstack sudo[94507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7877b275-cef0-44bb-97f9-4500c5973de7 -F qcow2 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-7877b275-cef0-44bb-97f9-4500c5973de7.4663a6de-8a4e-43df-94c9-8938197055b8 Jun 17 04:37:35 devstack sudo[94507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:37:36 devstack sudo[94507]: pam_unix(sudo:session): session closed for user root Jun 17 04:37:36 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-7ce41242-a2e9-4059-a84d-0c2d16fd4eea tempest-GroupSnapshotsTest-2072112239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7877b275-cef0-44bb-97f9-4500c5973de7 -F qcow2 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-7877b275-cef0-44bb-97f9-4500c5973de7.4663a6de-8a4e-43df-94c9-8938197055b8" returned: 0 in 0.627s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:37:36 devstack cinder-volume[92060]: WARNING cinder.volume.drivers.remotefs [None req-7ce41242-a2e9-4059-a84d-0c2d16fd4eea tempest-GroupSnapshotsTest-2072112239 None] /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-7877b275-cef0-44bb-97f9-4500c5973de7.4663a6de-8a4e-43df-94c9-8938197055b8 is being set with open permissions: ugo+rw: NotImplementedError Jun 17 04:37:36 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-7ce41242-a2e9-4059-a84d-0c2d16fd4eea tempest-GroupSnapshotsTest-2072112239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-7877b275-cef0-44bb-97f9-4500c5973de7.4663a6de-8a4e-43df-94c9-8938197055b8 {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:37:36 devstack sudo[94512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-7877b275-cef0-44bb-97f9-4500c5973de7.4663a6de-8a4e-43df-94c9-8938197055b8 Jun 17 04:37:36 devstack sudo[94512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:37:36 devstack sudo[94512]: pam_unix(sudo:session): session closed for user root Jun 17 04:37:36 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-7ce41242-a2e9-4059-a84d-0c2d16fd4eea tempest-GroupSnapshotsTest-2072112239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-7877b275-cef0-44bb-97f9-4500c5973de7.4663a6de-8a4e-43df-94c9-8938197055b8" returned: 0 in 0.717s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:37:36 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-7ce41242-a2e9-4059-a84d-0c2d16fd4eea tempest-GroupSnapshotsTest-2072112239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-7877b275-cef0-44bb-97f9-4500c5973de7.info {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:37:37 devstack sudo[94540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-7877b275-cef0-44bb-97f9-4500c5973de7.info Jun 17 04:37:37 devstack sudo[94540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:37:37 devstack cinder-volume[92060]: DEBUG cinder.volume.flows.manager.create_volume [None req-44fe8098-7f56-4568-90cc-740d9658ac06 tempest-ServerActionsTestOtherA-1987628563 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92060) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 17 04:37:37 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-44fe8098-7f56-4568-90cc-740d9658ac06 tempest-ServerActionsTestOtherA-1987628563 None] Flow 'volume_create_manager' (d3861567-1594-488a-bac7-cf6c4460b0b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 17 04:37:37 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-44fe8098-7f56-4568-90cc-740d9658ac06 tempest-ServerActionsTestOtherA-1987628563 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8ec7bc96-e94f-4e9c-a5a5-e0df4fd92c46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:37:37 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-44fe8098-7f56-4568-90cc-740d9658ac06 tempest-ServerActionsTestOtherA-1987628563 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8ec7bc96-e94f-4e9c-a5a5-e0df4fd92c46) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-17T02:37:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-1337428049',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=87612384-1fa0-40a0-b4fb-f5570b67b53a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e87497adca3f47a691d78c131560f5b9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T02:37:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T02:37:37Z,use_quota=True,user_id='d03737ab77ca4235b37141940e0baa41',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aad9ce24-93f9-41a6-baa1-5125964f96d1),volume_type_id=aad9ce24-93f9-41a6-baa1-5125964f96d1)' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:37:37 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-44fe8098-7f56-4568-90cc-740d9658ac06 tempest-ServerActionsTestOtherA-1987628563 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e788b75b-160e-48d9-9642-1f8ba4b9adc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:37:37 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-44fe8098-7f56-4568-90cc-740d9658ac06 tempest-ServerActionsTestOtherA-1987628563 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e788b75b-160e-48d9-9642-1f8ba4b9adc0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:37:37 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-44fe8098-7f56-4568-90cc-740d9658ac06 tempest-ServerActionsTestOtherA-1987628563 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ba4e725e-2af1-44ca-98c9-12944fab4d48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:37:37 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-44fe8098-7f56-4568-90cc-740d9658ac06 tempest-ServerActionsTestOtherA-1987628563 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ba4e725e-2af1-44ca-98c9-12944fab4d48) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '87612384-1fa0-40a0-b4fb-f5570b67b53a', 'volume_name': 'volume-87612384-1fa0-40a0-b4fb-f5570b67b53a', 'volume_size': 1}' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:37:37 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-44fe8098-7f56-4568-90cc-740d9658ac06 tempest-ServerActionsTestOtherA-1987628563 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8f9f4470-d203-41ac-9d70-5be0c2670525) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:37:37 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-44fe8098-7f56-4568-90cc-740d9658ac06 tempest-ServerActionsTestOtherA-1987628563 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8f9f4470-d203-41ac-9d70-5be0c2670525) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:37:37 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-44fe8098-7f56-4568-90cc-740d9658ac06 tempest-ServerActionsTestOtherA-1987628563 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f3af419a-a02a-4b9f-ab9e-cf7e60bbf4b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:37:37 devstack cinder-volume[92060]: INFO cinder.volume.flows.manager.create_volume [None req-44fe8098-7f56-4568-90cc-740d9658ac06 tempest-ServerActionsTestOtherA-1987628563 None] Volume 87612384-1fa0-40a0-b4fb-f5570b67b53a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-87612384-1fa0-40a0-b4fb-f5570b67b53a', 'volume_size': 1} Jun 17 04:37:37 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-44fe8098-7f56-4568-90cc-740d9658ac06 tempest-ServerActionsTestOtherA-1987628563 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 04:37:37 devstack sudo[94540]: pam_unix(sudo:session): session closed for user root Jun 17 04:37:37 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-7ce41242-a2e9-4059-a84d-0c2d16fd4eea tempest-GroupSnapshotsTest-2072112239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-7877b275-cef0-44bb-97f9-4500c5973de7.info" returned: 0 in 0.764s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:37:37 devstack cinder-volume[92060]: WARNING cinder.volume.drivers.remotefs [None req-7ce41242-a2e9-4059-a84d-0c2d16fd4eea tempest-GroupSnapshotsTest-2072112239 None] /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-7877b275-cef0-44bb-97f9-4500c5973de7.info is being set with open permissions: ugo+rw: NotImplementedError Jun 17 04:37:37 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-7ce41242-a2e9-4059-a84d-0c2d16fd4eea tempest-GroupSnapshotsTest-2072112239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-7877b275-cef0-44bb-97f9-4500c5973de7.info {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:37:37 devstack sudo[94561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-7877b275-cef0-44bb-97f9-4500c5973de7.info Jun 17 04:37:37 devstack sudo[94561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:37:38 devstack sudo[94561]: pam_unix(sudo:session): session closed for user root Jun 17 04:37:38 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-7ce41242-a2e9-4059-a84d-0c2d16fd4eea tempest-GroupSnapshotsTest-2072112239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-7877b275-cef0-44bb-97f9-4500c5973de7.info" returned: 0 in 0.698s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:37:38 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-7ce41242-a2e9-4059-a84d-0c2d16fd4eea tempest-GroupSnapshotsTest-2072112239 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.548s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 04:37:38 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-44fe8098-7f56-4568-90cc-740d9658ac06 tempest-ServerActionsTestOtherA-1987628563 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.887s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 04:37:38 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-44fe8098-7f56-4568-90cc-740d9658ac06 tempest-ServerActionsTestOtherA-1987628563 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-17T02:37:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-1337428049',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=87612384-1fa0-40a0-b4fb-f5570b67b53a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e87497adca3f47a691d78c131560f5b9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T02:37:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T02:37:37Z,use_quota=True,user_id='d03737ab77ca4235b37141940e0baa41',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aad9ce24-93f9-41a6-baa1-5125964f96d1),volume_type_id=aad9ce24-93f9-41a6-baa1-5125964f96d1)}" {{(pid=92060) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 17 04:37:38 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.remotefs [None req-44fe8098-7f56-4568-90cc-740d9658ac06 tempest-ServerActionsTestOtherA-1987628563 None] Creating volume 87612384-1fa0-40a0-b4fb-f5570b67b53a {{(pid=92060) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 17 04:37:38 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-44fe8098-7f56-4568-90cc-740d9658ac06 tempest-ServerActionsTestOtherA-1987628563 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 04:37:38 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-44fe8098-7f56-4568-90cc-740d9658ac06 tempest-ServerActionsTestOtherA-1987628563 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 04:37:38 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-44fe8098-7f56-4568-90cc-740d9658ac06 tempest-ServerActionsTestOtherA-1987628563 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588': None} {{(pid=92060) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 17 04:37:38 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-44fe8098-7f56-4568-90cc-740d9658ac06 tempest-ServerActionsTestOtherA-1987628563 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588'] {{(pid=92060) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 17 04:37:38 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-44fe8098-7f56-4568-90cc-740d9658ac06 tempest-ServerActionsTestOtherA-1987628563 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 04:37:38 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-44fe8098-7f56-4568-90cc-740d9658ac06 tempest-ServerActionsTestOtherA-1987628563 None] Selected osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588 as target Quobyte volume. {{(pid=92060) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 17 04:37:38 devstack cinder-volume[92060]: INFO cinder.volume.drivers.remotefs [None req-44fe8098-7f56-4568-90cc-740d9658ac06 tempest-ServerActionsTestOtherA-1987628563 None] casted to osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588 Jun 17 04:37:38 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-44fe8098-7f56-4568-90cc-740d9658ac06 tempest-ServerActionsTestOtherA-1987628563 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-87612384-1fa0-40a0-b4fb-f5570b67b53a 1073741824 {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:37:38 devstack sudo[94565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-87612384-1fa0-40a0-b4fb-f5570b67b53a 1073741824 Jun 17 04:37:38 devstack sudo[94565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:37:38 devstack cinder-volume[92060]: INFO cinder.volume.manager [None req-7ce41242-a2e9-4059-a84d-0c2d16fd4eea tempest-GroupSnapshotsTest-2072112239 None] group_snapshot 4bcdc1ef-23c9-4e0d-9e24-de5290ca47bb: created successfully Jun 17 04:37:39 devstack sudo[94565]: pam_unix(sudo:session): session closed for user root Jun 17 04:37:39 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-44fe8098-7f56-4568-90cc-740d9658ac06 tempest-ServerActionsTestOtherA-1987628563 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-87612384-1fa0-40a0-b4fb-f5570b67b53a 1073741824" returned: 0 in 0.994s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:37:39 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-44fe8098-7f56-4568-90cc-740d9658ac06 tempest-ServerActionsTestOtherA-1987628563 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-87612384-1fa0-40a0-b4fb-f5570b67b53a {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:37:39 devstack sudo[94572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-87612384-1fa0-40a0-b4fb-f5570b67b53a Jun 17 04:37:39 devstack sudo[94572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:37:40 devstack sudo[94572]: pam_unix(sudo:session): session closed for user root Jun 17 04:37:40 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-44fe8098-7f56-4568-90cc-740d9658ac06 tempest-ServerActionsTestOtherA-1987628563 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-87612384-1fa0-40a0-b4fb-f5570b67b53a" returned: 0 in 0.625s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:37:40 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-44fe8098-7f56-4568-90cc-740d9658ac06 tempest-ServerActionsTestOtherA-1987628563 None] <== create_volume: return (1671ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588'} {{(pid=92060) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 17 04:37:40 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-44fe8098-7f56-4568-90cc-740d9658ac06 tempest-ServerActionsTestOtherA-1987628563 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.674s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 04:37:40 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-44fe8098-7f56-4568-90cc-740d9658ac06 tempest-ServerActionsTestOtherA-1987628563 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f3af419a-a02a-4b9f-ab9e-cf7e60bbf4b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-87612384-1fa0-40a0-b4fb-f5570b67b53a', 'volume_size': 1}' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:37:40 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-44fe8098-7f56-4568-90cc-740d9658ac06 tempest-ServerActionsTestOtherA-1987628563 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b520752a-2747-480c-b8cd-8d186c7b1227) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:37:40 devstack cinder-volume[92060]: INFO cinder.volume.flows.manager.create_volume [None req-44fe8098-7f56-4568-90cc-740d9658ac06 tempest-ServerActionsTestOtherA-1987628563 None] Volume volume-87612384-1fa0-40a0-b4fb-f5570b67b53a (87612384-1fa0-40a0-b4fb-f5570b67b53a): created successfully Jun 17 04:37:40 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-44fe8098-7f56-4568-90cc-740d9658ac06 tempest-ServerActionsTestOtherA-1987628563 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b520752a-2747-480c-b8cd-8d186c7b1227) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:37:40 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-44fe8098-7f56-4568-90cc-740d9658ac06 tempest-ServerActionsTestOtherA-1987628563 None] Flow 'volume_create_manager' (d3861567-1594-488a-bac7-cf6c4460b0b2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92060) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 17 04:37:40 devstack cinder-volume[92060]: INFO cinder.volume.manager [None req-44fe8098-7f56-4568-90cc-740d9658ac06 tempest-ServerActionsTestOtherA-1987628563 None] Created volume successfully. Jun 17 04:37:40 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-74f8df74-d465-440d-b63c-e235ad158bd6 tempest-GroupSnapshotsTest-2072112239 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 04:37:40 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-74f8df74-d465-440d-b63c-e235ad158bd6 tempest-GroupSnapshotsTest-2072112239 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 04:37:40 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-74f8df74-d465-440d-b63c-e235ad158bd6 tempest-GroupSnapshotsTest-2072112239 None] Acquiring lock "cinder-quobyte-4663a6de-8a4e-43df-94c9-8938197055b8-b3224eda-f849-490c-aa9f-b60f670aae0c" by "_create_volume_from_snapshot" {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 04:37:40 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-74f8df74-d465-440d-b63c-e235ad158bd6 tempest-GroupSnapshotsTest-2072112239 None] Lock "cinder-quobyte-4663a6de-8a4e-43df-94c9-8938197055b8-b3224eda-f849-490c-aa9f-b60f670aae0c" acquired by "_create_volume_from_snapshot" :: waited 0.018s {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 04:37:40 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-74f8df74-d465-440d-b63c-e235ad158bd6 tempest-GroupSnapshotsTest-2072112239 None] Creating volume b3224eda-f849-490c-aa9f-b60f670aae0c from snapshot 4663a6de-8a4e-43df-94c9-8938197055b8 {{(pid=92060) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jun 17 04:37:40 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-74f8df74-d465-440d-b63c-e235ad158bd6 tempest-GroupSnapshotsTest-2072112239 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 04:37:40 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-74f8df74-d465-440d-b63c-e235ad158bd6 tempest-GroupSnapshotsTest-2072112239 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 04:37:40 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-74f8df74-d465-440d-b63c-e235ad158bd6 tempest-GroupSnapshotsTest-2072112239 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588': None} {{(pid=92060) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 17 04:37:40 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-74f8df74-d465-440d-b63c-e235ad158bd6 tempest-GroupSnapshotsTest-2072112239 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588'] {{(pid=92060) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 17 04:37:40 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-74f8df74-d465-440d-b63c-e235ad158bd6 tempest-GroupSnapshotsTest-2072112239 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 04:37:40 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-74f8df74-d465-440d-b63c-e235ad158bd6 tempest-GroupSnapshotsTest-2072112239 None] Selected osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588 as target Quobyte volume. {{(pid=92060) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 17 04:37:40 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-74f8df74-d465-440d-b63c-e235ad158bd6 tempest-GroupSnapshotsTest-2072112239 None] Acquiring lock "cinder-quobyte-b3224eda-f849-490c-aa9f-b60f670aae0c" by "_copy_volume_from_snapshot" {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 04:37:40 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-74f8df74-d465-440d-b63c-e235ad158bd6 tempest-GroupSnapshotsTest-2072112239 None] Lock "cinder-quobyte-b3224eda-f849-490c-aa9f-b60f670aae0c" acquired by "_copy_volume_from_snapshot" :: waited 0.025s {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 04:37:40 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-74f8df74-d465-440d-b63c-e235ad158bd6 tempest-GroupSnapshotsTest-2072112239 None] snapshot: 4663a6de-8a4e-43df-94c9-8938197055b8, volume: b3224eda-f849-490c-aa9f-b60f670aae0c, {{(pid=92060) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jun 17 04:37:40 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-74f8df74-d465-440d-b63c-e235ad158bd6 tempest-GroupSnapshotsTest-2072112239 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 04:37:40 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-74f8df74-d465-440d-b63c-e235ad158bd6 tempest-GroupSnapshotsTest-2072112239 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 04:37:40 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-74f8df74-d465-440d-b63c-e235ad158bd6 tempest-GroupSnapshotsTest-2072112239 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588': None} {{(pid=92060) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 17 04:37:40 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-74f8df74-d465-440d-b63c-e235ad158bd6 tempest-GroupSnapshotsTest-2072112239 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588'] {{(pid=92060) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 17 04:37:40 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-74f8df74-d465-440d-b63c-e235ad158bd6 tempest-GroupSnapshotsTest-2072112239 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 04:37:40 devstack cinder-volume[92060]: DEBUG oslo.privsep.daemon [-] privsep: reply[1524aaf9-af36-4b34-b6ab-8cf02cfbb017]: (4, 'qcow2') {{(pid=93130) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 04:37:40 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-74f8df74-d465-440d-b63c-e235ad158bd6 tempest-GroupSnapshotsTest-2072112239 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-7877b275-cef0-44bb-97f9-4500c5973de7.4663a6de-8a4e-43df-94c9-8938197055b8 {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:37:40 devstack sudo[94578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-7877b275-cef0-44bb-97f9-4500c5973de7.4663a6de-8a4e-43df-94c9-8938197055b8 Jun 17 04:37:40 devstack sudo[94578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:37:41 devstack sudo[94578]: pam_unix(sudo:session): session closed for user root Jun 17 04:37:41 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-74f8df74-d465-440d-b63c-e235ad158bd6 tempest-GroupSnapshotsTest-2072112239 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-7877b275-cef0-44bb-97f9-4500c5973de7.4663a6de-8a4e-43df-94c9-8938197055b8" returned: 0 in 0.741s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:37:41 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.remotefs [None req-74f8df74-d465-440d-b63c-e235ad158bd6 tempest-GroupSnapshotsTest-2072112239 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7877b275-cef0-44bb-97f9-4500c5973de7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=92060) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 17 04:37:41 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-74f8df74-d465-440d-b63c-e235ad158bd6 tempest-GroupSnapshotsTest-2072112239 None] will copy from snapshot at /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-7877b275-cef0-44bb-97f9-4500c5973de7 {{(pid=92060) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jun 17 04:37:41 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-74f8df74-d465-440d-b63c-e235ad158bd6 tempest-GroupSnapshotsTest-2072112239 None] Creating direct copy from snapshot {{(pid=92060) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jun 17 04:37:41 devstack cinder-volume[92060]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4ffb812-842d-417d-b8b0-075b4ca22316]: (4, 'qcow2') {{(pid=93130) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 04:37:41 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-74f8df74-d465-440d-b63c-e235ad158bd6 tempest-GroupSnapshotsTest-2072112239 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-7877b275-cef0-44bb-97f9-4500c5973de7 {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:37:41 devstack sudo[94586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-7877b275-cef0-44bb-97f9-4500c5973de7 Jun 17 04:37:41 devstack sudo[94586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:37:41 devstack sudo[94586]: pam_unix(sudo:session): session closed for user root Jun 17 04:37:41 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-74f8df74-d465-440d-b63c-e235ad158bd6 tempest-GroupSnapshotsTest-2072112239 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-7877b275-cef0-44bb-97f9-4500c5973de7" returned: 0 in 0.706s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:37:41 devstack cinder-volume[92060]: DEBUG cinder.utils [None req-74f8df74-d465-440d-b63c-e235ad158bd6 tempest-GroupSnapshotsTest-2072112239 None] Path /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-b3224eda-f849-490c-aa9f-b60f670aae0c not found in is_blk_device check {{(pid=92060) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jun 17 04:37:41 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-74f8df74-d465-440d-b63c-e235ad158bd6 tempest-GroupSnapshotsTest-2072112239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-7877b275-cef0-44bb-97f9-4500c5973de7 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-b3224eda-f849-490c-aa9f-b60f670aae0c {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:37:41 devstack sudo[94591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-7877b275-cef0-44bb-97f9-4500c5973de7 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-b3224eda-f849-490c-aa9f-b60f670aae0c Jun 17 04:37:41 devstack sudo[94591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:37:44 devstack cinder-volume[92060]: DEBUG oslo_service.periodic_task [None req-60d279ad-ad8c-4d36-a4b8-f593e74fb922 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=92060) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 17 04:37:44 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-60d279ad-ad8c-4d36-a4b8-f593e74fb922 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 04:37:44 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-60d279ad-ad8c-4d36-a4b8-f593e74fb922 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 04:37:44 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-60d279ad-ad8c-4d36-a4b8-f593e74fb922 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588': None} {{(pid=92060) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 17 04:37:44 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-60d279ad-ad8c-4d36-a4b8-f593e74fb922 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588'] {{(pid=92060) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 17 04:37:44 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-60d279ad-ad8c-4d36-a4b8-f593e74fb922 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.033s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 04:37:44 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-60d279ad-ad8c-4d36-a4b8-f593e74fb922 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:37:44 devstack sudo[94666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a Jun 17 04:37:44 devstack sudo[94666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:37:46 devstack sudo[94666]: pam_unix(sudo:session): session closed for user root Jun 17 04:37:46 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-60d279ad-ad8c-4d36-a4b8-f593e74fb922 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a" returned: 0 in 1.193s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:37:46 devstack cinder-volume[92060]: DEBUG cinder.manager [None req-60d279ad-ad8c-4d36-a4b8-f593e74fb922 None None] Notifying Schedulers of capabilities ... {{(pid=92060) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 17 04:37:46 devstack cinder-volume[92060]: DEBUG oslo_service.periodic_task [None req-60d279ad-ad8c-4d36-a4b8-f593e74fb922 None None] Running periodic task VolumeManager._thread_info {{(pid=92060) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 17 04:37:46 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-60d279ad-ad8c-4d36-a4b8-f593e74fb922 None None] thread count: 8 {{(pid=92060) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 17 04:37:46 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-60d279ad-ad8c-4d36-a4b8-f593e74fb922 None None] thread info: [<_MainThread(MainThread, started 130061806440576)>, , , , , , , ] {{(pid=92060) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 17 04:37:49 devstack cinder-volume[92060]: DEBUG cinder.volume.flows.manager.create_volume [None req-b9c81a15-dd6a-4b66-9164-06b2a02463f0 tempest-AttachVolumeShelveTestJSON-134363980 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92060) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 17 04:37:49 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-b9c81a15-dd6a-4b66-9164-06b2a02463f0 tempest-AttachVolumeShelveTestJSON-134363980 None] Flow 'volume_create_manager' (170067ae-c12f-44dc-b760-0c13ee8a015d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 17 04:37:49 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-b9c81a15-dd6a-4b66-9164-06b2a02463f0 tempest-AttachVolumeShelveTestJSON-134363980 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (93bd7b63-3779-47e5-9bf6-398dad68f705) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:37:49 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-b9c81a15-dd6a-4b66-9164-06b2a02463f0 tempest-AttachVolumeShelveTestJSON-134363980 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (93bd7b63-3779-47e5-9bf6-398dad68f705) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-17T02:37:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-262096615',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bf2eca3e-8c5a-4863-bbb8-1003435f17a2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='51b31662b38d4586825b0c761e731e86',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T02:37:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T02:37:49Z,use_quota=True,user_id='7bde37e17f6247789a101e63fbac5bce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aad9ce24-93f9-41a6-baa1-5125964f96d1),volume_type_id=aad9ce24-93f9-41a6-baa1-5125964f96d1)' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:37:49 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-b9c81a15-dd6a-4b66-9164-06b2a02463f0 tempest-AttachVolumeShelveTestJSON-134363980 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (34adbcf7-4ce1-482d-b78e-376c8122844c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:37:49 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-b9c81a15-dd6a-4b66-9164-06b2a02463f0 tempest-AttachVolumeShelveTestJSON-134363980 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (34adbcf7-4ce1-482d-b78e-376c8122844c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:37:49 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-b9c81a15-dd6a-4b66-9164-06b2a02463f0 tempest-AttachVolumeShelveTestJSON-134363980 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (16340be8-ebe8-4098-aac6-3321d857cb47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:37:49 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-b9c81a15-dd6a-4b66-9164-06b2a02463f0 tempest-AttachVolumeShelveTestJSON-134363980 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (16340be8-ebe8-4098-aac6-3321d857cb47) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bf2eca3e-8c5a-4863-bbb8-1003435f17a2', 'volume_name': 'volume-bf2eca3e-8c5a-4863-bbb8-1003435f17a2', 'volume_size': 1}' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:37:49 devstack sudo[94591]: pam_unix(sudo:session): session closed for user root Jun 17 04:37:49 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-b9c81a15-dd6a-4b66-9164-06b2a02463f0 tempest-AttachVolumeShelveTestJSON-134363980 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bcad9643-41d4-48e8-9f99-8b9761e8292c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:37:49 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-b9c81a15-dd6a-4b66-9164-06b2a02463f0 tempest-AttachVolumeShelveTestJSON-134363980 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bcad9643-41d4-48e8-9f99-8b9761e8292c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:37:49 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-b9c81a15-dd6a-4b66-9164-06b2a02463f0 tempest-AttachVolumeShelveTestJSON-134363980 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f6b0d6f3-4d56-4683-a2fd-a2d50ac6c9bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:37:49 devstack cinder-volume[92060]: INFO cinder.volume.flows.manager.create_volume [None req-b9c81a15-dd6a-4b66-9164-06b2a02463f0 tempest-AttachVolumeShelveTestJSON-134363980 None] Volume bf2eca3e-8c5a-4863-bbb8-1003435f17a2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bf2eca3e-8c5a-4863-bbb8-1003435f17a2', 'volume_size': 1} Jun 17 04:37:49 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-b9c81a15-dd6a-4b66-9164-06b2a02463f0 tempest-AttachVolumeShelveTestJSON-134363980 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 04:37:49 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-74f8df74-d465-440d-b63c-e235ad158bd6 tempest-GroupSnapshotsTest-2072112239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-7877b275-cef0-44bb-97f9-4500c5973de7 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-b3224eda-f849-490c-aa9f-b60f670aae0c" returned: 0 in 7.182s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:37:49 devstack cinder-volume[92060]: DEBUG oslo.privsep.daemon [-] privsep: reply[61a5d249-006d-4240-96c4-509f7a0ab755]: (4, 'qcow2') {{(pid=93130) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 04:37:49 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-74f8df74-d465-440d-b63c-e235ad158bd6 tempest-GroupSnapshotsTest-2072112239 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-7877b275-cef0-44bb-97f9-4500c5973de7 {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:37:49 devstack sudo[94687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-7877b275-cef0-44bb-97f9-4500c5973de7 Jun 17 04:37:49 devstack sudo[94687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:37:50 devstack sudo[94687]: pam_unix(sudo:session): session closed for user root Jun 17 04:37:50 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-74f8df74-d465-440d-b63c-e235ad158bd6 tempest-GroupSnapshotsTest-2072112239 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-7877b275-cef0-44bb-97f9-4500c5973de7" returned: 0 in 0.961s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:37:50 devstack cinder-volume[92060]: DEBUG cinder.image.image_utils [None req-74f8df74-d465-440d-b63c-e235ad158bd6 tempest-GroupSnapshotsTest-2072112239 None] Image conversion details: src /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-7877b275-cef0-44bb-97f9-4500c5973de7, size 1024.00 MB, duration 7.18 sec, destination /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-b3224eda-f849-490c-aa9f-b60f670aae0c {{(pid=92060) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 17 04:37:50 devstack cinder-volume[92060]: INFO cinder.image.image_utils [None req-74f8df74-d465-440d-b63c-e235ad158bd6 tempest-GroupSnapshotsTest-2072112239 None] Converted 1024.00 MB image at 142.56 MB/s Jun 17 04:37:50 devstack cinder-volume[92060]: WARNING cinder.volume.drivers.remotefs [None req-74f8df74-d465-440d-b63c-e235ad158bd6 tempest-GroupSnapshotsTest-2072112239 None] /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-b3224eda-f849-490c-aa9f-b60f670aae0c is being set with open permissions: ugo+rw: NotImplementedError Jun 17 04:37:50 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-74f8df74-d465-440d-b63c-e235ad158bd6 tempest-GroupSnapshotsTest-2072112239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-b3224eda-f849-490c-aa9f-b60f670aae0c {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:37:50 devstack sudo[94694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-b3224eda-f849-490c-aa9f-b60f670aae0c Jun 17 04:37:50 devstack sudo[94694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:37:50 devstack sudo[94694]: pam_unix(sudo:session): session closed for user root Jun 17 04:37:50 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-74f8df74-d465-440d-b63c-e235ad158bd6 tempest-GroupSnapshotsTest-2072112239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-b3224eda-f849-490c-aa9f-b60f670aae0c" returned: 0 in 0.605s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:37:50 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-74f8df74-d465-440d-b63c-e235ad158bd6 tempest-GroupSnapshotsTest-2072112239 None] Lock "cinder-quobyte-b3224eda-f849-490c-aa9f-b60f670aae0c" released by "_copy_volume_from_snapshot" :: held 10.289s {{(pid=92060) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 04:37:50 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-74f8df74-d465-440d-b63c-e235ad158bd6 tempest-GroupSnapshotsTest-2072112239 None] Lock "cinder-quobyte-4663a6de-8a4e-43df-94c9-8938197055b8-b3224eda-f849-490c-aa9f-b60f670aae0c" released by "_create_volume_from_snapshot" :: held 10.332s {{(pid=92060) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 04:37:50 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-74f8df74-d465-440d-b63c-e235ad158bd6 tempest-GroupSnapshotsTest-2072112239 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 10.351s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 04:37:50 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-b9c81a15-dd6a-4b66-9164-06b2a02463f0 tempest-AttachVolumeShelveTestJSON-134363980 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.608s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 04:37:50 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-b9c81a15-dd6a-4b66-9164-06b2a02463f0 tempest-AttachVolumeShelveTestJSON-134363980 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-17T02:37:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-262096615',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bf2eca3e-8c5a-4863-bbb8-1003435f17a2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='51b31662b38d4586825b0c761e731e86',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T02:37:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T02:37:49Z,use_quota=True,user_id='7bde37e17f6247789a101e63fbac5bce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aad9ce24-93f9-41a6-baa1-5125964f96d1),volume_type_id=aad9ce24-93f9-41a6-baa1-5125964f96d1)}" {{(pid=92060) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 17 04:37:50 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.remotefs [None req-b9c81a15-dd6a-4b66-9164-06b2a02463f0 tempest-AttachVolumeShelveTestJSON-134363980 None] Creating volume bf2eca3e-8c5a-4863-bbb8-1003435f17a2 {{(pid=92060) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 17 04:37:50 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-b9c81a15-dd6a-4b66-9164-06b2a02463f0 tempest-AttachVolumeShelveTestJSON-134363980 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 04:37:50 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-b9c81a15-dd6a-4b66-9164-06b2a02463f0 tempest-AttachVolumeShelveTestJSON-134363980 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 04:37:50 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-b9c81a15-dd6a-4b66-9164-06b2a02463f0 tempest-AttachVolumeShelveTestJSON-134363980 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588': None} {{(pid=92060) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 17 04:37:50 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-b9c81a15-dd6a-4b66-9164-06b2a02463f0 tempest-AttachVolumeShelveTestJSON-134363980 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588'] {{(pid=92060) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 17 04:37:50 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-b9c81a15-dd6a-4b66-9164-06b2a02463f0 tempest-AttachVolumeShelveTestJSON-134363980 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 04:37:50 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-b9c81a15-dd6a-4b66-9164-06b2a02463f0 tempest-AttachVolumeShelveTestJSON-134363980 None] Selected osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588 as target Quobyte volume. {{(pid=92060) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 17 04:37:50 devstack cinder-volume[92060]: INFO cinder.volume.drivers.remotefs [None req-b9c81a15-dd6a-4b66-9164-06b2a02463f0 tempest-AttachVolumeShelveTestJSON-134363980 None] casted to osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588 Jun 17 04:37:50 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-b9c81a15-dd6a-4b66-9164-06b2a02463f0 tempest-AttachVolumeShelveTestJSON-134363980 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-bf2eca3e-8c5a-4863-bbb8-1003435f17a2 1073741824 {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:37:50 devstack sudo[94706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-bf2eca3e-8c5a-4863-bbb8-1003435f17a2 1073741824 Jun 17 04:37:50 devstack sudo[94706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:37:50 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [req-af0d5983-15f6-4821-b795-ad206e86ab31 req-b206f744-14f1-4462-b60f-39c3dd64153c tempest-TaggedAttachmentsTest-658082151 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 04:37:50 devstack cinder-volume[92060]: INFO cinder.volume.manager [None req-74f8df74-d465-440d-b63c-e235ad158bd6 tempest-GroupSnapshotsTest-2072112239 None] Create group from source-snapshot-4bcdc1ef-23c9-4e0d-9e24-de5290ca47bb completed successfully. Jun 17 04:37:51 devstack sudo[94706]: pam_unix(sudo:session): session closed for user root Jun 17 04:37:51 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-b9c81a15-dd6a-4b66-9164-06b2a02463f0 tempest-AttachVolumeShelveTestJSON-134363980 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-bf2eca3e-8c5a-4863-bbb8-1003435f17a2 1073741824" returned: 0 in 0.835s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:37:51 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-b9c81a15-dd6a-4b66-9164-06b2a02463f0 tempest-AttachVolumeShelveTestJSON-134363980 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-bf2eca3e-8c5a-4863-bbb8-1003435f17a2 {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:37:51 devstack sudo[94713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-bf2eca3e-8c5a-4863-bbb8-1003435f17a2 Jun 17 04:37:51 devstack sudo[94713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:37:51 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-8a57c477-fa90-4716-bf23-f945c26f6aef tempest-GroupSnapshotsTest-2072112239 None] Acquiring lock "cinder-quobyte-b3224eda-f849-490c-aa9f-b60f670aae0c" by "delete_volume" {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 04:37:51 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-8a57c477-fa90-4716-bf23-f945c26f6aef tempest-GroupSnapshotsTest-2072112239 None] Lock "cinder-quobyte-b3224eda-f849-490c-aa9f-b60f670aae0c" acquired by "delete_volume" :: waited 0.024s {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 04:37:51 devstack cinder-volume[92060]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1599f43-b7ec-4c24-85c0-bf95aa793635]: (4, 'qcow2') {{(pid=93130) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 04:37:51 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-8a57c477-fa90-4716-bf23-f945c26f6aef tempest-GroupSnapshotsTest-2072112239 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-b3224eda-f849-490c-aa9f-b60f670aae0c {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:37:51 devstack sudo[94715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-b3224eda-f849-490c-aa9f-b60f670aae0c Jun 17 04:37:51 devstack sudo[94715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:37:52 devstack sudo[94713]: pam_unix(sudo:session): session closed for user root Jun 17 04:37:52 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-b9c81a15-dd6a-4b66-9164-06b2a02463f0 tempest-AttachVolumeShelveTestJSON-134363980 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-bf2eca3e-8c5a-4863-bbb8-1003435f17a2" returned: 0 in 0.716s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:37:52 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-b9c81a15-dd6a-4b66-9164-06b2a02463f0 tempest-AttachVolumeShelveTestJSON-134363980 None] <== create_volume: return (1591ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588'} {{(pid=92060) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 17 04:37:52 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-b9c81a15-dd6a-4b66-9164-06b2a02463f0 tempest-AttachVolumeShelveTestJSON-134363980 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.593s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 04:37:52 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [req-af0d5983-15f6-4821-b795-ad206e86ab31 req-b206f744-14f1-4462-b60f-39c3dd64153c tempest-TaggedAttachmentsTest-658082151 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 1.447s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 04:37:52 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-b9c81a15-dd6a-4b66-9164-06b2a02463f0 tempest-AttachVolumeShelveTestJSON-134363980 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f6b0d6f3-4d56-4683-a2fd-a2d50ac6c9bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bf2eca3e-8c5a-4863-bbb8-1003435f17a2', 'volume_size': 1}' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:37:52 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-b9c81a15-dd6a-4b66-9164-06b2a02463f0 tempest-AttachVolumeShelveTestJSON-134363980 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f731729e-12b4-4dc5-9e4c-422015ba98a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:37:52 devstack cinder-volume[92060]: DEBUG oslo.privsep.daemon [-] privsep: reply[13299b64-233f-4377-9bcd-f03087283497]: (4, 'qcow2') {{(pid=93130) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 04:37:52 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [req-af0d5983-15f6-4821-b795-ad206e86ab31 req-b206f744-14f1-4462-b60f-39c3dd64153c tempest-TaggedAttachmentsTest-658082151 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-846d0cdb-7c70-4c34-97aa-f7bef6b0f570 {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:37:52 devstack cinder-volume[92060]: INFO cinder.volume.flows.manager.create_volume [None req-b9c81a15-dd6a-4b66-9164-06b2a02463f0 tempest-AttachVolumeShelveTestJSON-134363980 None] Volume volume-bf2eca3e-8c5a-4863-bbb8-1003435f17a2 (bf2eca3e-8c5a-4863-bbb8-1003435f17a2): created successfully Jun 17 04:37:52 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-b9c81a15-dd6a-4b66-9164-06b2a02463f0 tempest-AttachVolumeShelveTestJSON-134363980 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f731729e-12b4-4dc5-9e4c-422015ba98a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:37:52 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-b9c81a15-dd6a-4b66-9164-06b2a02463f0 tempest-AttachVolumeShelveTestJSON-134363980 None] Flow 'volume_create_manager' (170067ae-c12f-44dc-b760-0c13ee8a015d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92060) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 17 04:37:52 devstack cinder-volume[92060]: INFO cinder.volume.manager [None req-b9c81a15-dd6a-4b66-9164-06b2a02463f0 tempest-AttachVolumeShelveTestJSON-134363980 None] Created volume successfully. Jun 17 04:37:52 devstack sudo[94718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-846d0cdb-7c70-4c34-97aa-f7bef6b0f570 Jun 17 04:37:52 devstack sudo[94718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:37:52 devstack sudo[94715]: pam_unix(sudo:session): session closed for user root Jun 17 04:37:52 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-8a57c477-fa90-4716-bf23-f945c26f6aef tempest-GroupSnapshotsTest-2072112239 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-b3224eda-f849-490c-aa9f-b60f670aae0c" returned: 0 in 0.755s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:37:52 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-8a57c477-fa90-4716-bf23-f945c26f6aef tempest-GroupSnapshotsTest-2072112239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-b3224eda-f849-490c-aa9f-b60f670aae0c {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:37:52 devstack sudo[94724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-b3224eda-f849-490c-aa9f-b60f670aae0c Jun 17 04:37:52 devstack sudo[94724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:37:53 devstack sudo[94718]: pam_unix(sudo:session): session closed for user root Jun 17 04:37:53 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [req-af0d5983-15f6-4821-b795-ad206e86ab31 req-b206f744-14f1-4462-b60f-39c3dd64153c tempest-TaggedAttachmentsTest-658082151 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-846d0cdb-7c70-4c34-97aa-f7bef6b0f570" returned: 0 in 0.754s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:37:53 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [req-af0d5983-15f6-4821-b795-ad206e86ab31 req-b206f744-14f1-4462-b60f-39c3dd64153c tempest-TaggedAttachmentsTest-658082151 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.776s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 04:37:53 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [req-af0d5983-15f6-4821-b795-ad206e86ab31 req-b206f744-14f1-4462-b60f-39c3dd64153c tempest-TaggedAttachmentsTest-658082151 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588', 'name': 'volume-846d0cdb-7c70-4c34-97aa-f7bef6b0f570', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '1cce6cf8-fde0-4ddd-901c-06ca8773fd19', 'enforce_multipath': True} {{(pid=92060) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 17 04:37:53 devstack sudo[94724]: pam_unix(sudo:session): session closed for user root Jun 17 04:37:53 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-8a57c477-fa90-4716-bf23-f945c26f6aef tempest-GroupSnapshotsTest-2072112239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-b3224eda-f849-490c-aa9f-b60f670aae0c" returned: 0 in 0.627s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:37:53 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-8a57c477-fa90-4716-bf23-f945c26f6aef tempest-GroupSnapshotsTest-2072112239 None] Lock "cinder-quobyte-b3224eda-f849-490c-aa9f-b60f670aae0c" released by "delete_volume" :: held 1.449s {{(pid=92060) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 04:37:53 devstack cinder-volume[92060]: INFO cinder.volume.manager [req-af0d5983-15f6-4821-b795-ad206e86ab31 req-b206f744-14f1-4462-b60f-39c3dd64153c tempest-TaggedAttachmentsTest-658082151 None] attachment_update completed successfully. Jun 17 04:37:53 devstack cinder-volume[92060]: DEBUG cinder.quota [None req-8a57c477-fa90-4716-bf23-f945c26f6aef tempest-GroupSnapshotsTest-2072112239 None] Created reservations ['56e0f1e5-3471-4aa9-9999-ff9d85f0bd9d'] {{(pid=92060) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 17 04:37:53 devstack cinder-volume[92060]: WARNING cinder.quota [None req-8a57c477-fa90-4716-bf23-f945c26f6aef tempest-GroupSnapshotsTest-2072112239 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-509811037 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-509811037, it is now deprecated. Please use the default quota class for default quota. Jun 17 04:37:53 devstack cinder-volume[92060]: WARNING cinder.quota [None req-8a57c477-fa90-4716-bf23-f945c26f6aef tempest-GroupSnapshotsTest-2072112239 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-509811037 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-509811037, it is now deprecated. Please use the default quota class for default quota. Jun 17 04:37:53 devstack cinder-volume[92060]: DEBUG cinder.quota [None req-8a57c477-fa90-4716-bf23-f945c26f6aef tempest-GroupSnapshotsTest-2072112239 None] Created reservations ['98cc0b94-28a5-449e-a0a9-9793391ff150', '09d68e7a-6bf8-4dbc-8267-ac820488d5cd', '820fb8c8-cba5-4751-b0f8-4b5af39b4919', '0bd86d7e-d5a7-4583-997c-1beed7306f7d'] {{(pid=92060) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 17 04:37:53 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-8a57c477-fa90-4716-bf23-f945c26f6aef tempest-GroupSnapshotsTest-2072112239 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 04:37:53 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-8a57c477-fa90-4716-bf23-f945c26f6aef tempest-GroupSnapshotsTest-2072112239 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 04:37:53 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-8a57c477-fa90-4716-bf23-f945c26f6aef tempest-GroupSnapshotsTest-2072112239 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588': None} {{(pid=92060) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 17 04:37:53 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-8a57c477-fa90-4716-bf23-f945c26f6aef tempest-GroupSnapshotsTest-2072112239 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588'] {{(pid=92060) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 17 04:37:53 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-8a57c477-fa90-4716-bf23-f945c26f6aef tempest-GroupSnapshotsTest-2072112239 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 04:37:53 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-8a57c477-fa90-4716-bf23-f945c26f6aef tempest-GroupSnapshotsTest-2072112239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:37:53 devstack sudo[94759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a Jun 17 04:37:53 devstack sudo[94759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:37:54 devstack cinder-volume[92060]: INFO cinder.volume.manager [None req-e25d849f-a948-4a74-ac18-f11853a58b0b tempest-GroupSnapshotsTest-2072112239 None] group_snapshot 4bcdc1ef-23c9-4e0d-9e24-de5290ca47bb: deleting Jun 17 04:37:54 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-e25d849f-a948-4a74-ac18-f11853a58b0b tempest-GroupSnapshotsTest-2072112239 None] group_snapshot 4bcdc1ef-23c9-4e0d-9e24-de5290ca47bb: deleting {{(pid=92060) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Jun 17 04:37:54 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-e25d849f-a948-4a74-ac18-f11853a58b0b tempest-GroupSnapshotsTest-2072112239 None] Acquiring lock "cinder-quobyte-7877b275-cef0-44bb-97f9-4500c5973de7" by "delete_snapshot" {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 04:37:54 devstack sudo[94759]: pam_unix(sudo:session): session closed for user root Jun 17 04:37:54 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-e25d849f-a948-4a74-ac18-f11853a58b0b tempest-GroupSnapshotsTest-2072112239 None] Lock "cinder-quobyte-7877b275-cef0-44bb-97f9-4500c5973de7" acquired by "delete_snapshot" :: waited 0.025s {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 04:37:54 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-e25d849f-a948-4a74-ac18-f11853a58b0b tempest-GroupSnapshotsTest-2072112239 None] Acquiring lock "cinder-quobyte-4663a6de-8a4e-43df-94c9-8938197055b8" by "_delete_snapshot" {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 04:37:54 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-8a57c477-fa90-4716-bf23-f945c26f6aef tempest-GroupSnapshotsTest-2072112239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a" returned: 0 in 0.682s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:37:54 devstack cinder-volume[92060]: DEBUG cinder.manager [None req-8a57c477-fa90-4716-bf23-f945c26f6aef tempest-GroupSnapshotsTest-2072112239 None] Notifying Schedulers of capabilities ... {{(pid=92060) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 17 04:37:54 devstack cinder-volume[92060]: INFO cinder.volume.manager [None req-8a57c477-fa90-4716-bf23-f945c26f6aef tempest-GroupSnapshotsTest-2072112239 None] Delete group completed successfully. Jun 17 04:37:54 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-e25d849f-a948-4a74-ac18-f11853a58b0b tempest-GroupSnapshotsTest-2072112239 None] Lock "cinder-quobyte-4663a6de-8a4e-43df-94c9-8938197055b8" acquired by "_delete_snapshot" :: waited 0.031s {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 04:37:54 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.remotefs [None req-e25d849f-a948-4a74-ac18-f11853a58b0b tempest-GroupSnapshotsTest-2072112239 None] Deleting offline snapshot 4663a6de-8a4e-43df-94c9-8938197055b8 of volume 7877b275-cef0-44bb-97f9-4500c5973de7 {{(pid=92060) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 17 04:37:54 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.remotefs [None req-e25d849f-a948-4a74-ac18-f11853a58b0b tempest-GroupSnapshotsTest-2072112239 None] snapshot_file for this snap is: volume-7877b275-cef0-44bb-97f9-4500c5973de7.4663a6de-8a4e-43df-94c9-8938197055b8 {{(pid=92060) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 17 04:37:54 devstack cinder-volume[92060]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c492944-e04a-4967-9116-123ac5905425]: (4, 'qcow2') {{(pid=93130) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 04:37:54 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-e25d849f-a948-4a74-ac18-f11853a58b0b tempest-GroupSnapshotsTest-2072112239 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-7877b275-cef0-44bb-97f9-4500c5973de7.4663a6de-8a4e-43df-94c9-8938197055b8 {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:37:54 devstack sudo[94808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-7877b275-cef0-44bb-97f9-4500c5973de7.4663a6de-8a4e-43df-94c9-8938197055b8 Jun 17 04:37:54 devstack sudo[94808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:37:55 devstack sudo[94808]: pam_unix(sudo:session): session closed for user root Jun 17 04:37:55 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-e25d849f-a948-4a74-ac18-f11853a58b0b tempest-GroupSnapshotsTest-2072112239 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-7877b275-cef0-44bb-97f9-4500c5973de7.4663a6de-8a4e-43df-94c9-8938197055b8" returned: 0 in 1.005s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:37:55 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.remotefs [None req-e25d849f-a948-4a74-ac18-f11853a58b0b tempest-GroupSnapshotsTest-2072112239 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7877b275-cef0-44bb-97f9-4500c5973de7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=92060) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 17 04:37:55 devstack cinder-volume[92060]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a08bcb3-2ee4-4076-9dd0-7e1df95dfbeb]: (4, 'qcow2') {{(pid=93130) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 04:37:55 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-e25d849f-a948-4a74-ac18-f11853a58b0b tempest-GroupSnapshotsTest-2072112239 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-7877b275-cef0-44bb-97f9-4500c5973de7 {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:37:55 devstack sudo[95164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-7877b275-cef0-44bb-97f9-4500c5973de7 Jun 17 04:37:55 devstack sudo[95164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:37:56 devstack sudo[95164]: pam_unix(sudo:session): session closed for user root Jun 17 04:37:56 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-e25d849f-a948-4a74-ac18-f11853a58b0b tempest-GroupSnapshotsTest-2072112239 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-7877b275-cef0-44bb-97f9-4500c5973de7" returned: 0 in 0.821s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:37:56 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-e25d849f-a948-4a74-ac18-f11853a58b0b tempest-GroupSnapshotsTest-2072112239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-7877b275-cef0-44bb-97f9-4500c5973de7.4663a6de-8a4e-43df-94c9-8938197055b8 {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:37:56 devstack sudo[95171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-7877b275-cef0-44bb-97f9-4500c5973de7.4663a6de-8a4e-43df-94c9-8938197055b8 Jun 17 04:37:56 devstack sudo[95171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:37:57 devstack sudo[95171]: pam_unix(sudo:session): session closed for user root Jun 17 04:37:57 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-e25d849f-a948-4a74-ac18-f11853a58b0b tempest-GroupSnapshotsTest-2072112239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-7877b275-cef0-44bb-97f9-4500c5973de7.4663a6de-8a4e-43df-94c9-8938197055b8" returned: 0 in 1.675s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:37:57 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-e25d849f-a948-4a74-ac18-f11853a58b0b tempest-GroupSnapshotsTest-2072112239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-7877b275-cef0-44bb-97f9-4500c5973de7.4663a6de-8a4e-43df-94c9-8938197055b8 {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:37:57 devstack sudo[95208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-7877b275-cef0-44bb-97f9-4500c5973de7.4663a6de-8a4e-43df-94c9-8938197055b8 Jun 17 04:37:57 devstack sudo[95208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:37:59 devstack sudo[95208]: pam_unix(sudo:session): session closed for user root Jun 17 04:37:59 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-e25d849f-a948-4a74-ac18-f11853a58b0b tempest-GroupSnapshotsTest-2072112239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-7877b275-cef0-44bb-97f9-4500c5973de7.4663a6de-8a4e-43df-94c9-8938197055b8" returned: 0 in 1.248s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:37:59 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-e25d849f-a948-4a74-ac18-f11853a58b0b tempest-GroupSnapshotsTest-2072112239 None] Lock "cinder-quobyte-4663a6de-8a4e-43df-94c9-8938197055b8" released by "_delete_snapshot" :: held 4.919s {{(pid=92060) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 04:37:59 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-e25d849f-a948-4a74-ac18-f11853a58b0b tempest-GroupSnapshotsTest-2072112239 None] Lock "cinder-quobyte-7877b275-cef0-44bb-97f9-4500c5973de7" released by "delete_snapshot" :: held 4.961s {{(pid=92060) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 04:37:59 devstack cinder-volume[92060]: DEBUG dbcounter [-] [92060] Writing DB stats cinder:SELECT=50,cinder:UPDATE=47,cinder:INSERT=7,cinder:DELETE=2 {{(pid=92060) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 17 04:37:59 devstack cinder-volume[92060]: DEBUG dbcounter [-] [92060] Writing DB stats cinder:SELECT=50,cinder:UPDATE=42,cinder:DELETE=4,cinder:INSERT=12 {{(pid=92060) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 17 04:37:59 devstack cinder-volume[92060]: WARNING cinder.quota [None req-e25d849f-a948-4a74-ac18-f11853a58b0b tempest-GroupSnapshotsTest-2072112239 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-509811037 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-509811037, it is now deprecated. Please use the default quota class for default quota. Jun 17 04:37:59 devstack cinder-volume[92060]: DEBUG cinder.quota [None req-e25d849f-a948-4a74-ac18-f11853a58b0b tempest-GroupSnapshotsTest-2072112239 None] Created reservations ['26bf66f2-1dd3-4d20-b922-1276be0d498c', 'ad6ac4ef-08f1-48a7-9ca0-86e2a9c0bee0', 'f2d7440a-54dc-4f6e-910f-4cca45b25286', 'b7b7bf5f-a0da-489a-b30b-d8b402a567e8'] {{(pid=92060) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 17 04:37:59 devstack cinder-volume[92060]: INFO cinder.volume.manager [None req-e25d849f-a948-4a74-ac18-f11853a58b0b tempest-GroupSnapshotsTest-2072112239 None] group_snapshot 4bcdc1ef-23c9-4e0d-9e24-de5290ca47bb: deleted successfully Jun 17 04:37:59 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-de878136-11dc-4c85-a92e-a7647fef3e29 tempest-GroupSnapshotsTest-2072112239 None] Acquiring lock "cinder-quobyte-7877b275-cef0-44bb-97f9-4500c5973de7" by "delete_volume" {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 04:37:59 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-de878136-11dc-4c85-a92e-a7647fef3e29 tempest-GroupSnapshotsTest-2072112239 None] Lock "cinder-quobyte-7877b275-cef0-44bb-97f9-4500c5973de7" acquired by "delete_volume" :: waited 0.042s {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 04:38:00 devstack cinder-volume[92060]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ece531d-4656-49c7-a092-967703408ae1]: (4, 'qcow2') {{(pid=93130) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 04:38:00 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-de878136-11dc-4c85-a92e-a7647fef3e29 tempest-GroupSnapshotsTest-2072112239 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-7877b275-cef0-44bb-97f9-4500c5973de7 {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:38:00 devstack sudo[95223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-7877b275-cef0-44bb-97f9-4500c5973de7 Jun 17 04:38:00 devstack sudo[95223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:38:01 devstack cinder-volume[92060]: INFO cinder.volume.manager [req-365ef2b2-c0a7-4a11-a5b5-fa55d8bcfd54 req-d85aef69-d2fe-494a-a315-adc1f812e679 tempest-TaggedAttachmentsTest-658082151 None] Terminate volume connection completed successfully. Jun 17 04:38:01 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [req-365ef2b2-c0a7-4a11-a5b5-fa55d8bcfd54 req-d85aef69-d2fe-494a-a315-adc1f812e679 tempest-TaggedAttachmentsTest-658082151 None] Deleting attachment 1cce6cf8-fde0-4ddd-901c-06ca8773fd19. {{(pid=92060) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 17 04:38:01 devstack sudo[95223]: pam_unix(sudo:session): session closed for user root Jun 17 04:38:01 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-de878136-11dc-4c85-a92e-a7647fef3e29 tempest-GroupSnapshotsTest-2072112239 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-7877b275-cef0-44bb-97f9-4500c5973de7" returned: 0 in 1.474s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:38:01 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-de878136-11dc-4c85-a92e-a7647fef3e29 tempest-GroupSnapshotsTest-2072112239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-7877b275-cef0-44bb-97f9-4500c5973de7 {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:38:01 devstack sudo[95257]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-7877b275-cef0-44bb-97f9-4500c5973de7 Jun 17 04:38:01 devstack sudo[95257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:38:02 devstack sudo[95257]: pam_unix(sudo:session): session closed for user root Jun 17 04:38:02 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-de878136-11dc-4c85-a92e-a7647fef3e29 tempest-GroupSnapshotsTest-2072112239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-7877b275-cef0-44bb-97f9-4500c5973de7" returned: 0 in 0.799s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:38:02 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-de878136-11dc-4c85-a92e-a7647fef3e29 tempest-GroupSnapshotsTest-2072112239 None] Lock "cinder-quobyte-7877b275-cef0-44bb-97f9-4500c5973de7" released by "delete_volume" :: held 2.376s {{(pid=92060) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 04:38:02 devstack cinder-volume[92060]: DEBUG cinder.quota [None req-de878136-11dc-4c85-a92e-a7647fef3e29 tempest-GroupSnapshotsTest-2072112239 None] Created reservations ['a4a17e37-626b-406c-9e2a-c1ef0f5085c1'] {{(pid=92060) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 17 04:38:02 devstack cinder-volume[92060]: WARNING cinder.db.sqlalchemy.api [None req-de878136-11dc-4c85-a92e-a7647fef3e29 tempest-GroupSnapshotsTest-2072112239 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-509811037'] Jun 17 04:38:02 devstack cinder-volume[92060]: DEBUG cinder.quota [None req-de878136-11dc-4c85-a92e-a7647fef3e29 tempest-GroupSnapshotsTest-2072112239 None] Created reservations ['4ebe4a73-ff26-4344-8ca4-b99e3359a22e', '9c125218-9859-4d13-9f41-35500ec344c8', 'a1a39f8c-b1e8-4ed3-80e3-aca88e6f5995', '1eadb236-9344-43b7-8660-1abe5067da2f'] {{(pid=92060) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 17 04:38:02 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-de878136-11dc-4c85-a92e-a7647fef3e29 tempest-GroupSnapshotsTest-2072112239 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 04:38:02 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-de878136-11dc-4c85-a92e-a7647fef3e29 tempest-GroupSnapshotsTest-2072112239 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 04:38:02 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-de878136-11dc-4c85-a92e-a7647fef3e29 tempest-GroupSnapshotsTest-2072112239 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588': None} {{(pid=92060) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 17 04:38:02 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-de878136-11dc-4c85-a92e-a7647fef3e29 tempest-GroupSnapshotsTest-2072112239 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588'] {{(pid=92060) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 17 04:38:02 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-de878136-11dc-4c85-a92e-a7647fef3e29 tempest-GroupSnapshotsTest-2072112239 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 04:38:02 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-de878136-11dc-4c85-a92e-a7647fef3e29 tempest-GroupSnapshotsTest-2072112239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:38:02 devstack sudo[95261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a Jun 17 04:38:02 devstack sudo[95261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:38:03 devstack sudo[95261]: pam_unix(sudo:session): session closed for user root Jun 17 04:38:04 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-de878136-11dc-4c85-a92e-a7647fef3e29 tempest-GroupSnapshotsTest-2072112239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a" returned: 0 in 1.212s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:38:04 devstack cinder-volume[92060]: DEBUG cinder.manager [None req-de878136-11dc-4c85-a92e-a7647fef3e29 tempest-GroupSnapshotsTest-2072112239 None] Notifying Schedulers of capabilities ... {{(pid=92060) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 17 04:38:04 devstack cinder-volume[92060]: INFO cinder.volume.manager [None req-de878136-11dc-4c85-a92e-a7647fef3e29 tempest-GroupSnapshotsTest-2072112239 None] Delete group completed successfully. Jun 17 04:38:04 devstack cinder-volume[92060]: INFO cinder.volume.manager [None req-83773cc5-ace1-47e3-a559-6675c3c07258 tempest-GroupSnapshotsTest-2072112239 None] Group tempest-GroupSnapshotsTest-Group-526598688: creating Jun 17 04:38:04 devstack cinder-volume[92060]: INFO cinder.volume.manager [None req-83773cc5-ace1-47e3-a559-6675c3c07258 tempest-GroupSnapshotsTest-2072112239 None] Group tempest-GroupSnapshotsTest-Group-526598688: created successfully Jun 17 04:38:04 devstack cinder-volume[92060]: INFO cinder.volume.manager [None req-83773cc5-ace1-47e3-a559-6675c3c07258 tempest-GroupSnapshotsTest-2072112239 None] Create group completed successfully. Jun 17 04:38:06 devstack cinder-volume[92060]: DEBUG cinder.volume.flows.manager.create_volume [None req-f47a17df-a51a-4c8b-9eeb-84024c9b53c9 tempest-GroupSnapshotsTest-2072112239 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92060) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 17 04:38:06 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-f47a17df-a51a-4c8b-9eeb-84024c9b53c9 tempest-GroupSnapshotsTest-2072112239 None] Flow 'volume_create_manager' (2d35d702-c158-4f6a-bae2-cd14d996d371) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 17 04:38:06 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-f47a17df-a51a-4c8b-9eeb-84024c9b53c9 tempest-GroupSnapshotsTest-2072112239 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8f6d8bca-821a-4b22-9771-ada174d2d11a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:38:06 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-f47a17df-a51a-4c8b-9eeb-84024c9b53c9 tempest-GroupSnapshotsTest-2072112239 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8f6d8bca-821a-4b22-9771-ada174d2d11a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-17T02:38:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1594631516',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=15ce457a-f89a-4f09-a3a7-1f86de73383c,host='devstack@QuobyteHD#QuobyteHD',id=7aa4ca9b-afcd-475c-9841-1d3a078d21e1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e16b050b2b1f4789a93c0fd072e157c7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T02:38:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T02:38:06Z,use_quota=True,user_id='e22a2c2c4660479797c6f7cb8a003c1f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bfd82c54-888d-480d-bf1b-965c8694d53f),volume_type_id=bfd82c54-888d-480d-bf1b-965c8694d53f)' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:38:06 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-f47a17df-a51a-4c8b-9eeb-84024c9b53c9 tempest-GroupSnapshotsTest-2072112239 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1e4a1d67-eb5b-433b-a169-1fe62291f294) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:38:06 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-f47a17df-a51a-4c8b-9eeb-84024c9b53c9 tempest-GroupSnapshotsTest-2072112239 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1e4a1d67-eb5b-433b-a169-1fe62291f294) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:38:06 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-f47a17df-a51a-4c8b-9eeb-84024c9b53c9 tempest-GroupSnapshotsTest-2072112239 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c1be4efa-952c-4b55-b411-8477d9d5c9c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:38:06 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-f47a17df-a51a-4c8b-9eeb-84024c9b53c9 tempest-GroupSnapshotsTest-2072112239 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c1be4efa-952c-4b55-b411-8477d9d5c9c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7aa4ca9b-afcd-475c-9841-1d3a078d21e1', 'volume_name': 'volume-7aa4ca9b-afcd-475c-9841-1d3a078d21e1', 'volume_size': 1}' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:38:06 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-f47a17df-a51a-4c8b-9eeb-84024c9b53c9 tempest-GroupSnapshotsTest-2072112239 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a4fec9a0-a5f5-4d7b-8503-fd18e88bb881) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:38:06 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-f47a17df-a51a-4c8b-9eeb-84024c9b53c9 tempest-GroupSnapshotsTest-2072112239 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a4fec9a0-a5f5-4d7b-8503-fd18e88bb881) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:38:06 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-f47a17df-a51a-4c8b-9eeb-84024c9b53c9 tempest-GroupSnapshotsTest-2072112239 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9825953b-90de-4296-9e8d-cd767fbd2b38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:38:06 devstack cinder-volume[92060]: INFO cinder.volume.flows.manager.create_volume [None req-f47a17df-a51a-4c8b-9eeb-84024c9b53c9 tempest-GroupSnapshotsTest-2072112239 None] Volume 7aa4ca9b-afcd-475c-9841-1d3a078d21e1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7aa4ca9b-afcd-475c-9841-1d3a078d21e1', 'volume_size': 1} Jun 17 04:38:06 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-f47a17df-a51a-4c8b-9eeb-84024c9b53c9 tempest-GroupSnapshotsTest-2072112239 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 04:38:06 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-f47a17df-a51a-4c8b-9eeb-84024c9b53c9 tempest-GroupSnapshotsTest-2072112239 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 04:38:06 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-f47a17df-a51a-4c8b-9eeb-84024c9b53c9 tempest-GroupSnapshotsTest-2072112239 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=15ce457a-f89a-4f09-a3a7-1f86de73383c,created_at=2026-06-17T02:38:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1594631516',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=15ce457a-f89a-4f09-a3a7-1f86de73383c,host='devstack@QuobyteHD#QuobyteHD',id=7aa4ca9b-afcd-475c-9841-1d3a078d21e1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e16b050b2b1f4789a93c0fd072e157c7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T02:38:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T02:38:06Z,use_quota=True,user_id='e22a2c2c4660479797c6f7cb8a003c1f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bfd82c54-888d-480d-bf1b-965c8694d53f),volume_type_id=bfd82c54-888d-480d-bf1b-965c8694d53f)}" {{(pid=92060) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 17 04:38:06 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.remotefs [None req-f47a17df-a51a-4c8b-9eeb-84024c9b53c9 tempest-GroupSnapshotsTest-2072112239 None] Creating volume 7aa4ca9b-afcd-475c-9841-1d3a078d21e1 {{(pid=92060) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 17 04:38:06 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-f47a17df-a51a-4c8b-9eeb-84024c9b53c9 tempest-GroupSnapshotsTest-2072112239 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 04:38:06 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-f47a17df-a51a-4c8b-9eeb-84024c9b53c9 tempest-GroupSnapshotsTest-2072112239 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 04:38:06 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-f47a17df-a51a-4c8b-9eeb-84024c9b53c9 tempest-GroupSnapshotsTest-2072112239 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588': None} {{(pid=92060) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 17 04:38:06 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-f47a17df-a51a-4c8b-9eeb-84024c9b53c9 tempest-GroupSnapshotsTest-2072112239 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588'] {{(pid=92060) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 17 04:38:06 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-f47a17df-a51a-4c8b-9eeb-84024c9b53c9 tempest-GroupSnapshotsTest-2072112239 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 04:38:06 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-f47a17df-a51a-4c8b-9eeb-84024c9b53c9 tempest-GroupSnapshotsTest-2072112239 None] Selected osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588 as target Quobyte volume. {{(pid=92060) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 17 04:38:06 devstack cinder-volume[92060]: INFO cinder.volume.drivers.remotefs [None req-f47a17df-a51a-4c8b-9eeb-84024c9b53c9 tempest-GroupSnapshotsTest-2072112239 None] casted to osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588 Jun 17 04:38:06 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-f47a17df-a51a-4c8b-9eeb-84024c9b53c9 tempest-GroupSnapshotsTest-2072112239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-7aa4ca9b-afcd-475c-9841-1d3a078d21e1 1073741824 {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:38:06 devstack sudo[95300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-7aa4ca9b-afcd-475c-9841-1d3a078d21e1 1073741824 Jun 17 04:38:06 devstack sudo[95300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:38:07 devstack sudo[95300]: pam_unix(sudo:session): session closed for user root Jun 17 04:38:07 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-f47a17df-a51a-4c8b-9eeb-84024c9b53c9 tempest-GroupSnapshotsTest-2072112239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-7aa4ca9b-afcd-475c-9841-1d3a078d21e1 1073741824" returned: 0 in 0.919s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:38:07 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-f47a17df-a51a-4c8b-9eeb-84024c9b53c9 tempest-GroupSnapshotsTest-2072112239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-7aa4ca9b-afcd-475c-9841-1d3a078d21e1 {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:38:07 devstack sudo[95312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-7aa4ca9b-afcd-475c-9841-1d3a078d21e1 Jun 17 04:38:07 devstack sudo[95312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:38:08 devstack sudo[95312]: pam_unix(sudo:session): session closed for user root Jun 17 04:38:08 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-f47a17df-a51a-4c8b-9eeb-84024c9b53c9 tempest-GroupSnapshotsTest-2072112239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-7aa4ca9b-afcd-475c-9841-1d3a078d21e1" returned: 0 in 0.668s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:38:08 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-f47a17df-a51a-4c8b-9eeb-84024c9b53c9 tempest-GroupSnapshotsTest-2072112239 None] <== create_volume: return (1630ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588'} {{(pid=92060) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 17 04:38:08 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-f47a17df-a51a-4c8b-9eeb-84024c9b53c9 tempest-GroupSnapshotsTest-2072112239 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.633s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 04:38:08 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-f47a17df-a51a-4c8b-9eeb-84024c9b53c9 tempest-GroupSnapshotsTest-2072112239 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9825953b-90de-4296-9e8d-cd767fbd2b38) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7aa4ca9b-afcd-475c-9841-1d3a078d21e1', 'volume_size': 1}' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:38:08 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-f47a17df-a51a-4c8b-9eeb-84024c9b53c9 tempest-GroupSnapshotsTest-2072112239 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d7c2597c-d119-456e-89d6-89b737314431) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:38:08 devstack cinder-volume[92060]: INFO cinder.volume.flows.manager.create_volume [None req-f47a17df-a51a-4c8b-9eeb-84024c9b53c9 tempest-GroupSnapshotsTest-2072112239 None] Volume volume-7aa4ca9b-afcd-475c-9841-1d3a078d21e1 (7aa4ca9b-afcd-475c-9841-1d3a078d21e1): created successfully Jun 17 04:38:08 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-f47a17df-a51a-4c8b-9eeb-84024c9b53c9 tempest-GroupSnapshotsTest-2072112239 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d7c2597c-d119-456e-89d6-89b737314431) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:38:08 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-f47a17df-a51a-4c8b-9eeb-84024c9b53c9 tempest-GroupSnapshotsTest-2072112239 None] Flow 'volume_create_manager' (2d35d702-c158-4f6a-bae2-cd14d996d371) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92060) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 17 04:38:08 devstack cinder-volume[92060]: INFO cinder.volume.manager [None req-f47a17df-a51a-4c8b-9eeb-84024c9b53c9 tempest-GroupSnapshotsTest-2072112239 None] Created volume successfully. Jun 17 04:38:09 devstack cinder-volume[92060]: DEBUG cinder.volume.flows.manager.create_volume [None req-df71bef5-e2b4-46b0-a4f8-65215b1806ea tempest-GroupSnapshotsTest-2072112239 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92060) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 17 04:38:09 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-df71bef5-e2b4-46b0-a4f8-65215b1806ea tempest-GroupSnapshotsTest-2072112239 None] Flow 'volume_create_manager' (2bdfe411-50e9-4ab4-b821-fec839526445) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 17 04:38:09 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-df71bef5-e2b4-46b0-a4f8-65215b1806ea tempest-GroupSnapshotsTest-2072112239 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (39110eff-455f-4289-b800-28675b6c413e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:38:09 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-df71bef5-e2b4-46b0-a4f8-65215b1806ea tempest-GroupSnapshotsTest-2072112239 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (39110eff-455f-4289-b800-28675b6c413e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-17T02:38:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-722774724',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=15ce457a-f89a-4f09-a3a7-1f86de73383c,host='devstack@QuobyteHD#QuobyteHD',id=4ab4f99f-cc87-4155-af1e-7e63973926b9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e16b050b2b1f4789a93c0fd072e157c7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T02:38:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T02:38:09Z,use_quota=True,user_id='e22a2c2c4660479797c6f7cb8a003c1f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bfd82c54-888d-480d-bf1b-965c8694d53f),volume_type_id=bfd82c54-888d-480d-bf1b-965c8694d53f)' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:38:09 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-df71bef5-e2b4-46b0-a4f8-65215b1806ea tempest-GroupSnapshotsTest-2072112239 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (32b7660a-8337-483a-942b-c694dc5abd4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:38:09 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-df71bef5-e2b4-46b0-a4f8-65215b1806ea tempest-GroupSnapshotsTest-2072112239 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (32b7660a-8337-483a-942b-c694dc5abd4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:38:09 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-df71bef5-e2b4-46b0-a4f8-65215b1806ea tempest-GroupSnapshotsTest-2072112239 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (be1f60a0-daa3-433a-b341-dc707307ed83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:38:09 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-df71bef5-e2b4-46b0-a4f8-65215b1806ea tempest-GroupSnapshotsTest-2072112239 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (be1f60a0-daa3-433a-b341-dc707307ed83) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4ab4f99f-cc87-4155-af1e-7e63973926b9', 'volume_name': 'volume-4ab4f99f-cc87-4155-af1e-7e63973926b9', 'volume_size': 1}' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:38:09 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-df71bef5-e2b4-46b0-a4f8-65215b1806ea tempest-GroupSnapshotsTest-2072112239 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (46d24ce5-5110-455e-a17c-655b505a1fd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:38:09 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-df71bef5-e2b4-46b0-a4f8-65215b1806ea tempest-GroupSnapshotsTest-2072112239 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (46d24ce5-5110-455e-a17c-655b505a1fd2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:38:09 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-df71bef5-e2b4-46b0-a4f8-65215b1806ea tempest-GroupSnapshotsTest-2072112239 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0212d510-9f7f-4012-85da-b4a4009ca7f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:38:09 devstack cinder-volume[92060]: INFO cinder.volume.flows.manager.create_volume [None req-df71bef5-e2b4-46b0-a4f8-65215b1806ea tempest-GroupSnapshotsTest-2072112239 None] Volume 4ab4f99f-cc87-4155-af1e-7e63973926b9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4ab4f99f-cc87-4155-af1e-7e63973926b9', 'volume_size': 1} Jun 17 04:38:09 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-df71bef5-e2b4-46b0-a4f8-65215b1806ea tempest-GroupSnapshotsTest-2072112239 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 04:38:09 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-df71bef5-e2b4-46b0-a4f8-65215b1806ea tempest-GroupSnapshotsTest-2072112239 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 04:38:09 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-df71bef5-e2b4-46b0-a4f8-65215b1806ea tempest-GroupSnapshotsTest-2072112239 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=15ce457a-f89a-4f09-a3a7-1f86de73383c,created_at=2026-06-17T02:38:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-722774724',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=15ce457a-f89a-4f09-a3a7-1f86de73383c,host='devstack@QuobyteHD#QuobyteHD',id=4ab4f99f-cc87-4155-af1e-7e63973926b9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e16b050b2b1f4789a93c0fd072e157c7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T02:38:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T02:38:09Z,use_quota=True,user_id='e22a2c2c4660479797c6f7cb8a003c1f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bfd82c54-888d-480d-bf1b-965c8694d53f),volume_type_id=bfd82c54-888d-480d-bf1b-965c8694d53f)}" {{(pid=92060) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 17 04:38:09 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.remotefs [None req-df71bef5-e2b4-46b0-a4f8-65215b1806ea tempest-GroupSnapshotsTest-2072112239 None] Creating volume 4ab4f99f-cc87-4155-af1e-7e63973926b9 {{(pid=92060) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 17 04:38:09 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-df71bef5-e2b4-46b0-a4f8-65215b1806ea tempest-GroupSnapshotsTest-2072112239 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 04:38:09 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-df71bef5-e2b4-46b0-a4f8-65215b1806ea tempest-GroupSnapshotsTest-2072112239 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 04:38:09 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-df71bef5-e2b4-46b0-a4f8-65215b1806ea tempest-GroupSnapshotsTest-2072112239 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588': None} {{(pid=92060) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 17 04:38:09 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-df71bef5-e2b4-46b0-a4f8-65215b1806ea tempest-GroupSnapshotsTest-2072112239 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588'] {{(pid=92060) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 17 04:38:09 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-df71bef5-e2b4-46b0-a4f8-65215b1806ea tempest-GroupSnapshotsTest-2072112239 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 04:38:09 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-df71bef5-e2b4-46b0-a4f8-65215b1806ea tempest-GroupSnapshotsTest-2072112239 None] Selected osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588 as target Quobyte volume. {{(pid=92060) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 17 04:38:09 devstack cinder-volume[92060]: INFO cinder.volume.drivers.remotefs [None req-df71bef5-e2b4-46b0-a4f8-65215b1806ea tempest-GroupSnapshotsTest-2072112239 None] casted to osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588 Jun 17 04:38:09 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-df71bef5-e2b4-46b0-a4f8-65215b1806ea tempest-GroupSnapshotsTest-2072112239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-4ab4f99f-cc87-4155-af1e-7e63973926b9 1073741824 {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:38:09 devstack sudo[95340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-4ab4f99f-cc87-4155-af1e-7e63973926b9 1073741824 Jun 17 04:38:09 devstack sudo[95340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:38:10 devstack sudo[95340]: pam_unix(sudo:session): session closed for user root Jun 17 04:38:10 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-df71bef5-e2b4-46b0-a4f8-65215b1806ea tempest-GroupSnapshotsTest-2072112239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-4ab4f99f-cc87-4155-af1e-7e63973926b9 1073741824" returned: 0 in 0.832s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:38:10 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-df71bef5-e2b4-46b0-a4f8-65215b1806ea tempest-GroupSnapshotsTest-2072112239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-4ab4f99f-cc87-4155-af1e-7e63973926b9 {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:38:10 devstack sudo[95346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-4ab4f99f-cc87-4155-af1e-7e63973926b9 Jun 17 04:38:10 devstack sudo[95346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:38:10 devstack sudo[95346]: pam_unix(sudo:session): session closed for user root Jun 17 04:38:10 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-df71bef5-e2b4-46b0-a4f8-65215b1806ea tempest-GroupSnapshotsTest-2072112239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-4ab4f99f-cc87-4155-af1e-7e63973926b9" returned: 0 in 0.637s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:38:10 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-df71bef5-e2b4-46b0-a4f8-65215b1806ea tempest-GroupSnapshotsTest-2072112239 None] <== create_volume: return (1512ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588'} {{(pid=92060) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 17 04:38:10 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-df71bef5-e2b4-46b0-a4f8-65215b1806ea tempest-GroupSnapshotsTest-2072112239 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.515s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 04:38:10 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-df71bef5-e2b4-46b0-a4f8-65215b1806ea tempest-GroupSnapshotsTest-2072112239 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0212d510-9f7f-4012-85da-b4a4009ca7f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4ab4f99f-cc87-4155-af1e-7e63973926b9', 'volume_size': 1}' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:38:10 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-df71bef5-e2b4-46b0-a4f8-65215b1806ea tempest-GroupSnapshotsTest-2072112239 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e2a82dc8-9ac9-4614-a92d-dede0189c95e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:38:10 devstack cinder-volume[92060]: INFO cinder.volume.flows.manager.create_volume [None req-df71bef5-e2b4-46b0-a4f8-65215b1806ea tempest-GroupSnapshotsTest-2072112239 None] Volume volume-4ab4f99f-cc87-4155-af1e-7e63973926b9 (4ab4f99f-cc87-4155-af1e-7e63973926b9): created successfully Jun 17 04:38:10 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-df71bef5-e2b4-46b0-a4f8-65215b1806ea tempest-GroupSnapshotsTest-2072112239 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e2a82dc8-9ac9-4614-a92d-dede0189c95e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:38:10 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-df71bef5-e2b4-46b0-a4f8-65215b1806ea tempest-GroupSnapshotsTest-2072112239 None] Flow 'volume_create_manager' (2bdfe411-50e9-4ab4-b821-fec839526445) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92060) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 17 04:38:10 devstack cinder-volume[92060]: INFO cinder.volume.manager [None req-df71bef5-e2b4-46b0-a4f8-65215b1806ea tempest-GroupSnapshotsTest-2072112239 None] Created volume successfully. Jun 17 04:38:11 devstack cinder-volume[92060]: INFO cinder.volume.manager [None req-bd3e497e-0d22-4b7b-b108-3d066723df54 tempest-GroupSnapshotsTest-2072112239 None] Update group completed successfully. Jun 17 04:38:12 devstack cinder-volume[92060]: INFO cinder.volume.manager [None req-9d17e405-ac8a-40a1-9902-75a71bc86c45 tempest-GroupSnapshotsTest-2072112239 None] Update group completed successfully. Jun 17 04:38:14 devstack cinder-volume[92060]: INFO cinder.volume.manager [None req-0ad7c002-f5a4-4e5e-b456-3bc420b6eb98 tempest-GroupSnapshotsTest-2072112239 None] Update group completed successfully. Jun 17 04:38:15 devstack cinder-volume[92060]: INFO cinder.volume.manager [None req-a08d28e0-c74c-4202-9b0c-fd39536283ed tempest-GroupSnapshotsTest-2072112239 None] Update group completed successfully. Jun 17 04:38:15 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [req-a9cf6abd-358c-42b5-92c2-dc5cc709dfbf req-0a963410-910e-4c3a-9ddc-104d8710dcc7 tempest-AttachVolumeShelveTestJSON-134363980 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 04:38:15 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [req-a9cf6abd-358c-42b5-92c2-dc5cc709dfbf req-0a963410-910e-4c3a-9ddc-104d8710dcc7 tempest-AttachVolumeShelveTestJSON-134363980 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 04:38:15 devstack cinder-volume[92060]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fd0d47d-c4b8-4803-827a-307295e6aa2a]: (4, 'qcow2') {{(pid=93130) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 04:38:15 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [req-a9cf6abd-358c-42b5-92c2-dc5cc709dfbf req-0a963410-910e-4c3a-9ddc-104d8710dcc7 tempest-AttachVolumeShelveTestJSON-134363980 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-bf2eca3e-8c5a-4863-bbb8-1003435f17a2 {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:38:15 devstack sudo[95437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-bf2eca3e-8c5a-4863-bbb8-1003435f17a2 Jun 17 04:38:15 devstack sudo[95437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:38:16 devstack sudo[95437]: pam_unix(sudo:session): session closed for user root Jun 17 04:38:16 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [req-a9cf6abd-358c-42b5-92c2-dc5cc709dfbf req-0a963410-910e-4c3a-9ddc-104d8710dcc7 tempest-AttachVolumeShelveTestJSON-134363980 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-bf2eca3e-8c5a-4863-bbb8-1003435f17a2" returned: 0 in 0.781s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:38:16 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [req-a9cf6abd-358c-42b5-92c2-dc5cc709dfbf req-0a963410-910e-4c3a-9ddc-104d8710dcc7 tempest-AttachVolumeShelveTestJSON-134363980 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.811s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 04:38:16 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [req-a9cf6abd-358c-42b5-92c2-dc5cc709dfbf req-0a963410-910e-4c3a-9ddc-104d8710dcc7 tempest-AttachVolumeShelveTestJSON-134363980 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588', 'name': 'volume-bf2eca3e-8c5a-4863-bbb8-1003435f17a2', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '6ed1571f-cfda-4dbb-95b9-03c238076017', 'enforce_multipath': True} {{(pid=92060) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 17 04:38:16 devstack cinder-volume[92060]: INFO cinder.volume.manager [req-a9cf6abd-358c-42b5-92c2-dc5cc709dfbf req-0a963410-910e-4c3a-9ddc-104d8710dcc7 tempest-AttachVolumeShelveTestJSON-134363980 None] attachment_update completed successfully. Jun 17 04:38:16 devstack cinder-volume[92060]: INFO cinder.volume.manager [None req-f69f2bbe-0ff6-4488-bed2-7352bb088fe4 tempest-GroupSnapshotsTest-2072112239 None] GroupSnapshot 79098fae-1cee-4568-9ed1-d3c2159f13d1: creating. Jun 17 04:38:16 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-f69f2bbe-0ff6-4488-bed2-7352bb088fe4 tempest-GroupSnapshotsTest-2072112239 None] Group snapshot 79098fae-1cee-4568-9ed1-d3c2159f13d1: creating. {{(pid=92060) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Jun 17 04:38:16 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-f69f2bbe-0ff6-4488-bed2-7352bb088fe4 tempest-GroupSnapshotsTest-2072112239 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 04:38:16 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-f69f2bbe-0ff6-4488-bed2-7352bb088fe4 tempest-GroupSnapshotsTest-2072112239 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 04:38:16 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.remotefs [None req-f69f2bbe-0ff6-4488-bed2-7352bb088fe4 tempest-GroupSnapshotsTest-2072112239 None] Creating offline snapshot adecb790-efc7-4e2e-a7da-f80bcbc868ff of volume 4ab4f99f-cc87-4155-af1e-7e63973926b9 {{(pid=92060) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 17 04:38:16 devstack cinder-volume[92060]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3e13a6a-cb4e-469f-ab6b-b2639cbfa04a]: (4, 'qcow2') {{(pid=93130) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 04:38:16 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-f69f2bbe-0ff6-4488-bed2-7352bb088fe4 tempest-GroupSnapshotsTest-2072112239 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-4ab4f99f-cc87-4155-af1e-7e63973926b9 {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:38:17 devstack sudo[95442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-4ab4f99f-cc87-4155-af1e-7e63973926b9 Jun 17 04:38:17 devstack sudo[95442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:38:17 devstack sudo[95442]: pam_unix(sudo:session): session closed for user root Jun 17 04:38:17 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-f69f2bbe-0ff6-4488-bed2-7352bb088fe4 tempest-GroupSnapshotsTest-2072112239 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-4ab4f99f-cc87-4155-af1e-7e63973926b9" returned: 0 in 0.773s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:38:17 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-f69f2bbe-0ff6-4488-bed2-7352bb088fe4 tempest-GroupSnapshotsTest-2072112239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-4ab4f99f-cc87-4155-af1e-7e63973926b9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-4ab4f99f-cc87-4155-af1e-7e63973926b9.adecb790-efc7-4e2e-a7da-f80bcbc868ff 1G {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:38:17 devstack sudo[95447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-4ab4f99f-cc87-4155-af1e-7e63973926b9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-4ab4f99f-cc87-4155-af1e-7e63973926b9.adecb790-efc7-4e2e-a7da-f80bcbc868ff 1G Jun 17 04:38:17 devstack sudo[95447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:38:18 devstack sudo[95447]: pam_unix(sudo:session): session closed for user root Jun 17 04:38:18 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-f69f2bbe-0ff6-4488-bed2-7352bb088fe4 tempest-GroupSnapshotsTest-2072112239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-4ab4f99f-cc87-4155-af1e-7e63973926b9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-4ab4f99f-cc87-4155-af1e-7e63973926b9.adecb790-efc7-4e2e-a7da-f80bcbc868ff 1G" returned: 0 in 0.746s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:38:18 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-f69f2bbe-0ff6-4488-bed2-7352bb088fe4 tempest-GroupSnapshotsTest-2072112239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4ab4f99f-cc87-4155-af1e-7e63973926b9 -F qcow2 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-4ab4f99f-cc87-4155-af1e-7e63973926b9.adecb790-efc7-4e2e-a7da-f80bcbc868ff {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:38:18 devstack sudo[95453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4ab4f99f-cc87-4155-af1e-7e63973926b9 -F qcow2 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-4ab4f99f-cc87-4155-af1e-7e63973926b9.adecb790-efc7-4e2e-a7da-f80bcbc868ff Jun 17 04:38:18 devstack sudo[95453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:38:19 devstack sudo[95453]: pam_unix(sudo:session): session closed for user root Jun 17 04:38:19 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-f69f2bbe-0ff6-4488-bed2-7352bb088fe4 tempest-GroupSnapshotsTest-2072112239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4ab4f99f-cc87-4155-af1e-7e63973926b9 -F qcow2 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-4ab4f99f-cc87-4155-af1e-7e63973926b9.adecb790-efc7-4e2e-a7da-f80bcbc868ff" returned: 0 in 0.637s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:38:19 devstack cinder-volume[92060]: WARNING cinder.volume.drivers.remotefs [None req-f69f2bbe-0ff6-4488-bed2-7352bb088fe4 tempest-GroupSnapshotsTest-2072112239 None] /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-4ab4f99f-cc87-4155-af1e-7e63973926b9.adecb790-efc7-4e2e-a7da-f80bcbc868ff is being set with open permissions: ugo+rw: NotImplementedError Jun 17 04:38:19 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-f69f2bbe-0ff6-4488-bed2-7352bb088fe4 tempest-GroupSnapshotsTest-2072112239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-4ab4f99f-cc87-4155-af1e-7e63973926b9.adecb790-efc7-4e2e-a7da-f80bcbc868ff {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:38:19 devstack sudo[95459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-4ab4f99f-cc87-4155-af1e-7e63973926b9.adecb790-efc7-4e2e-a7da-f80bcbc868ff Jun 17 04:38:19 devstack sudo[95459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:38:19 devstack sudo[95459]: pam_unix(sudo:session): session closed for user root Jun 17 04:38:19 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-f69f2bbe-0ff6-4488-bed2-7352bb088fe4 tempest-GroupSnapshotsTest-2072112239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-4ab4f99f-cc87-4155-af1e-7e63973926b9.adecb790-efc7-4e2e-a7da-f80bcbc868ff" returned: 0 in 0.634s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:38:19 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-f69f2bbe-0ff6-4488-bed2-7352bb088fe4 tempest-GroupSnapshotsTest-2072112239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-4ab4f99f-cc87-4155-af1e-7e63973926b9.info {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:38:19 devstack sudo[95462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-4ab4f99f-cc87-4155-af1e-7e63973926b9.info Jun 17 04:38:19 devstack sudo[95462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:38:20 devstack sudo[95462]: pam_unix(sudo:session): session closed for user root Jun 17 04:38:20 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-f69f2bbe-0ff6-4488-bed2-7352bb088fe4 tempest-GroupSnapshotsTest-2072112239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-4ab4f99f-cc87-4155-af1e-7e63973926b9.info" returned: 0 in 0.654s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:38:20 devstack cinder-volume[92060]: WARNING cinder.volume.drivers.remotefs [None req-f69f2bbe-0ff6-4488-bed2-7352bb088fe4 tempest-GroupSnapshotsTest-2072112239 None] /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-4ab4f99f-cc87-4155-af1e-7e63973926b9.info is being set with open permissions: ugo+rw: NotImplementedError Jun 17 04:38:20 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-f69f2bbe-0ff6-4488-bed2-7352bb088fe4 tempest-GroupSnapshotsTest-2072112239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-4ab4f99f-cc87-4155-af1e-7e63973926b9.info {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:38:20 devstack sudo[95465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-4ab4f99f-cc87-4155-af1e-7e63973926b9.info Jun 17 04:38:20 devstack sudo[95465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:38:20 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-9f060f5c-eda5-4fe8-8bab-4ffdaf172322 tempest-TaggedAttachmentsTest-658082151 None] Acquiring lock "cinder-846d0cdb-7c70-4c34-97aa-f7bef6b0f570-delete_volume" by "delete_volume" {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 04:38:20 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-9f060f5c-eda5-4fe8-8bab-4ffdaf172322 tempest-TaggedAttachmentsTest-658082151 None] Lock "cinder-846d0cdb-7c70-4c34-97aa-f7bef6b0f570-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 04:38:20 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-9f060f5c-eda5-4fe8-8bab-4ffdaf172322 tempest-TaggedAttachmentsTest-658082151 None] Acquiring lock "cinder-quobyte-846d0cdb-7c70-4c34-97aa-f7bef6b0f570" by "delete_volume" {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 04:38:20 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-9f060f5c-eda5-4fe8-8bab-4ffdaf172322 tempest-TaggedAttachmentsTest-658082151 None] Lock "cinder-quobyte-846d0cdb-7c70-4c34-97aa-f7bef6b0f570" acquired by "delete_volume" :: waited 0.019s {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 04:38:20 devstack cinder-volume[92060]: DEBUG oslo.privsep.daemon [-] privsep: reply[cebcc3a2-0664-4180-ac3c-bdb329d04549]: (4, 'qcow2') {{(pid=93130) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 04:38:20 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-9f060f5c-eda5-4fe8-8bab-4ffdaf172322 tempest-TaggedAttachmentsTest-658082151 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-846d0cdb-7c70-4c34-97aa-f7bef6b0f570 {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:38:21 devstack sudo[95469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-846d0cdb-7c70-4c34-97aa-f7bef6b0f570 Jun 17 04:38:21 devstack sudo[95469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:38:21 devstack sudo[95465]: pam_unix(sudo:session): session closed for user root Jun 17 04:38:21 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-f69f2bbe-0ff6-4488-bed2-7352bb088fe4 tempest-GroupSnapshotsTest-2072112239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-4ab4f99f-cc87-4155-af1e-7e63973926b9.info" returned: 0 in 0.789s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:38:21 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-f69f2bbe-0ff6-4488-bed2-7352bb088fe4 tempest-GroupSnapshotsTest-2072112239 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.319s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 04:38:21 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-f69f2bbe-0ff6-4488-bed2-7352bb088fe4 tempest-GroupSnapshotsTest-2072112239 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 04:38:21 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-f69f2bbe-0ff6-4488-bed2-7352bb088fe4 tempest-GroupSnapshotsTest-2072112239 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 04:38:21 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.remotefs [None req-f69f2bbe-0ff6-4488-bed2-7352bb088fe4 tempest-GroupSnapshotsTest-2072112239 None] Creating offline snapshot e16e7142-c393-4418-b1fa-d2f136894e48 of volume 7aa4ca9b-afcd-475c-9841-1d3a078d21e1 {{(pid=92060) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 17 04:38:21 devstack cinder-volume[92060]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b619437-366b-4a35-9906-7c7c1e1831c3]: (4, 'qcow2') {{(pid=93130) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 04:38:21 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-f69f2bbe-0ff6-4488-bed2-7352bb088fe4 tempest-GroupSnapshotsTest-2072112239 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-7aa4ca9b-afcd-475c-9841-1d3a078d21e1 {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:38:21 devstack sudo[95474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-7aa4ca9b-afcd-475c-9841-1d3a078d21e1 Jun 17 04:38:21 devstack sudo[95474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:38:21 devstack sudo[95469]: pam_unix(sudo:session): session closed for user root Jun 17 04:38:21 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-9f060f5c-eda5-4fe8-8bab-4ffdaf172322 tempest-TaggedAttachmentsTest-658082151 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-846d0cdb-7c70-4c34-97aa-f7bef6b0f570" returned: 0 in 0.945s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:38:21 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-9f060f5c-eda5-4fe8-8bab-4ffdaf172322 tempest-TaggedAttachmentsTest-658082151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-846d0cdb-7c70-4c34-97aa-f7bef6b0f570 {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:38:21 devstack sudo[95481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-846d0cdb-7c70-4c34-97aa-f7bef6b0f570 Jun 17 04:38:21 devstack sudo[95481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:38:22 devstack sudo[95474]: pam_unix(sudo:session): session closed for user root Jun 17 04:38:22 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-f69f2bbe-0ff6-4488-bed2-7352bb088fe4 tempest-GroupSnapshotsTest-2072112239 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-7aa4ca9b-afcd-475c-9841-1d3a078d21e1" returned: 0 in 0.940s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:38:22 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-f69f2bbe-0ff6-4488-bed2-7352bb088fe4 tempest-GroupSnapshotsTest-2072112239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-7aa4ca9b-afcd-475c-9841-1d3a078d21e1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-7aa4ca9b-afcd-475c-9841-1d3a078d21e1.e16e7142-c393-4418-b1fa-d2f136894e48 1G {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:38:22 devstack sudo[95488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-7aa4ca9b-afcd-475c-9841-1d3a078d21e1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-7aa4ca9b-afcd-475c-9841-1d3a078d21e1.e16e7142-c393-4418-b1fa-d2f136894e48 1G Jun 17 04:38:22 devstack sudo[95488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:38:22 devstack sudo[95481]: pam_unix(sudo:session): session closed for user root Jun 17 04:38:22 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-9f060f5c-eda5-4fe8-8bab-4ffdaf172322 tempest-TaggedAttachmentsTest-658082151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-846d0cdb-7c70-4c34-97aa-f7bef6b0f570" returned: 0 in 0.685s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:38:22 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-9f060f5c-eda5-4fe8-8bab-4ffdaf172322 tempest-TaggedAttachmentsTest-658082151 None] Lock "cinder-quobyte-846d0cdb-7c70-4c34-97aa-f7bef6b0f570" released by "delete_volume" :: held 1.681s {{(pid=92060) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 04:38:22 devstack cinder-volume[92060]: DEBUG cinder.quota [None req-9f060f5c-eda5-4fe8-8bab-4ffdaf172322 tempest-TaggedAttachmentsTest-658082151 None] Created reservations ['2d1c99c0-b387-4d03-ac86-921ff68ee5f9', 'c11fbed1-aeef-4437-b25d-26daaf589d75', '628b5940-e2b6-4c59-9e88-e5abdaab5c79', '16d96ca9-0d28-4421-91d8-dbf971707c3b'] {{(pid=92060) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 17 04:38:22 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-9f060f5c-eda5-4fe8-8bab-4ffdaf172322 tempest-TaggedAttachmentsTest-658082151 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 04:38:22 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-9f060f5c-eda5-4fe8-8bab-4ffdaf172322 tempest-TaggedAttachmentsTest-658082151 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 04:38:22 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-9f060f5c-eda5-4fe8-8bab-4ffdaf172322 tempest-TaggedAttachmentsTest-658082151 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588': None} {{(pid=92060) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 17 04:38:22 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-9f060f5c-eda5-4fe8-8bab-4ffdaf172322 tempest-TaggedAttachmentsTest-658082151 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588'] {{(pid=92060) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 17 04:38:22 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-9f060f5c-eda5-4fe8-8bab-4ffdaf172322 tempest-TaggedAttachmentsTest-658082151 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 04:38:22 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-9f060f5c-eda5-4fe8-8bab-4ffdaf172322 tempest-TaggedAttachmentsTest-658082151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:38:22 devstack sudo[95495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a Jun 17 04:38:22 devstack sudo[95495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:38:22 devstack sudo[95488]: pam_unix(sudo:session): session closed for user root Jun 17 04:38:22 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-f69f2bbe-0ff6-4488-bed2-7352bb088fe4 tempest-GroupSnapshotsTest-2072112239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-7aa4ca9b-afcd-475c-9841-1d3a078d21e1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-7aa4ca9b-afcd-475c-9841-1d3a078d21e1.e16e7142-c393-4418-b1fa-d2f136894e48 1G" returned: 0 in 0.830s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:38:22 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-f69f2bbe-0ff6-4488-bed2-7352bb088fe4 tempest-GroupSnapshotsTest-2072112239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7aa4ca9b-afcd-475c-9841-1d3a078d21e1 -F qcow2 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-7aa4ca9b-afcd-475c-9841-1d3a078d21e1.e16e7142-c393-4418-b1fa-d2f136894e48 {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:38:23 devstack sudo[95497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7aa4ca9b-afcd-475c-9841-1d3a078d21e1 -F qcow2 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-7aa4ca9b-afcd-475c-9841-1d3a078d21e1.e16e7142-c393-4418-b1fa-d2f136894e48 Jun 17 04:38:23 devstack sudo[95497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:38:23 devstack sudo[95495]: pam_unix(sudo:session): session closed for user root Jun 17 04:38:23 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-9f060f5c-eda5-4fe8-8bab-4ffdaf172322 tempest-TaggedAttachmentsTest-658082151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a" returned: 0 in 0.675s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:38:23 devstack cinder-volume[92060]: DEBUG cinder.manager [None req-9f060f5c-eda5-4fe8-8bab-4ffdaf172322 tempest-TaggedAttachmentsTest-658082151 None] Notifying Schedulers of capabilities ... {{(pid=92060) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 17 04:38:23 devstack cinder-volume[92060]: INFO cinder.volume.manager [None req-9f060f5c-eda5-4fe8-8bab-4ffdaf172322 tempest-TaggedAttachmentsTest-658082151 None] Deleted volume successfully. Jun 17 04:38:23 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-9f060f5c-eda5-4fe8-8bab-4ffdaf172322 tempest-TaggedAttachmentsTest-658082151 None] Lock "cinder-846d0cdb-7c70-4c34-97aa-f7bef6b0f570-delete_volume" released by "delete_volume" :: held 2.593s {{(pid=92060) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 04:38:23 devstack sudo[95497]: pam_unix(sudo:session): session closed for user root Jun 17 04:38:23 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-f69f2bbe-0ff6-4488-bed2-7352bb088fe4 tempest-GroupSnapshotsTest-2072112239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7aa4ca9b-afcd-475c-9841-1d3a078d21e1 -F qcow2 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-7aa4ca9b-afcd-475c-9841-1d3a078d21e1.e16e7142-c393-4418-b1fa-d2f136894e48" returned: 0 in 0.765s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:38:23 devstack cinder-volume[92060]: WARNING cinder.volume.drivers.remotefs [None req-f69f2bbe-0ff6-4488-bed2-7352bb088fe4 tempest-GroupSnapshotsTest-2072112239 None] /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-7aa4ca9b-afcd-475c-9841-1d3a078d21e1.e16e7142-c393-4418-b1fa-d2f136894e48 is being set with open permissions: ugo+rw: NotImplementedError Jun 17 04:38:23 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-f69f2bbe-0ff6-4488-bed2-7352bb088fe4 tempest-GroupSnapshotsTest-2072112239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-7aa4ca9b-afcd-475c-9841-1d3a078d21e1.e16e7142-c393-4418-b1fa-d2f136894e48 {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:38:23 devstack sudo[95503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-7aa4ca9b-afcd-475c-9841-1d3a078d21e1.e16e7142-c393-4418-b1fa-d2f136894e48 Jun 17 04:38:23 devstack sudo[95503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:38:24 devstack sudo[95503]: pam_unix(sudo:session): session closed for user root Jun 17 04:38:24 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-f69f2bbe-0ff6-4488-bed2-7352bb088fe4 tempest-GroupSnapshotsTest-2072112239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-7aa4ca9b-afcd-475c-9841-1d3a078d21e1.e16e7142-c393-4418-b1fa-d2f136894e48" returned: 0 in 0.723s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:38:24 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-f69f2bbe-0ff6-4488-bed2-7352bb088fe4 tempest-GroupSnapshotsTest-2072112239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-7aa4ca9b-afcd-475c-9841-1d3a078d21e1.info {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:38:24 devstack sudo[95506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-7aa4ca9b-afcd-475c-9841-1d3a078d21e1.info Jun 17 04:38:24 devstack sudo[95506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:38:25 devstack sudo[95506]: pam_unix(sudo:session): session closed for user root Jun 17 04:38:25 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-f69f2bbe-0ff6-4488-bed2-7352bb088fe4 tempest-GroupSnapshotsTest-2072112239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-7aa4ca9b-afcd-475c-9841-1d3a078d21e1.info" returned: 0 in 0.748s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:38:25 devstack cinder-volume[92060]: WARNING cinder.volume.drivers.remotefs [None req-f69f2bbe-0ff6-4488-bed2-7352bb088fe4 tempest-GroupSnapshotsTest-2072112239 None] /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-7aa4ca9b-afcd-475c-9841-1d3a078d21e1.info is being set with open permissions: ugo+rw: NotImplementedError Jun 17 04:38:25 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-f69f2bbe-0ff6-4488-bed2-7352bb088fe4 tempest-GroupSnapshotsTest-2072112239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-7aa4ca9b-afcd-475c-9841-1d3a078d21e1.info {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:38:25 devstack sudo[95510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-7aa4ca9b-afcd-475c-9841-1d3a078d21e1.info Jun 17 04:38:25 devstack sudo[95510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:38:26 devstack sudo[95510]: pam_unix(sudo:session): session closed for user root Jun 17 04:38:26 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-f69f2bbe-0ff6-4488-bed2-7352bb088fe4 tempest-GroupSnapshotsTest-2072112239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-7aa4ca9b-afcd-475c-9841-1d3a078d21e1.info" returned: 0 in 0.788s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:38:26 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-f69f2bbe-0ff6-4488-bed2-7352bb088fe4 tempest-GroupSnapshotsTest-2072112239 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.915s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 04:38:26 devstack cinder-volume[92060]: INFO cinder.volume.manager [None req-f69f2bbe-0ff6-4488-bed2-7352bb088fe4 tempest-GroupSnapshotsTest-2072112239 None] group_snapshot 79098fae-1cee-4568-9ed1-d3c2159f13d1: created successfully Jun 17 04:38:26 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [req-e83d4669-2e32-46ff-9b13-1ae77f3f8203 req-1d8fe713-2657-4af3-b4ac-477d2fbf0536 tempest-ServerActionsTestOtherA-1987628563 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 04:38:26 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [req-e83d4669-2e32-46ff-9b13-1ae77f3f8203 req-1d8fe713-2657-4af3-b4ac-477d2fbf0536 tempest-ServerActionsTestOtherA-1987628563 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 04:38:26 devstack cinder-volume[92060]: DEBUG oslo.privsep.daemon [-] privsep: reply[5958e3a1-5d10-43ad-80f5-f7aa608dd130]: (4, 'qcow2') {{(pid=93130) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 04:38:26 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [req-e83d4669-2e32-46ff-9b13-1ae77f3f8203 req-1d8fe713-2657-4af3-b4ac-477d2fbf0536 tempest-ServerActionsTestOtherA-1987628563 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-87612384-1fa0-40a0-b4fb-f5570b67b53a {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:38:26 devstack sudo[95531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-87612384-1fa0-40a0-b4fb-f5570b67b53a Jun 17 04:38:26 devstack sudo[95531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:38:26 devstack cinder-volume[92060]: INFO cinder.volume.manager [None req-0342f81f-419e-49de-9570-e0ca6d9566c2 tempest-GroupSnapshotsTest-2072112239 None] group_snapshot 79098fae-1cee-4568-9ed1-d3c2159f13d1: deleting Jun 17 04:38:26 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-0342f81f-419e-49de-9570-e0ca6d9566c2 tempest-GroupSnapshotsTest-2072112239 None] group_snapshot 79098fae-1cee-4568-9ed1-d3c2159f13d1: deleting {{(pid=92060) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Jun 17 04:38:26 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-0342f81f-419e-49de-9570-e0ca6d9566c2 tempest-GroupSnapshotsTest-2072112239 None] Acquiring lock "cinder-quobyte-4ab4f99f-cc87-4155-af1e-7e63973926b9" by "delete_snapshot" {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 04:38:26 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-0342f81f-419e-49de-9570-e0ca6d9566c2 tempest-GroupSnapshotsTest-2072112239 None] Lock "cinder-quobyte-4ab4f99f-cc87-4155-af1e-7e63973926b9" acquired by "delete_snapshot" :: waited 0.032s {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 04:38:26 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-0342f81f-419e-49de-9570-e0ca6d9566c2 tempest-GroupSnapshotsTest-2072112239 None] Acquiring lock "cinder-quobyte-adecb790-efc7-4e2e-a7da-f80bcbc868ff" by "_delete_snapshot" {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 04:38:26 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-0342f81f-419e-49de-9570-e0ca6d9566c2 tempest-GroupSnapshotsTest-2072112239 None] Lock "cinder-quobyte-adecb790-efc7-4e2e-a7da-f80bcbc868ff" acquired by "_delete_snapshot" :: waited 0.028s {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 04:38:26 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.remotefs [None req-0342f81f-419e-49de-9570-e0ca6d9566c2 tempest-GroupSnapshotsTest-2072112239 None] Deleting offline snapshot adecb790-efc7-4e2e-a7da-f80bcbc868ff of volume 4ab4f99f-cc87-4155-af1e-7e63973926b9 {{(pid=92060) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 17 04:38:26 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.remotefs [None req-0342f81f-419e-49de-9570-e0ca6d9566c2 tempest-GroupSnapshotsTest-2072112239 None] snapshot_file for this snap is: volume-4ab4f99f-cc87-4155-af1e-7e63973926b9.adecb790-efc7-4e2e-a7da-f80bcbc868ff {{(pid=92060) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 17 04:38:26 devstack cinder-volume[92060]: DEBUG oslo.privsep.daemon [-] privsep: reply[49ea177d-d927-402a-a420-a7ea8f3505bb]: (4, 'qcow2') {{(pid=93130) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 04:38:26 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-0342f81f-419e-49de-9570-e0ca6d9566c2 tempest-GroupSnapshotsTest-2072112239 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-4ab4f99f-cc87-4155-af1e-7e63973926b9.adecb790-efc7-4e2e-a7da-f80bcbc868ff {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:38:26 devstack sudo[95537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-4ab4f99f-cc87-4155-af1e-7e63973926b9.adecb790-efc7-4e2e-a7da-f80bcbc868ff Jun 17 04:38:26 devstack sudo[95537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:38:27 devstack sudo[95531]: pam_unix(sudo:session): session closed for user root Jun 17 04:38:27 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [req-e83d4669-2e32-46ff-9b13-1ae77f3f8203 req-1d8fe713-2657-4af3-b4ac-477d2fbf0536 tempest-ServerActionsTestOtherA-1987628563 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-87612384-1fa0-40a0-b4fb-f5570b67b53a" returned: 0 in 1.089s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:38:27 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [req-e83d4669-2e32-46ff-9b13-1ae77f3f8203 req-1d8fe713-2657-4af3-b4ac-477d2fbf0536 tempest-ServerActionsTestOtherA-1987628563 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.138s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 04:38:27 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [req-e83d4669-2e32-46ff-9b13-1ae77f3f8203 req-1d8fe713-2657-4af3-b4ac-477d2fbf0536 tempest-ServerActionsTestOtherA-1987628563 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588', 'name': 'volume-87612384-1fa0-40a0-b4fb-f5570b67b53a', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '43c35d56-b63d-43c4-802b-37dabca34d35', 'enforce_multipath': True} {{(pid=92060) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 17 04:38:27 devstack cinder-volume[92060]: INFO cinder.volume.manager [req-e83d4669-2e32-46ff-9b13-1ae77f3f8203 req-1d8fe713-2657-4af3-b4ac-477d2fbf0536 tempest-ServerActionsTestOtherA-1987628563 None] attachment_update completed successfully. Jun 17 04:38:27 devstack sudo[95537]: pam_unix(sudo:session): session closed for user root Jun 17 04:38:27 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-0342f81f-419e-49de-9570-e0ca6d9566c2 tempest-GroupSnapshotsTest-2072112239 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-4ab4f99f-cc87-4155-af1e-7e63973926b9.adecb790-efc7-4e2e-a7da-f80bcbc868ff" returned: 0 in 0.890s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:38:27 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.remotefs [None req-0342f81f-419e-49de-9570-e0ca6d9566c2 tempest-GroupSnapshotsTest-2072112239 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4ab4f99f-cc87-4155-af1e-7e63973926b9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=92060) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 17 04:38:27 devstack cinder-volume[92060]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5626d2b-dd8f-4109-abd7-ab4aefb612ad]: (4, 'qcow2') {{(pid=93130) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 04:38:27 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-0342f81f-419e-49de-9570-e0ca6d9566c2 tempest-GroupSnapshotsTest-2072112239 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-4ab4f99f-cc87-4155-af1e-7e63973926b9 {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:38:27 devstack sudo[95559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-4ab4f99f-cc87-4155-af1e-7e63973926b9 Jun 17 04:38:27 devstack sudo[95559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:38:28 devstack sudo[95559]: pam_unix(sudo:session): session closed for user root Jun 17 04:38:28 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-0342f81f-419e-49de-9570-e0ca6d9566c2 tempest-GroupSnapshotsTest-2072112239 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-4ab4f99f-cc87-4155-af1e-7e63973926b9" returned: 0 in 0.889s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:38:28 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-0342f81f-419e-49de-9570-e0ca6d9566c2 tempest-GroupSnapshotsTest-2072112239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-4ab4f99f-cc87-4155-af1e-7e63973926b9.adecb790-efc7-4e2e-a7da-f80bcbc868ff {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:38:28 devstack sudo[95642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-4ab4f99f-cc87-4155-af1e-7e63973926b9.adecb790-efc7-4e2e-a7da-f80bcbc868ff Jun 17 04:38:28 devstack sudo[95642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:38:29 devstack sudo[95642]: pam_unix(sudo:session): session closed for user root Jun 17 04:38:29 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-0342f81f-419e-49de-9570-e0ca6d9566c2 tempest-GroupSnapshotsTest-2072112239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-4ab4f99f-cc87-4155-af1e-7e63973926b9.adecb790-efc7-4e2e-a7da-f80bcbc868ff" returned: 0 in 0.989s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:38:29 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-0342f81f-419e-49de-9570-e0ca6d9566c2 tempest-GroupSnapshotsTest-2072112239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-4ab4f99f-cc87-4155-af1e-7e63973926b9.adecb790-efc7-4e2e-a7da-f80bcbc868ff {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:38:29 devstack sudo[95967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-4ab4f99f-cc87-4155-af1e-7e63973926b9.adecb790-efc7-4e2e-a7da-f80bcbc868ff Jun 17 04:38:29 devstack sudo[95967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:38:30 devstack sudo[95967]: pam_unix(sudo:session): session closed for user root Jun 17 04:38:30 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-0342f81f-419e-49de-9570-e0ca6d9566c2 tempest-GroupSnapshotsTest-2072112239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-4ab4f99f-cc87-4155-af1e-7e63973926b9.adecb790-efc7-4e2e-a7da-f80bcbc868ff" returned: 0 in 0.689s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:38:30 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-0342f81f-419e-49de-9570-e0ca6d9566c2 tempest-GroupSnapshotsTest-2072112239 None] Lock "cinder-quobyte-adecb790-efc7-4e2e-a7da-f80bcbc868ff" released by "_delete_snapshot" :: held 3.586s {{(pid=92060) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 04:38:30 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-0342f81f-419e-49de-9570-e0ca6d9566c2 tempest-GroupSnapshotsTest-2072112239 None] Lock "cinder-quobyte-4ab4f99f-cc87-4155-af1e-7e63973926b9" released by "delete_snapshot" :: held 3.622s {{(pid=92060) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 04:38:30 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-0342f81f-419e-49de-9570-e0ca6d9566c2 tempest-GroupSnapshotsTest-2072112239 None] Acquiring lock "cinder-quobyte-7aa4ca9b-afcd-475c-9841-1d3a078d21e1" by "delete_snapshot" {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 04:38:30 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-0342f81f-419e-49de-9570-e0ca6d9566c2 tempest-GroupSnapshotsTest-2072112239 None] Lock "cinder-quobyte-7aa4ca9b-afcd-475c-9841-1d3a078d21e1" acquired by "delete_snapshot" :: waited 0.015s {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 04:38:30 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-0342f81f-419e-49de-9570-e0ca6d9566c2 tempest-GroupSnapshotsTest-2072112239 None] Acquiring lock "cinder-quobyte-e16e7142-c393-4418-b1fa-d2f136894e48" by "_delete_snapshot" {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 04:38:30 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-0342f81f-419e-49de-9570-e0ca6d9566c2 tempest-GroupSnapshotsTest-2072112239 None] Lock "cinder-quobyte-e16e7142-c393-4418-b1fa-d2f136894e48" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 04:38:30 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.remotefs [None req-0342f81f-419e-49de-9570-e0ca6d9566c2 tempest-GroupSnapshotsTest-2072112239 None] Deleting offline snapshot e16e7142-c393-4418-b1fa-d2f136894e48 of volume 7aa4ca9b-afcd-475c-9841-1d3a078d21e1 {{(pid=92060) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 17 04:38:30 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.remotefs [None req-0342f81f-419e-49de-9570-e0ca6d9566c2 tempest-GroupSnapshotsTest-2072112239 None] snapshot_file for this snap is: volume-7aa4ca9b-afcd-475c-9841-1d3a078d21e1.e16e7142-c393-4418-b1fa-d2f136894e48 {{(pid=92060) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 17 04:38:30 devstack cinder-volume[92060]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fde8700-b9d7-4fbe-99c3-fdd0da5f793b]: (4, 'qcow2') {{(pid=93130) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 04:38:30 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-0342f81f-419e-49de-9570-e0ca6d9566c2 tempest-GroupSnapshotsTest-2072112239 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-7aa4ca9b-afcd-475c-9841-1d3a078d21e1.e16e7142-c393-4418-b1fa-d2f136894e48 {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:38:30 devstack sudo[95971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-7aa4ca9b-afcd-475c-9841-1d3a078d21e1.e16e7142-c393-4418-b1fa-d2f136894e48 Jun 17 04:38:30 devstack sudo[95971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:38:31 devstack sudo[95971]: pam_unix(sudo:session): session closed for user root Jun 17 04:38:31 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-0342f81f-419e-49de-9570-e0ca6d9566c2 tempest-GroupSnapshotsTest-2072112239 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-7aa4ca9b-afcd-475c-9841-1d3a078d21e1.e16e7142-c393-4418-b1fa-d2f136894e48" returned: 0 in 0.887s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:38:31 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.remotefs [None req-0342f81f-419e-49de-9570-e0ca6d9566c2 tempest-GroupSnapshotsTest-2072112239 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7aa4ca9b-afcd-475c-9841-1d3a078d21e1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=92060) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 17 04:38:31 devstack cinder-volume[92060]: DEBUG oslo.privsep.daemon [-] privsep: reply[f477572e-6f03-4add-9179-bdb35d0b5ad5]: (4, 'qcow2') {{(pid=93130) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 04:38:31 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-0342f81f-419e-49de-9570-e0ca6d9566c2 tempest-GroupSnapshotsTest-2072112239 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-7aa4ca9b-afcd-475c-9841-1d3a078d21e1 {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:38:31 devstack sudo[95988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-7aa4ca9b-afcd-475c-9841-1d3a078d21e1 Jun 17 04:38:31 devstack sudo[95988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:38:32 devstack sudo[95988]: pam_unix(sudo:session): session closed for user root Jun 17 04:38:32 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-0342f81f-419e-49de-9570-e0ca6d9566c2 tempest-GroupSnapshotsTest-2072112239 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-7aa4ca9b-afcd-475c-9841-1d3a078d21e1" returned: 0 in 0.982s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:38:32 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-0342f81f-419e-49de-9570-e0ca6d9566c2 tempest-GroupSnapshotsTest-2072112239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-7aa4ca9b-afcd-475c-9841-1d3a078d21e1.e16e7142-c393-4418-b1fa-d2f136894e48 {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:38:32 devstack sudo[95998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-7aa4ca9b-afcd-475c-9841-1d3a078d21e1.e16e7142-c393-4418-b1fa-d2f136894e48 Jun 17 04:38:32 devstack sudo[95998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:38:33 devstack sudo[95998]: pam_unix(sudo:session): session closed for user root Jun 17 04:38:33 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-0342f81f-419e-49de-9570-e0ca6d9566c2 tempest-GroupSnapshotsTest-2072112239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-7aa4ca9b-afcd-475c-9841-1d3a078d21e1.e16e7142-c393-4418-b1fa-d2f136894e48" returned: 0 in 1.103s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:38:33 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-0342f81f-419e-49de-9570-e0ca6d9566c2 tempest-GroupSnapshotsTest-2072112239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-7aa4ca9b-afcd-475c-9841-1d3a078d21e1.e16e7142-c393-4418-b1fa-d2f136894e48 {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:38:33 devstack sudo[96026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-7aa4ca9b-afcd-475c-9841-1d3a078d21e1.e16e7142-c393-4418-b1fa-d2f136894e48 Jun 17 04:38:33 devstack sudo[96026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:38:34 devstack sudo[96026]: pam_unix(sudo:session): session closed for user root Jun 17 04:38:34 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-0342f81f-419e-49de-9570-e0ca6d9566c2 tempest-GroupSnapshotsTest-2072112239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-7aa4ca9b-afcd-475c-9841-1d3a078d21e1.e16e7142-c393-4418-b1fa-d2f136894e48" returned: 0 in 1.210s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:38:34 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-0342f81f-419e-49de-9570-e0ca6d9566c2 tempest-GroupSnapshotsTest-2072112239 None] Lock "cinder-quobyte-e16e7142-c393-4418-b1fa-d2f136894e48" released by "_delete_snapshot" :: held 4.302s {{(pid=92060) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 04:38:34 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-0342f81f-419e-49de-9570-e0ca6d9566c2 tempest-GroupSnapshotsTest-2072112239 None] Lock "cinder-quobyte-7aa4ca9b-afcd-475c-9841-1d3a078d21e1" released by "delete_snapshot" :: held 4.334s {{(pid=92060) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 04:38:34 devstack cinder-volume[92060]: WARNING cinder.quota [None req-0342f81f-419e-49de-9570-e0ca6d9566c2 tempest-GroupSnapshotsTest-2072112239 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1100659435 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1100659435, it is now deprecated. Please use the default quota class for default quota. Jun 17 04:38:34 devstack cinder-volume[92060]: WARNING cinder.quota [None req-0342f81f-419e-49de-9570-e0ca6d9566c2 tempest-GroupSnapshotsTest-2072112239 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1100659435 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1100659435, it is now deprecated. Please use the default quota class for default quota. Jun 17 04:38:34 devstack cinder-volume[92060]: DEBUG cinder.quota [None req-0342f81f-419e-49de-9570-e0ca6d9566c2 tempest-GroupSnapshotsTest-2072112239 None] Created reservations ['5508801d-a5ec-4fa6-95da-de3c17378eab', 'cb4616b7-c1e2-42eb-8172-04dde7d90133', '4b439f54-d352-4a4d-9647-256fd19c5dc0', '3d7cc0f3-f443-4a7f-8637-7619be99b621'] {{(pid=92060) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 17 04:38:35 devstack cinder-volume[92060]: DEBUG cinder.quota [None req-0342f81f-419e-49de-9570-e0ca6d9566c2 tempest-GroupSnapshotsTest-2072112239 None] Created reservations ['4783faaa-f31b-4e6e-a92c-811c3ffbb934', '19051f02-e116-4fa5-8e85-83aff41f14ab', 'a58b5f8d-493c-407d-97ee-47f3e406b366', '774c603f-4b69-4365-8ab6-7c142f974cc8'] {{(pid=92060) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 17 04:38:35 devstack cinder-volume[92060]: INFO cinder.volume.manager [None req-0342f81f-419e-49de-9570-e0ca6d9566c2 tempest-GroupSnapshotsTest-2072112239 None] group_snapshot 79098fae-1cee-4568-9ed1-d3c2159f13d1: deleted successfully Jun 17 04:38:35 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-6e70b230-ce4a-4b9b-9d38-69303846017a tempest-GroupSnapshotsTest-2072112239 None] Acquiring lock "cinder-quobyte-4ab4f99f-cc87-4155-af1e-7e63973926b9" by "delete_volume" {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 04:38:36 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-6e70b230-ce4a-4b9b-9d38-69303846017a tempest-GroupSnapshotsTest-2072112239 None] Lock "cinder-quobyte-4ab4f99f-cc87-4155-af1e-7e63973926b9" acquired by "delete_volume" :: waited 0.081s {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 04:38:36 devstack cinder-volume[92060]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d05f476-c1bf-4c50-92c3-4bd72f20afc1]: (4, 'qcow2') {{(pid=93130) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 04:38:36 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-6e70b230-ce4a-4b9b-9d38-69303846017a tempest-GroupSnapshotsTest-2072112239 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-4ab4f99f-cc87-4155-af1e-7e63973926b9 {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:38:36 devstack sudo[96106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-4ab4f99f-cc87-4155-af1e-7e63973926b9 Jun 17 04:38:36 devstack sudo[96106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:38:37 devstack cinder-volume[92060]: INFO cinder.volume.manager [req-0c6066f4-524b-4dd2-9239-ca460bdeb5f8 req-a236f8b6-bab7-4b26-8cb1-09a31818b92d tempest-ServerActionsTestOtherA-1987628563 None] Terminate volume connection completed successfully. Jun 17 04:38:37 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [req-0c6066f4-524b-4dd2-9239-ca460bdeb5f8 req-a236f8b6-bab7-4b26-8cb1-09a31818b92d tempest-ServerActionsTestOtherA-1987628563 None] Deleting attachment 43c35d56-b63d-43c4-802b-37dabca34d35. {{(pid=92060) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 17 04:38:37 devstack sudo[96106]: pam_unix(sudo:session): session closed for user root Jun 17 04:38:37 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-6e70b230-ce4a-4b9b-9d38-69303846017a tempest-GroupSnapshotsTest-2072112239 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-4ab4f99f-cc87-4155-af1e-7e63973926b9" returned: 0 in 1.390s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:38:37 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-6e70b230-ce4a-4b9b-9d38-69303846017a tempest-GroupSnapshotsTest-2072112239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-4ab4f99f-cc87-4155-af1e-7e63973926b9 {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:38:37 devstack sudo[96123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-4ab4f99f-cc87-4155-af1e-7e63973926b9 Jun 17 04:38:37 devstack sudo[96123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:38:38 devstack sudo[96123]: pam_unix(sudo:session): session closed for user root Jun 17 04:38:38 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-6e70b230-ce4a-4b9b-9d38-69303846017a tempest-GroupSnapshotsTest-2072112239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-4ab4f99f-cc87-4155-af1e-7e63973926b9" returned: 0 in 0.897s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:38:38 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-6e70b230-ce4a-4b9b-9d38-69303846017a tempest-GroupSnapshotsTest-2072112239 None] Lock "cinder-quobyte-4ab4f99f-cc87-4155-af1e-7e63973926b9" released by "delete_volume" :: held 2.462s {{(pid=92060) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 04:38:38 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-6e70b230-ce4a-4b9b-9d38-69303846017a tempest-GroupSnapshotsTest-2072112239 None] Acquiring lock "cinder-quobyte-7aa4ca9b-afcd-475c-9841-1d3a078d21e1" by "delete_volume" {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 04:38:38 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-6e70b230-ce4a-4b9b-9d38-69303846017a tempest-GroupSnapshotsTest-2072112239 None] Lock "cinder-quobyte-7aa4ca9b-afcd-475c-9841-1d3a078d21e1" acquired by "delete_volume" :: waited 0.017s {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 04:38:38 devstack cinder-volume[92060]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a02096b-8907-4c8f-8950-d43017284b91]: (4, 'qcow2') {{(pid=93130) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 04:38:38 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-6e70b230-ce4a-4b9b-9d38-69303846017a tempest-GroupSnapshotsTest-2072112239 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-7aa4ca9b-afcd-475c-9841-1d3a078d21e1 {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:38:38 devstack sudo[96129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-7aa4ca9b-afcd-475c-9841-1d3a078d21e1 Jun 17 04:38:38 devstack sudo[96129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:38:39 devstack sudo[96129]: pam_unix(sudo:session): session closed for user root Jun 17 04:38:39 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-6e70b230-ce4a-4b9b-9d38-69303846017a tempest-GroupSnapshotsTest-2072112239 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-7aa4ca9b-afcd-475c-9841-1d3a078d21e1" returned: 0 in 0.832s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:38:39 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-6e70b230-ce4a-4b9b-9d38-69303846017a tempest-GroupSnapshotsTest-2072112239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-7aa4ca9b-afcd-475c-9841-1d3a078d21e1 {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:38:39 devstack sudo[96135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-7aa4ca9b-afcd-475c-9841-1d3a078d21e1 Jun 17 04:38:39 devstack sudo[96135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:38:39 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [req-0c6066f4-524b-4dd2-9239-ca460bdeb5f8 req-55dd06dd-4464-4935-ac4d-23f1c1e1ae77 tempest-ServerActionsTestOtherA-1987628563 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 04:38:39 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [req-0c6066f4-524b-4dd2-9239-ca460bdeb5f8 req-55dd06dd-4464-4935-ac4d-23f1c1e1ae77 tempest-ServerActionsTestOtherA-1987628563 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 04:38:39 devstack cinder-volume[92060]: DEBUG oslo.privsep.daemon [-] privsep: reply[e91f7e67-c060-4172-a460-cdf4e8837b59]: (4, 'qcow2') {{(pid=93130) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 04:38:39 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [req-0c6066f4-524b-4dd2-9239-ca460bdeb5f8 req-55dd06dd-4464-4935-ac4d-23f1c1e1ae77 tempest-ServerActionsTestOtherA-1987628563 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-87612384-1fa0-40a0-b4fb-f5570b67b53a {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:38:40 devstack sudo[96145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-87612384-1fa0-40a0-b4fb-f5570b67b53a Jun 17 04:38:40 devstack sudo[96145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:38:40 devstack sudo[96135]: pam_unix(sudo:session): session closed for user root Jun 17 04:38:40 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-6e70b230-ce4a-4b9b-9d38-69303846017a tempest-GroupSnapshotsTest-2072112239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-7aa4ca9b-afcd-475c-9841-1d3a078d21e1" returned: 0 in 0.801s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:38:40 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-6e70b230-ce4a-4b9b-9d38-69303846017a tempest-GroupSnapshotsTest-2072112239 None] Lock "cinder-quobyte-7aa4ca9b-afcd-475c-9841-1d3a078d21e1" released by "delete_volume" :: held 1.716s {{(pid=92060) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 04:38:40 devstack cinder-volume[92060]: DEBUG cinder.quota [None req-6e70b230-ce4a-4b9b-9d38-69303846017a tempest-GroupSnapshotsTest-2072112239 None] Created reservations ['2af92203-f0b6-468e-b09c-c03d2386f61a'] {{(pid=92060) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 17 04:38:40 devstack cinder-volume[92060]: WARNING cinder.quota [None req-6e70b230-ce4a-4b9b-9d38-69303846017a tempest-GroupSnapshotsTest-2072112239 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1100659435 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1100659435, it is now deprecated. Please use the default quota class for default quota. Jun 17 04:38:40 devstack cinder-volume[92060]: DEBUG cinder.quota [None req-6e70b230-ce4a-4b9b-9d38-69303846017a tempest-GroupSnapshotsTest-2072112239 None] Created reservations ['aa77ddb1-1f5b-40d9-b70a-96837e8163c4', '1c3fd62c-2364-4de8-83fd-ee36e012f6c2', 'ee9bde71-747b-4ffb-9109-4ba24c114cfe', '38641a21-e291-4645-ac80-c33507641121'] {{(pid=92060) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 17 04:38:40 devstack cinder-volume[92060]: DEBUG cinder.quota [None req-6e70b230-ce4a-4b9b-9d38-69303846017a tempest-GroupSnapshotsTest-2072112239 None] Created reservations ['cc390b3c-f292-46c9-8917-21b9c424c72b', '9527449e-cfbd-4bf9-a4b5-68cebc57b8a1', '66a3e794-a0a4-44ef-9eef-6c90359b5a8f', '589a0b67-7809-4727-ac50-ee174149979b'] {{(pid=92060) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 17 04:38:40 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-6e70b230-ce4a-4b9b-9d38-69303846017a tempest-GroupSnapshotsTest-2072112239 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 04:38:40 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-6e70b230-ce4a-4b9b-9d38-69303846017a tempest-GroupSnapshotsTest-2072112239 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.014s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 04:38:40 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-6e70b230-ce4a-4b9b-9d38-69303846017a tempest-GroupSnapshotsTest-2072112239 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588': None} {{(pid=92060) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 17 04:38:40 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-6e70b230-ce4a-4b9b-9d38-69303846017a tempest-GroupSnapshotsTest-2072112239 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588'] {{(pid=92060) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 17 04:38:40 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-6e70b230-ce4a-4b9b-9d38-69303846017a tempest-GroupSnapshotsTest-2072112239 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.040s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 04:38:40 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-6e70b230-ce4a-4b9b-9d38-69303846017a tempest-GroupSnapshotsTest-2072112239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:38:40 devstack sudo[96152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a Jun 17 04:38:40 devstack sudo[96152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:38:40 devstack sudo[96145]: pam_unix(sudo:session): session closed for user root Jun 17 04:38:40 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [req-0c6066f4-524b-4dd2-9239-ca460bdeb5f8 req-55dd06dd-4464-4935-ac4d-23f1c1e1ae77 tempest-ServerActionsTestOtherA-1987628563 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-87612384-1fa0-40a0-b4fb-f5570b67b53a" returned: 0 in 1.074s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:38:40 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [req-0c6066f4-524b-4dd2-9239-ca460bdeb5f8 req-55dd06dd-4464-4935-ac4d-23f1c1e1ae77 tempest-ServerActionsTestOtherA-1987628563 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.101s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 04:38:41 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [req-0c6066f4-524b-4dd2-9239-ca460bdeb5f8 req-55dd06dd-4464-4935-ac4d-23f1c1e1ae77 tempest-ServerActionsTestOtherA-1987628563 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588', 'name': 'volume-87612384-1fa0-40a0-b4fb-f5570b67b53a', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '36c3abd6-39ed-450d-a492-e426a94ad17a', 'enforce_multipath': True} {{(pid=92060) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 17 04:38:41 devstack cinder-volume[92060]: INFO cinder.volume.manager [req-0c6066f4-524b-4dd2-9239-ca460bdeb5f8 req-55dd06dd-4464-4935-ac4d-23f1c1e1ae77 tempest-ServerActionsTestOtherA-1987628563 None] attachment_update completed successfully. Jun 17 04:38:41 devstack cinder-volume[92060]: INFO cinder.volume.manager [None req-29a758fa-b126-4077-ba3e-ee56048d7dde tempest-GroupSnapshotsTest-2072112239 None] Group tempest-GroupSnapshotsTest-Group-388003759: creating Jun 17 04:38:41 devstack cinder-volume[92060]: INFO cinder.volume.manager [None req-29a758fa-b126-4077-ba3e-ee56048d7dde tempest-GroupSnapshotsTest-2072112239 None] Group tempest-GroupSnapshotsTest-Group-388003759: created successfully Jun 17 04:38:41 devstack cinder-volume[92060]: INFO cinder.volume.manager [None req-29a758fa-b126-4077-ba3e-ee56048d7dde tempest-GroupSnapshotsTest-2072112239 None] Create group completed successfully. Jun 17 04:38:41 devstack sudo[96152]: pam_unix(sudo:session): session closed for user root Jun 17 04:38:41 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-6e70b230-ce4a-4b9b-9d38-69303846017a tempest-GroupSnapshotsTest-2072112239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a" returned: 0 in 0.968s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:38:41 devstack cinder-volume[92060]: DEBUG cinder.manager [None req-6e70b230-ce4a-4b9b-9d38-69303846017a tempest-GroupSnapshotsTest-2072112239 None] Notifying Schedulers of capabilities ... {{(pid=92060) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 17 04:38:41 devstack cinder-volume[92060]: INFO cinder.volume.manager [None req-6e70b230-ce4a-4b9b-9d38-69303846017a tempest-GroupSnapshotsTest-2072112239 None] Delete group completed successfully. Jun 17 04:38:43 devstack cinder-volume[92060]: DEBUG cinder.volume.flows.manager.create_volume [None req-244b9704-c2b3-408c-89a4-a5cfa73d0b0f tempest-GroupSnapshotsTest-2072112239 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92060) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 17 04:38:43 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-244b9704-c2b3-408c-89a4-a5cfa73d0b0f tempest-GroupSnapshotsTest-2072112239 None] Flow 'volume_create_manager' (51a1e5e3-ed58-4375-85a8-cf896b50b418) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 17 04:38:43 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-244b9704-c2b3-408c-89a4-a5cfa73d0b0f tempest-GroupSnapshotsTest-2072112239 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (781e1e67-d9a9-45cf-90a8-f08ad3c4d07b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:38:43 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-244b9704-c2b3-408c-89a4-a5cfa73d0b0f tempest-GroupSnapshotsTest-2072112239 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (781e1e67-d9a9-45cf-90a8-f08ad3c4d07b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-17T02:38:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1984661329',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=436d1048-a650-4fda-9e66-a30b47fb4c32,host='devstack@QuobyteHD#QuobyteHD',id=76ee8fa0-fdc3-43fe-b0a1-6b5a3cc626c2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e16b050b2b1f4789a93c0fd072e157c7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T02:38:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T02:38:43Z,use_quota=True,user_id='e22a2c2c4660479797c6f7cb8a003c1f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(072b707a-213d-46fc-9a01-d28b973d9b66),volume_type_id=072b707a-213d-46fc-9a01-d28b973d9b66)' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:38:43 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-244b9704-c2b3-408c-89a4-a5cfa73d0b0f tempest-GroupSnapshotsTest-2072112239 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (faf5343b-bff2-4395-98f1-40fdedd0641b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:38:43 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-244b9704-c2b3-408c-89a4-a5cfa73d0b0f tempest-GroupSnapshotsTest-2072112239 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (faf5343b-bff2-4395-98f1-40fdedd0641b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:38:43 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-244b9704-c2b3-408c-89a4-a5cfa73d0b0f tempest-GroupSnapshotsTest-2072112239 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fa0be7b3-fb0f-4ac0-9054-d20ef4bd4515) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:38:43 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-244b9704-c2b3-408c-89a4-a5cfa73d0b0f tempest-GroupSnapshotsTest-2072112239 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fa0be7b3-fb0f-4ac0-9054-d20ef4bd4515) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '76ee8fa0-fdc3-43fe-b0a1-6b5a3cc626c2', 'volume_name': 'volume-76ee8fa0-fdc3-43fe-b0a1-6b5a3cc626c2', 'volume_size': 1}' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:38:43 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-244b9704-c2b3-408c-89a4-a5cfa73d0b0f tempest-GroupSnapshotsTest-2072112239 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f11aab0d-35a0-4076-8fd2-4b7be78279ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:38:43 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-244b9704-c2b3-408c-89a4-a5cfa73d0b0f tempest-GroupSnapshotsTest-2072112239 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f11aab0d-35a0-4076-8fd2-4b7be78279ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:38:43 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-244b9704-c2b3-408c-89a4-a5cfa73d0b0f tempest-GroupSnapshotsTest-2072112239 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dfd11b5b-24d5-44b6-8e08-8d3335b5f335) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:38:43 devstack cinder-volume[92060]: INFO cinder.volume.flows.manager.create_volume [None req-244b9704-c2b3-408c-89a4-a5cfa73d0b0f tempest-GroupSnapshotsTest-2072112239 None] Volume 76ee8fa0-fdc3-43fe-b0a1-6b5a3cc626c2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-76ee8fa0-fdc3-43fe-b0a1-6b5a3cc626c2', 'volume_size': 1} Jun 17 04:38:43 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-244b9704-c2b3-408c-89a4-a5cfa73d0b0f tempest-GroupSnapshotsTest-2072112239 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 04:38:43 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-244b9704-c2b3-408c-89a4-a5cfa73d0b0f tempest-GroupSnapshotsTest-2072112239 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 04:38:43 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-244b9704-c2b3-408c-89a4-a5cfa73d0b0f tempest-GroupSnapshotsTest-2072112239 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=436d1048-a650-4fda-9e66-a30b47fb4c32,created_at=2026-06-17T02:38:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1984661329',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=436d1048-a650-4fda-9e66-a30b47fb4c32,host='devstack@QuobyteHD#QuobyteHD',id=76ee8fa0-fdc3-43fe-b0a1-6b5a3cc626c2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e16b050b2b1f4789a93c0fd072e157c7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T02:38:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T02:38:43Z,use_quota=True,user_id='e22a2c2c4660479797c6f7cb8a003c1f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(072b707a-213d-46fc-9a01-d28b973d9b66),volume_type_id=072b707a-213d-46fc-9a01-d28b973d9b66)}" {{(pid=92060) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 17 04:38:43 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.remotefs [None req-244b9704-c2b3-408c-89a4-a5cfa73d0b0f tempest-GroupSnapshotsTest-2072112239 None] Creating volume 76ee8fa0-fdc3-43fe-b0a1-6b5a3cc626c2 {{(pid=92060) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 17 04:38:43 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-244b9704-c2b3-408c-89a4-a5cfa73d0b0f tempest-GroupSnapshotsTest-2072112239 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 04:38:43 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-244b9704-c2b3-408c-89a4-a5cfa73d0b0f tempest-GroupSnapshotsTest-2072112239 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 04:38:43 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-244b9704-c2b3-408c-89a4-a5cfa73d0b0f tempest-GroupSnapshotsTest-2072112239 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588': None} {{(pid=92060) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 17 04:38:43 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-244b9704-c2b3-408c-89a4-a5cfa73d0b0f tempest-GroupSnapshotsTest-2072112239 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588'] {{(pid=92060) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 17 04:38:43 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-244b9704-c2b3-408c-89a4-a5cfa73d0b0f tempest-GroupSnapshotsTest-2072112239 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 04:38:43 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-244b9704-c2b3-408c-89a4-a5cfa73d0b0f tempest-GroupSnapshotsTest-2072112239 None] Selected osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588 as target Quobyte volume. {{(pid=92060) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 17 04:38:43 devstack cinder-volume[92060]: INFO cinder.volume.drivers.remotefs [None req-244b9704-c2b3-408c-89a4-a5cfa73d0b0f tempest-GroupSnapshotsTest-2072112239 None] casted to osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588 Jun 17 04:38:43 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-244b9704-c2b3-408c-89a4-a5cfa73d0b0f tempest-GroupSnapshotsTest-2072112239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-76ee8fa0-fdc3-43fe-b0a1-6b5a3cc626c2 1073741824 {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:38:43 devstack sudo[96156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-76ee8fa0-fdc3-43fe-b0a1-6b5a3cc626c2 1073741824 Jun 17 04:38:43 devstack sudo[96156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:38:44 devstack sudo[96156]: pam_unix(sudo:session): session closed for user root Jun 17 04:38:44 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-244b9704-c2b3-408c-89a4-a5cfa73d0b0f tempest-GroupSnapshotsTest-2072112239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-76ee8fa0-fdc3-43fe-b0a1-6b5a3cc626c2 1073741824" returned: 0 in 1.144s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:38:44 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-244b9704-c2b3-408c-89a4-a5cfa73d0b0f tempest-GroupSnapshotsTest-2072112239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-76ee8fa0-fdc3-43fe-b0a1-6b5a3cc626c2 {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:38:44 devstack sudo[96177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-76ee8fa0-fdc3-43fe-b0a1-6b5a3cc626c2 Jun 17 04:38:44 devstack sudo[96177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:38:44 devstack cinder-volume[92060]: DEBUG oslo_service.periodic_task [None req-60d279ad-ad8c-4d36-a4b8-f593e74fb922 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=92060) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 17 04:38:44 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-60d279ad-ad8c-4d36-a4b8-f593e74fb922 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 04:38:44 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-60d279ad-ad8c-4d36-a4b8-f593e74fb922 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 04:38:44 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-60d279ad-ad8c-4d36-a4b8-f593e74fb922 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588': None} {{(pid=92060) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 17 04:38:44 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-60d279ad-ad8c-4d36-a4b8-f593e74fb922 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588'] {{(pid=92060) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 17 04:38:44 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-60d279ad-ad8c-4d36-a4b8-f593e74fb922 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 04:38:44 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-60d279ad-ad8c-4d36-a4b8-f593e74fb922 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:38:44 devstack sudo[96180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a Jun 17 04:38:44 devstack sudo[96180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:38:45 devstack sudo[96177]: pam_unix(sudo:session): session closed for user root Jun 17 04:38:45 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-244b9704-c2b3-408c-89a4-a5cfa73d0b0f tempest-GroupSnapshotsTest-2072112239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-76ee8fa0-fdc3-43fe-b0a1-6b5a3cc626c2" returned: 0 in 0.805s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:38:45 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-244b9704-c2b3-408c-89a4-a5cfa73d0b0f tempest-GroupSnapshotsTest-2072112239 None] <== create_volume: return (1997ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588'} {{(pid=92060) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 17 04:38:45 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-244b9704-c2b3-408c-89a4-a5cfa73d0b0f tempest-GroupSnapshotsTest-2072112239 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.999s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 04:38:45 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-244b9704-c2b3-408c-89a4-a5cfa73d0b0f tempest-GroupSnapshotsTest-2072112239 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dfd11b5b-24d5-44b6-8e08-8d3335b5f335) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-76ee8fa0-fdc3-43fe-b0a1-6b5a3cc626c2', 'volume_size': 1}' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:38:45 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-244b9704-c2b3-408c-89a4-a5cfa73d0b0f tempest-GroupSnapshotsTest-2072112239 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f4a9aec9-38e4-4571-b908-22bde49bad52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:38:45 devstack cinder-volume[92060]: INFO cinder.volume.flows.manager.create_volume [None req-244b9704-c2b3-408c-89a4-a5cfa73d0b0f tempest-GroupSnapshotsTest-2072112239 None] Volume volume-76ee8fa0-fdc3-43fe-b0a1-6b5a3cc626c2 (76ee8fa0-fdc3-43fe-b0a1-6b5a3cc626c2): created successfully Jun 17 04:38:45 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-244b9704-c2b3-408c-89a4-a5cfa73d0b0f tempest-GroupSnapshotsTest-2072112239 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f4a9aec9-38e4-4571-b908-22bde49bad52) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:38:45 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-244b9704-c2b3-408c-89a4-a5cfa73d0b0f tempest-GroupSnapshotsTest-2072112239 None] Flow 'volume_create_manager' (51a1e5e3-ed58-4375-85a8-cf896b50b418) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92060) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 17 04:38:45 devstack cinder-volume[92060]: INFO cinder.volume.manager [None req-244b9704-c2b3-408c-89a4-a5cfa73d0b0f tempest-GroupSnapshotsTest-2072112239 None] Created volume successfully. Jun 17 04:38:45 devstack cinder-volume[92060]: INFO cinder.volume.manager [None req-1471d883-ea18-42d9-8c45-5e02cfd577d9 tempest-GroupSnapshotsTest-2072112239 None] GroupSnapshot b1c11c18-b6a1-4328-8f3d-965551ddd1e4: creating. Jun 17 04:38:45 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-1471d883-ea18-42d9-8c45-5e02cfd577d9 tempest-GroupSnapshotsTest-2072112239 None] Group snapshot b1c11c18-b6a1-4328-8f3d-965551ddd1e4: creating. {{(pid=92060) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Jun 17 04:38:45 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-1471d883-ea18-42d9-8c45-5e02cfd577d9 tempest-GroupSnapshotsTest-2072112239 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 04:38:45 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-1471d883-ea18-42d9-8c45-5e02cfd577d9 tempest-GroupSnapshotsTest-2072112239 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 04:38:45 devstack sudo[96180]: pam_unix(sudo:session): session closed for user root Jun 17 04:38:45 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-60d279ad-ad8c-4d36-a4b8-f593e74fb922 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a" returned: 0 in 0.829s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:38:45 devstack cinder-volume[92060]: DEBUG cinder.manager [None req-60d279ad-ad8c-4d36-a4b8-f593e74fb922 None None] Notifying Schedulers of capabilities ... {{(pid=92060) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 17 04:38:45 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.remotefs [None req-1471d883-ea18-42d9-8c45-5e02cfd577d9 tempest-GroupSnapshotsTest-2072112239 None] Creating offline snapshot 50f17a54-c4e8-41c5-8dd4-01b388c5ed95 of volume 76ee8fa0-fdc3-43fe-b0a1-6b5a3cc626c2 {{(pid=92060) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 17 04:38:45 devstack cinder-volume[92060]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c91fcf1-fe98-41f0-8a28-213589e086f4]: (4, 'qcow2') {{(pid=93130) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 04:38:45 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-1471d883-ea18-42d9-8c45-5e02cfd577d9 tempest-GroupSnapshotsTest-2072112239 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-76ee8fa0-fdc3-43fe-b0a1-6b5a3cc626c2 {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:38:45 devstack sudo[96186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-76ee8fa0-fdc3-43fe-b0a1-6b5a3cc626c2 Jun 17 04:38:45 devstack sudo[96186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:38:46 devstack sudo[96186]: pam_unix(sudo:session): session closed for user root Jun 17 04:38:46 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-1471d883-ea18-42d9-8c45-5e02cfd577d9 tempest-GroupSnapshotsTest-2072112239 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-76ee8fa0-fdc3-43fe-b0a1-6b5a3cc626c2" returned: 0 in 0.909s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:38:46 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-1471d883-ea18-42d9-8c45-5e02cfd577d9 tempest-GroupSnapshotsTest-2072112239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-76ee8fa0-fdc3-43fe-b0a1-6b5a3cc626c2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-76ee8fa0-fdc3-43fe-b0a1-6b5a3cc626c2.50f17a54-c4e8-41c5-8dd4-01b388c5ed95 1G {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:38:46 devstack sudo[96192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-76ee8fa0-fdc3-43fe-b0a1-6b5a3cc626c2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-76ee8fa0-fdc3-43fe-b0a1-6b5a3cc626c2.50f17a54-c4e8-41c5-8dd4-01b388c5ed95 1G Jun 17 04:38:46 devstack sudo[96192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:38:48 devstack sudo[96192]: pam_unix(sudo:session): session closed for user root Jun 17 04:38:48 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-1471d883-ea18-42d9-8c45-5e02cfd577d9 tempest-GroupSnapshotsTest-2072112239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-76ee8fa0-fdc3-43fe-b0a1-6b5a3cc626c2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-76ee8fa0-fdc3-43fe-b0a1-6b5a3cc626c2.50f17a54-c4e8-41c5-8dd4-01b388c5ed95 1G" returned: 0 in 1.696s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:38:48 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-1471d883-ea18-42d9-8c45-5e02cfd577d9 tempest-GroupSnapshotsTest-2072112239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-76ee8fa0-fdc3-43fe-b0a1-6b5a3cc626c2 -F qcow2 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-76ee8fa0-fdc3-43fe-b0a1-6b5a3cc626c2.50f17a54-c4e8-41c5-8dd4-01b388c5ed95 {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:38:48 devstack sudo[96278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-76ee8fa0-fdc3-43fe-b0a1-6b5a3cc626c2 -F qcow2 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-76ee8fa0-fdc3-43fe-b0a1-6b5a3cc626c2.50f17a54-c4e8-41c5-8dd4-01b388c5ed95 Jun 17 04:38:48 devstack sudo[96278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:38:49 devstack sudo[96278]: pam_unix(sudo:session): session closed for user root Jun 17 04:38:49 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-1471d883-ea18-42d9-8c45-5e02cfd577d9 tempest-GroupSnapshotsTest-2072112239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-76ee8fa0-fdc3-43fe-b0a1-6b5a3cc626c2 -F qcow2 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-76ee8fa0-fdc3-43fe-b0a1-6b5a3cc626c2.50f17a54-c4e8-41c5-8dd4-01b388c5ed95" returned: 0 in 0.922s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:38:49 devstack cinder-volume[92060]: WARNING cinder.volume.drivers.remotefs [None req-1471d883-ea18-42d9-8c45-5e02cfd577d9 tempest-GroupSnapshotsTest-2072112239 None] /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-76ee8fa0-fdc3-43fe-b0a1-6b5a3cc626c2.50f17a54-c4e8-41c5-8dd4-01b388c5ed95 is being set with open permissions: ugo+rw: NotImplementedError Jun 17 04:38:49 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-1471d883-ea18-42d9-8c45-5e02cfd577d9 tempest-GroupSnapshotsTest-2072112239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-76ee8fa0-fdc3-43fe-b0a1-6b5a3cc626c2.50f17a54-c4e8-41c5-8dd4-01b388c5ed95 {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:38:49 devstack sudo[96284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-76ee8fa0-fdc3-43fe-b0a1-6b5a3cc626c2.50f17a54-c4e8-41c5-8dd4-01b388c5ed95 Jun 17 04:38:49 devstack sudo[96284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:38:50 devstack sudo[96284]: pam_unix(sudo:session): session closed for user root Jun 17 04:38:50 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-1471d883-ea18-42d9-8c45-5e02cfd577d9 tempest-GroupSnapshotsTest-2072112239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-76ee8fa0-fdc3-43fe-b0a1-6b5a3cc626c2.50f17a54-c4e8-41c5-8dd4-01b388c5ed95" returned: 0 in 0.844s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:38:50 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-1471d883-ea18-42d9-8c45-5e02cfd577d9 tempest-GroupSnapshotsTest-2072112239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-76ee8fa0-fdc3-43fe-b0a1-6b5a3cc626c2.info {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:38:50 devstack sudo[96288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-76ee8fa0-fdc3-43fe-b0a1-6b5a3cc626c2.info Jun 17 04:38:50 devstack sudo[96288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:38:51 devstack sudo[96288]: pam_unix(sudo:session): session closed for user root Jun 17 04:38:51 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-1471d883-ea18-42d9-8c45-5e02cfd577d9 tempest-GroupSnapshotsTest-2072112239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-76ee8fa0-fdc3-43fe-b0a1-6b5a3cc626c2.info" returned: 0 in 1.040s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:38:51 devstack cinder-volume[92060]: WARNING cinder.volume.drivers.remotefs [None req-1471d883-ea18-42d9-8c45-5e02cfd577d9 tempest-GroupSnapshotsTest-2072112239 None] /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-76ee8fa0-fdc3-43fe-b0a1-6b5a3cc626c2.info is being set with open permissions: ugo+rw: NotImplementedError Jun 17 04:38:51 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-1471d883-ea18-42d9-8c45-5e02cfd577d9 tempest-GroupSnapshotsTest-2072112239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-76ee8fa0-fdc3-43fe-b0a1-6b5a3cc626c2.info {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:38:51 devstack sudo[96292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-76ee8fa0-fdc3-43fe-b0a1-6b5a3cc626c2.info Jun 17 04:38:51 devstack sudo[96292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:38:52 devstack sudo[96292]: pam_unix(sudo:session): session closed for user root Jun 17 04:38:52 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-1471d883-ea18-42d9-8c45-5e02cfd577d9 tempest-GroupSnapshotsTest-2072112239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-76ee8fa0-fdc3-43fe-b0a1-6b5a3cc626c2.info" returned: 0 in 0.927s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:38:52 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-1471d883-ea18-42d9-8c45-5e02cfd577d9 tempest-GroupSnapshotsTest-2072112239 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 6.462s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 04:38:52 devstack cinder-volume[92060]: INFO cinder.volume.manager [None req-1471d883-ea18-42d9-8c45-5e02cfd577d9 tempest-GroupSnapshotsTest-2072112239 None] group_snapshot b1c11c18-b6a1-4328-8f3d-965551ddd1e4: created successfully Jun 17 04:38:53 devstack cinder-volume[92060]: INFO cinder.volume.manager [None req-cc4e66b2-5f49-4e3f-92f2-f44492e4819f tempest-GroupSnapshotsTest-2072112239 None] group_snapshot b1c11c18-b6a1-4328-8f3d-965551ddd1e4: deleting Jun 17 04:38:53 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-cc4e66b2-5f49-4e3f-92f2-f44492e4819f tempest-GroupSnapshotsTest-2072112239 None] group_snapshot b1c11c18-b6a1-4328-8f3d-965551ddd1e4: deleting {{(pid=92060) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Jun 17 04:38:53 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-cc4e66b2-5f49-4e3f-92f2-f44492e4819f tempest-GroupSnapshotsTest-2072112239 None] Acquiring lock "cinder-quobyte-76ee8fa0-fdc3-43fe-b0a1-6b5a3cc626c2" by "delete_snapshot" {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 04:38:53 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-cc4e66b2-5f49-4e3f-92f2-f44492e4819f tempest-GroupSnapshotsTest-2072112239 None] Lock "cinder-quobyte-76ee8fa0-fdc3-43fe-b0a1-6b5a3cc626c2" acquired by "delete_snapshot" :: waited 0.019s {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 04:38:53 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-cc4e66b2-5f49-4e3f-92f2-f44492e4819f tempest-GroupSnapshotsTest-2072112239 None] Acquiring lock "cinder-quobyte-50f17a54-c4e8-41c5-8dd4-01b388c5ed95" by "_delete_snapshot" {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 04:38:53 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-cc4e66b2-5f49-4e3f-92f2-f44492e4819f tempest-GroupSnapshotsTest-2072112239 None] Lock "cinder-quobyte-50f17a54-c4e8-41c5-8dd4-01b388c5ed95" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 04:38:53 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.remotefs [None req-cc4e66b2-5f49-4e3f-92f2-f44492e4819f tempest-GroupSnapshotsTest-2072112239 None] Deleting offline snapshot 50f17a54-c4e8-41c5-8dd4-01b388c5ed95 of volume 76ee8fa0-fdc3-43fe-b0a1-6b5a3cc626c2 {{(pid=92060) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 17 04:38:53 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.remotefs [None req-cc4e66b2-5f49-4e3f-92f2-f44492e4819f tempest-GroupSnapshotsTest-2072112239 None] snapshot_file for this snap is: volume-76ee8fa0-fdc3-43fe-b0a1-6b5a3cc626c2.50f17a54-c4e8-41c5-8dd4-01b388c5ed95 {{(pid=92060) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 17 04:38:53 devstack cinder-volume[92060]: DEBUG oslo.privsep.daemon [-] privsep: reply[56f1bf4e-7e78-4d2d-a611-f9e923a2fdc7]: (4, 'qcow2') {{(pid=93130) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 04:38:53 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-cc4e66b2-5f49-4e3f-92f2-f44492e4819f tempest-GroupSnapshotsTest-2072112239 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-76ee8fa0-fdc3-43fe-b0a1-6b5a3cc626c2.50f17a54-c4e8-41c5-8dd4-01b388c5ed95 {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:38:53 devstack sudo[96298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-76ee8fa0-fdc3-43fe-b0a1-6b5a3cc626c2.50f17a54-c4e8-41c5-8dd4-01b388c5ed95 Jun 17 04:38:53 devstack sudo[96298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:38:54 devstack sudo[96298]: pam_unix(sudo:session): session closed for user root Jun 17 04:38:54 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-cc4e66b2-5f49-4e3f-92f2-f44492e4819f tempest-GroupSnapshotsTest-2072112239 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-76ee8fa0-fdc3-43fe-b0a1-6b5a3cc626c2.50f17a54-c4e8-41c5-8dd4-01b388c5ed95" returned: 0 in 0.880s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:38:54 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.remotefs [None req-cc4e66b2-5f49-4e3f-92f2-f44492e4819f tempest-GroupSnapshotsTest-2072112239 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-76ee8fa0-fdc3-43fe-b0a1-6b5a3cc626c2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=92060) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 17 04:38:54 devstack cinder-volume[92060]: DEBUG oslo.privsep.daemon [-] privsep: reply[784e2b67-aa22-45c1-8be0-db0dd9f0c633]: (4, 'qcow2') {{(pid=93130) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 04:38:54 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-cc4e66b2-5f49-4e3f-92f2-f44492e4819f tempest-GroupSnapshotsTest-2072112239 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-76ee8fa0-fdc3-43fe-b0a1-6b5a3cc626c2 {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:38:54 devstack sudo[96305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-76ee8fa0-fdc3-43fe-b0a1-6b5a3cc626c2 Jun 17 04:38:54 devstack sudo[96305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:38:55 devstack sudo[96305]: pam_unix(sudo:session): session closed for user root Jun 17 04:38:55 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-cc4e66b2-5f49-4e3f-92f2-f44492e4819f tempest-GroupSnapshotsTest-2072112239 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-76ee8fa0-fdc3-43fe-b0a1-6b5a3cc626c2" returned: 0 in 0.780s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:38:55 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-cc4e66b2-5f49-4e3f-92f2-f44492e4819f tempest-GroupSnapshotsTest-2072112239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-76ee8fa0-fdc3-43fe-b0a1-6b5a3cc626c2.50f17a54-c4e8-41c5-8dd4-01b388c5ed95 {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:38:55 devstack sudo[96311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-76ee8fa0-fdc3-43fe-b0a1-6b5a3cc626c2.50f17a54-c4e8-41c5-8dd4-01b388c5ed95 Jun 17 04:38:55 devstack sudo[96311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:38:56 devstack sudo[96311]: pam_unix(sudo:session): session closed for user root Jun 17 04:38:56 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-cc4e66b2-5f49-4e3f-92f2-f44492e4819f tempest-GroupSnapshotsTest-2072112239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-76ee8fa0-fdc3-43fe-b0a1-6b5a3cc626c2.50f17a54-c4e8-41c5-8dd4-01b388c5ed95" returned: 0 in 0.923s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:38:56 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-cc4e66b2-5f49-4e3f-92f2-f44492e4819f tempest-GroupSnapshotsTest-2072112239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-76ee8fa0-fdc3-43fe-b0a1-6b5a3cc626c2.50f17a54-c4e8-41c5-8dd4-01b388c5ed95 {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:38:56 devstack sudo[96316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-76ee8fa0-fdc3-43fe-b0a1-6b5a3cc626c2.50f17a54-c4e8-41c5-8dd4-01b388c5ed95 Jun 17 04:38:56 devstack sudo[96316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:38:57 devstack sudo[96316]: pam_unix(sudo:session): session closed for user root Jun 17 04:38:57 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-cc4e66b2-5f49-4e3f-92f2-f44492e4819f tempest-GroupSnapshotsTest-2072112239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-76ee8fa0-fdc3-43fe-b0a1-6b5a3cc626c2.50f17a54-c4e8-41c5-8dd4-01b388c5ed95" returned: 0 in 0.938s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:38:57 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-cc4e66b2-5f49-4e3f-92f2-f44492e4819f tempest-GroupSnapshotsTest-2072112239 None] Lock "cinder-quobyte-50f17a54-c4e8-41c5-8dd4-01b388c5ed95" released by "_delete_snapshot" :: held 3.656s {{(pid=92060) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 04:38:57 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-cc4e66b2-5f49-4e3f-92f2-f44492e4819f tempest-GroupSnapshotsTest-2072112239 None] Lock "cinder-quobyte-76ee8fa0-fdc3-43fe-b0a1-6b5a3cc626c2" released by "delete_snapshot" :: held 3.686s {{(pid=92060) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 04:38:57 devstack cinder-volume[92060]: WARNING cinder.quota [None req-cc4e66b2-5f49-4e3f-92f2-f44492e4819f tempest-GroupSnapshotsTest-2072112239 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1822469955 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1822469955, it is now deprecated. Please use the default quota class for default quota. Jun 17 04:38:57 devstack cinder-volume[92060]: WARNING cinder.quota [None req-cc4e66b2-5f49-4e3f-92f2-f44492e4819f tempest-GroupSnapshotsTest-2072112239 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1822469955 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1822469955, it is now deprecated. Please use the default quota class for default quota. Jun 17 04:38:57 devstack cinder-volume[92060]: DEBUG cinder.quota [None req-cc4e66b2-5f49-4e3f-92f2-f44492e4819f tempest-GroupSnapshotsTest-2072112239 None] Created reservations ['c2eccdda-88af-499e-baf4-c5a7e846cc29', 'f20e6772-bd95-4007-a757-b3d120637a36', '6f6d5e16-1851-41fb-86e9-3ddab4550b38', '3c5aae4b-c2a3-4018-b0ab-3c74f18fbfb5'] {{(pid=92060) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 17 04:38:57 devstack cinder-volume[92060]: INFO cinder.volume.manager [None req-cc4e66b2-5f49-4e3f-92f2-f44492e4819f tempest-GroupSnapshotsTest-2072112239 None] group_snapshot b1c11c18-b6a1-4328-8f3d-965551ddd1e4: deleted successfully Jun 17 04:38:58 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-b363e351-d27f-4d5c-8d5f-f96ead2d0b45 tempest-GroupSnapshotsTest-2072112239 None] Acquiring lock "cinder-quobyte-76ee8fa0-fdc3-43fe-b0a1-6b5a3cc626c2" by "delete_volume" {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 04:38:58 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-b363e351-d27f-4d5c-8d5f-f96ead2d0b45 tempest-GroupSnapshotsTest-2072112239 None] Lock "cinder-quobyte-76ee8fa0-fdc3-43fe-b0a1-6b5a3cc626c2" acquired by "delete_volume" :: waited 0.030s {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 04:38:58 devstack cinder-volume[92060]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c7a607d-6aac-4003-81dc-f0b7334996e7]: (4, 'qcow2') {{(pid=93130) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 04:38:58 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-b363e351-d27f-4d5c-8d5f-f96ead2d0b45 tempest-GroupSnapshotsTest-2072112239 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-76ee8fa0-fdc3-43fe-b0a1-6b5a3cc626c2 {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:38:58 devstack cinder-volume[92060]: INFO cinder.volume.manager [req-f09dd356-1b36-4290-8337-f430df204ea1 req-ebbcbf9c-c92f-41e7-8e9e-e418f1e35ad0 tempest-AttachVolumeShelveTestJSON-134363980 None] Terminate volume connection completed successfully. Jun 17 04:38:58 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [req-f09dd356-1b36-4290-8337-f430df204ea1 req-ebbcbf9c-c92f-41e7-8e9e-e418f1e35ad0 tempest-AttachVolumeShelveTestJSON-134363980 None] Deleting attachment 6ed1571f-cfda-4dbb-95b9-03c238076017. {{(pid=92060) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 17 04:38:58 devstack sudo[96323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-76ee8fa0-fdc3-43fe-b0a1-6b5a3cc626c2 Jun 17 04:38:58 devstack sudo[96323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:38:59 devstack sudo[96323]: pam_unix(sudo:session): session closed for user root Jun 17 04:38:59 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-b363e351-d27f-4d5c-8d5f-f96ead2d0b45 tempest-GroupSnapshotsTest-2072112239 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-76ee8fa0-fdc3-43fe-b0a1-6b5a3cc626c2" returned: 0 in 0.976s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:38:59 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-b363e351-d27f-4d5c-8d5f-f96ead2d0b45 tempest-GroupSnapshotsTest-2072112239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-76ee8fa0-fdc3-43fe-b0a1-6b5a3cc626c2 {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:38:59 devstack sudo[96328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-76ee8fa0-fdc3-43fe-b0a1-6b5a3cc626c2 Jun 17 04:38:59 devstack sudo[96328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:39:00 devstack sudo[96328]: pam_unix(sudo:session): session closed for user root Jun 17 04:39:00 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-b363e351-d27f-4d5c-8d5f-f96ead2d0b45 tempest-GroupSnapshotsTest-2072112239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-76ee8fa0-fdc3-43fe-b0a1-6b5a3cc626c2" returned: 0 in 0.952s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:39:00 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-b363e351-d27f-4d5c-8d5f-f96ead2d0b45 tempest-GroupSnapshotsTest-2072112239 None] Lock "cinder-quobyte-76ee8fa0-fdc3-43fe-b0a1-6b5a3cc626c2" released by "delete_volume" :: held 2.057s {{(pid=92060) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 04:39:00 devstack cinder-volume[92060]: DEBUG dbcounter [-] [92060] Writing DB stats cinder:SELECT=102,cinder:INSERT=18,cinder:UPDATE=89,cinder:DELETE=2 {{(pid=92060) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 17 04:39:00 devstack cinder-volume[92060]: DEBUG dbcounter [-] [92060] Writing DB stats cinder:SELECT=102,cinder:INSERT=22,cinder:UPDATE=85,cinder:DELETE=2 {{(pid=92060) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 17 04:39:00 devstack cinder-volume[92060]: DEBUG cinder.quota [None req-b363e351-d27f-4d5c-8d5f-f96ead2d0b45 tempest-GroupSnapshotsTest-2072112239 None] Created reservations ['372a842a-5748-4335-b984-d6b933b451bf'] {{(pid=92060) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 17 04:39:00 devstack cinder-volume[92060]: WARNING cinder.quota [None req-b363e351-d27f-4d5c-8d5f-f96ead2d0b45 tempest-GroupSnapshotsTest-2072112239 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1822469955 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1822469955, it is now deprecated. Please use the default quota class for default quota. Jun 17 04:39:00 devstack cinder-volume[92060]: DEBUG cinder.quota [None req-b363e351-d27f-4d5c-8d5f-f96ead2d0b45 tempest-GroupSnapshotsTest-2072112239 None] Created reservations ['e2cd95a4-c30a-444d-8b5c-073984e30282', '5fa93fec-4ecb-4307-837f-97f133fe010f', '81eb8b3c-ac1d-4d13-a879-22568d28e9ad', '1f0af9b9-6a1f-465b-8d0c-430d39cf1ec1'] {{(pid=92060) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 17 04:39:00 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-b363e351-d27f-4d5c-8d5f-f96ead2d0b45 tempest-GroupSnapshotsTest-2072112239 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 04:39:00 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-b363e351-d27f-4d5c-8d5f-f96ead2d0b45 tempest-GroupSnapshotsTest-2072112239 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 04:39:00 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-b363e351-d27f-4d5c-8d5f-f96ead2d0b45 tempest-GroupSnapshotsTest-2072112239 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588': None} {{(pid=92060) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 17 04:39:01 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-b363e351-d27f-4d5c-8d5f-f96ead2d0b45 tempest-GroupSnapshotsTest-2072112239 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588'] {{(pid=92060) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 17 04:39:01 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-b363e351-d27f-4d5c-8d5f-f96ead2d0b45 tempest-GroupSnapshotsTest-2072112239 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 04:39:01 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-b363e351-d27f-4d5c-8d5f-f96ead2d0b45 tempest-GroupSnapshotsTest-2072112239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:39:01 devstack sudo[96351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a Jun 17 04:39:01 devstack sudo[96351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:39:02 devstack sudo[96351]: pam_unix(sudo:session): session closed for user root Jun 17 04:39:02 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-b363e351-d27f-4d5c-8d5f-f96ead2d0b45 tempest-GroupSnapshotsTest-2072112239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a" returned: 0 in 1.052s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:39:02 devstack cinder-volume[92060]: DEBUG cinder.manager [None req-b363e351-d27f-4d5c-8d5f-f96ead2d0b45 tempest-GroupSnapshotsTest-2072112239 None] Notifying Schedulers of capabilities ... {{(pid=92060) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 17 04:39:02 devstack cinder-volume[92060]: INFO cinder.volume.manager [None req-b363e351-d27f-4d5c-8d5f-f96ead2d0b45 tempest-GroupSnapshotsTest-2072112239 None] Delete group completed successfully. Jun 17 04:39:09 devstack cinder-volume[92060]: INFO cinder.volume.manager [None req-f4d0b60f-3286-41e3-9672-d77d60aa1d64 tempest-GroupsTest-435826423 None] Group tempest-Group1-957919935: creating Jun 17 04:39:10 devstack cinder-volume[92060]: INFO cinder.volume.manager [None req-f4d0b60f-3286-41e3-9672-d77d60aa1d64 tempest-GroupsTest-435826423 None] Group tempest-Group1-957919935: created successfully Jun 17 04:39:10 devstack cinder-volume[92060]: INFO cinder.volume.manager [None req-f4d0b60f-3286-41e3-9672-d77d60aa1d64 tempest-GroupsTest-435826423 None] Create group completed successfully. Jun 17 04:39:11 devstack cinder-volume[92060]: INFO cinder.volume.manager [None req-7acff06d-55b5-46f4-b952-cc3b0ce34bfb tempest-GroupsTest-435826423 None] Group tempest-Group2-1441827480: creating Jun 17 04:39:11 devstack cinder-volume[92060]: INFO cinder.volume.manager [None req-7acff06d-55b5-46f4-b952-cc3b0ce34bfb tempest-GroupsTest-435826423 None] Group tempest-Group2-1441827480: created successfully Jun 17 04:39:11 devstack cinder-volume[92060]: INFO cinder.volume.manager [None req-7acff06d-55b5-46f4-b952-cc3b0ce34bfb tempest-GroupsTest-435826423 None] Create group completed successfully. Jun 17 04:39:14 devstack cinder-volume[92060]: DEBUG cinder.volume.flows.manager.create_volume [None req-c59dfaf1-15b1-46c9-9ed4-120ec4dc92c2 tempest-GroupsTest-435826423 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92060) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 17 04:39:14 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-c59dfaf1-15b1-46c9-9ed4-120ec4dc92c2 tempest-GroupsTest-435826423 None] Flow 'volume_create_manager' (68cb63f0-31d1-41f7-8c0c-b04b4e5ca6a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 17 04:39:14 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-c59dfaf1-15b1-46c9-9ed4-120ec4dc92c2 tempest-GroupsTest-435826423 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cb906831-458c-4c02-a82f-134b51950ad8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:39:14 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-c59dfaf1-15b1-46c9-9ed4-120ec4dc92c2 tempest-GroupsTest-435826423 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cb906831-458c-4c02-a82f-134b51950ad8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-17T02:39:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-273962932',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=248e71bc-65e7-4ec9-9e83-516ffcee6bce,host='devstack@QuobyteHD#QuobyteHD',id=0a158046-9dcd-42d0-917d-70428d87865f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f0c195d77c8b45b7b8724980573b621b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T02:39:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T02:39:14Z,use_quota=True,user_id='ba08fcb4c0db4a60b666a7cc49d86059',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(afdbbde6-cf10-4552-8656-70fbe74776dd),volume_type_id=afdbbde6-cf10-4552-8656-70fbe74776dd)' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:39:14 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-c59dfaf1-15b1-46c9-9ed4-120ec4dc92c2 tempest-GroupsTest-435826423 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (793dc50c-5d89-47b3-bc39-d79d5f73a997) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:39:14 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-c59dfaf1-15b1-46c9-9ed4-120ec4dc92c2 tempest-GroupsTest-435826423 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (793dc50c-5d89-47b3-bc39-d79d5f73a997) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:39:14 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-c59dfaf1-15b1-46c9-9ed4-120ec4dc92c2 tempest-GroupsTest-435826423 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c132ba0b-c4f2-457f-95b1-391e9b79d0a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:39:14 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-c59dfaf1-15b1-46c9-9ed4-120ec4dc92c2 tempest-GroupsTest-435826423 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c132ba0b-c4f2-457f-95b1-391e9b79d0a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0a158046-9dcd-42d0-917d-70428d87865f', 'volume_name': 'volume-0a158046-9dcd-42d0-917d-70428d87865f', 'volume_size': 1}' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:39:14 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-c59dfaf1-15b1-46c9-9ed4-120ec4dc92c2 tempest-GroupsTest-435826423 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a59a9cbd-f48d-4afc-b258-5f417abbc9c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:39:14 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-c59dfaf1-15b1-46c9-9ed4-120ec4dc92c2 tempest-GroupsTest-435826423 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a59a9cbd-f48d-4afc-b258-5f417abbc9c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:39:14 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-c59dfaf1-15b1-46c9-9ed4-120ec4dc92c2 tempest-GroupsTest-435826423 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8c365d90-1c88-48ed-b2ae-657b684e0f20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:39:14 devstack cinder-volume[92060]: INFO cinder.volume.flows.manager.create_volume [None req-c59dfaf1-15b1-46c9-9ed4-120ec4dc92c2 tempest-GroupsTest-435826423 None] Volume 0a158046-9dcd-42d0-917d-70428d87865f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0a158046-9dcd-42d0-917d-70428d87865f', 'volume_size': 1} Jun 17 04:39:14 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-c59dfaf1-15b1-46c9-9ed4-120ec4dc92c2 tempest-GroupsTest-435826423 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 04:39:14 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-c59dfaf1-15b1-46c9-9ed4-120ec4dc92c2 tempest-GroupsTest-435826423 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 04:39:14 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-c59dfaf1-15b1-46c9-9ed4-120ec4dc92c2 tempest-GroupsTest-435826423 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=248e71bc-65e7-4ec9-9e83-516ffcee6bce,created_at=2026-06-17T02:39:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-273962932',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=248e71bc-65e7-4ec9-9e83-516ffcee6bce,host='devstack@QuobyteHD#QuobyteHD',id=0a158046-9dcd-42d0-917d-70428d87865f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f0c195d77c8b45b7b8724980573b621b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T02:39:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T02:39:14Z,use_quota=True,user_id='ba08fcb4c0db4a60b666a7cc49d86059',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(afdbbde6-cf10-4552-8656-70fbe74776dd),volume_type_id=afdbbde6-cf10-4552-8656-70fbe74776dd)}" {{(pid=92060) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 17 04:39:14 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.remotefs [None req-c59dfaf1-15b1-46c9-9ed4-120ec4dc92c2 tempest-GroupsTest-435826423 None] Creating volume 0a158046-9dcd-42d0-917d-70428d87865f {{(pid=92060) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 17 04:39:14 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-c59dfaf1-15b1-46c9-9ed4-120ec4dc92c2 tempest-GroupsTest-435826423 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 04:39:14 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-c59dfaf1-15b1-46c9-9ed4-120ec4dc92c2 tempest-GroupsTest-435826423 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 04:39:14 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-c59dfaf1-15b1-46c9-9ed4-120ec4dc92c2 tempest-GroupsTest-435826423 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588': None} {{(pid=92060) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 17 04:39:14 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-c59dfaf1-15b1-46c9-9ed4-120ec4dc92c2 tempest-GroupsTest-435826423 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588'] {{(pid=92060) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 17 04:39:14 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-c59dfaf1-15b1-46c9-9ed4-120ec4dc92c2 tempest-GroupsTest-435826423 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 04:39:14 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-c59dfaf1-15b1-46c9-9ed4-120ec4dc92c2 tempest-GroupsTest-435826423 None] Selected osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588 as target Quobyte volume. {{(pid=92060) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 17 04:39:14 devstack cinder-volume[92060]: INFO cinder.volume.drivers.remotefs [None req-c59dfaf1-15b1-46c9-9ed4-120ec4dc92c2 tempest-GroupsTest-435826423 None] casted to osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588 Jun 17 04:39:14 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-c59dfaf1-15b1-46c9-9ed4-120ec4dc92c2 tempest-GroupsTest-435826423 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-0a158046-9dcd-42d0-917d-70428d87865f 1073741824 {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:39:14 devstack sudo[96659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-0a158046-9dcd-42d0-917d-70428d87865f 1073741824 Jun 17 04:39:14 devstack sudo[96659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:39:15 devstack sudo[96659]: pam_unix(sudo:session): session closed for user root Jun 17 04:39:15 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-c59dfaf1-15b1-46c9-9ed4-120ec4dc92c2 tempest-GroupsTest-435826423 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-0a158046-9dcd-42d0-917d-70428d87865f 1073741824" returned: 0 in 1.287s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:39:15 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-c59dfaf1-15b1-46c9-9ed4-120ec4dc92c2 tempest-GroupsTest-435826423 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-0a158046-9dcd-42d0-917d-70428d87865f {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:39:15 devstack sudo[96667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-0a158046-9dcd-42d0-917d-70428d87865f Jun 17 04:39:15 devstack sudo[96667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:39:16 devstack cinder-volume[92060]: INFO cinder.volume.manager [req-f413e3b1-450b-4e45-aa15-68b03e589711 req-0f845c89-5f1a-432f-9553-50af20c8b15c tempest-ServerActionsTestOtherA-1987628563 None] Terminate volume connection completed successfully. Jun 17 04:39:16 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [req-f413e3b1-450b-4e45-aa15-68b03e589711 req-0f845c89-5f1a-432f-9553-50af20c8b15c tempest-ServerActionsTestOtherA-1987628563 None] Deleting attachment 36c3abd6-39ed-450d-a492-e426a94ad17a. {{(pid=92060) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 17 04:39:16 devstack sudo[96667]: pam_unix(sudo:session): session closed for user root Jun 17 04:39:16 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-c59dfaf1-15b1-46c9-9ed4-120ec4dc92c2 tempest-GroupsTest-435826423 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-0a158046-9dcd-42d0-917d-70428d87865f" returned: 0 in 0.908s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:39:16 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-c59dfaf1-15b1-46c9-9ed4-120ec4dc92c2 tempest-GroupsTest-435826423 None] <== create_volume: return (2314ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588'} {{(pid=92060) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 17 04:39:16 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-c59dfaf1-15b1-46c9-9ed4-120ec4dc92c2 tempest-GroupsTest-435826423 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.318s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 04:39:16 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-c59dfaf1-15b1-46c9-9ed4-120ec4dc92c2 tempest-GroupsTest-435826423 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8c365d90-1c88-48ed-b2ae-657b684e0f20) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0a158046-9dcd-42d0-917d-70428d87865f', 'volume_size': 1}' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:39:16 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-c59dfaf1-15b1-46c9-9ed4-120ec4dc92c2 tempest-GroupsTest-435826423 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3e08ee2d-d70c-4ad2-b59b-c976a55ff8a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:39:16 devstack cinder-volume[92060]: INFO cinder.volume.flows.manager.create_volume [None req-c59dfaf1-15b1-46c9-9ed4-120ec4dc92c2 tempest-GroupsTest-435826423 None] Volume volume-0a158046-9dcd-42d0-917d-70428d87865f (0a158046-9dcd-42d0-917d-70428d87865f): created successfully Jun 17 04:39:16 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-c59dfaf1-15b1-46c9-9ed4-120ec4dc92c2 tempest-GroupsTest-435826423 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3e08ee2d-d70c-4ad2-b59b-c976a55ff8a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:39:16 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-c59dfaf1-15b1-46c9-9ed4-120ec4dc92c2 tempest-GroupsTest-435826423 None] Flow 'volume_create_manager' (68cb63f0-31d1-41f7-8c0c-b04b4e5ca6a6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92060) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 17 04:39:16 devstack cinder-volume[92060]: INFO cinder.volume.manager [None req-c59dfaf1-15b1-46c9-9ed4-120ec4dc92c2 tempest-GroupsTest-435826423 None] Created volume successfully. Jun 17 04:39:18 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-60795886-2df7-4665-ada1-7a502c601ff4 tempest-GroupsTest-435826423 None] Acquiring lock "cinder-quobyte-0a158046-9dcd-42d0-917d-70428d87865f" by "delete_volume" {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 04:39:18 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-60795886-2df7-4665-ada1-7a502c601ff4 tempest-GroupsTest-435826423 None] Lock "cinder-quobyte-0a158046-9dcd-42d0-917d-70428d87865f" acquired by "delete_volume" :: waited 0.049s {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 04:39:18 devstack cinder-volume[92060]: DEBUG oslo.privsep.daemon [-] privsep: reply[1280f758-1669-4c1f-ba35-7119cf0681c7]: (4, 'qcow2') {{(pid=93130) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 04:39:18 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-60795886-2df7-4665-ada1-7a502c601ff4 tempest-GroupsTest-435826423 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-0a158046-9dcd-42d0-917d-70428d87865f {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:39:18 devstack sudo[96674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-0a158046-9dcd-42d0-917d-70428d87865f Jun 17 04:39:18 devstack sudo[96674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:39:19 devstack sudo[96674]: pam_unix(sudo:session): session closed for user root Jun 17 04:39:19 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-60795886-2df7-4665-ada1-7a502c601ff4 tempest-GroupsTest-435826423 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-0a158046-9dcd-42d0-917d-70428d87865f" returned: 0 in 1.369s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:39:19 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-60795886-2df7-4665-ada1-7a502c601ff4 tempest-GroupsTest-435826423 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-0a158046-9dcd-42d0-917d-70428d87865f {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:39:19 devstack sudo[96687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-0a158046-9dcd-42d0-917d-70428d87865f Jun 17 04:39:19 devstack sudo[96687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:39:21 devstack sudo[96687]: pam_unix(sudo:session): session closed for user root Jun 17 04:39:21 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-60795886-2df7-4665-ada1-7a502c601ff4 tempest-GroupsTest-435826423 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-0a158046-9dcd-42d0-917d-70428d87865f" returned: 0 in 1.513s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:39:21 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-60795886-2df7-4665-ada1-7a502c601ff4 tempest-GroupsTest-435826423 None] Lock "cinder-quobyte-0a158046-9dcd-42d0-917d-70428d87865f" released by "delete_volume" :: held 2.972s {{(pid=92060) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 04:39:21 devstack cinder-volume[92060]: DEBUG cinder.quota [None req-60795886-2df7-4665-ada1-7a502c601ff4 tempest-GroupsTest-435826423 None] Created reservations ['5c71b1e2-9bfc-4c94-8dc7-1fd14055653a'] {{(pid=92060) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 17 04:39:21 devstack cinder-volume[92060]: WARNING cinder.quota [None req-60795886-2df7-4665-ada1-7a502c601ff4 tempest-GroupsTest-435826423 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-939822724 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-939822724, it is now deprecated. Please use the default quota class for default quota. Jun 17 04:39:21 devstack cinder-volume[92060]: WARNING cinder.quota [None req-60795886-2df7-4665-ada1-7a502c601ff4 tempest-GroupsTest-435826423 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-939822724 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-939822724, it is now deprecated. Please use the default quota class for default quota. Jun 17 04:39:21 devstack cinder-volume[92060]: DEBUG cinder.quota [None req-60795886-2df7-4665-ada1-7a502c601ff4 tempest-GroupsTest-435826423 None] Created reservations ['3dea158f-9cd2-42f7-8974-34883d13f453', '0827f6b5-201b-4156-88c6-b3a1b50c108d', '61b15f65-2bff-45b2-93e0-a849b8354157', '2b32cff1-e794-4a92-a53b-a3d49755d945'] {{(pid=92060) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 17 04:39:21 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-60795886-2df7-4665-ada1-7a502c601ff4 tempest-GroupsTest-435826423 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 04:39:21 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-60795886-2df7-4665-ada1-7a502c601ff4 tempest-GroupsTest-435826423 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 04:39:21 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-60795886-2df7-4665-ada1-7a502c601ff4 tempest-GroupsTest-435826423 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588': None} {{(pid=92060) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 17 04:39:21 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-60795886-2df7-4665-ada1-7a502c601ff4 tempest-GroupsTest-435826423 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588'] {{(pid=92060) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 17 04:39:21 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-60795886-2df7-4665-ada1-7a502c601ff4 tempest-GroupsTest-435826423 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 04:39:21 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-60795886-2df7-4665-ada1-7a502c601ff4 tempest-GroupsTest-435826423 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:39:21 devstack sudo[96766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a Jun 17 04:39:21 devstack sudo[96766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:39:22 devstack cinder-volume[92060]: DEBUG cinder.quota [None req-a7874cdb-7ce4-4252-b5d2-4adf26141f31 tempest-GroupsTest-435826423 None] Created reservations ['ea512207-cc99-4a81-a178-f6b61818ab1c'] {{(pid=92060) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 17 04:39:22 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-a7874cdb-7ce4-4252-b5d2-4adf26141f31 tempest-GroupsTest-435826423 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 04:39:22 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-a7874cdb-7ce4-4252-b5d2-4adf26141f31 tempest-GroupsTest-435826423 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 04:39:22 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-a7874cdb-7ce4-4252-b5d2-4adf26141f31 tempest-GroupsTest-435826423 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588': None} {{(pid=92060) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 17 04:39:22 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-a7874cdb-7ce4-4252-b5d2-4adf26141f31 tempest-GroupsTest-435826423 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588'] {{(pid=92060) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 17 04:39:22 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-a7874cdb-7ce4-4252-b5d2-4adf26141f31 tempest-GroupsTest-435826423 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 04:39:22 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-a7874cdb-7ce4-4252-b5d2-4adf26141f31 tempest-GroupsTest-435826423 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:39:22 devstack sudo[96766]: pam_unix(sudo:session): session closed for user root Jun 17 04:39:22 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-60795886-2df7-4665-ada1-7a502c601ff4 tempest-GroupsTest-435826423 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a" returned: 0 in 1.104s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:39:22 devstack cinder-volume[92060]: DEBUG cinder.manager [None req-60795886-2df7-4665-ada1-7a502c601ff4 tempest-GroupsTest-435826423 None] Notifying Schedulers of capabilities ... {{(pid=92060) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 17 04:39:22 devstack cinder-volume[92060]: INFO cinder.volume.manager [None req-60795886-2df7-4665-ada1-7a502c601ff4 tempest-GroupsTest-435826423 None] Delete group completed successfully. Jun 17 04:39:22 devstack sudo[96771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a Jun 17 04:39:22 devstack sudo[96771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:39:23 devstack sudo[96771]: pam_unix(sudo:session): session closed for user root Jun 17 04:39:23 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-a7874cdb-7ce4-4252-b5d2-4adf26141f31 tempest-GroupsTest-435826423 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a" returned: 0 in 0.824s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:39:23 devstack cinder-volume[92060]: DEBUG cinder.manager [None req-a7874cdb-7ce4-4252-b5d2-4adf26141f31 tempest-GroupsTest-435826423 None] Notifying Schedulers of capabilities ... {{(pid=92060) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 17 04:39:23 devstack cinder-volume[92060]: INFO cinder.volume.manager [None req-a7874cdb-7ce4-4252-b5d2-4adf26141f31 tempest-GroupsTest-435826423 None] Delete group completed successfully. Jun 17 04:39:24 devstack cinder-volume[92060]: INFO cinder.volume.manager [None req-66f7591b-a2a9-4fdc-ab7d-dae31499bad7 tempest-GroupsTest-435826423 None] Group tempest-GroupsTest-Group-1983765596: creating Jun 17 04:39:24 devstack cinder-volume[92060]: INFO cinder.volume.manager [None req-66f7591b-a2a9-4fdc-ab7d-dae31499bad7 tempest-GroupsTest-435826423 None] Group tempest-GroupsTest-Group-1983765596: created successfully Jun 17 04:39:24 devstack cinder-volume[92060]: INFO cinder.volume.manager [None req-66f7591b-a2a9-4fdc-ab7d-dae31499bad7 tempest-GroupsTest-435826423 None] Create group completed successfully. Jun 17 04:39:26 devstack cinder-volume[92060]: DEBUG cinder.volume.flows.manager.create_volume [None req-2e2f76dd-3f13-430c-93e6-e53504107c90 tempest-GroupsTest-435826423 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92060) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 17 04:39:26 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-2e2f76dd-3f13-430c-93e6-e53504107c90 tempest-GroupsTest-435826423 None] Flow 'volume_create_manager' (5481ec70-162f-4455-bf43-08147bba122a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 17 04:39:26 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-2e2f76dd-3f13-430c-93e6-e53504107c90 tempest-GroupsTest-435826423 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8d582b42-a352-46f3-b5b5-6e148a256d2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:39:26 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-2e2f76dd-3f13-430c-93e6-e53504107c90 tempest-GroupsTest-435826423 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8d582b42-a352-46f3-b5b5-6e148a256d2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-17T02:39:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-29267097',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=d6984557-ae39-496d-a49b-a79ae8c507d8,host='devstack@QuobyteHD#QuobyteHD',id=6d99b392-a7f3-4a32-8c74-bf71e133e10c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f0c195d77c8b45b7b8724980573b621b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T02:39:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T02:39:27Z,use_quota=True,user_id='ba08fcb4c0db4a60b666a7cc49d86059',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f9a45ec-8da0-4080-ab59-b56af01abda1),volume_type_id=4f9a45ec-8da0-4080-ab59-b56af01abda1)' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:39:26 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-2e2f76dd-3f13-430c-93e6-e53504107c90 tempest-GroupsTest-435826423 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (488b7c6a-fd5e-4b23-beb4-37bcde74010c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:39:26 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-2e2f76dd-3f13-430c-93e6-e53504107c90 tempest-GroupsTest-435826423 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (488b7c6a-fd5e-4b23-beb4-37bcde74010c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:39:26 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-2e2f76dd-3f13-430c-93e6-e53504107c90 tempest-GroupsTest-435826423 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (df592c9d-4a6f-46f0-97a4-fb4dd7ca29b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:39:26 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-2e2f76dd-3f13-430c-93e6-e53504107c90 tempest-GroupsTest-435826423 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (df592c9d-4a6f-46f0-97a4-fb4dd7ca29b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6d99b392-a7f3-4a32-8c74-bf71e133e10c', 'volume_name': 'volume-6d99b392-a7f3-4a32-8c74-bf71e133e10c', 'volume_size': 1}' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:39:26 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-2e2f76dd-3f13-430c-93e6-e53504107c90 tempest-GroupsTest-435826423 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (20720814-2e1a-49f3-b3ec-8be26963332e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:39:26 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-2e2f76dd-3f13-430c-93e6-e53504107c90 tempest-GroupsTest-435826423 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (20720814-2e1a-49f3-b3ec-8be26963332e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:39:26 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-2e2f76dd-3f13-430c-93e6-e53504107c90 tempest-GroupsTest-435826423 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (df92940d-1601-4511-9141-bedf1eb9d5d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:39:26 devstack cinder-volume[92060]: INFO cinder.volume.flows.manager.create_volume [None req-2e2f76dd-3f13-430c-93e6-e53504107c90 tempest-GroupsTest-435826423 None] Volume 6d99b392-a7f3-4a32-8c74-bf71e133e10c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6d99b392-a7f3-4a32-8c74-bf71e133e10c', 'volume_size': 1} Jun 17 04:39:26 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-2e2f76dd-3f13-430c-93e6-e53504107c90 tempest-GroupsTest-435826423 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 04:39:26 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-2e2f76dd-3f13-430c-93e6-e53504107c90 tempest-GroupsTest-435826423 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 04:39:26 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-2e2f76dd-3f13-430c-93e6-e53504107c90 tempest-GroupsTest-435826423 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=d6984557-ae39-496d-a49b-a79ae8c507d8,created_at=2026-06-17T02:39:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-29267097',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=d6984557-ae39-496d-a49b-a79ae8c507d8,host='devstack@QuobyteHD#QuobyteHD',id=6d99b392-a7f3-4a32-8c74-bf71e133e10c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f0c195d77c8b45b7b8724980573b621b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T02:39:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T02:39:27Z,use_quota=True,user_id='ba08fcb4c0db4a60b666a7cc49d86059',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f9a45ec-8da0-4080-ab59-b56af01abda1),volume_type_id=4f9a45ec-8da0-4080-ab59-b56af01abda1)}" {{(pid=92060) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 17 04:39:26 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.remotefs [None req-2e2f76dd-3f13-430c-93e6-e53504107c90 tempest-GroupsTest-435826423 None] Creating volume 6d99b392-a7f3-4a32-8c74-bf71e133e10c {{(pid=92060) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 17 04:39:26 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-2e2f76dd-3f13-430c-93e6-e53504107c90 tempest-GroupsTest-435826423 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 04:39:26 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-2e2f76dd-3f13-430c-93e6-e53504107c90 tempest-GroupsTest-435826423 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 04:39:26 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-2e2f76dd-3f13-430c-93e6-e53504107c90 tempest-GroupsTest-435826423 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588': None} {{(pid=92060) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 17 04:39:26 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-2e2f76dd-3f13-430c-93e6-e53504107c90 tempest-GroupsTest-435826423 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588'] {{(pid=92060) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 17 04:39:26 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-2e2f76dd-3f13-430c-93e6-e53504107c90 tempest-GroupsTest-435826423 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 04:39:26 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-2e2f76dd-3f13-430c-93e6-e53504107c90 tempest-GroupsTest-435826423 None] Selected osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588 as target Quobyte volume. {{(pid=92060) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 17 04:39:26 devstack cinder-volume[92060]: INFO cinder.volume.drivers.remotefs [None req-2e2f76dd-3f13-430c-93e6-e53504107c90 tempest-GroupsTest-435826423 None] casted to osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588 Jun 17 04:39:26 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-2e2f76dd-3f13-430c-93e6-e53504107c90 tempest-GroupsTest-435826423 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-6d99b392-a7f3-4a32-8c74-bf71e133e10c 1073741824 {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:39:26 devstack sudo[96853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-6d99b392-a7f3-4a32-8c74-bf71e133e10c 1073741824 Jun 17 04:39:26 devstack sudo[96853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:39:27 devstack sudo[96853]: pam_unix(sudo:session): session closed for user root Jun 17 04:39:27 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-2e2f76dd-3f13-430c-93e6-e53504107c90 tempest-GroupsTest-435826423 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-6d99b392-a7f3-4a32-8c74-bf71e133e10c 1073741824" returned: 0 in 1.105s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:39:27 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-2e2f76dd-3f13-430c-93e6-e53504107c90 tempest-GroupsTest-435826423 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-6d99b392-a7f3-4a32-8c74-bf71e133e10c {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:39:27 devstack sudo[96867]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-6d99b392-a7f3-4a32-8c74-bf71e133e10c Jun 17 04:39:27 devstack sudo[96867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:39:28 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-596eb8df-9b80-4448-a560-a04daf7c9af4 tempest-ServerActionsTestOtherA-1987628563 None] Acquiring lock "cinder-87612384-1fa0-40a0-b4fb-f5570b67b53a-delete_volume" by "delete_volume" {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 04:39:28 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-596eb8df-9b80-4448-a560-a04daf7c9af4 tempest-ServerActionsTestOtherA-1987628563 None] Lock "cinder-87612384-1fa0-40a0-b4fb-f5570b67b53a-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 04:39:28 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-596eb8df-9b80-4448-a560-a04daf7c9af4 tempest-ServerActionsTestOtherA-1987628563 None] Acquiring lock "cinder-quobyte-87612384-1fa0-40a0-b4fb-f5570b67b53a" by "delete_volume" {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 04:39:28 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-596eb8df-9b80-4448-a560-a04daf7c9af4 tempest-ServerActionsTestOtherA-1987628563 None] Lock "cinder-quobyte-87612384-1fa0-40a0-b4fb-f5570b67b53a" acquired by "delete_volume" :: waited 0.042s {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 04:39:28 devstack cinder-volume[92060]: DEBUG oslo.privsep.daemon [-] privsep: reply[47bfcac2-3a15-4fa7-b530-a61b39ec80d8]: (4, 'qcow2') {{(pid=93130) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 04:39:28 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-596eb8df-9b80-4448-a560-a04daf7c9af4 tempest-ServerActionsTestOtherA-1987628563 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-87612384-1fa0-40a0-b4fb-f5570b67b53a {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:39:29 devstack sudo[96867]: pam_unix(sudo:session): session closed for user root Jun 17 04:39:29 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-2e2f76dd-3f13-430c-93e6-e53504107c90 tempest-GroupsTest-435826423 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-6d99b392-a7f3-4a32-8c74-bf71e133e10c" returned: 0 in 1.160s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:39:29 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-2e2f76dd-3f13-430c-93e6-e53504107c90 tempest-GroupsTest-435826423 None] <== create_volume: return (2345ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588'} {{(pid=92060) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 17 04:39:29 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-2e2f76dd-3f13-430c-93e6-e53504107c90 tempest-GroupsTest-435826423 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.349s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 04:39:29 devstack sudo[96885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-87612384-1fa0-40a0-b4fb-f5570b67b53a Jun 17 04:39:29 devstack sudo[96885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:39:29 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-2e2f76dd-3f13-430c-93e6-e53504107c90 tempest-GroupsTest-435826423 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (df92940d-1601-4511-9141-bedf1eb9d5d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6d99b392-a7f3-4a32-8c74-bf71e133e10c', 'volume_size': 1}' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:39:29 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-2e2f76dd-3f13-430c-93e6-e53504107c90 tempest-GroupsTest-435826423 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f4fe9fc1-0f9e-4663-8593-ee841253ce4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:39:29 devstack cinder-volume[92060]: INFO cinder.volume.flows.manager.create_volume [None req-2e2f76dd-3f13-430c-93e6-e53504107c90 tempest-GroupsTest-435826423 None] Volume volume-6d99b392-a7f3-4a32-8c74-bf71e133e10c (6d99b392-a7f3-4a32-8c74-bf71e133e10c): created successfully Jun 17 04:39:29 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-2e2f76dd-3f13-430c-93e6-e53504107c90 tempest-GroupsTest-435826423 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f4fe9fc1-0f9e-4663-8593-ee841253ce4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:39:29 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-2e2f76dd-3f13-430c-93e6-e53504107c90 tempest-GroupsTest-435826423 None] Flow 'volume_create_manager' (5481ec70-162f-4455-bf43-08147bba122a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92060) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 17 04:39:29 devstack cinder-volume[92060]: INFO cinder.volume.manager [None req-2e2f76dd-3f13-430c-93e6-e53504107c90 tempest-GroupsTest-435826423 None] Created volume successfully. Jun 17 04:39:29 devstack sudo[96885]: pam_unix(sudo:session): session closed for user root Jun 17 04:39:29 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-596eb8df-9b80-4448-a560-a04daf7c9af4 tempest-ServerActionsTestOtherA-1987628563 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-87612384-1fa0-40a0-b4fb-f5570b67b53a" returned: 0 in 0.927s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:39:29 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-596eb8df-9b80-4448-a560-a04daf7c9af4 tempest-ServerActionsTestOtherA-1987628563 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-87612384-1fa0-40a0-b4fb-f5570b67b53a {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:39:29 devstack sudo[96896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-87612384-1fa0-40a0-b4fb-f5570b67b53a Jun 17 04:39:29 devstack sudo[96896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:39:30 devstack cinder-volume[92060]: DEBUG cinder.volume.flows.manager.create_volume [None req-1b688c51-7c12-44d0-bf0d-a917db9ba958 tempest-ServerRescueNegativeTestJSON-973268383 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92060) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 17 04:39:30 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-1b688c51-7c12-44d0-bf0d-a917db9ba958 tempest-ServerRescueNegativeTestJSON-973268383 None] Flow 'volume_create_manager' (04dd12c9-512c-4629-bd5e-507c7f75c118) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 17 04:39:30 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-1b688c51-7c12-44d0-bf0d-a917db9ba958 tempest-ServerRescueNegativeTestJSON-973268383 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a5b508e6-d7be-407e-bfea-0fa59bb66387) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:39:30 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-1b688c51-7c12-44d0-bf0d-a917db9ba958 tempest-ServerRescueNegativeTestJSON-973268383 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a5b508e6-d7be-407e-bfea-0fa59bb66387) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-17T02:39:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-1517881949',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=292c8d5e-40b9-4ff4-ad15-be913fea8630,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='278b929b8d214c059657dd59bf5e5334',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T02:39:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T02:39:30Z,use_quota=True,user_id='c33f8a5b56a94d169c8a4b34235ccae2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aad9ce24-93f9-41a6-baa1-5125964f96d1),volume_type_id=aad9ce24-93f9-41a6-baa1-5125964f96d1)' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:39:30 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-1b688c51-7c12-44d0-bf0d-a917db9ba958 tempest-ServerRescueNegativeTestJSON-973268383 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0070fbaa-910c-4e0a-8c2a-5462b3b55ad1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:39:30 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-1b688c51-7c12-44d0-bf0d-a917db9ba958 tempest-ServerRescueNegativeTestJSON-973268383 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0070fbaa-910c-4e0a-8c2a-5462b3b55ad1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:39:30 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-1b688c51-7c12-44d0-bf0d-a917db9ba958 tempest-ServerRescueNegativeTestJSON-973268383 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3852ad20-a238-40f5-922e-5aa1db1f915b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:39:30 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-1b688c51-7c12-44d0-bf0d-a917db9ba958 tempest-ServerRescueNegativeTestJSON-973268383 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3852ad20-a238-40f5-922e-5aa1db1f915b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '292c8d5e-40b9-4ff4-ad15-be913fea8630', 'volume_name': 'volume-292c8d5e-40b9-4ff4-ad15-be913fea8630', 'volume_size': 1}' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:39:30 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-1b688c51-7c12-44d0-bf0d-a917db9ba958 tempest-ServerRescueNegativeTestJSON-973268383 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (33d09eff-7ee8-4fa4-bff4-ff23594d07fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:39:30 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-1b688c51-7c12-44d0-bf0d-a917db9ba958 tempest-ServerRescueNegativeTestJSON-973268383 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (33d09eff-7ee8-4fa4-bff4-ff23594d07fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:39:30 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-1b688c51-7c12-44d0-bf0d-a917db9ba958 tempest-ServerRescueNegativeTestJSON-973268383 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2011725c-90ee-4d9f-92da-e8fead722b8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:39:30 devstack cinder-volume[92060]: INFO cinder.volume.flows.manager.create_volume [None req-1b688c51-7c12-44d0-bf0d-a917db9ba958 tempest-ServerRescueNegativeTestJSON-973268383 None] Volume 292c8d5e-40b9-4ff4-ad15-be913fea8630: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-292c8d5e-40b9-4ff4-ad15-be913fea8630', 'volume_size': 1} Jun 17 04:39:30 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-1b688c51-7c12-44d0-bf0d-a917db9ba958 tempest-ServerRescueNegativeTestJSON-973268383 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 04:39:30 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-1b688c51-7c12-44d0-bf0d-a917db9ba958 tempest-ServerRescueNegativeTestJSON-973268383 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 04:39:30 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-1b688c51-7c12-44d0-bf0d-a917db9ba958 tempest-ServerRescueNegativeTestJSON-973268383 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-17T02:39:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-1517881949',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=292c8d5e-40b9-4ff4-ad15-be913fea8630,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='278b929b8d214c059657dd59bf5e5334',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T02:39:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T02:39:30Z,use_quota=True,user_id='c33f8a5b56a94d169c8a4b34235ccae2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aad9ce24-93f9-41a6-baa1-5125964f96d1),volume_type_id=aad9ce24-93f9-41a6-baa1-5125964f96d1)}" {{(pid=92060) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 17 04:39:30 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.remotefs [None req-1b688c51-7c12-44d0-bf0d-a917db9ba958 tempest-ServerRescueNegativeTestJSON-973268383 None] Creating volume 292c8d5e-40b9-4ff4-ad15-be913fea8630 {{(pid=92060) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 17 04:39:30 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-1b688c51-7c12-44d0-bf0d-a917db9ba958 tempest-ServerRescueNegativeTestJSON-973268383 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 04:39:30 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-1b688c51-7c12-44d0-bf0d-a917db9ba958 tempest-ServerRescueNegativeTestJSON-973268383 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 04:39:30 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-1b688c51-7c12-44d0-bf0d-a917db9ba958 tempest-ServerRescueNegativeTestJSON-973268383 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588': None} {{(pid=92060) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 17 04:39:30 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-1b688c51-7c12-44d0-bf0d-a917db9ba958 tempest-ServerRescueNegativeTestJSON-973268383 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588'] {{(pid=92060) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 17 04:39:30 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-1b688c51-7c12-44d0-bf0d-a917db9ba958 tempest-ServerRescueNegativeTestJSON-973268383 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 04:39:30 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-1b688c51-7c12-44d0-bf0d-a917db9ba958 tempest-ServerRescueNegativeTestJSON-973268383 None] Selected osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588 as target Quobyte volume. {{(pid=92060) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 17 04:39:30 devstack cinder-volume[92060]: INFO cinder.volume.drivers.remotefs [None req-1b688c51-7c12-44d0-bf0d-a917db9ba958 tempest-ServerRescueNegativeTestJSON-973268383 None] casted to osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588 Jun 17 04:39:30 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-1b688c51-7c12-44d0-bf0d-a917db9ba958 tempest-ServerRescueNegativeTestJSON-973268383 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-292c8d5e-40b9-4ff4-ad15-be913fea8630 1073741824 {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:39:30 devstack sudo[96901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-292c8d5e-40b9-4ff4-ad15-be913fea8630 1073741824 Jun 17 04:39:30 devstack sudo[96901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:39:30 devstack cinder-volume[92060]: DEBUG cinder.volume.flows.manager.create_volume [None req-15d7c199-1a61-45e3-87c0-8e0c33b11036 tempest-GroupsTest-435826423 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92060) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 17 04:39:30 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-15d7c199-1a61-45e3-87c0-8e0c33b11036 tempest-GroupsTest-435826423 None] Flow 'volume_create_manager' (561232a7-3810-405c-b330-199bc8c96511) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 17 04:39:30 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-15d7c199-1a61-45e3-87c0-8e0c33b11036 tempest-GroupsTest-435826423 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (88513338-b550-493a-ad55-49ed3ee67fb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:39:30 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-15d7c199-1a61-45e3-87c0-8e0c33b11036 tempest-GroupsTest-435826423 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (88513338-b550-493a-ad55-49ed3ee67fb1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-17T02:39:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2037374247',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=d6984557-ae39-496d-a49b-a79ae8c507d8,host='devstack@QuobyteHD#QuobyteHD',id=ce1ae651-30b1-4327-9a62-c7609f5311f0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f0c195d77c8b45b7b8724980573b621b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T02:39:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T02:39:31Z,use_quota=True,user_id='ba08fcb4c0db4a60b666a7cc49d86059',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f9a45ec-8da0-4080-ab59-b56af01abda1),volume_type_id=4f9a45ec-8da0-4080-ab59-b56af01abda1)' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:39:30 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-15d7c199-1a61-45e3-87c0-8e0c33b11036 tempest-GroupsTest-435826423 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (71907b7f-a864-48b5-b4eb-619091c94e96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:39:30 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-15d7c199-1a61-45e3-87c0-8e0c33b11036 tempest-GroupsTest-435826423 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (71907b7f-a864-48b5-b4eb-619091c94e96) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:39:30 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-15d7c199-1a61-45e3-87c0-8e0c33b11036 tempest-GroupsTest-435826423 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c22c2776-c525-488f-aed2-202590eabbef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:39:30 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-15d7c199-1a61-45e3-87c0-8e0c33b11036 tempest-GroupsTest-435826423 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c22c2776-c525-488f-aed2-202590eabbef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ce1ae651-30b1-4327-9a62-c7609f5311f0', 'volume_name': 'volume-ce1ae651-30b1-4327-9a62-c7609f5311f0', 'volume_size': 1}' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:39:31 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-15d7c199-1a61-45e3-87c0-8e0c33b11036 tempest-GroupsTest-435826423 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4724c3d9-28ba-43df-8043-7c1a9044a246) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:39:31 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-15d7c199-1a61-45e3-87c0-8e0c33b11036 tempest-GroupsTest-435826423 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4724c3d9-28ba-43df-8043-7c1a9044a246) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:39:31 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-15d7c199-1a61-45e3-87c0-8e0c33b11036 tempest-GroupsTest-435826423 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (024a2f3a-7ff0-43fa-9d6c-746fe4de2e96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:39:31 devstack cinder-volume[92060]: INFO cinder.volume.flows.manager.create_volume [None req-15d7c199-1a61-45e3-87c0-8e0c33b11036 tempest-GroupsTest-435826423 None] Volume ce1ae651-30b1-4327-9a62-c7609f5311f0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ce1ae651-30b1-4327-9a62-c7609f5311f0', 'volume_size': 1} Jun 17 04:39:31 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-15d7c199-1a61-45e3-87c0-8e0c33b11036 tempest-GroupsTest-435826423 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 04:39:31 devstack sudo[96896]: pam_unix(sudo:session): session closed for user root Jun 17 04:39:31 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-596eb8df-9b80-4448-a560-a04daf7c9af4 tempest-ServerActionsTestOtherA-1987628563 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-87612384-1fa0-40a0-b4fb-f5570b67b53a" returned: 0 in 1.304s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:39:31 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-596eb8df-9b80-4448-a560-a04daf7c9af4 tempest-ServerActionsTestOtherA-1987628563 None] Lock "cinder-quobyte-87612384-1fa0-40a0-b4fb-f5570b67b53a" released by "delete_volume" :: held 2.357s {{(pid=92060) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 04:39:31 devstack cinder-volume[92060]: DEBUG cinder.quota [None req-596eb8df-9b80-4448-a560-a04daf7c9af4 tempest-ServerActionsTestOtherA-1987628563 None] Created reservations ['27241a53-5d21-4ae2-8079-cf18a28b2248', 'f256f319-9266-4b11-942b-7194bb1e9068', '53b4c195-2a09-4fec-8edb-df214fcfe787', 'fa583450-660d-4c3a-bde4-3f55c2d00305'] {{(pid=92060) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 17 04:39:31 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-596eb8df-9b80-4448-a560-a04daf7c9af4 tempest-ServerActionsTestOtherA-1987628563 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 04:39:31 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-596eb8df-9b80-4448-a560-a04daf7c9af4 tempest-ServerActionsTestOtherA-1987628563 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 04:39:31 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-596eb8df-9b80-4448-a560-a04daf7c9af4 tempest-ServerActionsTestOtherA-1987628563 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588': None} {{(pid=92060) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 17 04:39:31 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-596eb8df-9b80-4448-a560-a04daf7c9af4 tempest-ServerActionsTestOtherA-1987628563 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588'] {{(pid=92060) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 17 04:39:31 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-596eb8df-9b80-4448-a560-a04daf7c9af4 tempest-ServerActionsTestOtherA-1987628563 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 04:39:31 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-596eb8df-9b80-4448-a560-a04daf7c9af4 tempest-ServerActionsTestOtherA-1987628563 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:39:31 devstack sudo[96909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a Jun 17 04:39:31 devstack sudo[96909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:39:31 devstack sudo[96901]: pam_unix(sudo:session): session closed for user root Jun 17 04:39:31 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-1b688c51-7c12-44d0-bf0d-a917db9ba958 tempest-ServerRescueNegativeTestJSON-973268383 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-292c8d5e-40b9-4ff4-ad15-be913fea8630 1073741824" returned: 0 in 1.184s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:39:31 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-1b688c51-7c12-44d0-bf0d-a917db9ba958 tempest-ServerRescueNegativeTestJSON-973268383 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-292c8d5e-40b9-4ff4-ad15-be913fea8630 {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:39:31 devstack sudo[96912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-292c8d5e-40b9-4ff4-ad15-be913fea8630 Jun 17 04:39:31 devstack sudo[96912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:39:32 devstack sudo[96909]: pam_unix(sudo:session): session closed for user root Jun 17 04:39:32 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-596eb8df-9b80-4448-a560-a04daf7c9af4 tempest-ServerActionsTestOtherA-1987628563 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a" returned: 0 in 1.556s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:39:32 devstack cinder-volume[92060]: DEBUG cinder.manager [None req-596eb8df-9b80-4448-a560-a04daf7c9af4 tempest-ServerActionsTestOtherA-1987628563 None] Notifying Schedulers of capabilities ... {{(pid=92060) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 17 04:39:32 devstack cinder-volume[92060]: INFO cinder.volume.manager [None req-596eb8df-9b80-4448-a560-a04daf7c9af4 tempest-ServerActionsTestOtherA-1987628563 None] Deleted volume successfully. Jun 17 04:39:32 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-596eb8df-9b80-4448-a560-a04daf7c9af4 tempest-ServerActionsTestOtherA-1987628563 None] Lock "cinder-87612384-1fa0-40a0-b4fb-f5570b67b53a-delete_volume" released by "delete_volume" :: held 4.295s {{(pid=92060) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 04:39:33 devstack sudo[96912]: pam_unix(sudo:session): session closed for user root Jun 17 04:39:33 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-1b688c51-7c12-44d0-bf0d-a917db9ba958 tempest-ServerRescueNegativeTestJSON-973268383 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-292c8d5e-40b9-4ff4-ad15-be913fea8630" returned: 0 in 1.676s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:39:33 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-1b688c51-7c12-44d0-bf0d-a917db9ba958 tempest-ServerRescueNegativeTestJSON-973268383 None] <== create_volume: return (2909ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588'} {{(pid=92060) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 17 04:39:33 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-1b688c51-7c12-44d0-bf0d-a917db9ba958 tempest-ServerRescueNegativeTestJSON-973268383 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.911s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 04:39:33 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-15d7c199-1a61-45e3-87c0-8e0c33b11036 tempest-GroupsTest-435826423 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.180s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 04:39:33 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-15d7c199-1a61-45e3-87c0-8e0c33b11036 tempest-GroupsTest-435826423 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=d6984557-ae39-496d-a49b-a79ae8c507d8,created_at=2026-06-17T02:39:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2037374247',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=d6984557-ae39-496d-a49b-a79ae8c507d8,host='devstack@QuobyteHD#QuobyteHD',id=ce1ae651-30b1-4327-9a62-c7609f5311f0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f0c195d77c8b45b7b8724980573b621b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T02:39:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T02:39:31Z,use_quota=True,user_id='ba08fcb4c0db4a60b666a7cc49d86059',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f9a45ec-8da0-4080-ab59-b56af01abda1),volume_type_id=4f9a45ec-8da0-4080-ab59-b56af01abda1)}" {{(pid=92060) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 17 04:39:33 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.remotefs [None req-15d7c199-1a61-45e3-87c0-8e0c33b11036 tempest-GroupsTest-435826423 None] Creating volume ce1ae651-30b1-4327-9a62-c7609f5311f0 {{(pid=92060) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 17 04:39:33 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-15d7c199-1a61-45e3-87c0-8e0c33b11036 tempest-GroupsTest-435826423 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 04:39:33 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-15d7c199-1a61-45e3-87c0-8e0c33b11036 tempest-GroupsTest-435826423 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 04:39:33 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-15d7c199-1a61-45e3-87c0-8e0c33b11036 tempest-GroupsTest-435826423 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588': None} {{(pid=92060) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 17 04:39:33 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-15d7c199-1a61-45e3-87c0-8e0c33b11036 tempest-GroupsTest-435826423 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588'] {{(pid=92060) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 17 04:39:33 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-15d7c199-1a61-45e3-87c0-8e0c33b11036 tempest-GroupsTest-435826423 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 04:39:33 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-15d7c199-1a61-45e3-87c0-8e0c33b11036 tempest-GroupsTest-435826423 None] Selected osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588 as target Quobyte volume. {{(pid=92060) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 17 04:39:33 devstack cinder-volume[92060]: INFO cinder.volume.drivers.remotefs [None req-15d7c199-1a61-45e3-87c0-8e0c33b11036 tempest-GroupsTest-435826423 None] casted to osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588 Jun 17 04:39:33 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-15d7c199-1a61-45e3-87c0-8e0c33b11036 tempest-GroupsTest-435826423 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-ce1ae651-30b1-4327-9a62-c7609f5311f0 1073741824 {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:39:33 devstack sudo[96975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-ce1ae651-30b1-4327-9a62-c7609f5311f0 1073741824 Jun 17 04:39:33 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-1b688c51-7c12-44d0-bf0d-a917db9ba958 tempest-ServerRescueNegativeTestJSON-973268383 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2011725c-90ee-4d9f-92da-e8fead722b8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-292c8d5e-40b9-4ff4-ad15-be913fea8630', 'volume_size': 1}' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:39:33 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-1b688c51-7c12-44d0-bf0d-a917db9ba958 tempest-ServerRescueNegativeTestJSON-973268383 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f67ee4c6-3909-4794-af8b-f27ab90496da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:39:33 devstack sudo[96975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:39:33 devstack cinder-volume[92060]: INFO cinder.volume.flows.manager.create_volume [None req-1b688c51-7c12-44d0-bf0d-a917db9ba958 tempest-ServerRescueNegativeTestJSON-973268383 None] Volume volume-292c8d5e-40b9-4ff4-ad15-be913fea8630 (292c8d5e-40b9-4ff4-ad15-be913fea8630): created successfully Jun 17 04:39:33 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-1b688c51-7c12-44d0-bf0d-a917db9ba958 tempest-ServerRescueNegativeTestJSON-973268383 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f67ee4c6-3909-4794-af8b-f27ab90496da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:39:33 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-1b688c51-7c12-44d0-bf0d-a917db9ba958 tempest-ServerRescueNegativeTestJSON-973268383 None] Flow 'volume_create_manager' (04dd12c9-512c-4629-bd5e-507c7f75c118) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92060) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 17 04:39:33 devstack cinder-volume[92060]: INFO cinder.volume.manager [None req-1b688c51-7c12-44d0-bf0d-a917db9ba958 tempest-ServerRescueNegativeTestJSON-973268383 None] Created volume successfully. Jun 17 04:39:35 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-15d7c199-1a61-45e3-87c0-8e0c33b11036 tempest-GroupsTest-435826423 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-ce1ae651-30b1-4327-9a62-c7609f5311f0 1073741824" returned: 0 in 2.241s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:39:35 devstack sudo[96975]: pam_unix(sudo:session): session closed for user root Jun 17 04:39:35 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-15d7c199-1a61-45e3-87c0-8e0c33b11036 tempest-GroupsTest-435826423 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-ce1ae651-30b1-4327-9a62-c7609f5311f0 {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:39:35 devstack sudo[97018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-ce1ae651-30b1-4327-9a62-c7609f5311f0 Jun 17 04:39:35 devstack sudo[97018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:39:36 devstack sudo[97018]: pam_unix(sudo:session): session closed for user root Jun 17 04:39:36 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-15d7c199-1a61-45e3-87c0-8e0c33b11036 tempest-GroupsTest-435826423 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-ce1ae651-30b1-4327-9a62-c7609f5311f0" returned: 0 in 1.239s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:39:36 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-15d7c199-1a61-45e3-87c0-8e0c33b11036 tempest-GroupsTest-435826423 None] <== create_volume: return (3531ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588'} {{(pid=92060) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 17 04:39:36 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-15d7c199-1a61-45e3-87c0-8e0c33b11036 tempest-GroupsTest-435826423 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.543s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 04:39:36 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-15d7c199-1a61-45e3-87c0-8e0c33b11036 tempest-GroupsTest-435826423 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (024a2f3a-7ff0-43fa-9d6c-746fe4de2e96) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ce1ae651-30b1-4327-9a62-c7609f5311f0', 'volume_size': 1}' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:39:36 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-15d7c199-1a61-45e3-87c0-8e0c33b11036 tempest-GroupsTest-435826423 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b6eeeafe-d772-4063-a289-e30b4946bc2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:39:36 devstack cinder-volume[92060]: INFO cinder.volume.flows.manager.create_volume [None req-15d7c199-1a61-45e3-87c0-8e0c33b11036 tempest-GroupsTest-435826423 None] Volume volume-ce1ae651-30b1-4327-9a62-c7609f5311f0 (ce1ae651-30b1-4327-9a62-c7609f5311f0): created successfully Jun 17 04:39:36 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-15d7c199-1a61-45e3-87c0-8e0c33b11036 tempest-GroupsTest-435826423 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b6eeeafe-d772-4063-a289-e30b4946bc2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:39:36 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-15d7c199-1a61-45e3-87c0-8e0c33b11036 tempest-GroupsTest-435826423 None] Flow 'volume_create_manager' (561232a7-3810-405c-b330-199bc8c96511) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92060) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 17 04:39:36 devstack cinder-volume[92060]: INFO cinder.volume.manager [None req-15d7c199-1a61-45e3-87c0-8e0c33b11036 tempest-GroupsTest-435826423 None] Created volume successfully. Jun 17 04:39:37 devstack cinder-volume[92060]: INFO cinder.volume.manager [None req-438036d2-458c-456c-9489-91092a88e0ae tempest-GroupsTest-435826423 None] Update group completed successfully. Jun 17 04:39:39 devstack cinder-volume[92060]: INFO cinder.volume.manager [None req-3ba6c582-3a93-4a64-9520-048e8cbdd389 tempest-GroupsTest-435826423 None] Update group completed successfully. Jun 17 04:39:41 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-6965349f-d81b-4a1d-8b07-ac354ae775da tempest-GroupsTest-435826423 None] Acquiring lock "cinder-quobyte-6d99b392-a7f3-4a32-8c74-bf71e133e10c" by "delete_volume" {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 04:39:41 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-6965349f-d81b-4a1d-8b07-ac354ae775da tempest-GroupsTest-435826423 None] Lock "cinder-quobyte-6d99b392-a7f3-4a32-8c74-bf71e133e10c" acquired by "delete_volume" :: waited 0.055s {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 04:39:41 devstack cinder-volume[92060]: DEBUG oslo.privsep.daemon [-] privsep: reply[422795df-4138-420a-a169-5711ddb5b506]: (4, 'qcow2') {{(pid=93130) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 04:39:41 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-6965349f-d81b-4a1d-8b07-ac354ae775da tempest-GroupsTest-435826423 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-6d99b392-a7f3-4a32-8c74-bf71e133e10c {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:39:41 devstack sudo[97064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-6d99b392-a7f3-4a32-8c74-bf71e133e10c Jun 17 04:39:41 devstack sudo[97064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:39:42 devstack sudo[97064]: pam_unix(sudo:session): session closed for user root Jun 17 04:39:42 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-6965349f-d81b-4a1d-8b07-ac354ae775da tempest-GroupsTest-435826423 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-6d99b392-a7f3-4a32-8c74-bf71e133e10c" returned: 0 in 1.002s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:39:42 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-6965349f-d81b-4a1d-8b07-ac354ae775da tempest-GroupsTest-435826423 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-6d99b392-a7f3-4a32-8c74-bf71e133e10c {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:39:42 devstack sudo[97113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-6d99b392-a7f3-4a32-8c74-bf71e133e10c Jun 17 04:39:42 devstack sudo[97113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:39:43 devstack sudo[97113]: pam_unix(sudo:session): session closed for user root Jun 17 04:39:43 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-6965349f-d81b-4a1d-8b07-ac354ae775da tempest-GroupsTest-435826423 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-6d99b392-a7f3-4a32-8c74-bf71e133e10c" returned: 0 in 0.896s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:39:43 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-6965349f-d81b-4a1d-8b07-ac354ae775da tempest-GroupsTest-435826423 None] Lock "cinder-quobyte-6d99b392-a7f3-4a32-8c74-bf71e133e10c" released by "delete_volume" :: held 1.976s {{(pid=92060) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 04:39:43 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-6965349f-d81b-4a1d-8b07-ac354ae775da tempest-GroupsTest-435826423 None] Acquiring lock "cinder-quobyte-ce1ae651-30b1-4327-9a62-c7609f5311f0" by "delete_volume" {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 04:39:43 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-6965349f-d81b-4a1d-8b07-ac354ae775da tempest-GroupsTest-435826423 None] Lock "cinder-quobyte-ce1ae651-30b1-4327-9a62-c7609f5311f0" acquired by "delete_volume" :: waited 0.026s {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 04:39:43 devstack cinder-volume[92060]: DEBUG oslo.privsep.daemon [-] privsep: reply[63ebf10e-0527-413a-9a9d-ded07b12ed15]: (4, 'qcow2') {{(pid=93130) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 04:39:43 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-6965349f-d81b-4a1d-8b07-ac354ae775da tempest-GroupsTest-435826423 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-ce1ae651-30b1-4327-9a62-c7609f5311f0 {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:39:43 devstack sudo[97116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-ce1ae651-30b1-4327-9a62-c7609f5311f0 Jun 17 04:39:43 devstack sudo[97116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:39:44 devstack sudo[97116]: pam_unix(sudo:session): session closed for user root Jun 17 04:39:44 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-6965349f-d81b-4a1d-8b07-ac354ae775da tempest-GroupsTest-435826423 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-ce1ae651-30b1-4327-9a62-c7609f5311f0" returned: 0 in 0.817s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:39:44 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-6965349f-d81b-4a1d-8b07-ac354ae775da tempest-GroupsTest-435826423 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-ce1ae651-30b1-4327-9a62-c7609f5311f0 {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:39:44 devstack sudo[97122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-ce1ae651-30b1-4327-9a62-c7609f5311f0 Jun 17 04:39:44 devstack sudo[97122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:39:44 devstack cinder-volume[92060]: DEBUG oslo_service.periodic_task [None req-60d279ad-ad8c-4d36-a4b8-f593e74fb922 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=92060) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 17 04:39:44 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-60d279ad-ad8c-4d36-a4b8-f593e74fb922 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 04:39:44 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-60d279ad-ad8c-4d36-a4b8-f593e74fb922 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 04:39:44 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-60d279ad-ad8c-4d36-a4b8-f593e74fb922 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588': None} {{(pid=92060) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 17 04:39:44 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-60d279ad-ad8c-4d36-a4b8-f593e74fb922 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588'] {{(pid=92060) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 17 04:39:44 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-60d279ad-ad8c-4d36-a4b8-f593e74fb922 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 04:39:44 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-60d279ad-ad8c-4d36-a4b8-f593e74fb922 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:39:44 devstack sudo[97127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a Jun 17 04:39:44 devstack sudo[97127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:39:45 devstack sudo[97122]: pam_unix(sudo:session): session closed for user root Jun 17 04:39:45 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-6965349f-d81b-4a1d-8b07-ac354ae775da tempest-GroupsTest-435826423 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-ce1ae651-30b1-4327-9a62-c7609f5311f0" returned: 0 in 0.747s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:39:45 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-6965349f-d81b-4a1d-8b07-ac354ae775da tempest-GroupsTest-435826423 None] Lock "cinder-quobyte-ce1ae651-30b1-4327-9a62-c7609f5311f0" released by "delete_volume" :: held 1.617s {{(pid=92060) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 04:39:45 devstack cinder-volume[92060]: DEBUG cinder.quota [None req-6965349f-d81b-4a1d-8b07-ac354ae775da tempest-GroupsTest-435826423 None] Created reservations ['c13fae64-12da-4a7c-a82c-51ca453cf96e'] {{(pid=92060) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 17 04:39:45 devstack cinder-volume[92060]: WARNING cinder.quota [None req-6965349f-d81b-4a1d-8b07-ac354ae775da tempest-GroupsTest-435826423 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-1459293269 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-1459293269, it is now deprecated. Please use the default quota class for default quota. Jun 17 04:39:45 devstack cinder-volume[92060]: WARNING cinder.quota [None req-6965349f-d81b-4a1d-8b07-ac354ae775da tempest-GroupsTest-435826423 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-1459293269 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-1459293269, it is now deprecated. Please use the default quota class for default quota. Jun 17 04:39:45 devstack cinder-volume[92060]: DEBUG cinder.quota [None req-6965349f-d81b-4a1d-8b07-ac354ae775da tempest-GroupsTest-435826423 None] Created reservations ['25e5e01c-5716-4151-a57c-5d6ca7041f1a', '2a75de48-6940-4dcf-9a59-b403476fe878', 'afb841b9-9543-4284-af4e-482dfbbce7bb', '9386dd35-d213-42d8-8e4f-8c3a9a6c5000'] {{(pid=92060) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 17 04:39:45 devstack cinder-volume[92060]: DEBUG cinder.quota [None req-6965349f-d81b-4a1d-8b07-ac354ae775da tempest-GroupsTest-435826423 None] Created reservations ['e785fb99-96be-4c4d-9832-c257c67d4414', '6a9f98d9-4a4a-441a-abb2-b7ddb17f9fc0', 'd61866fe-dd6a-4733-9d6f-f011e4763f38', '8057dff8-9e56-44b7-ba23-db078786ab98'] {{(pid=92060) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 17 04:39:45 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-6965349f-d81b-4a1d-8b07-ac354ae775da tempest-GroupsTest-435826423 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 04:39:45 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-6965349f-d81b-4a1d-8b07-ac354ae775da tempest-GroupsTest-435826423 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 04:39:45 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-6965349f-d81b-4a1d-8b07-ac354ae775da tempest-GroupsTest-435826423 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588': None} {{(pid=92060) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 17 04:39:45 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-6965349f-d81b-4a1d-8b07-ac354ae775da tempest-GroupsTest-435826423 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588'] {{(pid=92060) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 17 04:39:45 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-6965349f-d81b-4a1d-8b07-ac354ae775da tempest-GroupsTest-435826423 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 04:39:45 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-6965349f-d81b-4a1d-8b07-ac354ae775da tempest-GroupsTest-435826423 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:39:45 devstack sudo[97129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a Jun 17 04:39:45 devstack sudo[97129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:39:45 devstack sudo[97127]: pam_unix(sudo:session): session closed for user root Jun 17 04:39:45 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-60d279ad-ad8c-4d36-a4b8-f593e74fb922 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a" returned: 0 in 0.764s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:39:45 devstack cinder-volume[92060]: DEBUG cinder.manager [None req-60d279ad-ad8c-4d36-a4b8-f593e74fb922 None None] Notifying Schedulers of capabilities ... {{(pid=92060) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 17 04:39:45 devstack cinder-volume[92060]: DEBUG oslo_service.periodic_task [None req-60d279ad-ad8c-4d36-a4b8-f593e74fb922 None None] Running periodic task VolumeManager._thread_info {{(pid=92060) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 17 04:39:45 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-60d279ad-ad8c-4d36-a4b8-f593e74fb922 None None] thread count: 8 {{(pid=92060) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 17 04:39:45 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-60d279ad-ad8c-4d36-a4b8-f593e74fb922 None None] thread info: [<_MainThread(MainThread, started 130061806440576)>, , , , , , , ] {{(pid=92060) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 17 04:39:46 devstack sudo[97129]: pam_unix(sudo:session): session closed for user root Jun 17 04:39:46 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-6965349f-d81b-4a1d-8b07-ac354ae775da tempest-GroupsTest-435826423 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a" returned: 0 in 1.215s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:39:46 devstack cinder-volume[92060]: DEBUG cinder.manager [None req-6965349f-d81b-4a1d-8b07-ac354ae775da tempest-GroupsTest-435826423 None] Notifying Schedulers of capabilities ... {{(pid=92060) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 17 04:39:46 devstack cinder-volume[92060]: INFO cinder.volume.manager [None req-6965349f-d81b-4a1d-8b07-ac354ae775da tempest-GroupsTest-435826423 None] Delete group completed successfully. Jun 17 04:39:54 devstack cinder-volume[92060]: INFO cinder.volume.manager [None req-fb23767e-6ca0-44a3-9f21-a1d2b3c0f39f tempest-GroupsV314Test-1381606140 None] Group tempest-GroupsV314Test-Group-105980165: creating Jun 17 04:39:54 devstack cinder-volume[92060]: INFO cinder.volume.manager [None req-fb23767e-6ca0-44a3-9f21-a1d2b3c0f39f tempest-GroupsV314Test-1381606140 None] Group tempest-GroupsV314Test-Group-105980165: created successfully Jun 17 04:39:54 devstack cinder-volume[92060]: INFO cinder.volume.manager [None req-fb23767e-6ca0-44a3-9f21-a1d2b3c0f39f tempest-GroupsV314Test-1381606140 None] Create group completed successfully. Jun 17 04:39:55 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-d3f091c2-a960-4ae7-8297-9ff20fff285f tempest-BackendsCapabilitiesAdminTestsJSON-1536171678 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7578468322754, 'free_capacity_gb': 1775.7578468322754, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=92060) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Jun 17 04:39:55 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-3c510e64-802f-412a-8ec1-25f61abf7570 tempest-BackendsCapabilitiesAdminTestsJSON-1536171678 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7578468322754, 'free_capacity_gb': 1775.7578468322754, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=92060) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Jun 17 04:39:56 devstack cinder-volume[92060]: DEBUG cinder.volume.flows.manager.create_volume [None req-32ebb943-3a5c-4199-89f2-c7a75a2cfb35 tempest-GroupsV314Test-1381606140 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92060) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 17 04:39:56 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-32ebb943-3a5c-4199-89f2-c7a75a2cfb35 tempest-GroupsV314Test-1381606140 None] Flow 'volume_create_manager' (c2a2da11-562a-4590-a4ae-c6615dc6b8de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 17 04:39:56 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-32ebb943-3a5c-4199-89f2-c7a75a2cfb35 tempest-GroupsV314Test-1381606140 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7dd60910-fec2-46bc-be57-fbb5ce6c88a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:39:56 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-f288103c-0c54-43a0-b3f3-fd263b8e6df8 tempest-ServerRescueNegativeTestJSON-973268383 None] Acquiring lock "cinder-292c8d5e-40b9-4ff4-ad15-be913fea8630-delete_volume" by "delete_volume" {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 04:39:56 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-f288103c-0c54-43a0-b3f3-fd263b8e6df8 tempest-ServerRescueNegativeTestJSON-973268383 None] Lock "cinder-292c8d5e-40b9-4ff4-ad15-be913fea8630-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 04:39:56 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-32ebb943-3a5c-4199-89f2-c7a75a2cfb35 tempest-GroupsV314Test-1381606140 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7dd60910-fec2-46bc-be57-fbb5ce6c88a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-17T02:39:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-686160393',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=df229265-219b-4fa5-875e-91534a1949ea,host='devstack@QuobyteHD#QuobyteHD',id=37ce51f1-26d3-4eab-bc2e-1acdac1cf844,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c8f16ad1d38845cc8d356581346423ba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T02:39:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T02:39:56Z,use_quota=True,user_id='d94e5808f3b9448b8f9da08bb29e3fd0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f056b539-d0ba-4b7d-aa38-1a1684d1a749),volume_type_id=f056b539-d0ba-4b7d-aa38-1a1684d1a749)' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:39:56 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-32ebb943-3a5c-4199-89f2-c7a75a2cfb35 tempest-GroupsV314Test-1381606140 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f70925d7-92a6-4e07-aa9d-8f2f2ed6dc8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:39:56 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-32ebb943-3a5c-4199-89f2-c7a75a2cfb35 tempest-GroupsV314Test-1381606140 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f70925d7-92a6-4e07-aa9d-8f2f2ed6dc8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:39:56 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-32ebb943-3a5c-4199-89f2-c7a75a2cfb35 tempest-GroupsV314Test-1381606140 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9a10e8db-1fcc-4c37-849f-53adb85640e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:39:56 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-32ebb943-3a5c-4199-89f2-c7a75a2cfb35 tempest-GroupsV314Test-1381606140 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9a10e8db-1fcc-4c37-849f-53adb85640e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '37ce51f1-26d3-4eab-bc2e-1acdac1cf844', 'volume_name': 'volume-37ce51f1-26d3-4eab-bc2e-1acdac1cf844', 'volume_size': 1}' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:39:56 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-32ebb943-3a5c-4199-89f2-c7a75a2cfb35 tempest-GroupsV314Test-1381606140 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (52f17a3f-ec83-4697-b746-5d053c033cdf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:39:56 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-32ebb943-3a5c-4199-89f2-c7a75a2cfb35 tempest-GroupsV314Test-1381606140 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (52f17a3f-ec83-4697-b746-5d053c033cdf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:39:56 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-32ebb943-3a5c-4199-89f2-c7a75a2cfb35 tempest-GroupsV314Test-1381606140 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cdbb4689-aa86-4c97-be5e-b059424c57e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:39:56 devstack cinder-volume[92060]: INFO cinder.volume.flows.manager.create_volume [None req-32ebb943-3a5c-4199-89f2-c7a75a2cfb35 tempest-GroupsV314Test-1381606140 None] Volume 37ce51f1-26d3-4eab-bc2e-1acdac1cf844: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-37ce51f1-26d3-4eab-bc2e-1acdac1cf844', 'volume_size': 1} Jun 17 04:39:56 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-32ebb943-3a5c-4199-89f2-c7a75a2cfb35 tempest-GroupsV314Test-1381606140 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 04:39:56 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-32ebb943-3a5c-4199-89f2-c7a75a2cfb35 tempest-GroupsV314Test-1381606140 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 04:39:56 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-32ebb943-3a5c-4199-89f2-c7a75a2cfb35 tempest-GroupsV314Test-1381606140 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=df229265-219b-4fa5-875e-91534a1949ea,created_at=2026-06-17T02:39:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-686160393',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=df229265-219b-4fa5-875e-91534a1949ea,host='devstack@QuobyteHD#QuobyteHD',id=37ce51f1-26d3-4eab-bc2e-1acdac1cf844,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c8f16ad1d38845cc8d356581346423ba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T02:39:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T02:39:56Z,use_quota=True,user_id='d94e5808f3b9448b8f9da08bb29e3fd0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f056b539-d0ba-4b7d-aa38-1a1684d1a749),volume_type_id=f056b539-d0ba-4b7d-aa38-1a1684d1a749)}" {{(pid=92060) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 17 04:39:56 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.remotefs [None req-32ebb943-3a5c-4199-89f2-c7a75a2cfb35 tempest-GroupsV314Test-1381606140 None] Creating volume 37ce51f1-26d3-4eab-bc2e-1acdac1cf844 {{(pid=92060) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 17 04:39:56 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-32ebb943-3a5c-4199-89f2-c7a75a2cfb35 tempest-GroupsV314Test-1381606140 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 04:39:56 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-32ebb943-3a5c-4199-89f2-c7a75a2cfb35 tempest-GroupsV314Test-1381606140 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 04:39:56 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-32ebb943-3a5c-4199-89f2-c7a75a2cfb35 tempest-GroupsV314Test-1381606140 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588': None} {{(pid=92060) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 17 04:39:56 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-32ebb943-3a5c-4199-89f2-c7a75a2cfb35 tempest-GroupsV314Test-1381606140 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588'] {{(pid=92060) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 17 04:39:56 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-32ebb943-3a5c-4199-89f2-c7a75a2cfb35 tempest-GroupsV314Test-1381606140 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 04:39:56 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-32ebb943-3a5c-4199-89f2-c7a75a2cfb35 tempest-GroupsV314Test-1381606140 None] Selected osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588 as target Quobyte volume. {{(pid=92060) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 17 04:39:56 devstack cinder-volume[92060]: INFO cinder.volume.drivers.remotefs [None req-32ebb943-3a5c-4199-89f2-c7a75a2cfb35 tempest-GroupsV314Test-1381606140 None] casted to osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588 Jun 17 04:39:56 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-32ebb943-3a5c-4199-89f2-c7a75a2cfb35 tempest-GroupsV314Test-1381606140 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-37ce51f1-26d3-4eab-bc2e-1acdac1cf844 1073741824 {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:39:56 devstack sudo[97280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-37ce51f1-26d3-4eab-bc2e-1acdac1cf844 1073741824 Jun 17 04:39:56 devstack sudo[97280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:39:56 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-f288103c-0c54-43a0-b3f3-fd263b8e6df8 tempest-ServerRescueNegativeTestJSON-973268383 None] Acquiring lock "cinder-quobyte-292c8d5e-40b9-4ff4-ad15-be913fea8630" by "delete_volume" {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 04:39:56 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-f288103c-0c54-43a0-b3f3-fd263b8e6df8 tempest-ServerRescueNegativeTestJSON-973268383 None] Lock "cinder-quobyte-292c8d5e-40b9-4ff4-ad15-be913fea8630" acquired by "delete_volume" :: waited 0.023s {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 04:39:56 devstack cinder-volume[92060]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb43ef9c-46f1-4aa5-8c64-bd5d49b1bfa2]: (4, 'qcow2') {{(pid=93130) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 04:39:56 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-f288103c-0c54-43a0-b3f3-fd263b8e6df8 tempest-ServerRescueNegativeTestJSON-973268383 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-292c8d5e-40b9-4ff4-ad15-be913fea8630 {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:39:56 devstack sudo[97282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-292c8d5e-40b9-4ff4-ad15-be913fea8630 Jun 17 04:39:56 devstack sudo[97282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:39:57 devstack sudo[97280]: pam_unix(sudo:session): session closed for user root Jun 17 04:39:57 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-32ebb943-3a5c-4199-89f2-c7a75a2cfb35 tempest-GroupsV314Test-1381606140 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-37ce51f1-26d3-4eab-bc2e-1acdac1cf844 1073741824" returned: 0 in 1.224s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:39:57 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-32ebb943-3a5c-4199-89f2-c7a75a2cfb35 tempest-GroupsV314Test-1381606140 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-37ce51f1-26d3-4eab-bc2e-1acdac1cf844 {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:39:57 devstack sudo[97292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-37ce51f1-26d3-4eab-bc2e-1acdac1cf844 Jun 17 04:39:57 devstack sudo[97292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:39:57 devstack sudo[97282]: pam_unix(sudo:session): session closed for user root Jun 17 04:39:57 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-f288103c-0c54-43a0-b3f3-fd263b8e6df8 tempest-ServerRescueNegativeTestJSON-973268383 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-292c8d5e-40b9-4ff4-ad15-be913fea8630" returned: 0 in 1.220s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:39:57 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-f288103c-0c54-43a0-b3f3-fd263b8e6df8 tempest-ServerRescueNegativeTestJSON-973268383 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-292c8d5e-40b9-4ff4-ad15-be913fea8630 {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:39:57 devstack sudo[97294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-292c8d5e-40b9-4ff4-ad15-be913fea8630 Jun 17 04:39:57 devstack sudo[97294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:39:58 devstack sudo[97292]: pam_unix(sudo:session): session closed for user root Jun 17 04:39:58 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-32ebb943-3a5c-4199-89f2-c7a75a2cfb35 tempest-GroupsV314Test-1381606140 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-37ce51f1-26d3-4eab-bc2e-1acdac1cf844" returned: 0 in 0.863s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:39:58 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-32ebb943-3a5c-4199-89f2-c7a75a2cfb35 tempest-GroupsV314Test-1381606140 None] <== create_volume: return (2154ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588'} {{(pid=92060) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 17 04:39:58 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-32ebb943-3a5c-4199-89f2-c7a75a2cfb35 tempest-GroupsV314Test-1381606140 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.159s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 04:39:58 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-32ebb943-3a5c-4199-89f2-c7a75a2cfb35 tempest-GroupsV314Test-1381606140 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cdbb4689-aa86-4c97-be5e-b059424c57e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-37ce51f1-26d3-4eab-bc2e-1acdac1cf844', 'volume_size': 1}' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:39:58 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-32ebb943-3a5c-4199-89f2-c7a75a2cfb35 tempest-GroupsV314Test-1381606140 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (68f565cf-5e82-4d78-8a97-598b9a6ca406) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:39:58 devstack cinder-volume[92060]: INFO cinder.volume.flows.manager.create_volume [None req-32ebb943-3a5c-4199-89f2-c7a75a2cfb35 tempest-GroupsV314Test-1381606140 None] Volume volume-37ce51f1-26d3-4eab-bc2e-1acdac1cf844 (37ce51f1-26d3-4eab-bc2e-1acdac1cf844): created successfully Jun 17 04:39:58 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-32ebb943-3a5c-4199-89f2-c7a75a2cfb35 tempest-GroupsV314Test-1381606140 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (68f565cf-5e82-4d78-8a97-598b9a6ca406) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:39:58 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-32ebb943-3a5c-4199-89f2-c7a75a2cfb35 tempest-GroupsV314Test-1381606140 None] Flow 'volume_create_manager' (c2a2da11-562a-4590-a4ae-c6615dc6b8de) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92060) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 17 04:39:58 devstack cinder-volume[92060]: INFO cinder.volume.manager [None req-32ebb943-3a5c-4199-89f2-c7a75a2cfb35 tempest-GroupsV314Test-1381606140 None] Created volume successfully. Jun 17 04:39:58 devstack sudo[97294]: pam_unix(sudo:session): session closed for user root Jun 17 04:39:58 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-f288103c-0c54-43a0-b3f3-fd263b8e6df8 tempest-ServerRescueNegativeTestJSON-973268383 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-292c8d5e-40b9-4ff4-ad15-be913fea8630" returned: 0 in 0.954s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:39:58 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-f288103c-0c54-43a0-b3f3-fd263b8e6df8 tempest-ServerRescueNegativeTestJSON-973268383 None] Lock "cinder-quobyte-292c8d5e-40b9-4ff4-ad15-be913fea8630" released by "delete_volume" :: held 2.250s {{(pid=92060) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 04:39:58 devstack cinder-volume[92060]: DEBUG cinder.quota [None req-f288103c-0c54-43a0-b3f3-fd263b8e6df8 tempest-ServerRescueNegativeTestJSON-973268383 None] Created reservations ['7a5e1b05-67ee-4581-ba99-5c13a70f4f77', '72ba8403-e4c0-44da-8cc9-77520a6bd727', '87791d80-f5a2-442d-b9bb-e24ec56ce45d', 'c5c2e427-25d7-4222-9e8b-d8a563c57370'] {{(pid=92060) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 17 04:39:58 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-f288103c-0c54-43a0-b3f3-fd263b8e6df8 tempest-ServerRescueNegativeTestJSON-973268383 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 04:39:58 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-f288103c-0c54-43a0-b3f3-fd263b8e6df8 tempest-ServerRescueNegativeTestJSON-973268383 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 04:39:58 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-f288103c-0c54-43a0-b3f3-fd263b8e6df8 tempest-ServerRescueNegativeTestJSON-973268383 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588': None} {{(pid=92060) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 17 04:39:58 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-f288103c-0c54-43a0-b3f3-fd263b8e6df8 tempest-ServerRescueNegativeTestJSON-973268383 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588'] {{(pid=92060) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 17 04:39:58 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-f288103c-0c54-43a0-b3f3-fd263b8e6df8 tempest-ServerRescueNegativeTestJSON-973268383 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 04:39:58 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-f288103c-0c54-43a0-b3f3-fd263b8e6df8 tempest-ServerRescueNegativeTestJSON-973268383 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:39:58 devstack sudo[97298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a Jun 17 04:39:58 devstack sudo[97298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:39:59 devstack sudo[97298]: pam_unix(sudo:session): session closed for user root Jun 17 04:39:59 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-f288103c-0c54-43a0-b3f3-fd263b8e6df8 tempest-ServerRescueNegativeTestJSON-973268383 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a" returned: 0 in 0.639s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:39:59 devstack cinder-volume[92060]: DEBUG cinder.manager [None req-f288103c-0c54-43a0-b3f3-fd263b8e6df8 tempest-ServerRescueNegativeTestJSON-973268383 None] Notifying Schedulers of capabilities ... {{(pid=92060) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 17 04:39:59 devstack cinder-volume[92060]: INFO cinder.volume.manager [None req-f288103c-0c54-43a0-b3f3-fd263b8e6df8 tempest-ServerRescueNegativeTestJSON-973268383 None] Deleted volume successfully. Jun 17 04:39:59 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-f288103c-0c54-43a0-b3f3-fd263b8e6df8 tempest-ServerRescueNegativeTestJSON-973268383 None] Lock "cinder-292c8d5e-40b9-4ff4-ad15-be913fea8630-delete_volume" released by "delete_volume" :: held 3.268s {{(pid=92060) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 04:39:59 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-564b1aeb-3fe6-4ce9-84b1-7f68f20652a4 tempest-GroupsV314Test-1381606140 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 04:39:59 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-564b1aeb-3fe6-4ce9-84b1-7f68f20652a4 tempest-GroupsV314Test-1381606140 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 04:39:59 devstack cinder-volume[92060]: INFO cinder.volume.drivers.remotefs [None req-564b1aeb-3fe6-4ce9-84b1-7f68f20652a4 tempest-GroupsV314Test-1381606140 None] Cloning volume 37ce51f1-26d3-4eab-bc2e-1acdac1cf844 to volume f2cf2842-3aa2-4e5b-b658-865023e4304d Jun 17 04:40:00 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.remotefs [None req-564b1aeb-3fe6-4ce9-84b1-7f68f20652a4 tempest-GroupsV314Test-1381606140 None] Creating offline snapshot eed89e36-2b6b-4caf-b0fd-84867dc9585b of volume 37ce51f1-26d3-4eab-bc2e-1acdac1cf844 {{(pid=92060) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 17 04:40:00 devstack cinder-volume[92060]: DEBUG oslo.privsep.daemon [-] privsep: reply[feba4f4d-728e-49fb-9a88-bf164ff57f0f]: (4, 'qcow2') {{(pid=93130) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 04:40:00 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-564b1aeb-3fe6-4ce9-84b1-7f68f20652a4 tempest-GroupsV314Test-1381606140 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-37ce51f1-26d3-4eab-bc2e-1acdac1cf844 {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:40:00 devstack sudo[97303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-37ce51f1-26d3-4eab-bc2e-1acdac1cf844 Jun 17 04:40:00 devstack sudo[97303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:40:01 devstack cinder-volume[92060]: DEBUG dbcounter [-] [92060] Writing DB stats cinder:SELECT=72,cinder:INSERT=16,cinder:UPDATE=87,cinder:DELETE=3 {{(pid=92060) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 17 04:40:01 devstack cinder-volume[92060]: DEBUG dbcounter [-] [92060] Writing DB stats cinder:UPDATE=71,cinder:SELECT=65,cinder:INSERT=18,cinder:DELETE=4 {{(pid=92060) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 17 04:40:01 devstack cinder-volume[92060]: DEBUG cinder.volume.flows.manager.create_volume [None req-53b86a4a-ad9d-4c6f-a2b1-f9ef9ea74db3 tempest-AttachVolumeShelveTestJSON-134363980 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92060) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 17 04:40:01 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-53b86a4a-ad9d-4c6f-a2b1-f9ef9ea74db3 tempest-AttachVolumeShelveTestJSON-134363980 None] Flow 'volume_create_manager' (2c25800c-33df-4f99-9b7a-a6ffdab947c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 17 04:40:01 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-53b86a4a-ad9d-4c6f-a2b1-f9ef9ea74db3 tempest-AttachVolumeShelveTestJSON-134363980 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7c690932-221c-4c2d-aadc-44cdeb514512) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:40:01 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-53b86a4a-ad9d-4c6f-a2b1-f9ef9ea74db3 tempest-AttachVolumeShelveTestJSON-134363980 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7c690932-221c-4c2d-aadc-44cdeb514512) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-17T02:40:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-891666024',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0658b107-1fce-439f-a62e-8299bf3b43b8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='51b31662b38d4586825b0c761e731e86',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T02:40:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T02:40:01Z,use_quota=True,user_id='7bde37e17f6247789a101e63fbac5bce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aad9ce24-93f9-41a6-baa1-5125964f96d1),volume_type_id=aad9ce24-93f9-41a6-baa1-5125964f96d1)' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:40:01 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-53b86a4a-ad9d-4c6f-a2b1-f9ef9ea74db3 tempest-AttachVolumeShelveTestJSON-134363980 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bcef78b1-fdd0-4c7a-8c81-9e30e4bdad6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:40:01 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-53b86a4a-ad9d-4c6f-a2b1-f9ef9ea74db3 tempest-AttachVolumeShelveTestJSON-134363980 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bcef78b1-fdd0-4c7a-8c81-9e30e4bdad6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:40:01 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-53b86a4a-ad9d-4c6f-a2b1-f9ef9ea74db3 tempest-AttachVolumeShelveTestJSON-134363980 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ec57532b-cea0-4be5-8d5e-0fa9891392f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:40:01 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-53b86a4a-ad9d-4c6f-a2b1-f9ef9ea74db3 tempest-AttachVolumeShelveTestJSON-134363980 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ec57532b-cea0-4be5-8d5e-0fa9891392f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0658b107-1fce-439f-a62e-8299bf3b43b8', 'volume_name': 'volume-0658b107-1fce-439f-a62e-8299bf3b43b8', 'volume_size': 1}' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:40:01 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-53b86a4a-ad9d-4c6f-a2b1-f9ef9ea74db3 tempest-AttachVolumeShelveTestJSON-134363980 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (54f9bd68-8513-4b58-8905-d11872e62c96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:40:01 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-53b86a4a-ad9d-4c6f-a2b1-f9ef9ea74db3 tempest-AttachVolumeShelveTestJSON-134363980 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (54f9bd68-8513-4b58-8905-d11872e62c96) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:40:01 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-53b86a4a-ad9d-4c6f-a2b1-f9ef9ea74db3 tempest-AttachVolumeShelveTestJSON-134363980 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b22fbe94-3c5f-41e7-8b3d-315fbd95ced6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:40:01 devstack cinder-volume[92060]: INFO cinder.volume.flows.manager.create_volume [None req-53b86a4a-ad9d-4c6f-a2b1-f9ef9ea74db3 tempest-AttachVolumeShelveTestJSON-134363980 None] Volume 0658b107-1fce-439f-a62e-8299bf3b43b8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0658b107-1fce-439f-a62e-8299bf3b43b8', 'volume_size': 1} Jun 17 04:40:01 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-53b86a4a-ad9d-4c6f-a2b1-f9ef9ea74db3 tempest-AttachVolumeShelveTestJSON-134363980 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 04:40:01 devstack sudo[97303]: pam_unix(sudo:session): session closed for user root Jun 17 04:40:01 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-564b1aeb-3fe6-4ce9-84b1-7f68f20652a4 tempest-GroupsV314Test-1381606140 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-37ce51f1-26d3-4eab-bc2e-1acdac1cf844" returned: 0 in 1.561s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:40:01 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-564b1aeb-3fe6-4ce9-84b1-7f68f20652a4 tempest-GroupsV314Test-1381606140 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-37ce51f1-26d3-4eab-bc2e-1acdac1cf844,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-37ce51f1-26d3-4eab-bc2e-1acdac1cf844.eed89e36-2b6b-4caf-b0fd-84867dc9585b 1G {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:40:01 devstack sudo[97343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-37ce51f1-26d3-4eab-bc2e-1acdac1cf844,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-37ce51f1-26d3-4eab-bc2e-1acdac1cf844.eed89e36-2b6b-4caf-b0fd-84867dc9585b 1G Jun 17 04:40:01 devstack sudo[97343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:40:02 devstack sudo[97343]: pam_unix(sudo:session): session closed for user root Jun 17 04:40:02 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-564b1aeb-3fe6-4ce9-84b1-7f68f20652a4 tempest-GroupsV314Test-1381606140 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-37ce51f1-26d3-4eab-bc2e-1acdac1cf844,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-37ce51f1-26d3-4eab-bc2e-1acdac1cf844.eed89e36-2b6b-4caf-b0fd-84867dc9585b 1G" returned: 0 in 1.228s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:40:02 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-564b1aeb-3fe6-4ce9-84b1-7f68f20652a4 tempest-GroupsV314Test-1381606140 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-37ce51f1-26d3-4eab-bc2e-1acdac1cf844 -F qcow2 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-37ce51f1-26d3-4eab-bc2e-1acdac1cf844.eed89e36-2b6b-4caf-b0fd-84867dc9585b {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:40:02 devstack sudo[97350]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-37ce51f1-26d3-4eab-bc2e-1acdac1cf844 -F qcow2 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-37ce51f1-26d3-4eab-bc2e-1acdac1cf844.eed89e36-2b6b-4caf-b0fd-84867dc9585b Jun 17 04:40:02 devstack sudo[97350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:40:03 devstack sudo[97350]: pam_unix(sudo:session): session closed for user root Jun 17 04:40:03 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-564b1aeb-3fe6-4ce9-84b1-7f68f20652a4 tempest-GroupsV314Test-1381606140 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-37ce51f1-26d3-4eab-bc2e-1acdac1cf844 -F qcow2 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-37ce51f1-26d3-4eab-bc2e-1acdac1cf844.eed89e36-2b6b-4caf-b0fd-84867dc9585b" returned: 0 in 0.845s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:40:03 devstack cinder-volume[92060]: WARNING cinder.volume.drivers.remotefs [None req-564b1aeb-3fe6-4ce9-84b1-7f68f20652a4 tempest-GroupsV314Test-1381606140 None] /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-37ce51f1-26d3-4eab-bc2e-1acdac1cf844.eed89e36-2b6b-4caf-b0fd-84867dc9585b is being set with open permissions: ugo+rw: NotImplementedError Jun 17 04:40:03 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-564b1aeb-3fe6-4ce9-84b1-7f68f20652a4 tempest-GroupsV314Test-1381606140 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-37ce51f1-26d3-4eab-bc2e-1acdac1cf844.eed89e36-2b6b-4caf-b0fd-84867dc9585b {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:40:03 devstack sudo[97356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-37ce51f1-26d3-4eab-bc2e-1acdac1cf844.eed89e36-2b6b-4caf-b0fd-84867dc9585b Jun 17 04:40:03 devstack sudo[97356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:40:03 devstack cinder-volume[92060]: INFO cinder.volume.manager [None req-02fedff1-c724-455a-a143-3c398d90dde6 tempest-GroupSnapshotsV319Test-664216753 None] Group tempest-GroupSnapshotsV319Test-Group-1738921539: creating Jun 17 04:40:03 devstack cinder-volume[92060]: INFO cinder.volume.manager [None req-02fedff1-c724-455a-a143-3c398d90dde6 tempest-GroupSnapshotsV319Test-664216753 None] Group tempest-GroupSnapshotsV319Test-Group-1738921539: created successfully Jun 17 04:40:03 devstack cinder-volume[92060]: INFO cinder.volume.manager [None req-02fedff1-c724-455a-a143-3c398d90dde6 tempest-GroupSnapshotsV319Test-664216753 None] Create group completed successfully. Jun 17 04:40:04 devstack sudo[97356]: pam_unix(sudo:session): session closed for user root Jun 17 04:40:04 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-564b1aeb-3fe6-4ce9-84b1-7f68f20652a4 tempest-GroupsV314Test-1381606140 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-37ce51f1-26d3-4eab-bc2e-1acdac1cf844.eed89e36-2b6b-4caf-b0fd-84867dc9585b" returned: 0 in 0.645s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:40:04 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-564b1aeb-3fe6-4ce9-84b1-7f68f20652a4 tempest-GroupsV314Test-1381606140 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-37ce51f1-26d3-4eab-bc2e-1acdac1cf844.info {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:40:04 devstack sudo[97359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-37ce51f1-26d3-4eab-bc2e-1acdac1cf844.info Jun 17 04:40:04 devstack sudo[97359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:40:05 devstack sudo[97359]: pam_unix(sudo:session): session closed for user root Jun 17 04:40:05 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-564b1aeb-3fe6-4ce9-84b1-7f68f20652a4 tempest-GroupsV314Test-1381606140 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-37ce51f1-26d3-4eab-bc2e-1acdac1cf844.info" returned: 0 in 0.666s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:40:05 devstack cinder-volume[92060]: WARNING cinder.volume.drivers.remotefs [None req-564b1aeb-3fe6-4ce9-84b1-7f68f20652a4 tempest-GroupsV314Test-1381606140 None] /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-37ce51f1-26d3-4eab-bc2e-1acdac1cf844.info is being set with open permissions: ugo+rw: NotImplementedError Jun 17 04:40:05 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-564b1aeb-3fe6-4ce9-84b1-7f68f20652a4 tempest-GroupsV314Test-1381606140 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-37ce51f1-26d3-4eab-bc2e-1acdac1cf844.info {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:40:05 devstack sudo[97362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-37ce51f1-26d3-4eab-bc2e-1acdac1cf844.info Jun 17 04:40:05 devstack sudo[97362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:40:05 devstack cinder-volume[92060]: DEBUG cinder.volume.flows.manager.create_volume [None req-82609a69-75e4-46c5-b673-35eba0715970 tempest-GroupSnapshotsV319Test-664216753 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92060) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 17 04:40:05 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-82609a69-75e4-46c5-b673-35eba0715970 tempest-GroupSnapshotsV319Test-664216753 None] Flow 'volume_create_manager' (a287ec36-3b30-4da4-860c-6b2676fbf23f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 17 04:40:05 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-82609a69-75e4-46c5-b673-35eba0715970 tempest-GroupSnapshotsV319Test-664216753 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8fdba6a3-32b9-41a8-8362-20a4031f5154) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:40:05 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-82609a69-75e4-46c5-b673-35eba0715970 tempest-GroupSnapshotsV319Test-664216753 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8fdba6a3-32b9-41a8-8362-20a4031f5154) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-17T02:40:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1381660902',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=2bebf677-ba73-434d-98ea-3026b371a0c7,host='devstack@QuobyteHD#QuobyteHD',id=1098e642-cecd-431a-9f2d-805ea9ca164d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6e8ed10ff1f349b18559f3f2be45fbbf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T02:40:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T02:40:05Z,use_quota=True,user_id='47cbe4f05dcd44bcbdd2f4b874897ff9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(421f069a-0429-4066-b23d-6e6f089ee1ee),volume_type_id=421f069a-0429-4066-b23d-6e6f089ee1ee)' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:40:05 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-82609a69-75e4-46c5-b673-35eba0715970 tempest-GroupSnapshotsV319Test-664216753 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b52ef7c9-a13c-4cfb-99ba-1dc5b675e876) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:40:05 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-82609a69-75e4-46c5-b673-35eba0715970 tempest-GroupSnapshotsV319Test-664216753 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b52ef7c9-a13c-4cfb-99ba-1dc5b675e876) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:40:05 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-82609a69-75e4-46c5-b673-35eba0715970 tempest-GroupSnapshotsV319Test-664216753 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3885e474-141f-4c9e-981d-1f0bfef8a717) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:40:05 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-82609a69-75e4-46c5-b673-35eba0715970 tempest-GroupSnapshotsV319Test-664216753 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3885e474-141f-4c9e-981d-1f0bfef8a717) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1098e642-cecd-431a-9f2d-805ea9ca164d', 'volume_name': 'volume-1098e642-cecd-431a-9f2d-805ea9ca164d', 'volume_size': 1}' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:40:05 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-82609a69-75e4-46c5-b673-35eba0715970 tempest-GroupSnapshotsV319Test-664216753 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (23665490-026f-422a-84f6-38f7085a5e2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:40:05 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-82609a69-75e4-46c5-b673-35eba0715970 tempest-GroupSnapshotsV319Test-664216753 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (23665490-026f-422a-84f6-38f7085a5e2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:40:05 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-82609a69-75e4-46c5-b673-35eba0715970 tempest-GroupSnapshotsV319Test-664216753 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (780d3a14-174d-4790-bf8f-20bf63534d73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:40:05 devstack cinder-volume[92060]: INFO cinder.volume.flows.manager.create_volume [None req-82609a69-75e4-46c5-b673-35eba0715970 tempest-GroupSnapshotsV319Test-664216753 None] Volume 1098e642-cecd-431a-9f2d-805ea9ca164d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1098e642-cecd-431a-9f2d-805ea9ca164d', 'volume_size': 1} Jun 17 04:40:05 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-82609a69-75e4-46c5-b673-35eba0715970 tempest-GroupSnapshotsV319Test-664216753 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 04:40:05 devstack sudo[97362]: pam_unix(sudo:session): session closed for user root Jun 17 04:40:05 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-564b1aeb-3fe6-4ce9-84b1-7f68f20652a4 tempest-GroupsV314Test-1381606140 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-37ce51f1-26d3-4eab-bc2e-1acdac1cf844.info" returned: 0 in 0.702s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:40:05 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-564b1aeb-3fe6-4ce9-84b1-7f68f20652a4 tempest-GroupsV314Test-1381606140 None] Acquiring lock "cinder-quobyte-f2cf2842-3aa2-4e5b-b658-865023e4304d" by "_copy_volume_from_snapshot" {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 04:40:05 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-564b1aeb-3fe6-4ce9-84b1-7f68f20652a4 tempest-GroupsV314Test-1381606140 None] Lock "cinder-quobyte-f2cf2842-3aa2-4e5b-b658-865023e4304d" acquired by "_copy_volume_from_snapshot" :: waited 0.020s {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 04:40:05 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-564b1aeb-3fe6-4ce9-84b1-7f68f20652a4 tempest-GroupsV314Test-1381606140 None] snapshot: eed89e36-2b6b-4caf-b0fd-84867dc9585b, volume: f2cf2842-3aa2-4e5b-b658-865023e4304d, {{(pid=92060) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jun 17 04:40:05 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-564b1aeb-3fe6-4ce9-84b1-7f68f20652a4 tempest-GroupsV314Test-1381606140 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 04:40:05 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-564b1aeb-3fe6-4ce9-84b1-7f68f20652a4 tempest-GroupsV314Test-1381606140 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 04:40:05 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-564b1aeb-3fe6-4ce9-84b1-7f68f20652a4 tempest-GroupsV314Test-1381606140 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588': None} {{(pid=92060) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 17 04:40:05 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-564b1aeb-3fe6-4ce9-84b1-7f68f20652a4 tempest-GroupsV314Test-1381606140 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588'] {{(pid=92060) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 17 04:40:05 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-564b1aeb-3fe6-4ce9-84b1-7f68f20652a4 tempest-GroupsV314Test-1381606140 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 04:40:05 devstack cinder-volume[92060]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b8b48be-2a27-49a5-914d-57a844fa3638]: (4, 'qcow2') {{(pid=93130) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 04:40:05 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-564b1aeb-3fe6-4ce9-84b1-7f68f20652a4 tempest-GroupsV314Test-1381606140 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-37ce51f1-26d3-4eab-bc2e-1acdac1cf844.eed89e36-2b6b-4caf-b0fd-84867dc9585b {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:40:05 devstack sudo[97365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-37ce51f1-26d3-4eab-bc2e-1acdac1cf844.eed89e36-2b6b-4caf-b0fd-84867dc9585b Jun 17 04:40:05 devstack sudo[97365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:40:06 devstack sudo[97365]: pam_unix(sudo:session): session closed for user root Jun 17 04:40:06 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-564b1aeb-3fe6-4ce9-84b1-7f68f20652a4 tempest-GroupsV314Test-1381606140 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-37ce51f1-26d3-4eab-bc2e-1acdac1cf844.eed89e36-2b6b-4caf-b0fd-84867dc9585b" returned: 0 in 0.779s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:40:06 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.remotefs [None req-564b1aeb-3fe6-4ce9-84b1-7f68f20652a4 tempest-GroupsV314Test-1381606140 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-37ce51f1-26d3-4eab-bc2e-1acdac1cf844(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=92060) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 17 04:40:06 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-564b1aeb-3fe6-4ce9-84b1-7f68f20652a4 tempest-GroupsV314Test-1381606140 None] will copy from snapshot at /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-37ce51f1-26d3-4eab-bc2e-1acdac1cf844 {{(pid=92060) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jun 17 04:40:06 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-564b1aeb-3fe6-4ce9-84b1-7f68f20652a4 tempest-GroupsV314Test-1381606140 None] Creating direct copy from snapshot {{(pid=92060) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jun 17 04:40:06 devstack cinder-volume[92060]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe82253a-eb51-4fb4-a71d-228c20a3dfe7]: (4, 'qcow2') {{(pid=93130) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 04:40:06 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-564b1aeb-3fe6-4ce9-84b1-7f68f20652a4 tempest-GroupsV314Test-1381606140 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-37ce51f1-26d3-4eab-bc2e-1acdac1cf844 {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:40:06 devstack sudo[97370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-37ce51f1-26d3-4eab-bc2e-1acdac1cf844 Jun 17 04:40:06 devstack sudo[97370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:40:07 devstack sudo[97370]: pam_unix(sudo:session): session closed for user root Jun 17 04:40:07 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-564b1aeb-3fe6-4ce9-84b1-7f68f20652a4 tempest-GroupsV314Test-1381606140 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-37ce51f1-26d3-4eab-bc2e-1acdac1cf844" returned: 0 in 0.763s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:40:07 devstack cinder-volume[92060]: DEBUG cinder.utils [None req-564b1aeb-3fe6-4ce9-84b1-7f68f20652a4 tempest-GroupsV314Test-1381606140 None] Path /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-f2cf2842-3aa2-4e5b-b658-865023e4304d not found in is_blk_device check {{(pid=92060) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jun 17 04:40:07 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-564b1aeb-3fe6-4ce9-84b1-7f68f20652a4 tempest-GroupsV314Test-1381606140 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-37ce51f1-26d3-4eab-bc2e-1acdac1cf844 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-f2cf2842-3aa2-4e5b-b658-865023e4304d {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:40:07 devstack sudo[97384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-37ce51f1-26d3-4eab-bc2e-1acdac1cf844 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-f2cf2842-3aa2-4e5b-b658-865023e4304d Jun 17 04:40:07 devstack sudo[97384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:40:12 devstack sudo[97384]: pam_unix(sudo:session): session closed for user root Jun 17 04:40:12 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-564b1aeb-3fe6-4ce9-84b1-7f68f20652a4 tempest-GroupsV314Test-1381606140 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-37ce51f1-26d3-4eab-bc2e-1acdac1cf844 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-f2cf2842-3aa2-4e5b-b658-865023e4304d" returned: 0 in 5.547s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:40:12 devstack cinder-volume[92060]: DEBUG oslo.privsep.daemon [-] privsep: reply[78b622b2-9a2b-4f82-8754-7cb1b809ecff]: (4, 'qcow2') {{(pid=93130) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 04:40:12 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-564b1aeb-3fe6-4ce9-84b1-7f68f20652a4 tempest-GroupsV314Test-1381606140 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-37ce51f1-26d3-4eab-bc2e-1acdac1cf844 {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:40:13 devstack sudo[97439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-37ce51f1-26d3-4eab-bc2e-1acdac1cf844 Jun 17 04:40:13 devstack sudo[97439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:40:13 devstack sudo[97439]: pam_unix(sudo:session): session closed for user root Jun 17 04:40:13 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-564b1aeb-3fe6-4ce9-84b1-7f68f20652a4 tempest-GroupsV314Test-1381606140 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-37ce51f1-26d3-4eab-bc2e-1acdac1cf844" returned: 0 in 0.854s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:40:13 devstack cinder-volume[92060]: DEBUG cinder.image.image_utils [None req-564b1aeb-3fe6-4ce9-84b1-7f68f20652a4 tempest-GroupsV314Test-1381606140 None] Image conversion details: src /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-37ce51f1-26d3-4eab-bc2e-1acdac1cf844, size 1024.00 MB, duration 5.55 sec, destination /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-f2cf2842-3aa2-4e5b-b658-865023e4304d {{(pid=92060) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 17 04:40:13 devstack cinder-volume[92060]: INFO cinder.image.image_utils [None req-564b1aeb-3fe6-4ce9-84b1-7f68f20652a4 tempest-GroupsV314Test-1381606140 None] Converted 1024.00 MB image at 184.57 MB/s Jun 17 04:40:13 devstack cinder-volume[92060]: WARNING cinder.volume.drivers.remotefs [None req-564b1aeb-3fe6-4ce9-84b1-7f68f20652a4 tempest-GroupsV314Test-1381606140 None] /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-f2cf2842-3aa2-4e5b-b658-865023e4304d is being set with open permissions: ugo+rw: NotImplementedError Jun 17 04:40:13 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-564b1aeb-3fe6-4ce9-84b1-7f68f20652a4 tempest-GroupsV314Test-1381606140 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-f2cf2842-3aa2-4e5b-b658-865023e4304d {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:40:13 devstack sudo[97445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-f2cf2842-3aa2-4e5b-b658-865023e4304d Jun 17 04:40:13 devstack sudo[97445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:40:14 devstack sudo[97445]: pam_unix(sudo:session): session closed for user root Jun 17 04:40:14 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-564b1aeb-3fe6-4ce9-84b1-7f68f20652a4 tempest-GroupsV314Test-1381606140 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-f2cf2842-3aa2-4e5b-b658-865023e4304d" returned: 0 in 0.584s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:40:14 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-564b1aeb-3fe6-4ce9-84b1-7f68f20652a4 tempest-GroupsV314Test-1381606140 None] Lock "cinder-quobyte-f2cf2842-3aa2-4e5b-b658-865023e4304d" released by "_copy_volume_from_snapshot" :: held 8.609s {{(pid=92060) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 04:40:14 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-564b1aeb-3fe6-4ce9-84b1-7f68f20652a4 tempest-GroupsV314Test-1381606140 None] Acquiring lock "cinder-quobyte-eed89e36-2b6b-4caf-b0fd-84867dc9585b" by "_delete_snapshot" {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 04:40:14 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-564b1aeb-3fe6-4ce9-84b1-7f68f20652a4 tempest-GroupsV314Test-1381606140 None] Lock "cinder-quobyte-eed89e36-2b6b-4caf-b0fd-84867dc9585b" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 04:40:14 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.remotefs [None req-564b1aeb-3fe6-4ce9-84b1-7f68f20652a4 tempest-GroupsV314Test-1381606140 None] Deleting offline snapshot eed89e36-2b6b-4caf-b0fd-84867dc9585b of volume 37ce51f1-26d3-4eab-bc2e-1acdac1cf844 {{(pid=92060) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 17 04:40:14 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.remotefs [None req-564b1aeb-3fe6-4ce9-84b1-7f68f20652a4 tempest-GroupsV314Test-1381606140 None] snapshot_file for this snap is: volume-37ce51f1-26d3-4eab-bc2e-1acdac1cf844.eed89e36-2b6b-4caf-b0fd-84867dc9585b {{(pid=92060) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 17 04:40:14 devstack cinder-volume[92060]: DEBUG oslo.privsep.daemon [-] privsep: reply[f053f1c8-4df6-44f3-a197-f131ab92d64b]: (4, 'qcow2') {{(pid=93130) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 04:40:14 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-564b1aeb-3fe6-4ce9-84b1-7f68f20652a4 tempest-GroupsV314Test-1381606140 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-37ce51f1-26d3-4eab-bc2e-1acdac1cf844.eed89e36-2b6b-4caf-b0fd-84867dc9585b {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:40:14 devstack sudo[97448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-37ce51f1-26d3-4eab-bc2e-1acdac1cf844.eed89e36-2b6b-4caf-b0fd-84867dc9585b Jun 17 04:40:14 devstack sudo[97448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:40:15 devstack sudo[97448]: pam_unix(sudo:session): session closed for user root Jun 17 04:40:15 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-564b1aeb-3fe6-4ce9-84b1-7f68f20652a4 tempest-GroupsV314Test-1381606140 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-37ce51f1-26d3-4eab-bc2e-1acdac1cf844.eed89e36-2b6b-4caf-b0fd-84867dc9585b" returned: 0 in 0.701s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:40:15 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.remotefs [None req-564b1aeb-3fe6-4ce9-84b1-7f68f20652a4 tempest-GroupsV314Test-1381606140 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-37ce51f1-26d3-4eab-bc2e-1acdac1cf844(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=92060) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 17 04:40:15 devstack cinder-volume[92060]: DEBUG oslo.privsep.daemon [-] privsep: reply[63a8821e-b372-4aa5-9649-af5f49a22061]: (4, 'qcow2') {{(pid=93130) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 04:40:15 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-564b1aeb-3fe6-4ce9-84b1-7f68f20652a4 tempest-GroupsV314Test-1381606140 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-37ce51f1-26d3-4eab-bc2e-1acdac1cf844 {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:40:15 devstack sudo[97453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-37ce51f1-26d3-4eab-bc2e-1acdac1cf844 Jun 17 04:40:15 devstack sudo[97453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:40:15 devstack cinder-volume[92060]: DEBUG dbcounter [-] [92060] Writing DB stats cinder:SELECT=4,cinder:UPDATE=2,cinder:INSERT=1 {{(pid=92060) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 17 04:40:15 devstack sudo[97453]: pam_unix(sudo:session): session closed for user root Jun 17 04:40:15 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-564b1aeb-3fe6-4ce9-84b1-7f68f20652a4 tempest-GroupsV314Test-1381606140 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-37ce51f1-26d3-4eab-bc2e-1acdac1cf844" returned: 0 in 0.704s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:40:15 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-564b1aeb-3fe6-4ce9-84b1-7f68f20652a4 tempest-GroupsV314Test-1381606140 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-37ce51f1-26d3-4eab-bc2e-1acdac1cf844.eed89e36-2b6b-4caf-b0fd-84867dc9585b {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:40:15 devstack sudo[97494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-37ce51f1-26d3-4eab-bc2e-1acdac1cf844.eed89e36-2b6b-4caf-b0fd-84867dc9585b Jun 17 04:40:15 devstack sudo[97494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:40:16 devstack sudo[97494]: pam_unix(sudo:session): session closed for user root Jun 17 04:40:16 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-564b1aeb-3fe6-4ce9-84b1-7f68f20652a4 tempest-GroupsV314Test-1381606140 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-37ce51f1-26d3-4eab-bc2e-1acdac1cf844.eed89e36-2b6b-4caf-b0fd-84867dc9585b" returned: 0 in 0.677s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:40:16 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-564b1aeb-3fe6-4ce9-84b1-7f68f20652a4 tempest-GroupsV314Test-1381606140 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-37ce51f1-26d3-4eab-bc2e-1acdac1cf844.eed89e36-2b6b-4caf-b0fd-84867dc9585b {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:40:16 devstack sudo[97499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-37ce51f1-26d3-4eab-bc2e-1acdac1cf844.eed89e36-2b6b-4caf-b0fd-84867dc9585b Jun 17 04:40:16 devstack sudo[97499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:40:17 devstack sudo[97499]: pam_unix(sudo:session): session closed for user root Jun 17 04:40:17 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-564b1aeb-3fe6-4ce9-84b1-7f68f20652a4 tempest-GroupsV314Test-1381606140 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-37ce51f1-26d3-4eab-bc2e-1acdac1cf844.eed89e36-2b6b-4caf-b0fd-84867dc9585b" returned: 0 in 0.602s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:40:17 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-564b1aeb-3fe6-4ce9-84b1-7f68f20652a4 tempest-GroupsV314Test-1381606140 None] Lock "cinder-quobyte-eed89e36-2b6b-4caf-b0fd-84867dc9585b" released by "_delete_snapshot" :: held 2.773s {{(pid=92060) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 04:40:17 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-564b1aeb-3fe6-4ce9-84b1-7f68f20652a4 tempest-GroupsV314Test-1381606140 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 17.265s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 04:40:17 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-53b86a4a-ad9d-4c6f-a2b1-f9ef9ea74db3 tempest-AttachVolumeShelveTestJSON-134363980 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 15.846s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 04:40:17 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-53b86a4a-ad9d-4c6f-a2b1-f9ef9ea74db3 tempest-AttachVolumeShelveTestJSON-134363980 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-17T02:40:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-891666024',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0658b107-1fce-439f-a62e-8299bf3b43b8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='51b31662b38d4586825b0c761e731e86',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T02:40:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T02:40:01Z,use_quota=True,user_id='7bde37e17f6247789a101e63fbac5bce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aad9ce24-93f9-41a6-baa1-5125964f96d1),volume_type_id=aad9ce24-93f9-41a6-baa1-5125964f96d1)}" {{(pid=92060) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 17 04:40:17 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.remotefs [None req-53b86a4a-ad9d-4c6f-a2b1-f9ef9ea74db3 tempest-AttachVolumeShelveTestJSON-134363980 None] Creating volume 0658b107-1fce-439f-a62e-8299bf3b43b8 {{(pid=92060) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 17 04:40:17 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-53b86a4a-ad9d-4c6f-a2b1-f9ef9ea74db3 tempest-AttachVolumeShelveTestJSON-134363980 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 04:40:17 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-53b86a4a-ad9d-4c6f-a2b1-f9ef9ea74db3 tempest-AttachVolumeShelveTestJSON-134363980 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 04:40:17 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-53b86a4a-ad9d-4c6f-a2b1-f9ef9ea74db3 tempest-AttachVolumeShelveTestJSON-134363980 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588': None} {{(pid=92060) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 17 04:40:17 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-53b86a4a-ad9d-4c6f-a2b1-f9ef9ea74db3 tempest-AttachVolumeShelveTestJSON-134363980 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588'] {{(pid=92060) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 17 04:40:17 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-53b86a4a-ad9d-4c6f-a2b1-f9ef9ea74db3 tempest-AttachVolumeShelveTestJSON-134363980 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 04:40:17 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-53b86a4a-ad9d-4c6f-a2b1-f9ef9ea74db3 tempest-AttachVolumeShelveTestJSON-134363980 None] Selected osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588 as target Quobyte volume. {{(pid=92060) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 17 04:40:17 devstack cinder-volume[92060]: INFO cinder.volume.drivers.remotefs [None req-53b86a4a-ad9d-4c6f-a2b1-f9ef9ea74db3 tempest-AttachVolumeShelveTestJSON-134363980 None] casted to osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588 Jun 17 04:40:17 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-53b86a4a-ad9d-4c6f-a2b1-f9ef9ea74db3 tempest-AttachVolumeShelveTestJSON-134363980 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-0658b107-1fce-439f-a62e-8299bf3b43b8 1073741824 {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:40:17 devstack sudo[97502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-0658b107-1fce-439f-a62e-8299bf3b43b8 1073741824 Jun 17 04:40:17 devstack sudo[97502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:40:17 devstack cinder-volume[92060]: INFO cinder.volume.manager [None req-564b1aeb-3fe6-4ce9-84b1-7f68f20652a4 tempest-GroupsV314Test-1381606140 None] Create group from source-group-df229265-219b-4fa5-875e-91534a1949ea completed successfully. Jun 17 04:40:17 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-78d8c31e-b4d0-422e-a301-6fdcef221a5c tempest-GroupsV314Test-1381606140 None] Acquiring lock "cinder-quobyte-f2cf2842-3aa2-4e5b-b658-865023e4304d" by "delete_volume" {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 04:40:17 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-78d8c31e-b4d0-422e-a301-6fdcef221a5c tempest-GroupsV314Test-1381606140 None] Lock "cinder-quobyte-f2cf2842-3aa2-4e5b-b658-865023e4304d" acquired by "delete_volume" :: waited 0.023s {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 04:40:17 devstack cinder-volume[92060]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ef3a804-4f27-47e5-88fc-5391f1f32c0a]: (4, 'qcow2') {{(pid=93130) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 04:40:17 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-78d8c31e-b4d0-422e-a301-6fdcef221a5c tempest-GroupsV314Test-1381606140 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-f2cf2842-3aa2-4e5b-b658-865023e4304d {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:40:18 devstack sudo[97509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-f2cf2842-3aa2-4e5b-b658-865023e4304d Jun 17 04:40:18 devstack sudo[97509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:40:18 devstack sudo[97502]: pam_unix(sudo:session): session closed for user root Jun 17 04:40:18 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-53b86a4a-ad9d-4c6f-a2b1-f9ef9ea74db3 tempest-AttachVolumeShelveTestJSON-134363980 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-0658b107-1fce-439f-a62e-8299bf3b43b8 1073741824" returned: 0 in 0.852s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:40:18 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-53b86a4a-ad9d-4c6f-a2b1-f9ef9ea74db3 tempest-AttachVolumeShelveTestJSON-134363980 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-0658b107-1fce-439f-a62e-8299bf3b43b8 {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:40:18 devstack sudo[97511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-0658b107-1fce-439f-a62e-8299bf3b43b8 Jun 17 04:40:18 devstack sudo[97511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:40:18 devstack sudo[97509]: pam_unix(sudo:session): session closed for user root Jun 17 04:40:18 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-78d8c31e-b4d0-422e-a301-6fdcef221a5c tempest-GroupsV314Test-1381606140 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-f2cf2842-3aa2-4e5b-b658-865023e4304d" returned: 0 in 0.929s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:40:18 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-78d8c31e-b4d0-422e-a301-6fdcef221a5c tempest-GroupsV314Test-1381606140 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-f2cf2842-3aa2-4e5b-b658-865023e4304d {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:40:18 devstack sudo[97511]: pam_unix(sudo:session): session closed for user root Jun 17 04:40:18 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-53b86a4a-ad9d-4c6f-a2b1-f9ef9ea74db3 tempest-AttachVolumeShelveTestJSON-134363980 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-0658b107-1fce-439f-a62e-8299bf3b43b8" returned: 0 in 0.718s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:40:18 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-53b86a4a-ad9d-4c6f-a2b1-f9ef9ea74db3 tempest-AttachVolumeShelveTestJSON-134363980 None] <== create_volume: return (1616ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588'} {{(pid=92060) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 17 04:40:18 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-53b86a4a-ad9d-4c6f-a2b1-f9ef9ea74db3 tempest-AttachVolumeShelveTestJSON-134363980 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.621s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 04:40:18 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-82609a69-75e4-46c5-b673-35eba0715970 tempest-GroupSnapshotsV319Test-664216753 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 13.220s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 04:40:18 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-82609a69-75e4-46c5-b673-35eba0715970 tempest-GroupSnapshotsV319Test-664216753 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=2bebf677-ba73-434d-98ea-3026b371a0c7,created_at=2026-06-17T02:40:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1381660902',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=2bebf677-ba73-434d-98ea-3026b371a0c7,host='devstack@QuobyteHD#QuobyteHD',id=1098e642-cecd-431a-9f2d-805ea9ca164d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6e8ed10ff1f349b18559f3f2be45fbbf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T02:40:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T02:40:05Z,use_quota=True,user_id='47cbe4f05dcd44bcbdd2f4b874897ff9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(421f069a-0429-4066-b23d-6e6f089ee1ee),volume_type_id=421f069a-0429-4066-b23d-6e6f089ee1ee)}" {{(pid=92060) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 17 04:40:18 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.remotefs [None req-82609a69-75e4-46c5-b673-35eba0715970 tempest-GroupSnapshotsV319Test-664216753 None] Creating volume 1098e642-cecd-431a-9f2d-805ea9ca164d {{(pid=92060) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 17 04:40:18 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-82609a69-75e4-46c5-b673-35eba0715970 tempest-GroupSnapshotsV319Test-664216753 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 04:40:18 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-82609a69-75e4-46c5-b673-35eba0715970 tempest-GroupSnapshotsV319Test-664216753 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 04:40:18 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-82609a69-75e4-46c5-b673-35eba0715970 tempest-GroupSnapshotsV319Test-664216753 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588': None} {{(pid=92060) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 17 04:40:18 devstack sudo[97519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-f2cf2842-3aa2-4e5b-b658-865023e4304d Jun 17 04:40:18 devstack sudo[97519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:40:18 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-82609a69-75e4-46c5-b673-35eba0715970 tempest-GroupSnapshotsV319Test-664216753 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588'] {{(pid=92060) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 17 04:40:18 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-82609a69-75e4-46c5-b673-35eba0715970 tempest-GroupSnapshotsV319Test-664216753 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 04:40:18 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-82609a69-75e4-46c5-b673-35eba0715970 tempest-GroupSnapshotsV319Test-664216753 None] Selected osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588 as target Quobyte volume. {{(pid=92060) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 17 04:40:18 devstack cinder-volume[92060]: INFO cinder.volume.drivers.remotefs [None req-82609a69-75e4-46c5-b673-35eba0715970 tempest-GroupSnapshotsV319Test-664216753 None] casted to osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588 Jun 17 04:40:18 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-82609a69-75e4-46c5-b673-35eba0715970 tempest-GroupSnapshotsV319Test-664216753 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-1098e642-cecd-431a-9f2d-805ea9ca164d 1073741824 {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:40:18 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-53b86a4a-ad9d-4c6f-a2b1-f9ef9ea74db3 tempest-AttachVolumeShelveTestJSON-134363980 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b22fbe94-3c5f-41e7-8b3d-315fbd95ced6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0658b107-1fce-439f-a62e-8299bf3b43b8', 'volume_size': 1}' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:40:18 devstack sudo[97521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-1098e642-cecd-431a-9f2d-805ea9ca164d 1073741824 Jun 17 04:40:18 devstack sudo[97521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:40:18 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-53b86a4a-ad9d-4c6f-a2b1-f9ef9ea74db3 tempest-AttachVolumeShelveTestJSON-134363980 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (64bda8d2-a828-42d2-ba35-bc20a12d23dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:40:18 devstack cinder-volume[92060]: INFO cinder.volume.flows.manager.create_volume [None req-53b86a4a-ad9d-4c6f-a2b1-f9ef9ea74db3 tempest-AttachVolumeShelveTestJSON-134363980 None] Volume volume-0658b107-1fce-439f-a62e-8299bf3b43b8 (0658b107-1fce-439f-a62e-8299bf3b43b8): created successfully Jun 17 04:40:18 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-53b86a4a-ad9d-4c6f-a2b1-f9ef9ea74db3 tempest-AttachVolumeShelveTestJSON-134363980 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (64bda8d2-a828-42d2-ba35-bc20a12d23dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:40:18 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-53b86a4a-ad9d-4c6f-a2b1-f9ef9ea74db3 tempest-AttachVolumeShelveTestJSON-134363980 None] Flow 'volume_create_manager' (2c25800c-33df-4f99-9b7a-a6ffdab947c5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92060) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 17 04:40:18 devstack cinder-volume[92060]: INFO cinder.volume.manager [None req-53b86a4a-ad9d-4c6f-a2b1-f9ef9ea74db3 tempest-AttachVolumeShelveTestJSON-134363980 None] Created volume successfully. Jun 17 04:40:19 devstack sudo[97519]: pam_unix(sudo:session): session closed for user root Jun 17 04:40:19 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-78d8c31e-b4d0-422e-a301-6fdcef221a5c tempest-GroupsV314Test-1381606140 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-f2cf2842-3aa2-4e5b-b658-865023e4304d" returned: 0 in 0.652s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:40:19 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-78d8c31e-b4d0-422e-a301-6fdcef221a5c tempest-GroupsV314Test-1381606140 None] Lock "cinder-quobyte-f2cf2842-3aa2-4e5b-b658-865023e4304d" released by "delete_volume" :: held 1.630s {{(pid=92060) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 04:40:19 devstack cinder-volume[92060]: DEBUG cinder.quota [None req-78d8c31e-b4d0-422e-a301-6fdcef221a5c tempest-GroupsV314Test-1381606140 None] Created reservations ['f313faf0-5803-41ef-a928-e29e689d6d3d'] {{(pid=92060) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 17 04:40:19 devstack cinder-volume[92060]: WARNING cinder.quota [None req-78d8c31e-b4d0-422e-a301-6fdcef221a5c tempest-GroupsV314Test-1381606140 None] Deprecated: Default quota for resource: volumes_tempest-GroupsV314Test-volume-type-462537832 is set by the default quota flag: quota_volumes_tempest-GroupsV314Test-volume-type-462537832, it is now deprecated. Please use the default quota class for default quota. Jun 17 04:40:19 devstack cinder-volume[92060]: WARNING cinder.quota [None req-78d8c31e-b4d0-422e-a301-6fdcef221a5c tempest-GroupsV314Test-1381606140 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsV314Test-volume-type-462537832 is set by the default quota flag: quota_gigabytes_tempest-GroupsV314Test-volume-type-462537832, it is now deprecated. Please use the default quota class for default quota. Jun 17 04:40:19 devstack cinder-volume[92060]: DEBUG cinder.quota [None req-78d8c31e-b4d0-422e-a301-6fdcef221a5c tempest-GroupsV314Test-1381606140 None] Created reservations ['a2d6b00e-1756-44db-8fa9-edc66409f28f', '5cc18675-3acb-4b6e-92c3-8cb83536c91b', '8d463ee7-eb77-4597-b47f-420b107d1d22', 'd762b5af-5cca-4fcd-90c1-f95072db7f69'] {{(pid=92060) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 17 04:40:19 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-78d8c31e-b4d0-422e-a301-6fdcef221a5c tempest-GroupsV314Test-1381606140 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 04:40:19 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-78d8c31e-b4d0-422e-a301-6fdcef221a5c tempest-GroupsV314Test-1381606140 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 04:40:19 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-78d8c31e-b4d0-422e-a301-6fdcef221a5c tempest-GroupsV314Test-1381606140 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588': None} {{(pid=92060) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 17 04:40:19 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-78d8c31e-b4d0-422e-a301-6fdcef221a5c tempest-GroupsV314Test-1381606140 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588'] {{(pid=92060) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 17 04:40:19 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-78d8c31e-b4d0-422e-a301-6fdcef221a5c tempest-GroupsV314Test-1381606140 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 04:40:19 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-78d8c31e-b4d0-422e-a301-6fdcef221a5c tempest-GroupsV314Test-1381606140 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:40:19 devstack sudo[97521]: pam_unix(sudo:session): session closed for user root Jun 17 04:40:19 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-82609a69-75e4-46c5-b673-35eba0715970 tempest-GroupSnapshotsV319Test-664216753 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-1098e642-cecd-431a-9f2d-805ea9ca164d 1073741824" returned: 0 in 1.002s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:40:19 devstack sudo[97533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a Jun 17 04:40:19 devstack sudo[97533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:40:19 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-82609a69-75e4-46c5-b673-35eba0715970 tempest-GroupSnapshotsV319Test-664216753 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-1098e642-cecd-431a-9f2d-805ea9ca164d {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:40:19 devstack sudo[97535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-1098e642-cecd-431a-9f2d-805ea9ca164d Jun 17 04:40:19 devstack sudo[97535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:40:20 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-0e54d962-f7a7-4074-87b9-952ac574933c tempest-GroupsV314Test-1381606140 None] Acquiring lock "cinder-quobyte-37ce51f1-26d3-4eab-bc2e-1acdac1cf844" by "delete_volume" {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 04:40:20 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-0e54d962-f7a7-4074-87b9-952ac574933c tempest-GroupsV314Test-1381606140 None] Lock "cinder-quobyte-37ce51f1-26d3-4eab-bc2e-1acdac1cf844" acquired by "delete_volume" :: waited 0.027s {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 04:40:20 devstack cinder-volume[92060]: DEBUG oslo.privsep.daemon [-] privsep: reply[9de0a0c0-e0ab-4cc8-917a-0965a571b53c]: (4, 'qcow2') {{(pid=93130) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 04:40:20 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-0e54d962-f7a7-4074-87b9-952ac574933c tempest-GroupsV314Test-1381606140 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-37ce51f1-26d3-4eab-bc2e-1acdac1cf844 {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:40:20 devstack sudo[97533]: pam_unix(sudo:session): session closed for user root Jun 17 04:40:20 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-78d8c31e-b4d0-422e-a301-6fdcef221a5c tempest-GroupsV314Test-1381606140 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a" returned: 0 in 0.900s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:40:20 devstack cinder-volume[92060]: DEBUG cinder.manager [None req-78d8c31e-b4d0-422e-a301-6fdcef221a5c tempest-GroupsV314Test-1381606140 None] Notifying Schedulers of capabilities ... {{(pid=92060) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 17 04:40:20 devstack cinder-volume[92060]: INFO cinder.volume.manager [None req-78d8c31e-b4d0-422e-a301-6fdcef221a5c tempest-GroupsV314Test-1381606140 None] Delete group completed successfully. Jun 17 04:40:20 devstack sudo[97535]: pam_unix(sudo:session): session closed for user root Jun 17 04:40:20 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-82609a69-75e4-46c5-b673-35eba0715970 tempest-GroupSnapshotsV319Test-664216753 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-1098e642-cecd-431a-9f2d-805ea9ca164d" returned: 0 in 0.852s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:40:20 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-82609a69-75e4-46c5-b673-35eba0715970 tempest-GroupSnapshotsV319Test-664216753 None] <== create_volume: return (1917ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588'} {{(pid=92060) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 17 04:40:20 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-82609a69-75e4-46c5-b673-35eba0715970 tempest-GroupSnapshotsV319Test-664216753 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.920s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 04:40:20 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-82609a69-75e4-46c5-b673-35eba0715970 tempest-GroupSnapshotsV319Test-664216753 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (780d3a14-174d-4790-bf8f-20bf63534d73) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1098e642-cecd-431a-9f2d-805ea9ca164d', 'volume_size': 1}' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:40:20 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-82609a69-75e4-46c5-b673-35eba0715970 tempest-GroupSnapshotsV319Test-664216753 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1f625855-1558-4c63-b8a5-7a965e76491b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:40:20 devstack sudo[97540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-37ce51f1-26d3-4eab-bc2e-1acdac1cf844 Jun 17 04:40:20 devstack sudo[97540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:40:20 devstack cinder-volume[92060]: INFO cinder.volume.flows.manager.create_volume [None req-82609a69-75e4-46c5-b673-35eba0715970 tempest-GroupSnapshotsV319Test-664216753 None] Volume volume-1098e642-cecd-431a-9f2d-805ea9ca164d (1098e642-cecd-431a-9f2d-805ea9ca164d): created successfully Jun 17 04:40:20 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-82609a69-75e4-46c5-b673-35eba0715970 tempest-GroupSnapshotsV319Test-664216753 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1f625855-1558-4c63-b8a5-7a965e76491b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:40:20 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-82609a69-75e4-46c5-b673-35eba0715970 tempest-GroupSnapshotsV319Test-664216753 None] Flow 'volume_create_manager' (a287ec36-3b30-4da4-860c-6b2676fbf23f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92060) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 17 04:40:20 devstack cinder-volume[92060]: INFO cinder.volume.manager [None req-82609a69-75e4-46c5-b673-35eba0715970 tempest-GroupSnapshotsV319Test-664216753 None] Created volume successfully. Jun 17 04:40:21 devstack sudo[97540]: pam_unix(sudo:session): session closed for user root Jun 17 04:40:21 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-0e54d962-f7a7-4074-87b9-952ac574933c tempest-GroupsV314Test-1381606140 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-37ce51f1-26d3-4eab-bc2e-1acdac1cf844" returned: 0 in 0.858s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:40:21 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-0e54d962-f7a7-4074-87b9-952ac574933c tempest-GroupsV314Test-1381606140 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-37ce51f1-26d3-4eab-bc2e-1acdac1cf844 {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:40:21 devstack sudo[97545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-37ce51f1-26d3-4eab-bc2e-1acdac1cf844 Jun 17 04:40:21 devstack sudo[97545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:40:21 devstack cinder-volume[92060]: INFO cinder.volume.manager [None req-7b19a890-ff20-470a-aa02-519bf24aa401 tempest-GroupSnapshotsV319Test-664216753 None] GroupSnapshot 84937ad2-a39b-4189-b82b-881a4a5ace4d: creating. Jun 17 04:40:21 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-7b19a890-ff20-470a-aa02-519bf24aa401 tempest-GroupSnapshotsV319Test-664216753 None] Group snapshot 84937ad2-a39b-4189-b82b-881a4a5ace4d: creating. {{(pid=92060) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Jun 17 04:40:21 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-7b19a890-ff20-470a-aa02-519bf24aa401 tempest-GroupSnapshotsV319Test-664216753 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 04:40:21 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-7b19a890-ff20-470a-aa02-519bf24aa401 tempest-GroupSnapshotsV319Test-664216753 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 04:40:21 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.remotefs [None req-7b19a890-ff20-470a-aa02-519bf24aa401 tempest-GroupSnapshotsV319Test-664216753 None] Creating offline snapshot 73fc7dcf-9234-41bf-9914-ae481397bd97 of volume 1098e642-cecd-431a-9f2d-805ea9ca164d {{(pid=92060) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 17 04:40:21 devstack cinder-volume[92060]: DEBUG oslo.privsep.daemon [-] privsep: reply[3503507e-5fe8-4325-9537-bf48c24bd093]: (4, 'qcow2') {{(pid=93130) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 04:40:21 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-7b19a890-ff20-470a-aa02-519bf24aa401 tempest-GroupSnapshotsV319Test-664216753 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-1098e642-cecd-431a-9f2d-805ea9ca164d {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:40:22 devstack sudo[97549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-1098e642-cecd-431a-9f2d-805ea9ca164d Jun 17 04:40:22 devstack sudo[97549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:40:22 devstack sudo[97545]: pam_unix(sudo:session): session closed for user root Jun 17 04:40:22 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-0e54d962-f7a7-4074-87b9-952ac574933c tempest-GroupsV314Test-1381606140 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-37ce51f1-26d3-4eab-bc2e-1acdac1cf844" returned: 0 in 0.679s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:40:22 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-0e54d962-f7a7-4074-87b9-952ac574933c tempest-GroupsV314Test-1381606140 None] Lock "cinder-quobyte-37ce51f1-26d3-4eab-bc2e-1acdac1cf844" released by "delete_volume" :: held 1.643s {{(pid=92060) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 04:40:22 devstack cinder-volume[92060]: DEBUG cinder.quota [None req-0e54d962-f7a7-4074-87b9-952ac574933c tempest-GroupsV314Test-1381606140 None] Created reservations ['55e44266-a541-489d-89e3-5e59ae735cec'] {{(pid=92060) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 17 04:40:22 devstack cinder-volume[92060]: DEBUG cinder.quota [None req-0e54d962-f7a7-4074-87b9-952ac574933c tempest-GroupsV314Test-1381606140 None] Created reservations ['c379a0ad-ecf1-42be-bb65-2ce1a6241ce3', 'd1050124-fc6b-4d75-8dde-199bf8482604', 'e949cbbb-3d36-4600-8c99-c5c5e8dd6bb9', 'ac4754c0-727e-4375-9b60-6fde35b45fe4'] {{(pid=92060) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 17 04:40:22 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-0e54d962-f7a7-4074-87b9-952ac574933c tempest-GroupsV314Test-1381606140 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 04:40:22 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-0e54d962-f7a7-4074-87b9-952ac574933c tempest-GroupsV314Test-1381606140 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 04:40:22 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-0e54d962-f7a7-4074-87b9-952ac574933c tempest-GroupsV314Test-1381606140 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588': None} {{(pid=92060) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 17 04:40:22 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-0e54d962-f7a7-4074-87b9-952ac574933c tempest-GroupsV314Test-1381606140 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588'] {{(pid=92060) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 17 04:40:22 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-0e54d962-f7a7-4074-87b9-952ac574933c tempest-GroupsV314Test-1381606140 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 04:40:22 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-0e54d962-f7a7-4074-87b9-952ac574933c tempest-GroupsV314Test-1381606140 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:40:22 devstack sudo[97552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a Jun 17 04:40:22 devstack sudo[97552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:40:22 devstack sudo[97549]: pam_unix(sudo:session): session closed for user root Jun 17 04:40:22 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-7b19a890-ff20-470a-aa02-519bf24aa401 tempest-GroupSnapshotsV319Test-664216753 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-1098e642-cecd-431a-9f2d-805ea9ca164d" returned: 0 in 0.840s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:40:22 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-7b19a890-ff20-470a-aa02-519bf24aa401 tempest-GroupSnapshotsV319Test-664216753 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-1098e642-cecd-431a-9f2d-805ea9ca164d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-1098e642-cecd-431a-9f2d-805ea9ca164d.73fc7dcf-9234-41bf-9914-ae481397bd97 1G {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:40:22 devstack sudo[97560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-1098e642-cecd-431a-9f2d-805ea9ca164d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-1098e642-cecd-431a-9f2d-805ea9ca164d.73fc7dcf-9234-41bf-9914-ae481397bd97 1G Jun 17 04:40:22 devstack sudo[97560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:40:23 devstack sudo[97552]: pam_unix(sudo:session): session closed for user root Jun 17 04:40:23 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-0e54d962-f7a7-4074-87b9-952ac574933c tempest-GroupsV314Test-1381606140 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a" returned: 0 in 0.879s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:40:23 devstack cinder-volume[92060]: DEBUG cinder.manager [None req-0e54d962-f7a7-4074-87b9-952ac574933c tempest-GroupsV314Test-1381606140 None] Notifying Schedulers of capabilities ... {{(pid=92060) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 17 04:40:23 devstack cinder-volume[92060]: INFO cinder.volume.manager [None req-0e54d962-f7a7-4074-87b9-952ac574933c tempest-GroupsV314Test-1381606140 None] Delete group completed successfully. Jun 17 04:40:24 devstack sudo[97560]: pam_unix(sudo:session): session closed for user root Jun 17 04:40:24 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-7b19a890-ff20-470a-aa02-519bf24aa401 tempest-GroupSnapshotsV319Test-664216753 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-1098e642-cecd-431a-9f2d-805ea9ca164d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-1098e642-cecd-431a-9f2d-805ea9ca164d.73fc7dcf-9234-41bf-9914-ae481397bd97 1G" returned: 0 in 1.278s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:40:24 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-7b19a890-ff20-470a-aa02-519bf24aa401 tempest-GroupSnapshotsV319Test-664216753 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1098e642-cecd-431a-9f2d-805ea9ca164d -F qcow2 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-1098e642-cecd-431a-9f2d-805ea9ca164d.73fc7dcf-9234-41bf-9914-ae481397bd97 {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:40:24 devstack sudo[97601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1098e642-cecd-431a-9f2d-805ea9ca164d -F qcow2 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-1098e642-cecd-431a-9f2d-805ea9ca164d.73fc7dcf-9234-41bf-9914-ae481397bd97 Jun 17 04:40:24 devstack sudo[97601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:40:24 devstack sudo[97601]: pam_unix(sudo:session): session closed for user root Jun 17 04:40:24 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-7b19a890-ff20-470a-aa02-519bf24aa401 tempest-GroupSnapshotsV319Test-664216753 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1098e642-cecd-431a-9f2d-805ea9ca164d -F qcow2 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-1098e642-cecd-431a-9f2d-805ea9ca164d.73fc7dcf-9234-41bf-9914-ae481397bd97" returned: 0 in 0.842s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:40:24 devstack cinder-volume[92060]: WARNING cinder.volume.drivers.remotefs [None req-7b19a890-ff20-470a-aa02-519bf24aa401 tempest-GroupSnapshotsV319Test-664216753 None] /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-1098e642-cecd-431a-9f2d-805ea9ca164d.73fc7dcf-9234-41bf-9914-ae481397bd97 is being set with open permissions: ugo+rw: NotImplementedError Jun 17 04:40:24 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-7b19a890-ff20-470a-aa02-519bf24aa401 tempest-GroupSnapshotsV319Test-664216753 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-1098e642-cecd-431a-9f2d-805ea9ca164d.73fc7dcf-9234-41bf-9914-ae481397bd97 {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:40:24 devstack sudo[97608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-1098e642-cecd-431a-9f2d-805ea9ca164d.73fc7dcf-9234-41bf-9914-ae481397bd97 Jun 17 04:40:24 devstack sudo[97608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:40:25 devstack sudo[97608]: pam_unix(sudo:session): session closed for user root Jun 17 04:40:25 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-7b19a890-ff20-470a-aa02-519bf24aa401 tempest-GroupSnapshotsV319Test-664216753 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-1098e642-cecd-431a-9f2d-805ea9ca164d.73fc7dcf-9234-41bf-9914-ae481397bd97" returned: 0 in 0.802s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:40:25 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-7b19a890-ff20-470a-aa02-519bf24aa401 tempest-GroupSnapshotsV319Test-664216753 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-1098e642-cecd-431a-9f2d-805ea9ca164d.info {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:40:25 devstack sudo[97617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-1098e642-cecd-431a-9f2d-805ea9ca164d.info Jun 17 04:40:25 devstack sudo[97617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:40:26 devstack sudo[97617]: pam_unix(sudo:session): session closed for user root Jun 17 04:40:26 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-7b19a890-ff20-470a-aa02-519bf24aa401 tempest-GroupSnapshotsV319Test-664216753 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-1098e642-cecd-431a-9f2d-805ea9ca164d.info" returned: 0 in 0.856s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:40:26 devstack cinder-volume[92060]: WARNING cinder.volume.drivers.remotefs [None req-7b19a890-ff20-470a-aa02-519bf24aa401 tempest-GroupSnapshotsV319Test-664216753 None] /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-1098e642-cecd-431a-9f2d-805ea9ca164d.info is being set with open permissions: ugo+rw: NotImplementedError Jun 17 04:40:26 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-7b19a890-ff20-470a-aa02-519bf24aa401 tempest-GroupSnapshotsV319Test-664216753 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-1098e642-cecd-431a-9f2d-805ea9ca164d.info {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:40:26 devstack sudo[97620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-1098e642-cecd-431a-9f2d-805ea9ca164d.info Jun 17 04:40:26 devstack sudo[97620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:40:27 devstack sudo[97620]: pam_unix(sudo:session): session closed for user root Jun 17 04:40:27 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-7b19a890-ff20-470a-aa02-519bf24aa401 tempest-GroupSnapshotsV319Test-664216753 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-1098e642-cecd-431a-9f2d-805ea9ca164d.info" returned: 0 in 0.810s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:40:27 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-7b19a890-ff20-470a-aa02-519bf24aa401 tempest-GroupSnapshotsV319Test-664216753 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.540s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 04:40:27 devstack cinder-volume[92060]: INFO cinder.volume.manager [None req-7b19a890-ff20-470a-aa02-519bf24aa401 tempest-GroupSnapshotsV319Test-664216753 None] group_snapshot 84937ad2-a39b-4189-b82b-881a4a5ace4d: created successfully Jun 17 04:40:29 devstack cinder-volume[92060]: INFO cinder.volume.manager [None req-4032aae2-1b52-4aae-85f5-7403305ef5d5 tempest-GroupSnapshotsV319Test-664216753 None] group_snapshot 84937ad2-a39b-4189-b82b-881a4a5ace4d: deleting Jun 17 04:40:29 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-4032aae2-1b52-4aae-85f5-7403305ef5d5 tempest-GroupSnapshotsV319Test-664216753 None] group_snapshot 84937ad2-a39b-4189-b82b-881a4a5ace4d: deleting {{(pid=92060) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Jun 17 04:40:29 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-4032aae2-1b52-4aae-85f5-7403305ef5d5 tempest-GroupSnapshotsV319Test-664216753 None] Acquiring lock "cinder-quobyte-1098e642-cecd-431a-9f2d-805ea9ca164d" by "delete_snapshot" {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 04:40:29 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-4032aae2-1b52-4aae-85f5-7403305ef5d5 tempest-GroupSnapshotsV319Test-664216753 None] Lock "cinder-quobyte-1098e642-cecd-431a-9f2d-805ea9ca164d" acquired by "delete_snapshot" :: waited 0.036s {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 04:40:29 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-4032aae2-1b52-4aae-85f5-7403305ef5d5 tempest-GroupSnapshotsV319Test-664216753 None] Acquiring lock "cinder-quobyte-73fc7dcf-9234-41bf-9914-ae481397bd97" by "_delete_snapshot" {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 04:40:29 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-4032aae2-1b52-4aae-85f5-7403305ef5d5 tempest-GroupSnapshotsV319Test-664216753 None] Lock "cinder-quobyte-73fc7dcf-9234-41bf-9914-ae481397bd97" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 04:40:29 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.remotefs [None req-4032aae2-1b52-4aae-85f5-7403305ef5d5 tempest-GroupSnapshotsV319Test-664216753 None] Deleting offline snapshot 73fc7dcf-9234-41bf-9914-ae481397bd97 of volume 1098e642-cecd-431a-9f2d-805ea9ca164d {{(pid=92060) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 17 04:40:29 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.remotefs [None req-4032aae2-1b52-4aae-85f5-7403305ef5d5 tempest-GroupSnapshotsV319Test-664216753 None] snapshot_file for this snap is: volume-1098e642-cecd-431a-9f2d-805ea9ca164d.73fc7dcf-9234-41bf-9914-ae481397bd97 {{(pid=92060) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 17 04:40:29 devstack cinder-volume[92060]: DEBUG oslo.privsep.daemon [-] privsep: reply[74ce9d5b-dfa7-4ac4-8e27-e9f4e0c41f1a]: (4, 'qcow2') {{(pid=93130) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 04:40:29 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-4032aae2-1b52-4aae-85f5-7403305ef5d5 tempest-GroupSnapshotsV319Test-664216753 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-1098e642-cecd-431a-9f2d-805ea9ca164d.73fc7dcf-9234-41bf-9914-ae481397bd97 {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:40:29 devstack sudo[97631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-1098e642-cecd-431a-9f2d-805ea9ca164d.73fc7dcf-9234-41bf-9914-ae481397bd97 Jun 17 04:40:29 devstack sudo[97631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:40:30 devstack sudo[97631]: pam_unix(sudo:session): session closed for user root Jun 17 04:40:30 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-4032aae2-1b52-4aae-85f5-7403305ef5d5 tempest-GroupSnapshotsV319Test-664216753 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-1098e642-cecd-431a-9f2d-805ea9ca164d.73fc7dcf-9234-41bf-9914-ae481397bd97" returned: 0 in 0.979s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:40:30 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.remotefs [None req-4032aae2-1b52-4aae-85f5-7403305ef5d5 tempest-GroupSnapshotsV319Test-664216753 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1098e642-cecd-431a-9f2d-805ea9ca164d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=92060) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 17 04:40:30 devstack cinder-volume[92060]: DEBUG oslo.privsep.daemon [-] privsep: reply[606adec5-0cef-477c-a74f-6f0af18b2ff8]: (4, 'qcow2') {{(pid=93130) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 04:40:30 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-4032aae2-1b52-4aae-85f5-7403305ef5d5 tempest-GroupSnapshotsV319Test-664216753 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-1098e642-cecd-431a-9f2d-805ea9ca164d {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:40:30 devstack sudo[97637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-1098e642-cecd-431a-9f2d-805ea9ca164d Jun 17 04:40:30 devstack sudo[97637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:40:31 devstack sudo[97637]: pam_unix(sudo:session): session closed for user root Jun 17 04:40:31 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-4032aae2-1b52-4aae-85f5-7403305ef5d5 tempest-GroupSnapshotsV319Test-664216753 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-1098e642-cecd-431a-9f2d-805ea9ca164d" returned: 0 in 1.132s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:40:31 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-4032aae2-1b52-4aae-85f5-7403305ef5d5 tempest-GroupSnapshotsV319Test-664216753 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-1098e642-cecd-431a-9f2d-805ea9ca164d.73fc7dcf-9234-41bf-9914-ae481397bd97 {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:40:31 devstack sudo[97643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-1098e642-cecd-431a-9f2d-805ea9ca164d.73fc7dcf-9234-41bf-9914-ae481397bd97 Jun 17 04:40:31 devstack sudo[97643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:40:32 devstack sudo[97643]: pam_unix(sudo:session): session closed for user root Jun 17 04:40:32 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-4032aae2-1b52-4aae-85f5-7403305ef5d5 tempest-GroupSnapshotsV319Test-664216753 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-1098e642-cecd-431a-9f2d-805ea9ca164d.73fc7dcf-9234-41bf-9914-ae481397bd97" returned: 0 in 1.041s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:40:32 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-4032aae2-1b52-4aae-85f5-7403305ef5d5 tempest-GroupSnapshotsV319Test-664216753 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-1098e642-cecd-431a-9f2d-805ea9ca164d.73fc7dcf-9234-41bf-9914-ae481397bd97 {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:40:32 devstack sudo[97649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-1098e642-cecd-431a-9f2d-805ea9ca164d.73fc7dcf-9234-41bf-9914-ae481397bd97 Jun 17 04:40:32 devstack sudo[97649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:40:33 devstack sudo[97649]: pam_unix(sudo:session): session closed for user root Jun 17 04:40:33 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-4032aae2-1b52-4aae-85f5-7403305ef5d5 tempest-GroupSnapshotsV319Test-664216753 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-1098e642-cecd-431a-9f2d-805ea9ca164d.73fc7dcf-9234-41bf-9914-ae481397bd97" returned: 0 in 0.657s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:40:33 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-4032aae2-1b52-4aae-85f5-7403305ef5d5 tempest-GroupSnapshotsV319Test-664216753 None] Lock "cinder-quobyte-73fc7dcf-9234-41bf-9914-ae481397bd97" released by "_delete_snapshot" :: held 4.003s {{(pid=92060) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 04:40:33 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-4032aae2-1b52-4aae-85f5-7403305ef5d5 tempest-GroupSnapshotsV319Test-664216753 None] Lock "cinder-quobyte-1098e642-cecd-431a-9f2d-805ea9ca164d" released by "delete_snapshot" :: held 4.037s {{(pid=92060) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 04:40:33 devstack cinder-volume[92060]: WARNING cinder.quota [None req-4032aae2-1b52-4aae-85f5-7403305ef5d5 tempest-GroupSnapshotsV319Test-664216753 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-530779856 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-530779856, it is now deprecated. Please use the default quota class for default quota. Jun 17 04:40:33 devstack cinder-volume[92060]: WARNING cinder.quota [None req-4032aae2-1b52-4aae-85f5-7403305ef5d5 tempest-GroupSnapshotsV319Test-664216753 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-530779856 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-530779856, it is now deprecated. Please use the default quota class for default quota. Jun 17 04:40:33 devstack cinder-volume[92060]: DEBUG cinder.quota [None req-4032aae2-1b52-4aae-85f5-7403305ef5d5 tempest-GroupSnapshotsV319Test-664216753 None] Created reservations ['5ab2a6bf-277b-4759-9c0c-1dade03b3cef', '99678727-d86c-470e-8d0b-f1592ff188ff', '07b4b731-a6b4-4687-8d3a-cbb180cf323d', '7a179410-d278-4975-8011-f69dbe1982a6'] {{(pid=92060) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 17 04:40:33 devstack cinder-volume[92060]: INFO cinder.volume.manager [None req-4032aae2-1b52-4aae-85f5-7403305ef5d5 tempest-GroupSnapshotsV319Test-664216753 None] group_snapshot 84937ad2-a39b-4189-b82b-881a4a5ace4d: deleted successfully Jun 17 04:40:33 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-da56125e-809f-4605-a860-e9d54189e8fa tempest-GroupSnapshotsV319Test-664216753 None] Acquiring lock "cinder-quobyte-1098e642-cecd-431a-9f2d-805ea9ca164d" by "delete_volume" {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 04:40:33 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-da56125e-809f-4605-a860-e9d54189e8fa tempest-GroupSnapshotsV319Test-664216753 None] Lock "cinder-quobyte-1098e642-cecd-431a-9f2d-805ea9ca164d" acquired by "delete_volume" :: waited 0.016s {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 04:40:33 devstack cinder-volume[92060]: DEBUG oslo.privsep.daemon [-] privsep: reply[118f05aa-5c2b-4eab-b512-693c986b12e6]: (4, 'qcow2') {{(pid=93130) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 04:40:33 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-da56125e-809f-4605-a860-e9d54189e8fa tempest-GroupSnapshotsV319Test-664216753 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-1098e642-cecd-431a-9f2d-805ea9ca164d {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:40:33 devstack sudo[97652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-1098e642-cecd-431a-9f2d-805ea9ca164d Jun 17 04:40:33 devstack sudo[97652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:40:34 devstack sudo[97652]: pam_unix(sudo:session): session closed for user root Jun 17 04:40:34 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-da56125e-809f-4605-a860-e9d54189e8fa tempest-GroupSnapshotsV319Test-664216753 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-1098e642-cecd-431a-9f2d-805ea9ca164d" returned: 0 in 0.782s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:40:34 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-da56125e-809f-4605-a860-e9d54189e8fa tempest-GroupSnapshotsV319Test-664216753 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-1098e642-cecd-431a-9f2d-805ea9ca164d {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:40:34 devstack sudo[97658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-1098e642-cecd-431a-9f2d-805ea9ca164d Jun 17 04:40:34 devstack sudo[97658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:40:35 devstack sudo[97658]: pam_unix(sudo:session): session closed for user root Jun 17 04:40:35 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-da56125e-809f-4605-a860-e9d54189e8fa tempest-GroupSnapshotsV319Test-664216753 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-1098e642-cecd-431a-9f2d-805ea9ca164d" returned: 0 in 0.727s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:40:35 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-da56125e-809f-4605-a860-e9d54189e8fa tempest-GroupSnapshotsV319Test-664216753 None] Lock "cinder-quobyte-1098e642-cecd-431a-9f2d-805ea9ca164d" released by "delete_volume" :: held 1.601s {{(pid=92060) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 04:40:35 devstack cinder-volume[92060]: DEBUG cinder.quota [None req-da56125e-809f-4605-a860-e9d54189e8fa tempest-GroupSnapshotsV319Test-664216753 None] Created reservations ['9f7ec320-5c9c-49c5-b7cd-37c068da95b0'] {{(pid=92060) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 17 04:40:35 devstack cinder-volume[92060]: WARNING cinder.quota [None req-da56125e-809f-4605-a860-e9d54189e8fa tempest-GroupSnapshotsV319Test-664216753 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-530779856 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-530779856, it is now deprecated. Please use the default quota class for default quota. Jun 17 04:40:35 devstack cinder-volume[92060]: DEBUG cinder.quota [None req-da56125e-809f-4605-a860-e9d54189e8fa tempest-GroupSnapshotsV319Test-664216753 None] Created reservations ['e325415c-92ab-408e-9e38-96a47d6625a4', '7a276982-e96d-41f8-a8b6-8b5a94909c00', '55bd1c14-2f7e-47da-a85f-b0bc9e98bf28', '38e5374a-234c-4f98-9f79-bafa8b646e7b'] {{(pid=92060) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 17 04:40:35 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-da56125e-809f-4605-a860-e9d54189e8fa tempest-GroupSnapshotsV319Test-664216753 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 04:40:35 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-da56125e-809f-4605-a860-e9d54189e8fa tempest-GroupSnapshotsV319Test-664216753 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 04:40:35 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-da56125e-809f-4605-a860-e9d54189e8fa tempest-GroupSnapshotsV319Test-664216753 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588': None} {{(pid=92060) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 17 04:40:35 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-da56125e-809f-4605-a860-e9d54189e8fa tempest-GroupSnapshotsV319Test-664216753 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588'] {{(pid=92060) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 17 04:40:35 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-da56125e-809f-4605-a860-e9d54189e8fa tempest-GroupSnapshotsV319Test-664216753 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 04:40:35 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-da56125e-809f-4605-a860-e9d54189e8fa tempest-GroupSnapshotsV319Test-664216753 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:40:35 devstack sudo[97661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a Jun 17 04:40:35 devstack sudo[97661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:40:36 devstack sudo[97661]: pam_unix(sudo:session): session closed for user root Jun 17 04:40:36 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-da56125e-809f-4605-a860-e9d54189e8fa tempest-GroupSnapshotsV319Test-664216753 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a" returned: 0 in 0.907s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:40:36 devstack cinder-volume[92060]: DEBUG cinder.manager [None req-da56125e-809f-4605-a860-e9d54189e8fa tempest-GroupSnapshotsV319Test-664216753 None] Notifying Schedulers of capabilities ... {{(pid=92060) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 17 04:40:36 devstack cinder-volume[92060]: INFO cinder.volume.manager [None req-da56125e-809f-4605-a860-e9d54189e8fa tempest-GroupSnapshotsV319Test-664216753 None] Delete group completed successfully. Jun 17 04:40:39 devstack cinder-volume[92060]: DEBUG cinder.volume.flows.manager.create_volume [None req-5da118c8-dc84-4ed3-80df-604fe1ddf8d6 tempest-SnapshotsActionsTest-1887161024 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92060) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 17 04:40:39 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-5da118c8-dc84-4ed3-80df-604fe1ddf8d6 tempest-SnapshotsActionsTest-1887161024 None] Flow 'volume_create_manager' (a4c527c8-0ffd-4de9-b170-69d8b207ea30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 17 04:40:39 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-5da118c8-dc84-4ed3-80df-604fe1ddf8d6 tempest-SnapshotsActionsTest-1887161024 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (09c67e98-e8cf-407d-a16b-50f932d763cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:40:39 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-5da118c8-dc84-4ed3-80df-604fe1ddf8d6 tempest-SnapshotsActionsTest-1887161024 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (09c67e98-e8cf-407d-a16b-50f932d763cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-17T02:40:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-93406317',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d34f5b5f-658b-4614-8fc4-5c5254fa49d1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3d5aa039fb234117b3182b0393c49862',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T02:40:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T02:40:39Z,use_quota=True,user_id='65a1defb59ed4d9482cb0fe8e907e36b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aad9ce24-93f9-41a6-baa1-5125964f96d1),volume_type_id=aad9ce24-93f9-41a6-baa1-5125964f96d1)' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:40:39 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-5da118c8-dc84-4ed3-80df-604fe1ddf8d6 tempest-SnapshotsActionsTest-1887161024 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cec4b305-8c2b-447b-860c-089e0a02d1e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:40:39 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-5da118c8-dc84-4ed3-80df-604fe1ddf8d6 tempest-SnapshotsActionsTest-1887161024 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cec4b305-8c2b-447b-860c-089e0a02d1e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:40:39 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-5da118c8-dc84-4ed3-80df-604fe1ddf8d6 tempest-SnapshotsActionsTest-1887161024 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (52eed226-b9f5-4a4f-950b-773bd8c4d840) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:40:39 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-5da118c8-dc84-4ed3-80df-604fe1ddf8d6 tempest-SnapshotsActionsTest-1887161024 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (52eed226-b9f5-4a4f-950b-773bd8c4d840) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd34f5b5f-658b-4614-8fc4-5c5254fa49d1', 'volume_name': 'volume-d34f5b5f-658b-4614-8fc4-5c5254fa49d1', 'volume_size': 1}' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:40:39 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-5da118c8-dc84-4ed3-80df-604fe1ddf8d6 tempest-SnapshotsActionsTest-1887161024 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1ab88245-1e17-47c4-8046-8f9a40e998bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:40:39 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-5da118c8-dc84-4ed3-80df-604fe1ddf8d6 tempest-SnapshotsActionsTest-1887161024 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1ab88245-1e17-47c4-8046-8f9a40e998bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:40:39 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-5da118c8-dc84-4ed3-80df-604fe1ddf8d6 tempest-SnapshotsActionsTest-1887161024 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8edfcd0f-5fe3-42c5-8002-a5aa6240ccdf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:40:39 devstack cinder-volume[92060]: INFO cinder.volume.flows.manager.create_volume [None req-5da118c8-dc84-4ed3-80df-604fe1ddf8d6 tempest-SnapshotsActionsTest-1887161024 None] Volume d34f5b5f-658b-4614-8fc4-5c5254fa49d1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d34f5b5f-658b-4614-8fc4-5c5254fa49d1', 'volume_size': 1} Jun 17 04:40:39 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-5da118c8-dc84-4ed3-80df-604fe1ddf8d6 tempest-SnapshotsActionsTest-1887161024 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 04:40:39 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-5da118c8-dc84-4ed3-80df-604fe1ddf8d6 tempest-SnapshotsActionsTest-1887161024 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 04:40:39 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-5da118c8-dc84-4ed3-80df-604fe1ddf8d6 tempest-SnapshotsActionsTest-1887161024 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-17T02:40:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-93406317',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d34f5b5f-658b-4614-8fc4-5c5254fa49d1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3d5aa039fb234117b3182b0393c49862',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T02:40:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T02:40:39Z,use_quota=True,user_id='65a1defb59ed4d9482cb0fe8e907e36b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aad9ce24-93f9-41a6-baa1-5125964f96d1),volume_type_id=aad9ce24-93f9-41a6-baa1-5125964f96d1)}" {{(pid=92060) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 17 04:40:39 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.remotefs [None req-5da118c8-dc84-4ed3-80df-604fe1ddf8d6 tempest-SnapshotsActionsTest-1887161024 None] Creating volume d34f5b5f-658b-4614-8fc4-5c5254fa49d1 {{(pid=92060) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 17 04:40:39 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-5da118c8-dc84-4ed3-80df-604fe1ddf8d6 tempest-SnapshotsActionsTest-1887161024 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 04:40:39 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-5da118c8-dc84-4ed3-80df-604fe1ddf8d6 tempest-SnapshotsActionsTest-1887161024 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 04:40:39 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-5da118c8-dc84-4ed3-80df-604fe1ddf8d6 tempest-SnapshotsActionsTest-1887161024 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588': None} {{(pid=92060) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 17 04:40:39 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-5da118c8-dc84-4ed3-80df-604fe1ddf8d6 tempest-SnapshotsActionsTest-1887161024 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588'] {{(pid=92060) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 17 04:40:39 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-5da118c8-dc84-4ed3-80df-604fe1ddf8d6 tempest-SnapshotsActionsTest-1887161024 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 04:40:39 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-5da118c8-dc84-4ed3-80df-604fe1ddf8d6 tempest-SnapshotsActionsTest-1887161024 None] Selected osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588 as target Quobyte volume. {{(pid=92060) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 17 04:40:39 devstack cinder-volume[92060]: INFO cinder.volume.drivers.remotefs [None req-5da118c8-dc84-4ed3-80df-604fe1ddf8d6 tempest-SnapshotsActionsTest-1887161024 None] casted to osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588 Jun 17 04:40:39 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-5da118c8-dc84-4ed3-80df-604fe1ddf8d6 tempest-SnapshotsActionsTest-1887161024 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-d34f5b5f-658b-4614-8fc4-5c5254fa49d1 1073741824 {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:40:39 devstack sudo[97665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-d34f5b5f-658b-4614-8fc4-5c5254fa49d1 1073741824 Jun 17 04:40:39 devstack sudo[97665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:40:40 devstack sudo[97665]: pam_unix(sudo:session): session closed for user root Jun 17 04:40:40 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-5da118c8-dc84-4ed3-80df-604fe1ddf8d6 tempest-SnapshotsActionsTest-1887161024 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-d34f5b5f-658b-4614-8fc4-5c5254fa49d1 1073741824" returned: 0 in 1.092s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:40:40 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-5da118c8-dc84-4ed3-80df-604fe1ddf8d6 tempest-SnapshotsActionsTest-1887161024 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-d34f5b5f-658b-4614-8fc4-5c5254fa49d1 {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:40:40 devstack sudo[97672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-d34f5b5f-658b-4614-8fc4-5c5254fa49d1 Jun 17 04:40:40 devstack sudo[97672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:40:41 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [req-28bf2858-6c0f-4c50-bba7-e96023103ff9 req-75049d0a-86d1-47b4-bc85-53df47ac6298 tempest-AttachVolumeShelveTestJSON-134363980 None] No connector for attachment c88ab305-4a61-4ee9-b055-b111262b1270; skipping storage backend terminate_connection call. {{(pid=92060) _connection_terminate /opt/stack/cinder/cinder/volume/manager.py:5010}} Jun 17 04:40:41 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [req-28bf2858-6c0f-4c50-bba7-e96023103ff9 req-75049d0a-86d1-47b4-bc85-53df47ac6298 tempest-AttachVolumeShelveTestJSON-134363980 None] Deleting attachment c88ab305-4a61-4ee9-b055-b111262b1270. {{(pid=92060) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 17 04:40:41 devstack sudo[97672]: pam_unix(sudo:session): session closed for user root Jun 17 04:40:41 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-5da118c8-dc84-4ed3-80df-604fe1ddf8d6 tempest-SnapshotsActionsTest-1887161024 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-d34f5b5f-658b-4614-8fc4-5c5254fa49d1" returned: 0 in 0.749s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:40:41 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-5da118c8-dc84-4ed3-80df-604fe1ddf8d6 tempest-SnapshotsActionsTest-1887161024 None] <== create_volume: return (1893ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588'} {{(pid=92060) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 17 04:40:41 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-5da118c8-dc84-4ed3-80df-604fe1ddf8d6 tempest-SnapshotsActionsTest-1887161024 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.896s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 04:40:41 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-5da118c8-dc84-4ed3-80df-604fe1ddf8d6 tempest-SnapshotsActionsTest-1887161024 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8edfcd0f-5fe3-42c5-8002-a5aa6240ccdf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d34f5b5f-658b-4614-8fc4-5c5254fa49d1', 'volume_size': 1}' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:40:41 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-5da118c8-dc84-4ed3-80df-604fe1ddf8d6 tempest-SnapshotsActionsTest-1887161024 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (40535fe3-8f05-4a48-bf65-021b0350d2bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:40:41 devstack cinder-volume[92060]: INFO cinder.volume.flows.manager.create_volume [None req-5da118c8-dc84-4ed3-80df-604fe1ddf8d6 tempest-SnapshotsActionsTest-1887161024 None] Volume volume-d34f5b5f-658b-4614-8fc4-5c5254fa49d1 (d34f5b5f-658b-4614-8fc4-5c5254fa49d1): created successfully Jun 17 04:40:41 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-5da118c8-dc84-4ed3-80df-604fe1ddf8d6 tempest-SnapshotsActionsTest-1887161024 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (40535fe3-8f05-4a48-bf65-021b0350d2bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:40:41 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-5da118c8-dc84-4ed3-80df-604fe1ddf8d6 tempest-SnapshotsActionsTest-1887161024 None] Flow 'volume_create_manager' (a4c527c8-0ffd-4de9-b170-69d8b207ea30) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92060) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 17 04:40:41 devstack cinder-volume[92060]: INFO cinder.volume.manager [None req-5da118c8-dc84-4ed3-80df-604fe1ddf8d6 tempest-SnapshotsActionsTest-1887161024 None] Created volume successfully. Jun 17 04:40:42 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-765b4a52-7af3-4099-b371-c98cca6490d4 tempest-SnapshotsActionsTest-1887161024 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 04:40:42 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-765b4a52-7af3-4099-b371-c98cca6490d4 tempest-SnapshotsActionsTest-1887161024 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 04:40:42 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.remotefs [None req-765b4a52-7af3-4099-b371-c98cca6490d4 tempest-SnapshotsActionsTest-1887161024 None] Creating offline snapshot fa0422c1-2dcc-42b5-8af4-58157d6473cd of volume d34f5b5f-658b-4614-8fc4-5c5254fa49d1 {{(pid=92060) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 17 04:40:42 devstack cinder-volume[92060]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2abfbb1-cfe7-49ea-91e4-97fcc311ff68]: (4, 'qcow2') {{(pid=93130) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 04:40:42 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-765b4a52-7af3-4099-b371-c98cca6490d4 tempest-SnapshotsActionsTest-1887161024 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-d34f5b5f-658b-4614-8fc4-5c5254fa49d1 {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:40:42 devstack sudo[97677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-d34f5b5f-658b-4614-8fc4-5c5254fa49d1 Jun 17 04:40:42 devstack sudo[97677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:40:43 devstack sudo[97677]: pam_unix(sudo:session): session closed for user root Jun 17 04:40:43 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-765b4a52-7af3-4099-b371-c98cca6490d4 tempest-SnapshotsActionsTest-1887161024 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-d34f5b5f-658b-4614-8fc4-5c5254fa49d1" returned: 0 in 1.032s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:40:43 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-765b4a52-7af3-4099-b371-c98cca6490d4 tempest-SnapshotsActionsTest-1887161024 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-d34f5b5f-658b-4614-8fc4-5c5254fa49d1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-d34f5b5f-658b-4614-8fc4-5c5254fa49d1.fa0422c1-2dcc-42b5-8af4-58157d6473cd 1G {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:40:43 devstack sudo[97684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-d34f5b5f-658b-4614-8fc4-5c5254fa49d1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-d34f5b5f-658b-4614-8fc4-5c5254fa49d1.fa0422c1-2dcc-42b5-8af4-58157d6473cd 1G Jun 17 04:40:43 devstack sudo[97684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:40:43 devstack sudo[97684]: pam_unix(sudo:session): session closed for user root Jun 17 04:40:43 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-765b4a52-7af3-4099-b371-c98cca6490d4 tempest-SnapshotsActionsTest-1887161024 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-d34f5b5f-658b-4614-8fc4-5c5254fa49d1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-d34f5b5f-658b-4614-8fc4-5c5254fa49d1.fa0422c1-2dcc-42b5-8af4-58157d6473cd 1G" returned: 0 in 0.862s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:40:43 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-765b4a52-7af3-4099-b371-c98cca6490d4 tempest-SnapshotsActionsTest-1887161024 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d34f5b5f-658b-4614-8fc4-5c5254fa49d1 -F qcow2 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-d34f5b5f-658b-4614-8fc4-5c5254fa49d1.fa0422c1-2dcc-42b5-8af4-58157d6473cd {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:40:44 devstack sudo[97689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d34f5b5f-658b-4614-8fc4-5c5254fa49d1 -F qcow2 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-d34f5b5f-658b-4614-8fc4-5c5254fa49d1.fa0422c1-2dcc-42b5-8af4-58157d6473cd Jun 17 04:40:44 devstack sudo[97689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:40:44 devstack sudo[97689]: pam_unix(sudo:session): session closed for user root Jun 17 04:40:44 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-765b4a52-7af3-4099-b371-c98cca6490d4 tempest-SnapshotsActionsTest-1887161024 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d34f5b5f-658b-4614-8fc4-5c5254fa49d1 -F qcow2 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-d34f5b5f-658b-4614-8fc4-5c5254fa49d1.fa0422c1-2dcc-42b5-8af4-58157d6473cd" returned: 0 in 0.659s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:40:44 devstack cinder-volume[92060]: WARNING cinder.volume.drivers.remotefs [None req-765b4a52-7af3-4099-b371-c98cca6490d4 tempest-SnapshotsActionsTest-1887161024 None] /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-d34f5b5f-658b-4614-8fc4-5c5254fa49d1.fa0422c1-2dcc-42b5-8af4-58157d6473cd is being set with open permissions: ugo+rw Jun 17 04:40:44 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-765b4a52-7af3-4099-b371-c98cca6490d4 tempest-SnapshotsActionsTest-1887161024 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-d34f5b5f-658b-4614-8fc4-5c5254fa49d1.fa0422c1-2dcc-42b5-8af4-58157d6473cd {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:40:44 devstack sudo[97694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-d34f5b5f-658b-4614-8fc4-5c5254fa49d1.fa0422c1-2dcc-42b5-8af4-58157d6473cd Jun 17 04:40:44 devstack sudo[97694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:40:44 devstack cinder-volume[92060]: DEBUG oslo_service.periodic_task [None req-60d279ad-ad8c-4d36-a4b8-f593e74fb922 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=92060) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 17 04:40:44 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-60d279ad-ad8c-4d36-a4b8-f593e74fb922 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 04:40:44 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-60d279ad-ad8c-4d36-a4b8-f593e74fb922 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 04:40:44 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-60d279ad-ad8c-4d36-a4b8-f593e74fb922 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588': None} {{(pid=92060) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 17 04:40:44 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-60d279ad-ad8c-4d36-a4b8-f593e74fb922 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588'] {{(pid=92060) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 17 04:40:44 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-60d279ad-ad8c-4d36-a4b8-f593e74fb922 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 04:40:44 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-60d279ad-ad8c-4d36-a4b8-f593e74fb922 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:40:44 devstack sudo[97696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a Jun 17 04:40:44 devstack sudo[97696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:40:45 devstack sudo[97694]: pam_unix(sudo:session): session closed for user root Jun 17 04:40:45 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-765b4a52-7af3-4099-b371-c98cca6490d4 tempest-SnapshotsActionsTest-1887161024 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-d34f5b5f-658b-4614-8fc4-5c5254fa49d1.fa0422c1-2dcc-42b5-8af4-58157d6473cd" returned: 0 in 0.719s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:40:45 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-765b4a52-7af3-4099-b371-c98cca6490d4 tempest-SnapshotsActionsTest-1887161024 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-d34f5b5f-658b-4614-8fc4-5c5254fa49d1.info {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:40:45 devstack sudo[97699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-d34f5b5f-658b-4614-8fc4-5c5254fa49d1.info Jun 17 04:40:45 devstack sudo[97699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:40:45 devstack sudo[97696]: pam_unix(sudo:session): session closed for user root Jun 17 04:40:45 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-60d279ad-ad8c-4d36-a4b8-f593e74fb922 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a" returned: 0 in 0.743s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:40:45 devstack cinder-volume[92060]: DEBUG cinder.manager [None req-60d279ad-ad8c-4d36-a4b8-f593e74fb922 None None] Notifying Schedulers of capabilities ... {{(pid=92060) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 17 04:40:45 devstack cinder-volume[92060]: DEBUG oslo_service.periodic_task [None req-60d279ad-ad8c-4d36-a4b8-f593e74fb922 None None] Running periodic task VolumeManager._thread_info {{(pid=92060) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 17 04:40:45 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-60d279ad-ad8c-4d36-a4b8-f593e74fb922 None None] thread count: 8 {{(pid=92060) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 17 04:40:45 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-60d279ad-ad8c-4d36-a4b8-f593e74fb922 None None] thread info: [<_MainThread(MainThread, started 130061806440576)>, , , , , , , ] {{(pid=92060) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 17 04:40:46 devstack sudo[97699]: pam_unix(sudo:session): session closed for user root Jun 17 04:40:46 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-765b4a52-7af3-4099-b371-c98cca6490d4 tempest-SnapshotsActionsTest-1887161024 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-d34f5b5f-658b-4614-8fc4-5c5254fa49d1.info" returned: 0 in 0.626s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:40:46 devstack cinder-volume[92060]: WARNING cinder.volume.drivers.remotefs [None req-765b4a52-7af3-4099-b371-c98cca6490d4 tempest-SnapshotsActionsTest-1887161024 None] /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-d34f5b5f-658b-4614-8fc4-5c5254fa49d1.info is being set with open permissions: ugo+rw Jun 17 04:40:46 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-765b4a52-7af3-4099-b371-c98cca6490d4 tempest-SnapshotsActionsTest-1887161024 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-d34f5b5f-658b-4614-8fc4-5c5254fa49d1.info {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:40:46 devstack sudo[97703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-d34f5b5f-658b-4614-8fc4-5c5254fa49d1.info Jun 17 04:40:46 devstack sudo[97703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:40:46 devstack sudo[97703]: pam_unix(sudo:session): session closed for user root Jun 17 04:40:46 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-765b4a52-7af3-4099-b371-c98cca6490d4 tempest-SnapshotsActionsTest-1887161024 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-d34f5b5f-658b-4614-8fc4-5c5254fa49d1.info" returned: 0 in 0.691s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:40:46 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-765b4a52-7af3-4099-b371-c98cca6490d4 tempest-SnapshotsActionsTest-1887161024 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.726s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 04:40:46 devstack cinder-volume[92060]: INFO cinder.volume.manager [None req-765b4a52-7af3-4099-b371-c98cca6490d4 tempest-SnapshotsActionsTest-1887161024 None] Create snapshot completed successfully Jun 17 04:40:48 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-944378c6-7444-44b9-88a0-e263524c38f4 tempest-SnapshotsActionsTest-1887161024 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 04:40:48 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-944378c6-7444-44b9-88a0-e263524c38f4 tempest-SnapshotsActionsTest-1887161024 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 04:40:48 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.remotefs [None req-944378c6-7444-44b9-88a0-e263524c38f4 tempest-SnapshotsActionsTest-1887161024 None] Creating offline snapshot 2f4d1bfd-c08c-49f8-97a2-45a57cb69170 of volume d34f5b5f-658b-4614-8fc4-5c5254fa49d1 {{(pid=92060) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 17 04:40:48 devstack cinder-volume[92060]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3257a3a-604c-43bb-b241-fbbfa8dd3cd9]: (4, 'qcow2') {{(pid=93130) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 04:40:48 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-944378c6-7444-44b9-88a0-e263524c38f4 tempest-SnapshotsActionsTest-1887161024 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-d34f5b5f-658b-4614-8fc4-5c5254fa49d1.fa0422c1-2dcc-42b5-8af4-58157d6473cd {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:40:48 devstack sudo[97707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-d34f5b5f-658b-4614-8fc4-5c5254fa49d1.fa0422c1-2dcc-42b5-8af4-58157d6473cd Jun 17 04:40:48 devstack sudo[97707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:40:49 devstack sudo[97707]: pam_unix(sudo:session): session closed for user root Jun 17 04:40:49 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-944378c6-7444-44b9-88a0-e263524c38f4 tempest-SnapshotsActionsTest-1887161024 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-d34f5b5f-658b-4614-8fc4-5c5254fa49d1.fa0422c1-2dcc-42b5-8af4-58157d6473cd" returned: 0 in 0.854s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:40:49 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.remotefs [None req-944378c6-7444-44b9-88a0-e263524c38f4 tempest-SnapshotsActionsTest-1887161024 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d34f5b5f-658b-4614-8fc4-5c5254fa49d1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=92060) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 17 04:40:49 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-944378c6-7444-44b9-88a0-e263524c38f4 tempest-SnapshotsActionsTest-1887161024 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-d34f5b5f-658b-4614-8fc4-5c5254fa49d1.fa0422c1-2dcc-42b5-8af4-58157d6473cd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-d34f5b5f-658b-4614-8fc4-5c5254fa49d1.2f4d1bfd-c08c-49f8-97a2-45a57cb69170 1G {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:40:49 devstack sudo[97717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-d34f5b5f-658b-4614-8fc4-5c5254fa49d1.fa0422c1-2dcc-42b5-8af4-58157d6473cd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-d34f5b5f-658b-4614-8fc4-5c5254fa49d1.2f4d1bfd-c08c-49f8-97a2-45a57cb69170 1G Jun 17 04:40:49 devstack sudo[97717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:40:50 devstack sudo[97717]: pam_unix(sudo:session): session closed for user root Jun 17 04:40:50 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-944378c6-7444-44b9-88a0-e263524c38f4 tempest-SnapshotsActionsTest-1887161024 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-d34f5b5f-658b-4614-8fc4-5c5254fa49d1.fa0422c1-2dcc-42b5-8af4-58157d6473cd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-d34f5b5f-658b-4614-8fc4-5c5254fa49d1.2f4d1bfd-c08c-49f8-97a2-45a57cb69170 1G" returned: 0 in 0.994s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:40:50 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-944378c6-7444-44b9-88a0-e263524c38f4 tempest-SnapshotsActionsTest-1887161024 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d34f5b5f-658b-4614-8fc4-5c5254fa49d1.fa0422c1-2dcc-42b5-8af4-58157d6473cd -F qcow2 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-d34f5b5f-658b-4614-8fc4-5c5254fa49d1.2f4d1bfd-c08c-49f8-97a2-45a57cb69170 {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:40:50 devstack sudo[97739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d34f5b5f-658b-4614-8fc4-5c5254fa49d1.fa0422c1-2dcc-42b5-8af4-58157d6473cd -F qcow2 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-d34f5b5f-658b-4614-8fc4-5c5254fa49d1.2f4d1bfd-c08c-49f8-97a2-45a57cb69170 Jun 17 04:40:50 devstack sudo[97739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:40:51 devstack sudo[97739]: pam_unix(sudo:session): session closed for user root Jun 17 04:40:51 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-944378c6-7444-44b9-88a0-e263524c38f4 tempest-SnapshotsActionsTest-1887161024 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d34f5b5f-658b-4614-8fc4-5c5254fa49d1.fa0422c1-2dcc-42b5-8af4-58157d6473cd -F qcow2 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-d34f5b5f-658b-4614-8fc4-5c5254fa49d1.2f4d1bfd-c08c-49f8-97a2-45a57cb69170" returned: 0 in 0.846s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:40:51 devstack cinder-volume[92060]: WARNING cinder.volume.drivers.remotefs [None req-944378c6-7444-44b9-88a0-e263524c38f4 tempest-SnapshotsActionsTest-1887161024 None] /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-d34f5b5f-658b-4614-8fc4-5c5254fa49d1.2f4d1bfd-c08c-49f8-97a2-45a57cb69170 is being set with open permissions: ugo+rw Jun 17 04:40:51 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-944378c6-7444-44b9-88a0-e263524c38f4 tempest-SnapshotsActionsTest-1887161024 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-d34f5b5f-658b-4614-8fc4-5c5254fa49d1.2f4d1bfd-c08c-49f8-97a2-45a57cb69170 {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:40:51 devstack sudo[97746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-d34f5b5f-658b-4614-8fc4-5c5254fa49d1.2f4d1bfd-c08c-49f8-97a2-45a57cb69170 Jun 17 04:40:51 devstack sudo[97746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:40:51 devstack sudo[97746]: pam_unix(sudo:session): session closed for user root Jun 17 04:40:51 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-944378c6-7444-44b9-88a0-e263524c38f4 tempest-SnapshotsActionsTest-1887161024 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-d34f5b5f-658b-4614-8fc4-5c5254fa49d1.2f4d1bfd-c08c-49f8-97a2-45a57cb69170" returned: 0 in 0.635s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:40:51 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-944378c6-7444-44b9-88a0-e263524c38f4 tempest-SnapshotsActionsTest-1887161024 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.469s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 04:40:51 devstack cinder-volume[92060]: INFO cinder.volume.manager [None req-944378c6-7444-44b9-88a0-e263524c38f4 tempest-SnapshotsActionsTest-1887161024 None] Create snapshot completed successfully Jun 17 04:40:52 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-38f03ccf-0000-416f-b524-387358fa3fee tempest-SnapshotsActionsTest-1582591615 None] Acquiring lock "cinder-2f4d1bfd-c08c-49f8-97a2-45a57cb69170-delete_snapshot" by "delete_snapshot" {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 04:40:52 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-38f03ccf-0000-416f-b524-387358fa3fee tempest-SnapshotsActionsTest-1582591615 None] Lock "cinder-2f4d1bfd-c08c-49f8-97a2-45a57cb69170-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 04:40:52 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-38f03ccf-0000-416f-b524-387358fa3fee tempest-SnapshotsActionsTest-1582591615 None] Acquiring lock "cinder-quobyte-d34f5b5f-658b-4614-8fc4-5c5254fa49d1" by "delete_snapshot" {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 04:40:52 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-38f03ccf-0000-416f-b524-387358fa3fee tempest-SnapshotsActionsTest-1582591615 None] Lock "cinder-quobyte-d34f5b5f-658b-4614-8fc4-5c5254fa49d1" acquired by "delete_snapshot" :: waited 0.023s {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 04:40:52 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-38f03ccf-0000-416f-b524-387358fa3fee tempest-SnapshotsActionsTest-1582591615 None] Acquiring lock "cinder-quobyte-2f4d1bfd-c08c-49f8-97a2-45a57cb69170" by "_delete_snapshot" {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 04:40:52 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-38f03ccf-0000-416f-b524-387358fa3fee tempest-SnapshotsActionsTest-1582591615 None] Lock "cinder-quobyte-2f4d1bfd-c08c-49f8-97a2-45a57cb69170" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 04:40:52 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.remotefs [None req-38f03ccf-0000-416f-b524-387358fa3fee tempest-SnapshotsActionsTest-1582591615 None] Deleting offline snapshot 2f4d1bfd-c08c-49f8-97a2-45a57cb69170 of volume d34f5b5f-658b-4614-8fc4-5c5254fa49d1 {{(pid=92060) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 17 04:40:52 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.remotefs [None req-38f03ccf-0000-416f-b524-387358fa3fee tempest-SnapshotsActionsTest-1582591615 None] snapshot_file for this snap is: volume-d34f5b5f-658b-4614-8fc4-5c5254fa49d1.2f4d1bfd-c08c-49f8-97a2-45a57cb69170 {{(pid=92060) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 17 04:40:52 devstack cinder-volume[92060]: DEBUG oslo.privsep.daemon [-] privsep: reply[84eb8d6a-ffbe-430a-8a2b-36922e83177d]: (4, 'qcow2') {{(pid=93130) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 04:40:52 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-38f03ccf-0000-416f-b524-387358fa3fee tempest-SnapshotsActionsTest-1582591615 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-d34f5b5f-658b-4614-8fc4-5c5254fa49d1.2f4d1bfd-c08c-49f8-97a2-45a57cb69170 {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:40:52 devstack sudo[97749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-d34f5b5f-658b-4614-8fc4-5c5254fa49d1.2f4d1bfd-c08c-49f8-97a2-45a57cb69170 Jun 17 04:40:52 devstack sudo[97749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:40:53 devstack sudo[97749]: pam_unix(sudo:session): session closed for user root Jun 17 04:40:53 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-38f03ccf-0000-416f-b524-387358fa3fee tempest-SnapshotsActionsTest-1582591615 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-d34f5b5f-658b-4614-8fc4-5c5254fa49d1.2f4d1bfd-c08c-49f8-97a2-45a57cb69170" returned: 0 in 0.836s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:40:53 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.remotefs [None req-38f03ccf-0000-416f-b524-387358fa3fee tempest-SnapshotsActionsTest-1582591615 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d34f5b5f-658b-4614-8fc4-5c5254fa49d1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=92060) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 17 04:40:53 devstack cinder-volume[92060]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b58c392-4fd2-4d67-ba31-ee7ee0f4c62a]: (4, 'qcow2') {{(pid=93130) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 04:40:53 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-38f03ccf-0000-416f-b524-387358fa3fee tempest-SnapshotsActionsTest-1582591615 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-d34f5b5f-658b-4614-8fc4-5c5254fa49d1.fa0422c1-2dcc-42b5-8af4-58157d6473cd {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:40:53 devstack sudo[97754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-d34f5b5f-658b-4614-8fc4-5c5254fa49d1.fa0422c1-2dcc-42b5-8af4-58157d6473cd Jun 17 04:40:53 devstack sudo[97754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:40:54 devstack sudo[97754]: pam_unix(sudo:session): session closed for user root Jun 17 04:40:54 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-38f03ccf-0000-416f-b524-387358fa3fee tempest-SnapshotsActionsTest-1582591615 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-d34f5b5f-658b-4614-8fc4-5c5254fa49d1.fa0422c1-2dcc-42b5-8af4-58157d6473cd" returned: 0 in 0.852s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:40:54 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.remotefs [None req-38f03ccf-0000-416f-b524-387358fa3fee tempest-SnapshotsActionsTest-1582591615 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d34f5b5f-658b-4614-8fc4-5c5254fa49d1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=92060) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 17 04:40:54 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-38f03ccf-0000-416f-b524-387358fa3fee tempest-SnapshotsActionsTest-1582591615 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-d34f5b5f-658b-4614-8fc4-5c5254fa49d1.2f4d1bfd-c08c-49f8-97a2-45a57cb69170 {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:40:54 devstack sudo[97762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-d34f5b5f-658b-4614-8fc4-5c5254fa49d1.2f4d1bfd-c08c-49f8-97a2-45a57cb69170 Jun 17 04:40:54 devstack sudo[97762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:40:55 devstack sudo[97762]: pam_unix(sudo:session): session closed for user root Jun 17 04:40:55 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-38f03ccf-0000-416f-b524-387358fa3fee tempest-SnapshotsActionsTest-1582591615 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-d34f5b5f-658b-4614-8fc4-5c5254fa49d1.2f4d1bfd-c08c-49f8-97a2-45a57cb69170" returned: 0 in 0.867s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:40:55 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-38f03ccf-0000-416f-b524-387358fa3fee tempest-SnapshotsActionsTest-1582591615 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-d34f5b5f-658b-4614-8fc4-5c5254fa49d1.2f4d1bfd-c08c-49f8-97a2-45a57cb69170 {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:40:55 devstack sudo[97787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-d34f5b5f-658b-4614-8fc4-5c5254fa49d1.2f4d1bfd-c08c-49f8-97a2-45a57cb69170 Jun 17 04:40:55 devstack sudo[97787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:40:56 devstack sudo[97787]: pam_unix(sudo:session): session closed for user root Jun 17 04:40:56 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-38f03ccf-0000-416f-b524-387358fa3fee tempest-SnapshotsActionsTest-1582591615 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-d34f5b5f-658b-4614-8fc4-5c5254fa49d1.2f4d1bfd-c08c-49f8-97a2-45a57cb69170" returned: 0 in 0.699s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:40:56 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-38f03ccf-0000-416f-b524-387358fa3fee tempest-SnapshotsActionsTest-1582591615 None] Lock "cinder-quobyte-2f4d1bfd-c08c-49f8-97a2-45a57cb69170" released by "_delete_snapshot" :: held 3.390s {{(pid=92060) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 04:40:56 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-38f03ccf-0000-416f-b524-387358fa3fee tempest-SnapshotsActionsTest-1582591615 None] Lock "cinder-quobyte-d34f5b5f-658b-4614-8fc4-5c5254fa49d1" released by "delete_snapshot" :: held 3.425s {{(pid=92060) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 04:40:56 devstack cinder-volume[92060]: DEBUG cinder.quota [None req-38f03ccf-0000-416f-b524-387358fa3fee tempest-SnapshotsActionsTest-1582591615 None] Created reservations ['98c53f5d-8c34-4fd0-8d81-8868be378e60', 'b43c9eb4-e106-402a-9510-64cf576a877f', '8f2d5b1e-23d2-4eea-9a43-617c27350df2', '5d380b6f-0f70-4d1b-bd3c-8ad7a478cc57'] {{(pid=92060) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 17 04:40:56 devstack cinder-volume[92060]: INFO cinder.volume.manager [None req-38f03ccf-0000-416f-b524-387358fa3fee tempest-SnapshotsActionsTest-1582591615 None] Delete snapshot completed successfully. Jun 17 04:40:56 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-38f03ccf-0000-416f-b524-387358fa3fee tempest-SnapshotsActionsTest-1582591615 None] Lock "cinder-2f4d1bfd-c08c-49f8-97a2-45a57cb69170-delete_snapshot" released by "delete_snapshot" :: held 3.715s {{(pid=92060) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 04:40:57 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-728c6ada-5ed8-4566-968f-601c27b9ce78 tempest-SnapshotsActionsTest-1887161024 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 04:40:57 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-728c6ada-5ed8-4566-968f-601c27b9ce78 tempest-SnapshotsActionsTest-1887161024 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 04:40:57 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.remotefs [None req-728c6ada-5ed8-4566-968f-601c27b9ce78 tempest-SnapshotsActionsTest-1887161024 None] Creating offline snapshot da4ff203-37ff-426f-a08b-554f056b0b64 of volume d34f5b5f-658b-4614-8fc4-5c5254fa49d1 {{(pid=92060) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 17 04:40:57 devstack cinder-volume[92060]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f6dfaf6-e70b-4d12-ada8-792a6d4f5d2f]: (4, 'qcow2') {{(pid=93130) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 04:40:57 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-728c6ada-5ed8-4566-968f-601c27b9ce78 tempest-SnapshotsActionsTest-1887161024 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-d34f5b5f-658b-4614-8fc4-5c5254fa49d1.fa0422c1-2dcc-42b5-8af4-58157d6473cd {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:40:57 devstack sudo[97866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-d34f5b5f-658b-4614-8fc4-5c5254fa49d1.fa0422c1-2dcc-42b5-8af4-58157d6473cd Jun 17 04:40:57 devstack sudo[97866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:40:58 devstack sudo[97866]: pam_unix(sudo:session): session closed for user root Jun 17 04:40:58 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-728c6ada-5ed8-4566-968f-601c27b9ce78 tempest-SnapshotsActionsTest-1887161024 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-d34f5b5f-658b-4614-8fc4-5c5254fa49d1.fa0422c1-2dcc-42b5-8af4-58157d6473cd" returned: 0 in 1.047s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:40:58 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.remotefs [None req-728c6ada-5ed8-4566-968f-601c27b9ce78 tempest-SnapshotsActionsTest-1887161024 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d34f5b5f-658b-4614-8fc4-5c5254fa49d1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=92060) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 17 04:40:58 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-728c6ada-5ed8-4566-968f-601c27b9ce78 tempest-SnapshotsActionsTest-1887161024 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-d34f5b5f-658b-4614-8fc4-5c5254fa49d1.fa0422c1-2dcc-42b5-8af4-58157d6473cd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-d34f5b5f-658b-4614-8fc4-5c5254fa49d1.da4ff203-37ff-426f-a08b-554f056b0b64 1G {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:40:58 devstack sudo[97873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-d34f5b5f-658b-4614-8fc4-5c5254fa49d1.fa0422c1-2dcc-42b5-8af4-58157d6473cd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-d34f5b5f-658b-4614-8fc4-5c5254fa49d1.da4ff203-37ff-426f-a08b-554f056b0b64 1G Jun 17 04:40:58 devstack sudo[97873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:41:00 devstack sudo[97873]: pam_unix(sudo:session): session closed for user root Jun 17 04:41:00 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-728c6ada-5ed8-4566-968f-601c27b9ce78 tempest-SnapshotsActionsTest-1887161024 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-d34f5b5f-658b-4614-8fc4-5c5254fa49d1.fa0422c1-2dcc-42b5-8af4-58157d6473cd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-d34f5b5f-658b-4614-8fc4-5c5254fa49d1.da4ff203-37ff-426f-a08b-554f056b0b64 1G" returned: 0 in 1.325s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:41:00 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-728c6ada-5ed8-4566-968f-601c27b9ce78 tempest-SnapshotsActionsTest-1887161024 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d34f5b5f-658b-4614-8fc4-5c5254fa49d1.fa0422c1-2dcc-42b5-8af4-58157d6473cd -F qcow2 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-d34f5b5f-658b-4614-8fc4-5c5254fa49d1.da4ff203-37ff-426f-a08b-554f056b0b64 {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:41:00 devstack sudo[97879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d34f5b5f-658b-4614-8fc4-5c5254fa49d1.fa0422c1-2dcc-42b5-8af4-58157d6473cd -F qcow2 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-d34f5b5f-658b-4614-8fc4-5c5254fa49d1.da4ff203-37ff-426f-a08b-554f056b0b64 Jun 17 04:41:00 devstack sudo[97879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:41:00 devstack sudo[97879]: pam_unix(sudo:session): session closed for user root Jun 17 04:41:00 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-728c6ada-5ed8-4566-968f-601c27b9ce78 tempest-SnapshotsActionsTest-1887161024 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d34f5b5f-658b-4614-8fc4-5c5254fa49d1.fa0422c1-2dcc-42b5-8af4-58157d6473cd -F qcow2 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-d34f5b5f-658b-4614-8fc4-5c5254fa49d1.da4ff203-37ff-426f-a08b-554f056b0b64" returned: 0 in 0.855s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:41:00 devstack cinder-volume[92060]: WARNING cinder.volume.drivers.remotefs [None req-728c6ada-5ed8-4566-968f-601c27b9ce78 tempest-SnapshotsActionsTest-1887161024 None] /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-d34f5b5f-658b-4614-8fc4-5c5254fa49d1.da4ff203-37ff-426f-a08b-554f056b0b64 is being set with open permissions: ugo+rw Jun 17 04:41:00 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-728c6ada-5ed8-4566-968f-601c27b9ce78 tempest-SnapshotsActionsTest-1887161024 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-d34f5b5f-658b-4614-8fc4-5c5254fa49d1.da4ff203-37ff-426f-a08b-554f056b0b64 {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:41:01 devstack sudo[97891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-d34f5b5f-658b-4614-8fc4-5c5254fa49d1.da4ff203-37ff-426f-a08b-554f056b0b64 Jun 17 04:41:01 devstack sudo[97891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:41:01 devstack cinder-volume[92060]: DEBUG cinder.volume.flows.manager.create_volume [None req-502005b5-1edc-4c93-8d29-5796696ad0e4 tempest-VolumeQuotasNegativeTestJSON-68954603 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92060) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 17 04:41:01 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-502005b5-1edc-4c93-8d29-5796696ad0e4 tempest-VolumeQuotasNegativeTestJSON-68954603 None] Flow 'volume_create_manager' (4cb147b9-6525-4126-ae5b-a92938b5342a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 17 04:41:01 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-502005b5-1edc-4c93-8d29-5796696ad0e4 tempest-VolumeQuotasNegativeTestJSON-68954603 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8f699f8e-457d-40a1-a386-2cbec99f0e20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:41:01 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-502005b5-1edc-4c93-8d29-5796696ad0e4 tempest-VolumeQuotasNegativeTestJSON-68954603 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8f699f8e-457d-40a1-a386-2cbec99f0e20) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-17T02:41:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-980860066',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=23589460-1579-46f7-ab8d-70f7f897a065,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='59a846098fce462bba73429bfd04bb09',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T02:41:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T02:41:01Z,use_quota=True,user_id='04b7eac10eae471298340f570ffe9e42',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aad9ce24-93f9-41a6-baa1-5125964f96d1),volume_type_id=aad9ce24-93f9-41a6-baa1-5125964f96d1)' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:41:01 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-502005b5-1edc-4c93-8d29-5796696ad0e4 tempest-VolumeQuotasNegativeTestJSON-68954603 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d7ef8eba-35e2-47d4-8b6e-e99c883e6e4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:41:01 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-502005b5-1edc-4c93-8d29-5796696ad0e4 tempest-VolumeQuotasNegativeTestJSON-68954603 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d7ef8eba-35e2-47d4-8b6e-e99c883e6e4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:41:01 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-502005b5-1edc-4c93-8d29-5796696ad0e4 tempest-VolumeQuotasNegativeTestJSON-68954603 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d85e8591-6908-4213-8ec3-5bdaf8a105be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:41:01 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-502005b5-1edc-4c93-8d29-5796696ad0e4 tempest-VolumeQuotasNegativeTestJSON-68954603 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d85e8591-6908-4213-8ec3-5bdaf8a105be) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '23589460-1579-46f7-ab8d-70f7f897a065', 'volume_name': 'volume-23589460-1579-46f7-ab8d-70f7f897a065', 'volume_size': 1}' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:41:01 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-502005b5-1edc-4c93-8d29-5796696ad0e4 tempest-VolumeQuotasNegativeTestJSON-68954603 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a6da9356-2b1d-479e-b684-ee79a3ab1dcb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:41:01 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-502005b5-1edc-4c93-8d29-5796696ad0e4 tempest-VolumeQuotasNegativeTestJSON-68954603 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a6da9356-2b1d-479e-b684-ee79a3ab1dcb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:41:01 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-502005b5-1edc-4c93-8d29-5796696ad0e4 tempest-VolumeQuotasNegativeTestJSON-68954603 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (120728fa-52d1-4ac8-8e1c-b0c6d02d5b48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:41:01 devstack cinder-volume[92060]: INFO cinder.volume.flows.manager.create_volume [None req-502005b5-1edc-4c93-8d29-5796696ad0e4 tempest-VolumeQuotasNegativeTestJSON-68954603 None] Volume 23589460-1579-46f7-ab8d-70f7f897a065: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-23589460-1579-46f7-ab8d-70f7f897a065', 'volume_size': 1} Jun 17 04:41:01 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-502005b5-1edc-4c93-8d29-5796696ad0e4 tempest-VolumeQuotasNegativeTestJSON-68954603 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 04:41:01 devstack sudo[97891]: pam_unix(sudo:session): session closed for user root Jun 17 04:41:01 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-728c6ada-5ed8-4566-968f-601c27b9ce78 tempest-SnapshotsActionsTest-1887161024 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-d34f5b5f-658b-4614-8fc4-5c5254fa49d1.da4ff203-37ff-426f-a08b-554f056b0b64" returned: 0 in 0.785s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:41:01 devstack cinder-volume[92060]: DEBUG dbcounter [-] [92060] Writing DB stats cinder:SELECT=65,cinder:UPDATE=64,cinder:INSERT=16,cinder:DELETE=3 {{(pid=92060) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 17 04:41:01 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-728c6ada-5ed8-4566-968f-601c27b9ce78 tempest-SnapshotsActionsTest-1887161024 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.223s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 04:41:01 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-502005b5-1edc-4c93-8d29-5796696ad0e4 tempest-VolumeQuotasNegativeTestJSON-68954603 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.511s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 04:41:01 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-502005b5-1edc-4c93-8d29-5796696ad0e4 tempest-VolumeQuotasNegativeTestJSON-68954603 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-17T02:41:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-980860066',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=23589460-1579-46f7-ab8d-70f7f897a065,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='59a846098fce462bba73429bfd04bb09',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T02:41:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T02:41:01Z,use_quota=True,user_id='04b7eac10eae471298340f570ffe9e42',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aad9ce24-93f9-41a6-baa1-5125964f96d1),volume_type_id=aad9ce24-93f9-41a6-baa1-5125964f96d1)}" {{(pid=92060) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 17 04:41:01 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.remotefs [None req-502005b5-1edc-4c93-8d29-5796696ad0e4 tempest-VolumeQuotasNegativeTestJSON-68954603 None] Creating volume 23589460-1579-46f7-ab8d-70f7f897a065 {{(pid=92060) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 17 04:41:01 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-502005b5-1edc-4c93-8d29-5796696ad0e4 tempest-VolumeQuotasNegativeTestJSON-68954603 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 04:41:01 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-502005b5-1edc-4c93-8d29-5796696ad0e4 tempest-VolumeQuotasNegativeTestJSON-68954603 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 04:41:01 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-502005b5-1edc-4c93-8d29-5796696ad0e4 tempest-VolumeQuotasNegativeTestJSON-68954603 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588': None} {{(pid=92060) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 17 04:41:01 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-502005b5-1edc-4c93-8d29-5796696ad0e4 tempest-VolumeQuotasNegativeTestJSON-68954603 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588'] {{(pid=92060) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 17 04:41:01 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-502005b5-1edc-4c93-8d29-5796696ad0e4 tempest-VolumeQuotasNegativeTestJSON-68954603 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 04:41:01 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-502005b5-1edc-4c93-8d29-5796696ad0e4 tempest-VolumeQuotasNegativeTestJSON-68954603 None] Selected osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588 as target Quobyte volume. {{(pid=92060) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 17 04:41:01 devstack cinder-volume[92060]: INFO cinder.volume.drivers.remotefs [None req-502005b5-1edc-4c93-8d29-5796696ad0e4 tempest-VolumeQuotasNegativeTestJSON-68954603 None] casted to osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588 Jun 17 04:41:01 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-502005b5-1edc-4c93-8d29-5796696ad0e4 tempest-VolumeQuotasNegativeTestJSON-68954603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-23589460-1579-46f7-ab8d-70f7f897a065 1073741824 {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:41:01 devstack sudo[97896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-23589460-1579-46f7-ab8d-70f7f897a065 1073741824 Jun 17 04:41:01 devstack sudo[97896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:41:01 devstack cinder-volume[92060]: INFO cinder.volume.manager [None req-728c6ada-5ed8-4566-968f-601c27b9ce78 tempest-SnapshotsActionsTest-1887161024 None] Create snapshot completed successfully Jun 17 04:41:03 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-aaab26e3-9fc2-4d28-a864-b5f96096b7c4 tempest-SnapshotsActionsTest-1582591615 None] Acquiring lock "cinder-da4ff203-37ff-426f-a08b-554f056b0b64-delete_snapshot" by "delete_snapshot" {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 04:41:03 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-aaab26e3-9fc2-4d28-a864-b5f96096b7c4 tempest-SnapshotsActionsTest-1582591615 None] Lock "cinder-da4ff203-37ff-426f-a08b-554f056b0b64-delete_snapshot" acquired by "delete_snapshot" :: waited 0.063s {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 04:41:03 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-aaab26e3-9fc2-4d28-a864-b5f96096b7c4 tempest-SnapshotsActionsTest-1582591615 None] Acquiring lock "cinder-quobyte-d34f5b5f-658b-4614-8fc4-5c5254fa49d1" by "delete_snapshot" {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 04:41:03 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-aaab26e3-9fc2-4d28-a864-b5f96096b7c4 tempest-SnapshotsActionsTest-1582591615 None] Lock "cinder-quobyte-d34f5b5f-658b-4614-8fc4-5c5254fa49d1" acquired by "delete_snapshot" :: waited 0.062s {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 04:41:03 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-aaab26e3-9fc2-4d28-a864-b5f96096b7c4 tempest-SnapshotsActionsTest-1582591615 None] Acquiring lock "cinder-quobyte-da4ff203-37ff-426f-a08b-554f056b0b64" by "_delete_snapshot" {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 04:41:03 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-aaab26e3-9fc2-4d28-a864-b5f96096b7c4 tempest-SnapshotsActionsTest-1582591615 None] Lock "cinder-quobyte-da4ff203-37ff-426f-a08b-554f056b0b64" acquired by "_delete_snapshot" :: waited 0.060s {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 04:41:03 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.remotefs [None req-aaab26e3-9fc2-4d28-a864-b5f96096b7c4 tempest-SnapshotsActionsTest-1582591615 None] Deleting offline snapshot da4ff203-37ff-426f-a08b-554f056b0b64 of volume d34f5b5f-658b-4614-8fc4-5c5254fa49d1 {{(pid=92060) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 17 04:41:03 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.remotefs [None req-aaab26e3-9fc2-4d28-a864-b5f96096b7c4 tempest-SnapshotsActionsTest-1582591615 None] snapshot_file for this snap is: volume-d34f5b5f-658b-4614-8fc4-5c5254fa49d1.da4ff203-37ff-426f-a08b-554f056b0b64 {{(pid=92060) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 17 04:41:03 devstack cinder-volume[92060]: DEBUG oslo.privsep.daemon [-] privsep: reply[62ddc0ef-8353-486b-af5f-c56d03f26986]: (4, 'qcow2') {{(pid=93130) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 04:41:03 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-aaab26e3-9fc2-4d28-a864-b5f96096b7c4 tempest-SnapshotsActionsTest-1582591615 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-d34f5b5f-658b-4614-8fc4-5c5254fa49d1.da4ff203-37ff-426f-a08b-554f056b0b64 {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:41:03 devstack sudo[97964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-d34f5b5f-658b-4614-8fc4-5c5254fa49d1.da4ff203-37ff-426f-a08b-554f056b0b64 Jun 17 04:41:03 devstack sudo[97964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:41:03 devstack sudo[97896]: pam_unix(sudo:session): session closed for user root Jun 17 04:41:03 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-502005b5-1edc-4c93-8d29-5796696ad0e4 tempest-VolumeQuotasNegativeTestJSON-68954603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-23589460-1579-46f7-ab8d-70f7f897a065 1073741824" returned: 0 in 2.072s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:41:04 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-502005b5-1edc-4c93-8d29-5796696ad0e4 tempest-VolumeQuotasNegativeTestJSON-68954603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-23589460-1579-46f7-ab8d-70f7f897a065 {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:41:04 devstack sudo[97968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-23589460-1579-46f7-ab8d-70f7f897a065 Jun 17 04:41:04 devstack sudo[97968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:41:05 devstack sudo[97964]: pam_unix(sudo:session): session closed for user root Jun 17 04:41:05 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-aaab26e3-9fc2-4d28-a864-b5f96096b7c4 tempest-SnapshotsActionsTest-1582591615 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-d34f5b5f-658b-4614-8fc4-5c5254fa49d1.da4ff203-37ff-426f-a08b-554f056b0b64" returned: 0 in 1.470s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:41:05 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.remotefs [None req-aaab26e3-9fc2-4d28-a864-b5f96096b7c4 tempest-SnapshotsActionsTest-1582591615 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d34f5b5f-658b-4614-8fc4-5c5254fa49d1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=92060) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 17 04:41:05 devstack cinder-volume[92060]: DEBUG oslo.privsep.daemon [-] privsep: reply[9197f247-1b1d-4411-a2a5-e2cadc94672d]: (4, 'qcow2') {{(pid=93130) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 04:41:05 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-aaab26e3-9fc2-4d28-a864-b5f96096b7c4 tempest-SnapshotsActionsTest-1582591615 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-d34f5b5f-658b-4614-8fc4-5c5254fa49d1.fa0422c1-2dcc-42b5-8af4-58157d6473cd {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:41:05 devstack sudo[97968]: pam_unix(sudo:session): session closed for user root Jun 17 04:41:05 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-502005b5-1edc-4c93-8d29-5796696ad0e4 tempest-VolumeQuotasNegativeTestJSON-68954603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-23589460-1579-46f7-ab8d-70f7f897a065" returned: 0 in 1.063s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:41:05 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-502005b5-1edc-4c93-8d29-5796696ad0e4 tempest-VolumeQuotasNegativeTestJSON-68954603 None] <== create_volume: return (3273ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588'} {{(pid=92060) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 17 04:41:05 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-502005b5-1edc-4c93-8d29-5796696ad0e4 tempest-VolumeQuotasNegativeTestJSON-68954603 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.277s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 04:41:05 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-502005b5-1edc-4c93-8d29-5796696ad0e4 tempest-VolumeQuotasNegativeTestJSON-68954603 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (120728fa-52d1-4ac8-8e1c-b0c6d02d5b48) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-23589460-1579-46f7-ab8d-70f7f897a065', 'volume_size': 1}' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:41:05 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-502005b5-1edc-4c93-8d29-5796696ad0e4 tempest-VolumeQuotasNegativeTestJSON-68954603 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cd9916b4-f8e9-44b2-9ab0-99c74955e22d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:41:05 devstack cinder-volume[92060]: INFO cinder.volume.flows.manager.create_volume [None req-502005b5-1edc-4c93-8d29-5796696ad0e4 tempest-VolumeQuotasNegativeTestJSON-68954603 None] Volume volume-23589460-1579-46f7-ab8d-70f7f897a065 (23589460-1579-46f7-ab8d-70f7f897a065): created successfully Jun 17 04:41:05 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-502005b5-1edc-4c93-8d29-5796696ad0e4 tempest-VolumeQuotasNegativeTestJSON-68954603 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cd9916b4-f8e9-44b2-9ab0-99c74955e22d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:41:05 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-502005b5-1edc-4c93-8d29-5796696ad0e4 tempest-VolumeQuotasNegativeTestJSON-68954603 None] Flow 'volume_create_manager' (4cb147b9-6525-4126-ae5b-a92938b5342a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92060) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 17 04:41:05 devstack cinder-volume[92060]: INFO cinder.volume.manager [None req-502005b5-1edc-4c93-8d29-5796696ad0e4 tempest-VolumeQuotasNegativeTestJSON-68954603 None] Created volume successfully. Jun 17 04:41:05 devstack sudo[97974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-d34f5b5f-658b-4614-8fc4-5c5254fa49d1.fa0422c1-2dcc-42b5-8af4-58157d6473cd Jun 17 04:41:05 devstack sudo[97974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:41:05 devstack sudo[97974]: pam_unix(sudo:session): session closed for user root Jun 17 04:41:06 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-aaab26e3-9fc2-4d28-a864-b5f96096b7c4 tempest-SnapshotsActionsTest-1582591615 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-d34f5b5f-658b-4614-8fc4-5c5254fa49d1.fa0422c1-2dcc-42b5-8af4-58157d6473cd" returned: 0 in 0.939s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:41:06 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.remotefs [None req-aaab26e3-9fc2-4d28-a864-b5f96096b7c4 tempest-SnapshotsActionsTest-1582591615 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d34f5b5f-658b-4614-8fc4-5c5254fa49d1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=92060) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 17 04:41:06 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-aaab26e3-9fc2-4d28-a864-b5f96096b7c4 tempest-SnapshotsActionsTest-1582591615 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-d34f5b5f-658b-4614-8fc4-5c5254fa49d1.da4ff203-37ff-426f-a08b-554f056b0b64 {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:41:06 devstack sudo[97980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-d34f5b5f-658b-4614-8fc4-5c5254fa49d1.da4ff203-37ff-426f-a08b-554f056b0b64 Jun 17 04:41:06 devstack sudo[97980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:41:06 devstack sudo[97980]: pam_unix(sudo:session): session closed for user root Jun 17 04:41:06 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-aaab26e3-9fc2-4d28-a864-b5f96096b7c4 tempest-SnapshotsActionsTest-1582591615 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-d34f5b5f-658b-4614-8fc4-5c5254fa49d1.da4ff203-37ff-426f-a08b-554f056b0b64" returned: 0 in 0.843s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:41:06 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-aaab26e3-9fc2-4d28-a864-b5f96096b7c4 tempest-SnapshotsActionsTest-1582591615 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-d34f5b5f-658b-4614-8fc4-5c5254fa49d1.da4ff203-37ff-426f-a08b-554f056b0b64 {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:41:06 devstack sudo[97985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-d34f5b5f-658b-4614-8fc4-5c5254fa49d1.da4ff203-37ff-426f-a08b-554f056b0b64 Jun 17 04:41:06 devstack sudo[97985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:41:07 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-ef4c3870-43ec-42f9-9705-49a4692180ef tempest-VolumeQuotasNegativeTestJSON-68954603 None] Acquiring lock "cinder-23589460-1579-46f7-ab8d-70f7f897a065-delete_volume" by "delete_volume" {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 04:41:07 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-ef4c3870-43ec-42f9-9705-49a4692180ef tempest-VolumeQuotasNegativeTestJSON-68954603 None] Lock "cinder-23589460-1579-46f7-ab8d-70f7f897a065-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 04:41:07 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-ef4c3870-43ec-42f9-9705-49a4692180ef tempest-VolumeQuotasNegativeTestJSON-68954603 None] Acquiring lock "cinder-quobyte-23589460-1579-46f7-ab8d-70f7f897a065" by "delete_volume" {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 04:41:07 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-ef4c3870-43ec-42f9-9705-49a4692180ef tempest-VolumeQuotasNegativeTestJSON-68954603 None] Lock "cinder-quobyte-23589460-1579-46f7-ab8d-70f7f897a065" acquired by "delete_volume" :: waited 0.035s {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 04:41:07 devstack cinder-volume[92060]: DEBUG oslo.privsep.daemon [-] privsep: reply[c027e878-6cf3-4e63-87da-33e68a1cbe2a]: (4, 'qcow2') {{(pid=93130) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 04:41:07 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-ef4c3870-43ec-42f9-9705-49a4692180ef tempest-VolumeQuotasNegativeTestJSON-68954603 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-23589460-1579-46f7-ab8d-70f7f897a065 {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:41:07 devstack sudo[97991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-23589460-1579-46f7-ab8d-70f7f897a065 Jun 17 04:41:07 devstack sudo[97991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:41:07 devstack sudo[97985]: pam_unix(sudo:session): session closed for user root Jun 17 04:41:07 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-aaab26e3-9fc2-4d28-a864-b5f96096b7c4 tempest-SnapshotsActionsTest-1582591615 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-d34f5b5f-658b-4614-8fc4-5c5254fa49d1.da4ff203-37ff-426f-a08b-554f056b0b64" returned: 0 in 0.926s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:41:07 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-aaab26e3-9fc2-4d28-a864-b5f96096b7c4 tempest-SnapshotsActionsTest-1582591615 None] Lock "cinder-quobyte-da4ff203-37ff-426f-a08b-554f056b0b64" released by "_delete_snapshot" :: held 4.344s {{(pid=92060) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 04:41:07 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-aaab26e3-9fc2-4d28-a864-b5f96096b7c4 tempest-SnapshotsActionsTest-1582591615 None] Lock "cinder-quobyte-d34f5b5f-658b-4614-8fc4-5c5254fa49d1" released by "delete_snapshot" :: held 4.416s {{(pid=92060) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 04:41:07 devstack cinder-volume[92060]: DEBUG cinder.quota [None req-aaab26e3-9fc2-4d28-a864-b5f96096b7c4 tempest-SnapshotsActionsTest-1582591615 None] Created reservations ['bfd5e2f5-8ecb-45e9-bc20-62d86667d50b', 'd42421a2-c325-43a6-a2d5-5cefbd3eb064', '2bef98d5-717c-47a0-a441-f6e854a51829', 'cb9bbda9-330b-4977-8fb9-3d9ab9481e75'] {{(pid=92060) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 17 04:41:07 devstack cinder-volume[92060]: INFO cinder.volume.manager [None req-aaab26e3-9fc2-4d28-a864-b5f96096b7c4 tempest-SnapshotsActionsTest-1582591615 None] Delete snapshot completed successfully. Jun 17 04:41:07 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-aaab26e3-9fc2-4d28-a864-b5f96096b7c4 tempest-SnapshotsActionsTest-1582591615 None] Lock "cinder-da4ff203-37ff-426f-a08b-554f056b0b64-delete_snapshot" released by "delete_snapshot" :: held 4.648s {{(pid=92060) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 04:41:08 devstack sudo[97991]: pam_unix(sudo:session): session closed for user root Jun 17 04:41:08 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-ef4c3870-43ec-42f9-9705-49a4692180ef tempest-VolumeQuotasNegativeTestJSON-68954603 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-23589460-1579-46f7-ab8d-70f7f897a065" returned: 0 in 0.883s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:41:08 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-ef4c3870-43ec-42f9-9705-49a4692180ef tempest-VolumeQuotasNegativeTestJSON-68954603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-23589460-1579-46f7-ab8d-70f7f897a065 {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:41:08 devstack sudo[98000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-23589460-1579-46f7-ab8d-70f7f897a065 Jun 17 04:41:08 devstack sudo[98000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:41:08 devstack sudo[98000]: pam_unix(sudo:session): session closed for user root Jun 17 04:41:08 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-ef4c3870-43ec-42f9-9705-49a4692180ef tempest-VolumeQuotasNegativeTestJSON-68954603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-23589460-1579-46f7-ab8d-70f7f897a065" returned: 0 in 0.667s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:41:08 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-ef4c3870-43ec-42f9-9705-49a4692180ef tempest-VolumeQuotasNegativeTestJSON-68954603 None] Lock "cinder-quobyte-23589460-1579-46f7-ab8d-70f7f897a065" released by "delete_volume" :: held 1.611s {{(pid=92060) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 04:41:09 devstack cinder-volume[92060]: DEBUG cinder.quota [None req-ef4c3870-43ec-42f9-9705-49a4692180ef tempest-VolumeQuotasNegativeTestJSON-68954603 None] Created reservations ['3f22ab5a-46db-46a6-9931-09efd6e1b41d', 'fa37bbde-f62c-4a23-b955-18114386e9f1', '98719004-ef7d-4c24-92bc-b826a481847f', 'bad4a4d6-42b9-4eea-a5c2-334c4ded0d18'] {{(pid=92060) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 17 04:41:09 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-ef4c3870-43ec-42f9-9705-49a4692180ef tempest-VolumeQuotasNegativeTestJSON-68954603 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 04:41:09 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-ef4c3870-43ec-42f9-9705-49a4692180ef tempest-VolumeQuotasNegativeTestJSON-68954603 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 04:41:09 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-ef4c3870-43ec-42f9-9705-49a4692180ef tempest-VolumeQuotasNegativeTestJSON-68954603 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588': None} {{(pid=92060) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 17 04:41:09 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-ef4c3870-43ec-42f9-9705-49a4692180ef tempest-VolumeQuotasNegativeTestJSON-68954603 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588'] {{(pid=92060) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 17 04:41:09 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-ef4c3870-43ec-42f9-9705-49a4692180ef tempest-VolumeQuotasNegativeTestJSON-68954603 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 04:41:09 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-ef4c3870-43ec-42f9-9705-49a4692180ef tempest-VolumeQuotasNegativeTestJSON-68954603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:41:09 devstack sudo[98003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a Jun 17 04:41:09 devstack sudo[98003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:41:09 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-d1289f4f-bed3-4aa5-a908-8fb87ad4a31b tempest-SnapshotsActionsTest-1887161024 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 04:41:09 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-d1289f4f-bed3-4aa5-a908-8fb87ad4a31b tempest-SnapshotsActionsTest-1887161024 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 04:41:09 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.remotefs [None req-d1289f4f-bed3-4aa5-a908-8fb87ad4a31b tempest-SnapshotsActionsTest-1887161024 None] Creating offline snapshot f9a9c5a1-8075-4114-9835-39a1f332e56e of volume d34f5b5f-658b-4614-8fc4-5c5254fa49d1 {{(pid=92060) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 17 04:41:09 devstack cinder-volume[92060]: DEBUG oslo.privsep.daemon [-] privsep: reply[4be3325c-782b-4bce-8232-eb47585d0953]: (4, 'qcow2') {{(pid=93130) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 04:41:09 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-d1289f4f-bed3-4aa5-a908-8fb87ad4a31b tempest-SnapshotsActionsTest-1887161024 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-d34f5b5f-658b-4614-8fc4-5c5254fa49d1.fa0422c1-2dcc-42b5-8af4-58157d6473cd {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:41:09 devstack sudo[98005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-d34f5b5f-658b-4614-8fc4-5c5254fa49d1.fa0422c1-2dcc-42b5-8af4-58157d6473cd Jun 17 04:41:09 devstack sudo[98005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:41:09 devstack sudo[98003]: pam_unix(sudo:session): session closed for user root Jun 17 04:41:09 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-ef4c3870-43ec-42f9-9705-49a4692180ef tempest-VolumeQuotasNegativeTestJSON-68954603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a" returned: 0 in 0.833s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:41:09 devstack cinder-volume[92060]: DEBUG cinder.manager [None req-ef4c3870-43ec-42f9-9705-49a4692180ef tempest-VolumeQuotasNegativeTestJSON-68954603 None] Notifying Schedulers of capabilities ... {{(pid=92060) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 17 04:41:09 devstack cinder-volume[92060]: INFO cinder.volume.manager [None req-ef4c3870-43ec-42f9-9705-49a4692180ef tempest-VolumeQuotasNegativeTestJSON-68954603 None] Deleted volume successfully. Jun 17 04:41:10 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-ef4c3870-43ec-42f9-9705-49a4692180ef tempest-VolumeQuotasNegativeTestJSON-68954603 None] Lock "cinder-23589460-1579-46f7-ab8d-70f7f897a065-delete_volume" released by "delete_volume" :: held 2.793s {{(pid=92060) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 04:41:10 devstack sudo[98005]: pam_unix(sudo:session): session closed for user root Jun 17 04:41:10 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-d1289f4f-bed3-4aa5-a908-8fb87ad4a31b tempest-SnapshotsActionsTest-1887161024 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-d34f5b5f-658b-4614-8fc4-5c5254fa49d1.fa0422c1-2dcc-42b5-8af4-58157d6473cd" returned: 0 in 1.185s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:41:10 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.remotefs [None req-d1289f4f-bed3-4aa5-a908-8fb87ad4a31b tempest-SnapshotsActionsTest-1887161024 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d34f5b5f-658b-4614-8fc4-5c5254fa49d1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=92060) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 17 04:41:10 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-d1289f4f-bed3-4aa5-a908-8fb87ad4a31b tempest-SnapshotsActionsTest-1887161024 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-d34f5b5f-658b-4614-8fc4-5c5254fa49d1.fa0422c1-2dcc-42b5-8af4-58157d6473cd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-d34f5b5f-658b-4614-8fc4-5c5254fa49d1.f9a9c5a1-8075-4114-9835-39a1f332e56e 1G {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:41:10 devstack sudo[98012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-d34f5b5f-658b-4614-8fc4-5c5254fa49d1.fa0422c1-2dcc-42b5-8af4-58157d6473cd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-d34f5b5f-658b-4614-8fc4-5c5254fa49d1.f9a9c5a1-8075-4114-9835-39a1f332e56e 1G Jun 17 04:41:10 devstack sudo[98012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:41:11 devstack sudo[98012]: pam_unix(sudo:session): session closed for user root Jun 17 04:41:11 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-d1289f4f-bed3-4aa5-a908-8fb87ad4a31b tempest-SnapshotsActionsTest-1887161024 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-d34f5b5f-658b-4614-8fc4-5c5254fa49d1.fa0422c1-2dcc-42b5-8af4-58157d6473cd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-d34f5b5f-658b-4614-8fc4-5c5254fa49d1.f9a9c5a1-8075-4114-9835-39a1f332e56e 1G" returned: 0 in 0.923s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:41:11 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-d1289f4f-bed3-4aa5-a908-8fb87ad4a31b tempest-SnapshotsActionsTest-1887161024 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d34f5b5f-658b-4614-8fc4-5c5254fa49d1.fa0422c1-2dcc-42b5-8af4-58157d6473cd -F qcow2 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-d34f5b5f-658b-4614-8fc4-5c5254fa49d1.f9a9c5a1-8075-4114-9835-39a1f332e56e {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:41:11 devstack sudo[98040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d34f5b5f-658b-4614-8fc4-5c5254fa49d1.fa0422c1-2dcc-42b5-8af4-58157d6473cd -F qcow2 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-d34f5b5f-658b-4614-8fc4-5c5254fa49d1.f9a9c5a1-8075-4114-9835-39a1f332e56e Jun 17 04:41:11 devstack sudo[98040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:41:12 devstack sudo[98040]: pam_unix(sudo:session): session closed for user root Jun 17 04:41:12 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-d1289f4f-bed3-4aa5-a908-8fb87ad4a31b tempest-SnapshotsActionsTest-1887161024 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d34f5b5f-658b-4614-8fc4-5c5254fa49d1.fa0422c1-2dcc-42b5-8af4-58157d6473cd -F qcow2 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-d34f5b5f-658b-4614-8fc4-5c5254fa49d1.f9a9c5a1-8075-4114-9835-39a1f332e56e" returned: 0 in 0.723s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:41:12 devstack cinder-volume[92060]: WARNING cinder.volume.drivers.remotefs [None req-d1289f4f-bed3-4aa5-a908-8fb87ad4a31b tempest-SnapshotsActionsTest-1887161024 None] /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-d34f5b5f-658b-4614-8fc4-5c5254fa49d1.f9a9c5a1-8075-4114-9835-39a1f332e56e is being set with open permissions: ugo+rw Jun 17 04:41:12 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-d1289f4f-bed3-4aa5-a908-8fb87ad4a31b tempest-SnapshotsActionsTest-1887161024 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-d34f5b5f-658b-4614-8fc4-5c5254fa49d1.f9a9c5a1-8075-4114-9835-39a1f332e56e {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:41:12 devstack sudo[98045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-d34f5b5f-658b-4614-8fc4-5c5254fa49d1.f9a9c5a1-8075-4114-9835-39a1f332e56e Jun 17 04:41:12 devstack sudo[98045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:41:12 devstack sudo[98045]: pam_unix(sudo:session): session closed for user root Jun 17 04:41:12 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-d1289f4f-bed3-4aa5-a908-8fb87ad4a31b tempest-SnapshotsActionsTest-1887161024 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-d34f5b5f-658b-4614-8fc4-5c5254fa49d1.f9a9c5a1-8075-4114-9835-39a1f332e56e" returned: 0 in 0.644s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:41:12 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-d1289f4f-bed3-4aa5-a908-8fb87ad4a31b tempest-SnapshotsActionsTest-1887161024 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.597s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 04:41:12 devstack cinder-volume[92060]: INFO cinder.volume.manager [None req-d1289f4f-bed3-4aa5-a908-8fb87ad4a31b tempest-SnapshotsActionsTest-1887161024 None] Create snapshot completed successfully Jun 17 04:41:13 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-015cae18-3c8c-4fc2-9fb2-78f4ecbd36f5 tempest-SnapshotsActionsTest-1582591615 None] Acquiring lock "cinder-f9a9c5a1-8075-4114-9835-39a1f332e56e-delete_snapshot" by "delete_snapshot" {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 04:41:13 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-015cae18-3c8c-4fc2-9fb2-78f4ecbd36f5 tempest-SnapshotsActionsTest-1582591615 None] Lock "cinder-f9a9c5a1-8075-4114-9835-39a1f332e56e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.030s {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 04:41:13 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-015cae18-3c8c-4fc2-9fb2-78f4ecbd36f5 tempest-SnapshotsActionsTest-1582591615 None] Acquiring lock "cinder-quobyte-d34f5b5f-658b-4614-8fc4-5c5254fa49d1" by "delete_snapshot" {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 04:41:13 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-015cae18-3c8c-4fc2-9fb2-78f4ecbd36f5 tempest-SnapshotsActionsTest-1582591615 None] Lock "cinder-quobyte-d34f5b5f-658b-4614-8fc4-5c5254fa49d1" acquired by "delete_snapshot" :: waited 0.024s {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 04:41:13 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-015cae18-3c8c-4fc2-9fb2-78f4ecbd36f5 tempest-SnapshotsActionsTest-1582591615 None] Acquiring lock "cinder-quobyte-f9a9c5a1-8075-4114-9835-39a1f332e56e" by "_delete_snapshot" {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 04:41:13 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-015cae18-3c8c-4fc2-9fb2-78f4ecbd36f5 tempest-SnapshotsActionsTest-1582591615 None] Lock "cinder-quobyte-f9a9c5a1-8075-4114-9835-39a1f332e56e" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 04:41:13 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.remotefs [None req-015cae18-3c8c-4fc2-9fb2-78f4ecbd36f5 tempest-SnapshotsActionsTest-1582591615 None] Deleting offline snapshot f9a9c5a1-8075-4114-9835-39a1f332e56e of volume d34f5b5f-658b-4614-8fc4-5c5254fa49d1 {{(pid=92060) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 17 04:41:13 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.remotefs [None req-015cae18-3c8c-4fc2-9fb2-78f4ecbd36f5 tempest-SnapshotsActionsTest-1582591615 None] snapshot_file for this snap is: volume-d34f5b5f-658b-4614-8fc4-5c5254fa49d1.f9a9c5a1-8075-4114-9835-39a1f332e56e {{(pid=92060) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 17 04:41:13 devstack cinder-volume[92060]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfa637d0-80cd-4c64-a9bf-f196c7f1dde7]: (4, 'qcow2') {{(pid=93130) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 04:41:13 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-015cae18-3c8c-4fc2-9fb2-78f4ecbd36f5 tempest-SnapshotsActionsTest-1582591615 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-d34f5b5f-658b-4614-8fc4-5c5254fa49d1.f9a9c5a1-8075-4114-9835-39a1f332e56e {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:41:13 devstack sudo[98048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-d34f5b5f-658b-4614-8fc4-5c5254fa49d1.f9a9c5a1-8075-4114-9835-39a1f332e56e Jun 17 04:41:13 devstack sudo[98048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:41:14 devstack sudo[98048]: pam_unix(sudo:session): session closed for user root Jun 17 04:41:14 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-015cae18-3c8c-4fc2-9fb2-78f4ecbd36f5 tempest-SnapshotsActionsTest-1582591615 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-d34f5b5f-658b-4614-8fc4-5c5254fa49d1.f9a9c5a1-8075-4114-9835-39a1f332e56e" returned: 0 in 0.781s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:41:14 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.remotefs [None req-015cae18-3c8c-4fc2-9fb2-78f4ecbd36f5 tempest-SnapshotsActionsTest-1582591615 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d34f5b5f-658b-4614-8fc4-5c5254fa49d1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=92060) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 17 04:41:14 devstack cinder-volume[92060]: DEBUG oslo.privsep.daemon [-] privsep: reply[7480686b-7e74-47bf-8c66-6ae262b85ab6]: (4, 'qcow2') {{(pid=93130) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 04:41:14 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-015cae18-3c8c-4fc2-9fb2-78f4ecbd36f5 tempest-SnapshotsActionsTest-1582591615 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-d34f5b5f-658b-4614-8fc4-5c5254fa49d1.fa0422c1-2dcc-42b5-8af4-58157d6473cd {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:41:14 devstack sudo[98053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-d34f5b5f-658b-4614-8fc4-5c5254fa49d1.fa0422c1-2dcc-42b5-8af4-58157d6473cd Jun 17 04:41:14 devstack sudo[98053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:41:15 devstack cinder-volume[92060]: DEBUG cinder.volume.flows.manager.create_volume [None req-458eb05f-b458-4658-ad63-e3422c94c1e1 tempest-VolumeRetypeWithoutMigrationTest-458826757 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92060) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 17 04:41:15 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-458eb05f-b458-4658-ad63-e3422c94c1e1 tempest-VolumeRetypeWithoutMigrationTest-458826757 None] Flow 'volume_create_manager' (2e6f0235-f1c2-4023-99a4-8383c16c0946) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 17 04:41:15 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-458eb05f-b458-4658-ad63-e3422c94c1e1 tempest-VolumeRetypeWithoutMigrationTest-458826757 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ae513fc9-9e68-4e71-83bd-810738bace93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:41:15 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-458eb05f-b458-4658-ad63-e3422c94c1e1 tempest-VolumeRetypeWithoutMigrationTest-458826757 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ae513fc9-9e68-4e71-83bd-810738bace93) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-17T02:41:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-788647709',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=98ee011b-2492-4490-a699-c6f662e91c5b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f42b121ba6a14c059a71a221f09a1898',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T02:41:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T02:41:15Z,use_quota=True,user_id='4cac6055d4ca4e199715ad01598e768e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb53f2f9-6764-4009-bef1-f290f409e2b0),volume_type_id=bb53f2f9-6764-4009-bef1-f290f409e2b0)' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:41:15 devstack sudo[98053]: pam_unix(sudo:session): session closed for user root Jun 17 04:41:15 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-458eb05f-b458-4658-ad63-e3422c94c1e1 tempest-VolumeRetypeWithoutMigrationTest-458826757 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (29507f56-b92b-4372-b8fd-ac0274cba8e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:41:15 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-458eb05f-b458-4658-ad63-e3422c94c1e1 tempest-VolumeRetypeWithoutMigrationTest-458826757 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (29507f56-b92b-4372-b8fd-ac0274cba8e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:41:15 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-458eb05f-b458-4658-ad63-e3422c94c1e1 tempest-VolumeRetypeWithoutMigrationTest-458826757 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f60a14b7-fe13-4796-b212-74d02b7f22e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:41:15 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-458eb05f-b458-4658-ad63-e3422c94c1e1 tempest-VolumeRetypeWithoutMigrationTest-458826757 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f60a14b7-fe13-4796-b212-74d02b7f22e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '98ee011b-2492-4490-a699-c6f662e91c5b', 'volume_name': 'volume-98ee011b-2492-4490-a699-c6f662e91c5b', 'volume_size': 1}' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:41:15 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-458eb05f-b458-4658-ad63-e3422c94c1e1 tempest-VolumeRetypeWithoutMigrationTest-458826757 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aa678488-2b75-4bd9-ab29-1b1faa242fd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:41:15 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-458eb05f-b458-4658-ad63-e3422c94c1e1 tempest-VolumeRetypeWithoutMigrationTest-458826757 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aa678488-2b75-4bd9-ab29-1b1faa242fd3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:41:15 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-458eb05f-b458-4658-ad63-e3422c94c1e1 tempest-VolumeRetypeWithoutMigrationTest-458826757 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f0f5cb57-3daf-44c6-9ee5-9af824f19796) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:41:15 devstack cinder-volume[92060]: INFO cinder.volume.flows.manager.create_volume [None req-458eb05f-b458-4658-ad63-e3422c94c1e1 tempest-VolumeRetypeWithoutMigrationTest-458826757 None] Volume 98ee011b-2492-4490-a699-c6f662e91c5b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-98ee011b-2492-4490-a699-c6f662e91c5b', 'volume_size': 1} Jun 17 04:41:15 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-458eb05f-b458-4658-ad63-e3422c94c1e1 tempest-VolumeRetypeWithoutMigrationTest-458826757 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 04:41:15 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-458eb05f-b458-4658-ad63-e3422c94c1e1 tempest-VolumeRetypeWithoutMigrationTest-458826757 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 04:41:15 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-458eb05f-b458-4658-ad63-e3422c94c1e1 tempest-VolumeRetypeWithoutMigrationTest-458826757 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-17T02:41:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-788647709',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=98ee011b-2492-4490-a699-c6f662e91c5b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f42b121ba6a14c059a71a221f09a1898',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T02:41:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T02:41:15Z,use_quota=True,user_id='4cac6055d4ca4e199715ad01598e768e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb53f2f9-6764-4009-bef1-f290f409e2b0),volume_type_id=bb53f2f9-6764-4009-bef1-f290f409e2b0)}" {{(pid=92060) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 17 04:41:15 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.remotefs [None req-458eb05f-b458-4658-ad63-e3422c94c1e1 tempest-VolumeRetypeWithoutMigrationTest-458826757 None] Creating volume 98ee011b-2492-4490-a699-c6f662e91c5b {{(pid=92060) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 17 04:41:15 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-458eb05f-b458-4658-ad63-e3422c94c1e1 tempest-VolumeRetypeWithoutMigrationTest-458826757 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 04:41:15 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-458eb05f-b458-4658-ad63-e3422c94c1e1 tempest-VolumeRetypeWithoutMigrationTest-458826757 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 04:41:15 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-458eb05f-b458-4658-ad63-e3422c94c1e1 tempest-VolumeRetypeWithoutMigrationTest-458826757 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588': None} {{(pid=92060) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 17 04:41:15 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-458eb05f-b458-4658-ad63-e3422c94c1e1 tempest-VolumeRetypeWithoutMigrationTest-458826757 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588'] {{(pid=92060) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 17 04:41:15 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-458eb05f-b458-4658-ad63-e3422c94c1e1 tempest-VolumeRetypeWithoutMigrationTest-458826757 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 04:41:15 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-458eb05f-b458-4658-ad63-e3422c94c1e1 tempest-VolumeRetypeWithoutMigrationTest-458826757 None] Selected osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588 as target Quobyte volume. {{(pid=92060) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 17 04:41:15 devstack cinder-volume[92060]: INFO cinder.volume.drivers.remotefs [None req-458eb05f-b458-4658-ad63-e3422c94c1e1 tempest-VolumeRetypeWithoutMigrationTest-458826757 None] casted to osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588 Jun 17 04:41:15 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-458eb05f-b458-4658-ad63-e3422c94c1e1 tempest-VolumeRetypeWithoutMigrationTest-458826757 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-98ee011b-2492-4490-a699-c6f662e91c5b 1073741824 {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:41:15 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-015cae18-3c8c-4fc2-9fb2-78f4ecbd36f5 tempest-SnapshotsActionsTest-1582591615 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-d34f5b5f-658b-4614-8fc4-5c5254fa49d1.fa0422c1-2dcc-42b5-8af4-58157d6473cd" returned: 0 in 0.880s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:41:15 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.remotefs [None req-015cae18-3c8c-4fc2-9fb2-78f4ecbd36f5 tempest-SnapshotsActionsTest-1582591615 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d34f5b5f-658b-4614-8fc4-5c5254fa49d1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=92060) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 17 04:41:15 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-015cae18-3c8c-4fc2-9fb2-78f4ecbd36f5 tempest-SnapshotsActionsTest-1582591615 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-d34f5b5f-658b-4614-8fc4-5c5254fa49d1.f9a9c5a1-8075-4114-9835-39a1f332e56e {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:41:15 devstack sudo[98058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-98ee011b-2492-4490-a699-c6f662e91c5b 1073741824 Jun 17 04:41:15 devstack sudo[98058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:41:15 devstack sudo[98059]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-d34f5b5f-658b-4614-8fc4-5c5254fa49d1.f9a9c5a1-8075-4114-9835-39a1f332e56e Jun 17 04:41:15 devstack sudo[98059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:41:16 devstack sudo[98058]: pam_unix(sudo:session): session closed for user root Jun 17 04:41:16 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-458eb05f-b458-4658-ad63-e3422c94c1e1 tempest-VolumeRetypeWithoutMigrationTest-458826757 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-98ee011b-2492-4490-a699-c6f662e91c5b 1073741824" returned: 0 in 0.893s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:41:16 devstack sudo[98059]: pam_unix(sudo:session): session closed for user root Jun 17 04:41:16 devstack cinder-volume[92060]: DEBUG dbcounter [-] [92060] Writing DB stats cinder:UPDATE=79,cinder:SELECT=72,cinder:DELETE=5,cinder:INSERT=18 {{(pid=92060) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 17 04:41:16 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-015cae18-3c8c-4fc2-9fb2-78f4ecbd36f5 tempest-SnapshotsActionsTest-1582591615 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-d34f5b5f-658b-4614-8fc4-5c5254fa49d1.f9a9c5a1-8075-4114-9835-39a1f332e56e" returned: 0 in 0.914s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:41:16 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-015cae18-3c8c-4fc2-9fb2-78f4ecbd36f5 tempest-SnapshotsActionsTest-1582591615 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-d34f5b5f-658b-4614-8fc4-5c5254fa49d1.f9a9c5a1-8075-4114-9835-39a1f332e56e {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:41:16 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-458eb05f-b458-4658-ad63-e3422c94c1e1 tempest-VolumeRetypeWithoutMigrationTest-458826757 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-98ee011b-2492-4490-a699-c6f662e91c5b {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:41:16 devstack sudo[98105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-d34f5b5f-658b-4614-8fc4-5c5254fa49d1.f9a9c5a1-8075-4114-9835-39a1f332e56e Jun 17 04:41:16 devstack sudo[98105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:41:16 devstack sudo[98107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-98ee011b-2492-4490-a699-c6f662e91c5b Jun 17 04:41:16 devstack sudo[98107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:41:16 devstack sudo[98105]: pam_unix(sudo:session): session closed for user root Jun 17 04:41:16 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-015cae18-3c8c-4fc2-9fb2-78f4ecbd36f5 tempest-SnapshotsActionsTest-1582591615 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-d34f5b5f-658b-4614-8fc4-5c5254fa49d1.f9a9c5a1-8075-4114-9835-39a1f332e56e" returned: 0 in 0.695s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:41:17 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-015cae18-3c8c-4fc2-9fb2-78f4ecbd36f5 tempest-SnapshotsActionsTest-1582591615 None] Lock "cinder-quobyte-f9a9c5a1-8075-4114-9835-39a1f332e56e" released by "_delete_snapshot" :: held 3.394s {{(pid=92060) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 04:41:17 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-015cae18-3c8c-4fc2-9fb2-78f4ecbd36f5 tempest-SnapshotsActionsTest-1582591615 None] Lock "cinder-quobyte-d34f5b5f-658b-4614-8fc4-5c5254fa49d1" released by "delete_snapshot" :: held 3.425s {{(pid=92060) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 04:41:17 devstack sudo[98107]: pam_unix(sudo:session): session closed for user root Jun 17 04:41:17 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-458eb05f-b458-4658-ad63-e3422c94c1e1 tempest-VolumeRetypeWithoutMigrationTest-458826757 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-98ee011b-2492-4490-a699-c6f662e91c5b" returned: 0 in 0.767s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:41:17 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-458eb05f-b458-4658-ad63-e3422c94c1e1 tempest-VolumeRetypeWithoutMigrationTest-458826757 None] <== create_volume: return (1753ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588'} {{(pid=92060) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 17 04:41:17 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-458eb05f-b458-4658-ad63-e3422c94c1e1 tempest-VolumeRetypeWithoutMigrationTest-458826757 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.758s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 04:41:17 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-458eb05f-b458-4658-ad63-e3422c94c1e1 tempest-VolumeRetypeWithoutMigrationTest-458826757 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f0f5cb57-3daf-44c6-9ee5-9af824f19796) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-98ee011b-2492-4490-a699-c6f662e91c5b', 'volume_size': 1}' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:41:17 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-458eb05f-b458-4658-ad63-e3422c94c1e1 tempest-VolumeRetypeWithoutMigrationTest-458826757 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e13864fe-2fd5-4f87-a971-609f038ccbdb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:41:17 devstack cinder-volume[92060]: INFO cinder.volume.flows.manager.create_volume [None req-458eb05f-b458-4658-ad63-e3422c94c1e1 tempest-VolumeRetypeWithoutMigrationTest-458826757 None] Volume volume-98ee011b-2492-4490-a699-c6f662e91c5b (98ee011b-2492-4490-a699-c6f662e91c5b): created successfully Jun 17 04:41:17 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-458eb05f-b458-4658-ad63-e3422c94c1e1 tempest-VolumeRetypeWithoutMigrationTest-458826757 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e13864fe-2fd5-4f87-a971-609f038ccbdb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:41:17 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-458eb05f-b458-4658-ad63-e3422c94c1e1 tempest-VolumeRetypeWithoutMigrationTest-458826757 None] Flow 'volume_create_manager' (2e6f0235-f1c2-4023-99a4-8383c16c0946) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92060) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 17 04:41:17 devstack cinder-volume[92060]: DEBUG cinder.quota [None req-015cae18-3c8c-4fc2-9fb2-78f4ecbd36f5 tempest-SnapshotsActionsTest-1582591615 None] Created reservations ['9dda090f-6a83-4ee5-b6d9-023ad738e3ac', '4c65f233-4676-4578-b2b8-d82293590b5a', 'adaa9ea4-3fe6-48bf-a121-d96597674d9f', 'f858c996-421e-4c50-b139-6b5a338dc399'] {{(pid=92060) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 17 04:41:17 devstack cinder-volume[92060]: INFO cinder.volume.manager [None req-458eb05f-b458-4658-ad63-e3422c94c1e1 tempest-VolumeRetypeWithoutMigrationTest-458826757 None] Created volume successfully. Jun 17 04:41:17 devstack cinder-volume[92060]: INFO cinder.volume.manager [None req-015cae18-3c8c-4fc2-9fb2-78f4ecbd36f5 tempest-SnapshotsActionsTest-1582591615 None] Delete snapshot completed successfully. Jun 17 04:41:17 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-015cae18-3c8c-4fc2-9fb2-78f4ecbd36f5 tempest-SnapshotsActionsTest-1582591615 None] Lock "cinder-f9a9c5a1-8075-4114-9835-39a1f332e56e-delete_snapshot" released by "delete_snapshot" :: held 3.677s {{(pid=92060) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 04:41:17 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-07662db7-45c6-4295-a232-7365c56a11f4 tempest-VolumeRetypeWithoutMigrationTest-458826757 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 04:41:17 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-07662db7-45c6-4295-a232-7365c56a11f4 tempest-VolumeRetypeWithoutMigrationTest-458826757 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 04:41:17 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-07662db7-45c6-4295-a232-7365c56a11f4 tempest-VolumeRetypeWithoutMigrationTest-458826757 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588': None} {{(pid=92060) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 17 04:41:17 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-07662db7-45c6-4295-a232-7365c56a11f4 tempest-VolumeRetypeWithoutMigrationTest-458826757 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588'] {{(pid=92060) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 17 04:41:17 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-07662db7-45c6-4295-a232-7365c56a11f4 tempest-VolumeRetypeWithoutMigrationTest-458826757 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 04:41:17 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-07662db7-45c6-4295-a232-7365c56a11f4 tempest-VolumeRetypeWithoutMigrationTest-458826757 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:41:17 devstack sudo[98113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a Jun 17 04:41:17 devstack sudo[98113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:41:18 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-164de030-3e70-4ce3-90f4-7e8b1fa3f177 tempest-SnapshotsActionsTest-1887161024 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 04:41:18 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-164de030-3e70-4ce3-90f4-7e8b1fa3f177 tempest-SnapshotsActionsTest-1887161024 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 04:41:18 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.remotefs [None req-164de030-3e70-4ce3-90f4-7e8b1fa3f177 tempest-SnapshotsActionsTest-1887161024 None] Creating offline snapshot 8c71cd23-e284-4f86-8909-154069066aa9 of volume d34f5b5f-658b-4614-8fc4-5c5254fa49d1 {{(pid=92060) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 17 04:41:18 devstack cinder-volume[92060]: DEBUG oslo.privsep.daemon [-] privsep: reply[40d5c624-b16f-4a17-8566-c80302531f16]: (4, 'qcow2') {{(pid=93130) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 04:41:18 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-164de030-3e70-4ce3-90f4-7e8b1fa3f177 tempest-SnapshotsActionsTest-1887161024 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-d34f5b5f-658b-4614-8fc4-5c5254fa49d1.fa0422c1-2dcc-42b5-8af4-58157d6473cd {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:41:18 devstack sudo[98115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-d34f5b5f-658b-4614-8fc4-5c5254fa49d1.fa0422c1-2dcc-42b5-8af4-58157d6473cd Jun 17 04:41:18 devstack sudo[98115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:41:18 devstack sudo[98113]: pam_unix(sudo:session): session closed for user root Jun 17 04:41:18 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-07662db7-45c6-4295-a232-7365c56a11f4 tempest-VolumeRetypeWithoutMigrationTest-458826757 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a" returned: 0 in 0.681s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:41:18 devstack cinder-volume[92060]: DEBUG cinder.manager [None req-07662db7-45c6-4295-a232-7365c56a11f4 tempest-VolumeRetypeWithoutMigrationTest-458826757 None] Notifying Schedulers of capabilities ... {{(pid=92060) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 17 04:41:18 devstack cinder-volume[92060]: INFO cinder.volume.manager [None req-07662db7-45c6-4295-a232-7365c56a11f4 tempest-VolumeRetypeWithoutMigrationTest-458826757 None] Retype volume completed successfully. Jun 17 04:41:19 devstack sudo[98115]: pam_unix(sudo:session): session closed for user root Jun 17 04:41:19 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-164de030-3e70-4ce3-90f4-7e8b1fa3f177 tempest-SnapshotsActionsTest-1887161024 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-d34f5b5f-658b-4614-8fc4-5c5254fa49d1.fa0422c1-2dcc-42b5-8af4-58157d6473cd" returned: 0 in 0.771s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:41:19 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.remotefs [None req-164de030-3e70-4ce3-90f4-7e8b1fa3f177 tempest-SnapshotsActionsTest-1887161024 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d34f5b5f-658b-4614-8fc4-5c5254fa49d1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=92060) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 17 04:41:19 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-164de030-3e70-4ce3-90f4-7e8b1fa3f177 tempest-SnapshotsActionsTest-1887161024 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-d34f5b5f-658b-4614-8fc4-5c5254fa49d1.fa0422c1-2dcc-42b5-8af4-58157d6473cd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-d34f5b5f-658b-4614-8fc4-5c5254fa49d1.8c71cd23-e284-4f86-8909-154069066aa9 1G {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:41:19 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-e86e0c48-af86-451d-a8e4-2206f8ef6491 tempest-VolumeRetypeWithoutMigrationTest-458826757 None] Acquiring lock "cinder-98ee011b-2492-4490-a699-c6f662e91c5b-delete_volume" by "delete_volume" {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 04:41:19 devstack sudo[98123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-d34f5b5f-658b-4614-8fc4-5c5254fa49d1.fa0422c1-2dcc-42b5-8af4-58157d6473cd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-d34f5b5f-658b-4614-8fc4-5c5254fa49d1.8c71cd23-e284-4f86-8909-154069066aa9 1G Jun 17 04:41:19 devstack sudo[98123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:41:19 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-e86e0c48-af86-451d-a8e4-2206f8ef6491 tempest-VolumeRetypeWithoutMigrationTest-458826757 None] Lock "cinder-98ee011b-2492-4490-a699-c6f662e91c5b-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 04:41:19 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-e86e0c48-af86-451d-a8e4-2206f8ef6491 tempest-VolumeRetypeWithoutMigrationTest-458826757 None] Acquiring lock "cinder-quobyte-98ee011b-2492-4490-a699-c6f662e91c5b" by "delete_volume" {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 04:41:19 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-e86e0c48-af86-451d-a8e4-2206f8ef6491 tempest-VolumeRetypeWithoutMigrationTest-458826757 None] Lock "cinder-quobyte-98ee011b-2492-4490-a699-c6f662e91c5b" acquired by "delete_volume" :: waited 0.013s {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 04:41:19 devstack cinder-volume[92060]: DEBUG oslo.privsep.daemon [-] privsep: reply[6afb2866-01c1-43e1-a41a-aca58471b9fc]: (4, 'qcow2') {{(pid=93130) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 04:41:19 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-e86e0c48-af86-451d-a8e4-2206f8ef6491 tempest-VolumeRetypeWithoutMigrationTest-458826757 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-98ee011b-2492-4490-a699-c6f662e91c5b {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:41:19 devstack sudo[98125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-98ee011b-2492-4490-a699-c6f662e91c5b Jun 17 04:41:19 devstack sudo[98125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:41:19 devstack sudo[98123]: pam_unix(sudo:session): session closed for user root Jun 17 04:41:19 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-164de030-3e70-4ce3-90f4-7e8b1fa3f177 tempest-SnapshotsActionsTest-1887161024 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-d34f5b5f-658b-4614-8fc4-5c5254fa49d1.fa0422c1-2dcc-42b5-8af4-58157d6473cd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-d34f5b5f-658b-4614-8fc4-5c5254fa49d1.8c71cd23-e284-4f86-8909-154069066aa9 1G" returned: 0 in 0.831s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:41:19 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-164de030-3e70-4ce3-90f4-7e8b1fa3f177 tempest-SnapshotsActionsTest-1887161024 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d34f5b5f-658b-4614-8fc4-5c5254fa49d1.fa0422c1-2dcc-42b5-8af4-58157d6473cd -F qcow2 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-d34f5b5f-658b-4614-8fc4-5c5254fa49d1.8c71cd23-e284-4f86-8909-154069066aa9 {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:41:19 devstack sudo[98125]: pam_unix(sudo:session): session closed for user root Jun 17 04:41:19 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-e86e0c48-af86-451d-a8e4-2206f8ef6491 tempest-VolumeRetypeWithoutMigrationTest-458826757 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-98ee011b-2492-4490-a699-c6f662e91c5b" returned: 0 in 0.720s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:41:19 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-e86e0c48-af86-451d-a8e4-2206f8ef6491 tempest-VolumeRetypeWithoutMigrationTest-458826757 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-98ee011b-2492-4490-a699-c6f662e91c5b {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:41:19 devstack sudo[98133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d34f5b5f-658b-4614-8fc4-5c5254fa49d1.fa0422c1-2dcc-42b5-8af4-58157d6473cd -F qcow2 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-d34f5b5f-658b-4614-8fc4-5c5254fa49d1.8c71cd23-e284-4f86-8909-154069066aa9 Jun 17 04:41:19 devstack sudo[98133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:41:19 devstack sudo[98134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-98ee011b-2492-4490-a699-c6f662e91c5b Jun 17 04:41:19 devstack sudo[98134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:41:20 devstack sudo[98134]: pam_unix(sudo:session): session closed for user root Jun 17 04:41:20 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-e86e0c48-af86-451d-a8e4-2206f8ef6491 tempest-VolumeRetypeWithoutMigrationTest-458826757 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-98ee011b-2492-4490-a699-c6f662e91c5b" returned: 0 in 0.609s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:41:20 devstack sudo[98133]: pam_unix(sudo:session): session closed for user root Jun 17 04:41:20 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-e86e0c48-af86-451d-a8e4-2206f8ef6491 tempest-VolumeRetypeWithoutMigrationTest-458826757 None] Lock "cinder-quobyte-98ee011b-2492-4490-a699-c6f662e91c5b" released by "delete_volume" :: held 1.382s {{(pid=92060) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 04:41:20 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-164de030-3e70-4ce3-90f4-7e8b1fa3f177 tempest-SnapshotsActionsTest-1887161024 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d34f5b5f-658b-4614-8fc4-5c5254fa49d1.fa0422c1-2dcc-42b5-8af4-58157d6473cd -F qcow2 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-d34f5b5f-658b-4614-8fc4-5c5254fa49d1.8c71cd23-e284-4f86-8909-154069066aa9" returned: 0 in 0.648s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:41:20 devstack cinder-volume[92060]: WARNING cinder.volume.drivers.remotefs [None req-164de030-3e70-4ce3-90f4-7e8b1fa3f177 tempest-SnapshotsActionsTest-1887161024 None] /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-d34f5b5f-658b-4614-8fc4-5c5254fa49d1.8c71cd23-e284-4f86-8909-154069066aa9 is being set with open permissions: ugo+rw Jun 17 04:41:20 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-164de030-3e70-4ce3-90f4-7e8b1fa3f177 tempest-SnapshotsActionsTest-1887161024 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-d34f5b5f-658b-4614-8fc4-5c5254fa49d1.8c71cd23-e284-4f86-8909-154069066aa9 {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:41:20 devstack sudo[98142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-d34f5b5f-658b-4614-8fc4-5c5254fa49d1.8c71cd23-e284-4f86-8909-154069066aa9 Jun 17 04:41:20 devstack sudo[98142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:41:20 devstack cinder-volume[92060]: WARNING cinder.quota [None req-e86e0c48-af86-451d-a8e4-2206f8ef6491 tempest-VolumeRetypeWithoutMigrationTest-458826757 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Jun 17 04:41:20 devstack cinder-volume[92060]: WARNING cinder.quota [None req-e86e0c48-af86-451d-a8e4-2206f8ef6491 tempest-VolumeRetypeWithoutMigrationTest-458826757 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Jun 17 04:41:20 devstack cinder-volume[92060]: DEBUG cinder.quota [None req-e86e0c48-af86-451d-a8e4-2206f8ef6491 tempest-VolumeRetypeWithoutMigrationTest-458826757 None] Created reservations ['df8951ef-931b-421f-89cc-cf3d50dd39ec', '0e1f1a85-45e9-4e5b-bc30-d39b4643780d', '4b215566-d55f-44bf-a6a1-bb7df0b2ebb1', '72eb4a98-dca0-416e-a9b1-f40c8897d677'] {{(pid=92060) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 17 04:41:20 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-e86e0c48-af86-451d-a8e4-2206f8ef6491 tempest-VolumeRetypeWithoutMigrationTest-458826757 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 04:41:20 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-e86e0c48-af86-451d-a8e4-2206f8ef6491 tempest-VolumeRetypeWithoutMigrationTest-458826757 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 04:41:20 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-e86e0c48-af86-451d-a8e4-2206f8ef6491 tempest-VolumeRetypeWithoutMigrationTest-458826757 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588': None} {{(pid=92060) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 17 04:41:20 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-e86e0c48-af86-451d-a8e4-2206f8ef6491 tempest-VolumeRetypeWithoutMigrationTest-458826757 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588'] {{(pid=92060) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 17 04:41:20 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-e86e0c48-af86-451d-a8e4-2206f8ef6491 tempest-VolumeRetypeWithoutMigrationTest-458826757 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 04:41:20 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-e86e0c48-af86-451d-a8e4-2206f8ef6491 tempest-VolumeRetypeWithoutMigrationTest-458826757 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:41:20 devstack sudo[98145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a Jun 17 04:41:20 devstack sudo[98145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:41:21 devstack sudo[98142]: pam_unix(sudo:session): session closed for user root Jun 17 04:41:21 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-164de030-3e70-4ce3-90f4-7e8b1fa3f177 tempest-SnapshotsActionsTest-1887161024 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-d34f5b5f-658b-4614-8fc4-5c5254fa49d1.8c71cd23-e284-4f86-8909-154069066aa9" returned: 0 in 0.592s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:41:21 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-164de030-3e70-4ce3-90f4-7e8b1fa3f177 tempest-SnapshotsActionsTest-1887161024 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.934s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 04:41:21 devstack cinder-volume[92060]: INFO cinder.volume.manager [None req-164de030-3e70-4ce3-90f4-7e8b1fa3f177 tempest-SnapshotsActionsTest-1887161024 None] Create snapshot completed successfully Jun 17 04:41:21 devstack sudo[98145]: pam_unix(sudo:session): session closed for user root Jun 17 04:41:21 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-e86e0c48-af86-451d-a8e4-2206f8ef6491 tempest-VolumeRetypeWithoutMigrationTest-458826757 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a" returned: 0 in 0.593s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:41:21 devstack cinder-volume[92060]: DEBUG cinder.manager [None req-e86e0c48-af86-451d-a8e4-2206f8ef6491 tempest-VolumeRetypeWithoutMigrationTest-458826757 None] Notifying Schedulers of capabilities ... {{(pid=92060) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 17 04:41:21 devstack cinder-volume[92060]: INFO cinder.volume.manager [None req-e86e0c48-af86-451d-a8e4-2206f8ef6491 tempest-VolumeRetypeWithoutMigrationTest-458826757 None] Deleted volume successfully. Jun 17 04:41:21 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-e86e0c48-af86-451d-a8e4-2206f8ef6491 tempest-VolumeRetypeWithoutMigrationTest-458826757 None] Lock "cinder-98ee011b-2492-4490-a699-c6f662e91c5b-delete_volume" released by "delete_volume" :: held 2.178s {{(pid=92060) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 04:41:21 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-c05ef946-f824-4fbf-bc59-09da654133ac tempest-SnapshotsActionsTest-1582591615 None] Acquiring lock "cinder-8c71cd23-e284-4f86-8909-154069066aa9-delete_snapshot" by "delete_snapshot" {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 04:41:21 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-c05ef946-f824-4fbf-bc59-09da654133ac tempest-SnapshotsActionsTest-1582591615 None] Lock "cinder-8c71cd23-e284-4f86-8909-154069066aa9-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 04:41:21 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-c05ef946-f824-4fbf-bc59-09da654133ac tempest-SnapshotsActionsTest-1582591615 None] Acquiring lock "cinder-quobyte-d34f5b5f-658b-4614-8fc4-5c5254fa49d1" by "delete_snapshot" {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 04:41:21 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-c05ef946-f824-4fbf-bc59-09da654133ac tempest-SnapshotsActionsTest-1582591615 None] Lock "cinder-quobyte-d34f5b5f-658b-4614-8fc4-5c5254fa49d1" acquired by "delete_snapshot" :: waited 0.015s {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 04:41:21 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-c05ef946-f824-4fbf-bc59-09da654133ac tempest-SnapshotsActionsTest-1582591615 None] Acquiring lock "cinder-quobyte-8c71cd23-e284-4f86-8909-154069066aa9" by "_delete_snapshot" {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 04:41:21 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-c05ef946-f824-4fbf-bc59-09da654133ac tempest-SnapshotsActionsTest-1582591615 None] Lock "cinder-quobyte-8c71cd23-e284-4f86-8909-154069066aa9" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 04:41:21 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.remotefs [None req-c05ef946-f824-4fbf-bc59-09da654133ac tempest-SnapshotsActionsTest-1582591615 None] Deleting offline snapshot 8c71cd23-e284-4f86-8909-154069066aa9 of volume d34f5b5f-658b-4614-8fc4-5c5254fa49d1 {{(pid=92060) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 17 04:41:21 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.remotefs [None req-c05ef946-f824-4fbf-bc59-09da654133ac tempest-SnapshotsActionsTest-1582591615 None] snapshot_file for this snap is: volume-d34f5b5f-658b-4614-8fc4-5c5254fa49d1.8c71cd23-e284-4f86-8909-154069066aa9 {{(pid=92060) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 17 04:41:21 devstack cinder-volume[92060]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fd86468-08f6-4483-82be-e55c1f5da54a]: (4, 'qcow2') {{(pid=93130) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 04:41:21 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-c05ef946-f824-4fbf-bc59-09da654133ac tempest-SnapshotsActionsTest-1582591615 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-d34f5b5f-658b-4614-8fc4-5c5254fa49d1.8c71cd23-e284-4f86-8909-154069066aa9 {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:41:21 devstack sudo[98156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-d34f5b5f-658b-4614-8fc4-5c5254fa49d1.8c71cd23-e284-4f86-8909-154069066aa9 Jun 17 04:41:21 devstack sudo[98156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:41:22 devstack cinder-volume[92060]: DEBUG cinder.volume.flows.manager.create_volume [None req-58856f0c-8f51-43c2-a4ad-54a1d3ffdaa5 tempest-AttachVolumeTestJSON-189381823 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92060) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 17 04:41:22 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-58856f0c-8f51-43c2-a4ad-54a1d3ffdaa5 tempest-AttachVolumeTestJSON-189381823 None] Flow 'volume_create_manager' (7e0fca4a-f5e9-4351-be8c-e0626c467041) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 17 04:41:22 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-58856f0c-8f51-43c2-a4ad-54a1d3ffdaa5 tempest-AttachVolumeTestJSON-189381823 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5907296b-6138-48c5-ba74-059b16ee6ccd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:41:22 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-58856f0c-8f51-43c2-a4ad-54a1d3ffdaa5 tempest-AttachVolumeTestJSON-189381823 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5907296b-6138-48c5-ba74-059b16ee6ccd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-17T02:41:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1991394829',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1409e9c5-943a-4086-b281-042471eeb293,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9cb0f3e8aabc47e582b3e9924538b792',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T02:41:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T02:41:22Z,use_quota=True,user_id='f25a55d2802e4cf4b442a23df3eb34cc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aad9ce24-93f9-41a6-baa1-5125964f96d1),volume_type_id=aad9ce24-93f9-41a6-baa1-5125964f96d1)' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:41:22 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-58856f0c-8f51-43c2-a4ad-54a1d3ffdaa5 tempest-AttachVolumeTestJSON-189381823 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6de3459c-39e9-4568-b728-b83af9292900) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:41:22 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-58856f0c-8f51-43c2-a4ad-54a1d3ffdaa5 tempest-AttachVolumeTestJSON-189381823 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6de3459c-39e9-4568-b728-b83af9292900) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:41:22 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-58856f0c-8f51-43c2-a4ad-54a1d3ffdaa5 tempest-AttachVolumeTestJSON-189381823 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1356c187-e7c9-48a5-8334-291bd66b2507) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:41:22 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-58856f0c-8f51-43c2-a4ad-54a1d3ffdaa5 tempest-AttachVolumeTestJSON-189381823 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1356c187-e7c9-48a5-8334-291bd66b2507) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1409e9c5-943a-4086-b281-042471eeb293', 'volume_name': 'volume-1409e9c5-943a-4086-b281-042471eeb293', 'volume_size': 1}' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:41:22 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-58856f0c-8f51-43c2-a4ad-54a1d3ffdaa5 tempest-AttachVolumeTestJSON-189381823 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b700e110-9cfc-4433-803e-dca9227d91b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:41:22 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-58856f0c-8f51-43c2-a4ad-54a1d3ffdaa5 tempest-AttachVolumeTestJSON-189381823 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b700e110-9cfc-4433-803e-dca9227d91b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:41:22 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-58856f0c-8f51-43c2-a4ad-54a1d3ffdaa5 tempest-AttachVolumeTestJSON-189381823 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (482b8b04-5093-43af-98bc-6e4f2274cdf2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:41:22 devstack cinder-volume[92060]: INFO cinder.volume.flows.manager.create_volume [None req-58856f0c-8f51-43c2-a4ad-54a1d3ffdaa5 tempest-AttachVolumeTestJSON-189381823 None] Volume 1409e9c5-943a-4086-b281-042471eeb293: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1409e9c5-943a-4086-b281-042471eeb293', 'volume_size': 1} Jun 17 04:41:22 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-58856f0c-8f51-43c2-a4ad-54a1d3ffdaa5 tempest-AttachVolumeTestJSON-189381823 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 04:41:22 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-58856f0c-8f51-43c2-a4ad-54a1d3ffdaa5 tempest-AttachVolumeTestJSON-189381823 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 04:41:22 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-58856f0c-8f51-43c2-a4ad-54a1d3ffdaa5 tempest-AttachVolumeTestJSON-189381823 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-17T02:41:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1991394829',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1409e9c5-943a-4086-b281-042471eeb293,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9cb0f3e8aabc47e582b3e9924538b792',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T02:41:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T02:41:22Z,use_quota=True,user_id='f25a55d2802e4cf4b442a23df3eb34cc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aad9ce24-93f9-41a6-baa1-5125964f96d1),volume_type_id=aad9ce24-93f9-41a6-baa1-5125964f96d1)}" {{(pid=92060) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 17 04:41:22 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.remotefs [None req-58856f0c-8f51-43c2-a4ad-54a1d3ffdaa5 tempest-AttachVolumeTestJSON-189381823 None] Creating volume 1409e9c5-943a-4086-b281-042471eeb293 {{(pid=92060) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 17 04:41:22 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-58856f0c-8f51-43c2-a4ad-54a1d3ffdaa5 tempest-AttachVolumeTestJSON-189381823 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 04:41:22 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-58856f0c-8f51-43c2-a4ad-54a1d3ffdaa5 tempest-AttachVolumeTestJSON-189381823 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 04:41:22 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-58856f0c-8f51-43c2-a4ad-54a1d3ffdaa5 tempest-AttachVolumeTestJSON-189381823 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588': None} {{(pid=92060) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 17 04:41:22 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-58856f0c-8f51-43c2-a4ad-54a1d3ffdaa5 tempest-AttachVolumeTestJSON-189381823 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588'] {{(pid=92060) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 17 04:41:22 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-58856f0c-8f51-43c2-a4ad-54a1d3ffdaa5 tempest-AttachVolumeTestJSON-189381823 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 04:41:22 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-58856f0c-8f51-43c2-a4ad-54a1d3ffdaa5 tempest-AttachVolumeTestJSON-189381823 None] Selected osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588 as target Quobyte volume. {{(pid=92060) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 17 04:41:22 devstack cinder-volume[92060]: INFO cinder.volume.drivers.remotefs [None req-58856f0c-8f51-43c2-a4ad-54a1d3ffdaa5 tempest-AttachVolumeTestJSON-189381823 None] casted to osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588 Jun 17 04:41:22 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-58856f0c-8f51-43c2-a4ad-54a1d3ffdaa5 tempest-AttachVolumeTestJSON-189381823 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-1409e9c5-943a-4086-b281-042471eeb293 1073741824 {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:41:22 devstack sudo[98159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-1409e9c5-943a-4086-b281-042471eeb293 1073741824 Jun 17 04:41:22 devstack sudo[98159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:41:22 devstack sudo[98156]: pam_unix(sudo:session): session closed for user root Jun 17 04:41:22 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-c05ef946-f824-4fbf-bc59-09da654133ac tempest-SnapshotsActionsTest-1582591615 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-d34f5b5f-658b-4614-8fc4-5c5254fa49d1.8c71cd23-e284-4f86-8909-154069066aa9" returned: 0 in 0.776s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:41:22 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.remotefs [None req-c05ef946-f824-4fbf-bc59-09da654133ac tempest-SnapshotsActionsTest-1582591615 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d34f5b5f-658b-4614-8fc4-5c5254fa49d1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=92060) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 17 04:41:22 devstack cinder-volume[92060]: DEBUG oslo.privsep.daemon [-] privsep: reply[08950928-24b0-4fe3-a5c7-742eb17b5455]: (4, 'qcow2') {{(pid=93130) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 04:41:22 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-c05ef946-f824-4fbf-bc59-09da654133ac tempest-SnapshotsActionsTest-1582591615 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-d34f5b5f-658b-4614-8fc4-5c5254fa49d1.fa0422c1-2dcc-42b5-8af4-58157d6473cd {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:41:22 devstack sudo[98164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-d34f5b5f-658b-4614-8fc4-5c5254fa49d1.fa0422c1-2dcc-42b5-8af4-58157d6473cd Jun 17 04:41:22 devstack sudo[98164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:41:23 devstack sudo[98159]: pam_unix(sudo:session): session closed for user root Jun 17 04:41:23 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-58856f0c-8f51-43c2-a4ad-54a1d3ffdaa5 tempest-AttachVolumeTestJSON-189381823 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-1409e9c5-943a-4086-b281-042471eeb293 1073741824" returned: 0 in 0.875s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:41:23 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-58856f0c-8f51-43c2-a4ad-54a1d3ffdaa5 tempest-AttachVolumeTestJSON-189381823 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-1409e9c5-943a-4086-b281-042471eeb293 {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:41:23 devstack sudo[98173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-1409e9c5-943a-4086-b281-042471eeb293 Jun 17 04:41:23 devstack sudo[98173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:41:23 devstack sudo[98164]: pam_unix(sudo:session): session closed for user root Jun 17 04:41:23 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-c05ef946-f824-4fbf-bc59-09da654133ac tempest-SnapshotsActionsTest-1582591615 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-d34f5b5f-658b-4614-8fc4-5c5254fa49d1.fa0422c1-2dcc-42b5-8af4-58157d6473cd" returned: 0 in 0.808s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:41:23 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.remotefs [None req-c05ef946-f824-4fbf-bc59-09da654133ac tempest-SnapshotsActionsTest-1582591615 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d34f5b5f-658b-4614-8fc4-5c5254fa49d1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=92060) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 17 04:41:23 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-c05ef946-f824-4fbf-bc59-09da654133ac tempest-SnapshotsActionsTest-1582591615 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-d34f5b5f-658b-4614-8fc4-5c5254fa49d1.8c71cd23-e284-4f86-8909-154069066aa9 {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:41:23 devstack sudo[98175]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-d34f5b5f-658b-4614-8fc4-5c5254fa49d1.8c71cd23-e284-4f86-8909-154069066aa9 Jun 17 04:41:23 devstack sudo[98175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:41:23 devstack sudo[98173]: pam_unix(sudo:session): session closed for user root Jun 17 04:41:23 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-58856f0c-8f51-43c2-a4ad-54a1d3ffdaa5 tempest-AttachVolumeTestJSON-189381823 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-1409e9c5-943a-4086-b281-042471eeb293" returned: 0 in 0.663s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:41:23 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-58856f0c-8f51-43c2-a4ad-54a1d3ffdaa5 tempest-AttachVolumeTestJSON-189381823 None] <== create_volume: return (1597ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588'} {{(pid=92060) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 17 04:41:23 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-58856f0c-8f51-43c2-a4ad-54a1d3ffdaa5 tempest-AttachVolumeTestJSON-189381823 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.599s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 04:41:23 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-58856f0c-8f51-43c2-a4ad-54a1d3ffdaa5 tempest-AttachVolumeTestJSON-189381823 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (482b8b04-5093-43af-98bc-6e4f2274cdf2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1409e9c5-943a-4086-b281-042471eeb293', 'volume_size': 1}' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:41:23 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-58856f0c-8f51-43c2-a4ad-54a1d3ffdaa5 tempest-AttachVolumeTestJSON-189381823 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ef90c432-af2f-4e66-ac26-dc8c08ec8484) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:41:23 devstack cinder-volume[92060]: INFO cinder.volume.flows.manager.create_volume [None req-58856f0c-8f51-43c2-a4ad-54a1d3ffdaa5 tempest-AttachVolumeTestJSON-189381823 None] Volume volume-1409e9c5-943a-4086-b281-042471eeb293 (1409e9c5-943a-4086-b281-042471eeb293): created successfully Jun 17 04:41:23 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-58856f0c-8f51-43c2-a4ad-54a1d3ffdaa5 tempest-AttachVolumeTestJSON-189381823 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ef90c432-af2f-4e66-ac26-dc8c08ec8484) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:41:23 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-58856f0c-8f51-43c2-a4ad-54a1d3ffdaa5 tempest-AttachVolumeTestJSON-189381823 None] Flow 'volume_create_manager' (7e0fca4a-f5e9-4351-be8c-e0626c467041) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92060) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 17 04:41:23 devstack cinder-volume[92060]: INFO cinder.volume.manager [None req-58856f0c-8f51-43c2-a4ad-54a1d3ffdaa5 tempest-AttachVolumeTestJSON-189381823 None] Created volume successfully. Jun 17 04:41:23 devstack sudo[98175]: pam_unix(sudo:session): session closed for user root Jun 17 04:41:23 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-c05ef946-f824-4fbf-bc59-09da654133ac tempest-SnapshotsActionsTest-1582591615 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-d34f5b5f-658b-4614-8fc4-5c5254fa49d1.8c71cd23-e284-4f86-8909-154069066aa9" returned: 0 in 0.751s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:41:23 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-c05ef946-f824-4fbf-bc59-09da654133ac tempest-SnapshotsActionsTest-1582591615 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-d34f5b5f-658b-4614-8fc4-5c5254fa49d1.8c71cd23-e284-4f86-8909-154069066aa9 {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:41:23 devstack sudo[98181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-d34f5b5f-658b-4614-8fc4-5c5254fa49d1.8c71cd23-e284-4f86-8909-154069066aa9 Jun 17 04:41:23 devstack sudo[98181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:41:24 devstack sudo[98181]: pam_unix(sudo:session): session closed for user root Jun 17 04:41:24 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-c05ef946-f824-4fbf-bc59-09da654133ac tempest-SnapshotsActionsTest-1582591615 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-d34f5b5f-658b-4614-8fc4-5c5254fa49d1.8c71cd23-e284-4f86-8909-154069066aa9" returned: 0 in 0.625s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:41:24 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-c05ef946-f824-4fbf-bc59-09da654133ac tempest-SnapshotsActionsTest-1582591615 None] Lock "cinder-quobyte-8c71cd23-e284-4f86-8909-154069066aa9" released by "_delete_snapshot" :: held 3.075s {{(pid=92060) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 04:41:24 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-c05ef946-f824-4fbf-bc59-09da654133ac tempest-SnapshotsActionsTest-1582591615 None] Lock "cinder-quobyte-d34f5b5f-658b-4614-8fc4-5c5254fa49d1" released by "delete_snapshot" :: held 3.102s {{(pid=92060) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 04:41:24 devstack cinder-volume[92060]: DEBUG cinder.quota [None req-c05ef946-f824-4fbf-bc59-09da654133ac tempest-SnapshotsActionsTest-1582591615 None] Created reservations ['c3b8b410-c7f7-4a51-9e57-0f2278ca5958', '87e2078a-232f-4c59-a935-15f3c28ac6d5', '316356c3-6887-46c5-8e37-594126c12bd5', '80a87dff-cc89-4a32-8701-b1a9137acafd'] {{(pid=92060) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 17 04:41:24 devstack cinder-volume[92060]: INFO cinder.volume.manager [None req-c05ef946-f824-4fbf-bc59-09da654133ac tempest-SnapshotsActionsTest-1582591615 None] Delete snapshot completed successfully. Jun 17 04:41:24 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-c05ef946-f824-4fbf-bc59-09da654133ac tempest-SnapshotsActionsTest-1582591615 None] Lock "cinder-8c71cd23-e284-4f86-8909-154069066aa9-delete_snapshot" released by "delete_snapshot" :: held 3.330s {{(pid=92060) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 04:41:26 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-0aacd981-ea2e-4259-9bb0-87ae5f2ecb10 tempest-SnapshotsActionsTest-1887161024 None] Acquiring lock "cinder-fa0422c1-2dcc-42b5-8af4-58157d6473cd-delete_snapshot" by "delete_snapshot" {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 04:41:26 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-0aacd981-ea2e-4259-9bb0-87ae5f2ecb10 tempest-SnapshotsActionsTest-1887161024 None] Lock "cinder-fa0422c1-2dcc-42b5-8af4-58157d6473cd-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 04:41:26 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-0aacd981-ea2e-4259-9bb0-87ae5f2ecb10 tempest-SnapshotsActionsTest-1887161024 None] Acquiring lock "cinder-quobyte-d34f5b5f-658b-4614-8fc4-5c5254fa49d1" by "delete_snapshot" {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 04:41:26 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-0aacd981-ea2e-4259-9bb0-87ae5f2ecb10 tempest-SnapshotsActionsTest-1887161024 None] Lock "cinder-quobyte-d34f5b5f-658b-4614-8fc4-5c5254fa49d1" acquired by "delete_snapshot" :: waited 0.024s {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 04:41:26 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-0aacd981-ea2e-4259-9bb0-87ae5f2ecb10 tempest-SnapshotsActionsTest-1887161024 None] Acquiring lock "cinder-quobyte-fa0422c1-2dcc-42b5-8af4-58157d6473cd" by "_delete_snapshot" {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 04:41:26 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-0aacd981-ea2e-4259-9bb0-87ae5f2ecb10 tempest-SnapshotsActionsTest-1887161024 None] Lock "cinder-quobyte-fa0422c1-2dcc-42b5-8af4-58157d6473cd" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 04:41:26 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.remotefs [None req-0aacd981-ea2e-4259-9bb0-87ae5f2ecb10 tempest-SnapshotsActionsTest-1887161024 None] Deleting offline snapshot fa0422c1-2dcc-42b5-8af4-58157d6473cd of volume d34f5b5f-658b-4614-8fc4-5c5254fa49d1 {{(pid=92060) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 17 04:41:26 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.remotefs [None req-0aacd981-ea2e-4259-9bb0-87ae5f2ecb10 tempest-SnapshotsActionsTest-1887161024 None] snapshot_file for this snap is: volume-d34f5b5f-658b-4614-8fc4-5c5254fa49d1.fa0422c1-2dcc-42b5-8af4-58157d6473cd {{(pid=92060) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 17 04:41:26 devstack cinder-volume[92060]: DEBUG oslo.privsep.daemon [-] privsep: reply[a24107c5-7329-484a-9ff3-296fb8afacb7]: (4, 'qcow2') {{(pid=93130) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 04:41:26 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-0aacd981-ea2e-4259-9bb0-87ae5f2ecb10 tempest-SnapshotsActionsTest-1887161024 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-d34f5b5f-658b-4614-8fc4-5c5254fa49d1.fa0422c1-2dcc-42b5-8af4-58157d6473cd {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:41:26 devstack sudo[98186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-d34f5b5f-658b-4614-8fc4-5c5254fa49d1.fa0422c1-2dcc-42b5-8af4-58157d6473cd Jun 17 04:41:26 devstack sudo[98186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:41:27 devstack sudo[98186]: pam_unix(sudo:session): session closed for user root Jun 17 04:41:27 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-0aacd981-ea2e-4259-9bb0-87ae5f2ecb10 tempest-SnapshotsActionsTest-1887161024 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-d34f5b5f-658b-4614-8fc4-5c5254fa49d1.fa0422c1-2dcc-42b5-8af4-58157d6473cd" returned: 0 in 1.026s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:41:27 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.remotefs [None req-0aacd981-ea2e-4259-9bb0-87ae5f2ecb10 tempest-SnapshotsActionsTest-1887161024 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d34f5b5f-658b-4614-8fc4-5c5254fa49d1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=92060) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 17 04:41:27 devstack cinder-volume[92060]: DEBUG cinder.volume.flows.manager.create_volume [None req-6ed95922-cf94-4a17-9a58-283dfbcfc5d1 tempest-VolumeSnapshotQuotasNegativeTestJSON-43109603 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92060) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 17 04:41:27 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-6ed95922-cf94-4a17-9a58-283dfbcfc5d1 tempest-VolumeSnapshotQuotasNegativeTestJSON-43109603 None] Flow 'volume_create_manager' (d4ecbdac-220a-4610-933b-e85189bb185e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 17 04:41:27 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-6ed95922-cf94-4a17-9a58-283dfbcfc5d1 tempest-VolumeSnapshotQuotasNegativeTestJSON-43109603 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0f9f31d8-faad-4de5-a067-dbd4c2ab04c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:41:27 devstack cinder-volume[92060]: DEBUG oslo.privsep.daemon [-] privsep: reply[32d43fba-7369-42af-9c39-425a13d33372]: (4, 'qcow2') {{(pid=93130) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 04:41:27 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-0aacd981-ea2e-4259-9bb0-87ae5f2ecb10 tempest-SnapshotsActionsTest-1887161024 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-d34f5b5f-658b-4614-8fc4-5c5254fa49d1 {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:41:27 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-6ed95922-cf94-4a17-9a58-283dfbcfc5d1 tempest-VolumeSnapshotQuotasNegativeTestJSON-43109603 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0f9f31d8-faad-4de5-a067-dbd4c2ab04c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-17T02:41:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-289129408',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8ff39ee1-6d15-4b8f-bd4d-8fbe19447d8b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='190953f0bd8d41efbaf63765e2b9d950',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T02:41:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T02:41:27Z,use_quota=True,user_id='2525a161ebda4de3b76d2e8e305f3407',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aad9ce24-93f9-41a6-baa1-5125964f96d1),volume_type_id=aad9ce24-93f9-41a6-baa1-5125964f96d1)' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:41:27 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-6ed95922-cf94-4a17-9a58-283dfbcfc5d1 tempest-VolumeSnapshotQuotasNegativeTestJSON-43109603 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bb0c7a78-7c21-4037-997d-78a1e59cae77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:41:27 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-6ed95922-cf94-4a17-9a58-283dfbcfc5d1 tempest-VolumeSnapshotQuotasNegativeTestJSON-43109603 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bb0c7a78-7c21-4037-997d-78a1e59cae77) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:41:27 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-6ed95922-cf94-4a17-9a58-283dfbcfc5d1 tempest-VolumeSnapshotQuotasNegativeTestJSON-43109603 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (163d178a-c4d3-407c-b127-3693d64bd80f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:41:27 devstack sudo[98235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-d34f5b5f-658b-4614-8fc4-5c5254fa49d1 Jun 17 04:41:27 devstack sudo[98235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:41:27 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-6ed95922-cf94-4a17-9a58-283dfbcfc5d1 tempest-VolumeSnapshotQuotasNegativeTestJSON-43109603 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (163d178a-c4d3-407c-b127-3693d64bd80f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8ff39ee1-6d15-4b8f-bd4d-8fbe19447d8b', 'volume_name': 'volume-8ff39ee1-6d15-4b8f-bd4d-8fbe19447d8b', 'volume_size': 1}' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:41:27 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-6ed95922-cf94-4a17-9a58-283dfbcfc5d1 tempest-VolumeSnapshotQuotasNegativeTestJSON-43109603 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (838d172e-b355-446f-a5b8-9c452fa6d84a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:41:27 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-6ed95922-cf94-4a17-9a58-283dfbcfc5d1 tempest-VolumeSnapshotQuotasNegativeTestJSON-43109603 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (838d172e-b355-446f-a5b8-9c452fa6d84a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:41:27 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-6ed95922-cf94-4a17-9a58-283dfbcfc5d1 tempest-VolumeSnapshotQuotasNegativeTestJSON-43109603 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fe4aa52b-3efc-41ef-a522-ad08aeff75ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:41:27 devstack cinder-volume[92060]: INFO cinder.volume.flows.manager.create_volume [None req-6ed95922-cf94-4a17-9a58-283dfbcfc5d1 tempest-VolumeSnapshotQuotasNegativeTestJSON-43109603 None] Volume 8ff39ee1-6d15-4b8f-bd4d-8fbe19447d8b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8ff39ee1-6d15-4b8f-bd4d-8fbe19447d8b', 'volume_size': 1} Jun 17 04:41:27 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-6ed95922-cf94-4a17-9a58-283dfbcfc5d1 tempest-VolumeSnapshotQuotasNegativeTestJSON-43109603 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 04:41:27 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-6ed95922-cf94-4a17-9a58-283dfbcfc5d1 tempest-VolumeSnapshotQuotasNegativeTestJSON-43109603 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 04:41:27 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-6ed95922-cf94-4a17-9a58-283dfbcfc5d1 tempest-VolumeSnapshotQuotasNegativeTestJSON-43109603 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-17T02:41:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-289129408',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8ff39ee1-6d15-4b8f-bd4d-8fbe19447d8b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='190953f0bd8d41efbaf63765e2b9d950',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T02:41:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T02:41:27Z,use_quota=True,user_id='2525a161ebda4de3b76d2e8e305f3407',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aad9ce24-93f9-41a6-baa1-5125964f96d1),volume_type_id=aad9ce24-93f9-41a6-baa1-5125964f96d1)}" {{(pid=92060) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 17 04:41:27 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.remotefs [None req-6ed95922-cf94-4a17-9a58-283dfbcfc5d1 tempest-VolumeSnapshotQuotasNegativeTestJSON-43109603 None] Creating volume 8ff39ee1-6d15-4b8f-bd4d-8fbe19447d8b {{(pid=92060) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 17 04:41:27 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-6ed95922-cf94-4a17-9a58-283dfbcfc5d1 tempest-VolumeSnapshotQuotasNegativeTestJSON-43109603 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 04:41:27 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-6ed95922-cf94-4a17-9a58-283dfbcfc5d1 tempest-VolumeSnapshotQuotasNegativeTestJSON-43109603 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 04:41:27 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-6ed95922-cf94-4a17-9a58-283dfbcfc5d1 tempest-VolumeSnapshotQuotasNegativeTestJSON-43109603 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588': None} {{(pid=92060) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 17 04:41:27 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-6ed95922-cf94-4a17-9a58-283dfbcfc5d1 tempest-VolumeSnapshotQuotasNegativeTestJSON-43109603 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588'] {{(pid=92060) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 17 04:41:27 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-6ed95922-cf94-4a17-9a58-283dfbcfc5d1 tempest-VolumeSnapshotQuotasNegativeTestJSON-43109603 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 04:41:27 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-6ed95922-cf94-4a17-9a58-283dfbcfc5d1 tempest-VolumeSnapshotQuotasNegativeTestJSON-43109603 None] Selected osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588 as target Quobyte volume. {{(pid=92060) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 17 04:41:27 devstack cinder-volume[92060]: INFO cinder.volume.drivers.remotefs [None req-6ed95922-cf94-4a17-9a58-283dfbcfc5d1 tempest-VolumeSnapshotQuotasNegativeTestJSON-43109603 None] casted to osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588 Jun 17 04:41:27 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-6ed95922-cf94-4a17-9a58-283dfbcfc5d1 tempest-VolumeSnapshotQuotasNegativeTestJSON-43109603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-8ff39ee1-6d15-4b8f-bd4d-8fbe19447d8b 1073741824 {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:41:27 devstack sudo[98238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-8ff39ee1-6d15-4b8f-bd4d-8fbe19447d8b 1073741824 Jun 17 04:41:27 devstack sudo[98238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:41:27 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [req-a4280b3f-4ed4-47a6-bc92-aba0d48e9597 req-a7467858-d919-42da-aa4e-0cf98c693e67 tempest-AttachVolumeTestJSON-189381823 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 04:41:28 devstack sudo[98235]: pam_unix(sudo:session): session closed for user root Jun 17 04:41:28 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-0aacd981-ea2e-4259-9bb0-87ae5f2ecb10 tempest-SnapshotsActionsTest-1887161024 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-d34f5b5f-658b-4614-8fc4-5c5254fa49d1" returned: 0 in 0.869s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:41:28 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-0aacd981-ea2e-4259-9bb0-87ae5f2ecb10 tempest-SnapshotsActionsTest-1887161024 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-d34f5b5f-658b-4614-8fc4-5c5254fa49d1.fa0422c1-2dcc-42b5-8af4-58157d6473cd {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:41:28 devstack sudo[98248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-d34f5b5f-658b-4614-8fc4-5c5254fa49d1.fa0422c1-2dcc-42b5-8af4-58157d6473cd Jun 17 04:41:28 devstack sudo[98248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:41:28 devstack sudo[98238]: pam_unix(sudo:session): session closed for user root Jun 17 04:41:28 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-6ed95922-cf94-4a17-9a58-283dfbcfc5d1 tempest-VolumeSnapshotQuotasNegativeTestJSON-43109603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-8ff39ee1-6d15-4b8f-bd4d-8fbe19447d8b 1073741824" returned: 0 in 0.874s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:41:28 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-6ed95922-cf94-4a17-9a58-283dfbcfc5d1 tempest-VolumeSnapshotQuotasNegativeTestJSON-43109603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-8ff39ee1-6d15-4b8f-bd4d-8fbe19447d8b {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:41:28 devstack sudo[98253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-8ff39ee1-6d15-4b8f-bd4d-8fbe19447d8b Jun 17 04:41:28 devstack sudo[98253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:41:29 devstack sudo[98248]: pam_unix(sudo:session): session closed for user root Jun 17 04:41:29 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-0aacd981-ea2e-4259-9bb0-87ae5f2ecb10 tempest-SnapshotsActionsTest-1887161024 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-d34f5b5f-658b-4614-8fc4-5c5254fa49d1.fa0422c1-2dcc-42b5-8af4-58157d6473cd" returned: 0 in 0.824s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:41:29 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-0aacd981-ea2e-4259-9bb0-87ae5f2ecb10 tempest-SnapshotsActionsTest-1887161024 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-d34f5b5f-658b-4614-8fc4-5c5254fa49d1.fa0422c1-2dcc-42b5-8af4-58157d6473cd {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:41:29 devstack sudo[98263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-d34f5b5f-658b-4614-8fc4-5c5254fa49d1.fa0422c1-2dcc-42b5-8af4-58157d6473cd Jun 17 04:41:29 devstack sudo[98263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:41:29 devstack sudo[98253]: pam_unix(sudo:session): session closed for user root Jun 17 04:41:29 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-6ed95922-cf94-4a17-9a58-283dfbcfc5d1 tempest-VolumeSnapshotQuotasNegativeTestJSON-43109603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-8ff39ee1-6d15-4b8f-bd4d-8fbe19447d8b" returned: 0 in 0.771s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:41:29 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-6ed95922-cf94-4a17-9a58-283dfbcfc5d1 tempest-VolumeSnapshotQuotasNegativeTestJSON-43109603 None] <== create_volume: return (1697ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588'} {{(pid=92060) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 17 04:41:29 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-6ed95922-cf94-4a17-9a58-283dfbcfc5d1 tempest-VolumeSnapshotQuotasNegativeTestJSON-43109603 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.700s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 04:41:29 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [req-a4280b3f-4ed4-47a6-bc92-aba0d48e9597 req-a7467858-d919-42da-aa4e-0cf98c693e67 tempest-AttachVolumeTestJSON-189381823 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 1.613s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 04:41:29 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-6ed95922-cf94-4a17-9a58-283dfbcfc5d1 tempest-VolumeSnapshotQuotasNegativeTestJSON-43109603 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fe4aa52b-3efc-41ef-a522-ad08aeff75ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8ff39ee1-6d15-4b8f-bd4d-8fbe19447d8b', 'volume_size': 1}' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:41:29 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-6ed95922-cf94-4a17-9a58-283dfbcfc5d1 tempest-VolumeSnapshotQuotasNegativeTestJSON-43109603 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3ba65a9c-ea92-4c96-a5cd-f75e32f16f44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:41:29 devstack cinder-volume[92060]: DEBUG oslo.privsep.daemon [-] privsep: reply[77dbd083-ea95-4e30-afc7-5d03de2d95f1]: (4, 'qcow2') {{(pid=93130) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 04:41:29 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [req-a4280b3f-4ed4-47a6-bc92-aba0d48e9597 req-a7467858-d919-42da-aa4e-0cf98c693e67 tempest-AttachVolumeTestJSON-189381823 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-1409e9c5-943a-4086-b281-042471eeb293 {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:41:29 devstack cinder-volume[92060]: INFO cinder.volume.flows.manager.create_volume [None req-6ed95922-cf94-4a17-9a58-283dfbcfc5d1 tempest-VolumeSnapshotQuotasNegativeTestJSON-43109603 None] Volume volume-8ff39ee1-6d15-4b8f-bd4d-8fbe19447d8b (8ff39ee1-6d15-4b8f-bd4d-8fbe19447d8b): created successfully Jun 17 04:41:29 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-6ed95922-cf94-4a17-9a58-283dfbcfc5d1 tempest-VolumeSnapshotQuotasNegativeTestJSON-43109603 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3ba65a9c-ea92-4c96-a5cd-f75e32f16f44) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:41:29 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-6ed95922-cf94-4a17-9a58-283dfbcfc5d1 tempest-VolumeSnapshotQuotasNegativeTestJSON-43109603 None] Flow 'volume_create_manager' (d4ecbdac-220a-4610-933b-e85189bb185e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92060) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 17 04:41:29 devstack cinder-volume[92060]: INFO cinder.volume.manager [None req-6ed95922-cf94-4a17-9a58-283dfbcfc5d1 tempest-VolumeSnapshotQuotasNegativeTestJSON-43109603 None] Created volume successfully. Jun 17 04:41:29 devstack sudo[98266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-1409e9c5-943a-4086-b281-042471eeb293 Jun 17 04:41:29 devstack sudo[98266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:41:29 devstack sudo[98263]: pam_unix(sudo:session): session closed for user root Jun 17 04:41:29 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-0aacd981-ea2e-4259-9bb0-87ae5f2ecb10 tempest-SnapshotsActionsTest-1887161024 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-d34f5b5f-658b-4614-8fc4-5c5254fa49d1.fa0422c1-2dcc-42b5-8af4-58157d6473cd" returned: 0 in 0.770s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:41:29 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-0aacd981-ea2e-4259-9bb0-87ae5f2ecb10 tempest-SnapshotsActionsTest-1887161024 None] Lock "cinder-quobyte-fa0422c1-2dcc-42b5-8af4-58157d6473cd" released by "_delete_snapshot" :: held 3.660s {{(pid=92060) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 04:41:29 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-0aacd981-ea2e-4259-9bb0-87ae5f2ecb10 tempest-SnapshotsActionsTest-1887161024 None] Lock "cinder-quobyte-d34f5b5f-658b-4614-8fc4-5c5254fa49d1" released by "delete_snapshot" :: held 3.685s {{(pid=92060) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 04:41:29 devstack cinder-volume[92060]: DEBUG cinder.quota [None req-0aacd981-ea2e-4259-9bb0-87ae5f2ecb10 tempest-SnapshotsActionsTest-1887161024 None] Created reservations ['bec18ddc-8d28-4cff-8f0d-5a9fb31b0ab8', '52e14058-4bb6-41ae-af02-52a6ca5dff73', '6b4e0dcb-8712-430c-aea3-b3f83c1d4e6a', '75e328f2-1bb9-4a83-b192-7264c5a12c3c'] {{(pid=92060) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 17 04:41:29 devstack cinder-volume[92060]: INFO cinder.volume.manager [None req-0aacd981-ea2e-4259-9bb0-87ae5f2ecb10 tempest-SnapshotsActionsTest-1887161024 None] Delete snapshot completed successfully. Jun 17 04:41:29 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-0aacd981-ea2e-4259-9bb0-87ae5f2ecb10 tempest-SnapshotsActionsTest-1887161024 None] Lock "cinder-fa0422c1-2dcc-42b5-8af4-58157d6473cd-delete_snapshot" released by "delete_snapshot" :: held 3.841s {{(pid=92060) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 04:41:30 devstack sudo[98266]: pam_unix(sudo:session): session closed for user root Jun 17 04:41:30 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [req-a4280b3f-4ed4-47a6-bc92-aba0d48e9597 req-a7467858-d919-42da-aa4e-0cf98c693e67 tempest-AttachVolumeTestJSON-189381823 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-1409e9c5-943a-4086-b281-042471eeb293" returned: 0 in 0.774s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:41:30 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [req-a4280b3f-4ed4-47a6-bc92-aba0d48e9597 req-a7467858-d919-42da-aa4e-0cf98c693e67 tempest-AttachVolumeTestJSON-189381823 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.821s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 04:41:30 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [req-a4280b3f-4ed4-47a6-bc92-aba0d48e9597 req-a7467858-d919-42da-aa4e-0cf98c693e67 tempest-AttachVolumeTestJSON-189381823 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588', 'name': 'volume-1409e9c5-943a-4086-b281-042471eeb293', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '5a16e487-677a-499d-832f-5c5df31c0e17', 'enforce_multipath': True} {{(pid=92060) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 17 04:41:30 devstack cinder-volume[92060]: INFO cinder.volume.manager [req-a4280b3f-4ed4-47a6-bc92-aba0d48e9597 req-a7467858-d919-42da-aa4e-0cf98c693e67 tempest-AttachVolumeTestJSON-189381823 None] attachment_update completed successfully. Jun 17 04:41:30 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-66169bd8-f8b6-48a8-aa59-a81f95de2097 tempest-VolumeSnapshotQuotasNegativeTestJSON-43109603 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 04:41:30 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-66169bd8-f8b6-48a8-aa59-a81f95de2097 tempest-VolumeSnapshotQuotasNegativeTestJSON-43109603 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 04:41:30 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.remotefs [None req-66169bd8-f8b6-48a8-aa59-a81f95de2097 tempest-VolumeSnapshotQuotasNegativeTestJSON-43109603 None] Creating offline snapshot 4aa0b86f-9865-49f3-8911-caade952261d of volume 8ff39ee1-6d15-4b8f-bd4d-8fbe19447d8b {{(pid=92060) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 17 04:41:30 devstack cinder-volume[92060]: DEBUG oslo.privsep.daemon [-] privsep: reply[81d0022f-f612-4f59-835c-64067fc637c8]: (4, 'qcow2') {{(pid=93130) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 04:41:30 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-66169bd8-f8b6-48a8-aa59-a81f95de2097 tempest-VolumeSnapshotQuotasNegativeTestJSON-43109603 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-8ff39ee1-6d15-4b8f-bd4d-8fbe19447d8b {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:41:30 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-060197d2-35a8-4795-bce5-25bb95512348 tempest-SnapshotsActionsTest-1887161024 None] Acquiring lock "cinder-d34f5b5f-658b-4614-8fc4-5c5254fa49d1-delete_volume" by "delete_volume" {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 04:41:30 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-060197d2-35a8-4795-bce5-25bb95512348 tempest-SnapshotsActionsTest-1887161024 None] Lock "cinder-d34f5b5f-658b-4614-8fc4-5c5254fa49d1-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 04:41:30 devstack sudo[98274]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-8ff39ee1-6d15-4b8f-bd4d-8fbe19447d8b Jun 17 04:41:30 devstack sudo[98274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:41:30 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-060197d2-35a8-4795-bce5-25bb95512348 tempest-SnapshotsActionsTest-1887161024 None] Acquiring lock "cinder-quobyte-d34f5b5f-658b-4614-8fc4-5c5254fa49d1" by "delete_volume" {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 04:41:30 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-060197d2-35a8-4795-bce5-25bb95512348 tempest-SnapshotsActionsTest-1887161024 None] Lock "cinder-quobyte-d34f5b5f-658b-4614-8fc4-5c5254fa49d1" acquired by "delete_volume" :: waited 0.027s {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 04:41:30 devstack cinder-volume[92060]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1c98fb1-3871-444d-8121-3d51e214f078]: (4, 'qcow2') {{(pid=93130) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 04:41:30 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-060197d2-35a8-4795-bce5-25bb95512348 tempest-SnapshotsActionsTest-1887161024 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-d34f5b5f-658b-4614-8fc4-5c5254fa49d1 {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:41:30 devstack sudo[98299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-d34f5b5f-658b-4614-8fc4-5c5254fa49d1 Jun 17 04:41:30 devstack sudo[98299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:41:31 devstack sudo[98274]: pam_unix(sudo:session): session closed for user root Jun 17 04:41:31 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-66169bd8-f8b6-48a8-aa59-a81f95de2097 tempest-VolumeSnapshotQuotasNegativeTestJSON-43109603 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-8ff39ee1-6d15-4b8f-bd4d-8fbe19447d8b" returned: 0 in 0.834s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:41:31 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-66169bd8-f8b6-48a8-aa59-a81f95de2097 tempest-VolumeSnapshotQuotasNegativeTestJSON-43109603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-8ff39ee1-6d15-4b8f-bd4d-8fbe19447d8b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-8ff39ee1-6d15-4b8f-bd4d-8fbe19447d8b.4aa0b86f-9865-49f3-8911-caade952261d 1G {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:41:31 devstack sudo[98349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-8ff39ee1-6d15-4b8f-bd4d-8fbe19447d8b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-8ff39ee1-6d15-4b8f-bd4d-8fbe19447d8b.4aa0b86f-9865-49f3-8911-caade952261d 1G Jun 17 04:41:31 devstack sudo[98349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:41:31 devstack sudo[98299]: pam_unix(sudo:session): session closed for user root Jun 17 04:41:31 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-060197d2-35a8-4795-bce5-25bb95512348 tempest-SnapshotsActionsTest-1887161024 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-d34f5b5f-658b-4614-8fc4-5c5254fa49d1" returned: 0 in 0.811s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:41:31 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-060197d2-35a8-4795-bce5-25bb95512348 tempest-SnapshotsActionsTest-1887161024 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-d34f5b5f-658b-4614-8fc4-5c5254fa49d1 {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:41:31 devstack sudo[98669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-d34f5b5f-658b-4614-8fc4-5c5254fa49d1 Jun 17 04:41:31 devstack sudo[98669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:41:32 devstack sudo[98349]: pam_unix(sudo:session): session closed for user root Jun 17 04:41:32 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-66169bd8-f8b6-48a8-aa59-a81f95de2097 tempest-VolumeSnapshotQuotasNegativeTestJSON-43109603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-8ff39ee1-6d15-4b8f-bd4d-8fbe19447d8b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-8ff39ee1-6d15-4b8f-bd4d-8fbe19447d8b.4aa0b86f-9865-49f3-8911-caade952261d 1G" returned: 0 in 0.790s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:41:32 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-66169bd8-f8b6-48a8-aa59-a81f95de2097 tempest-VolumeSnapshotQuotasNegativeTestJSON-43109603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8ff39ee1-6d15-4b8f-bd4d-8fbe19447d8b -F qcow2 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-8ff39ee1-6d15-4b8f-bd4d-8fbe19447d8b.4aa0b86f-9865-49f3-8911-caade952261d {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:41:32 devstack sudo[98675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8ff39ee1-6d15-4b8f-bd4d-8fbe19447d8b -F qcow2 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-8ff39ee1-6d15-4b8f-bd4d-8fbe19447d8b.4aa0b86f-9865-49f3-8911-caade952261d Jun 17 04:41:32 devstack sudo[98675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:41:32 devstack sudo[98669]: pam_unix(sudo:session): session closed for user root Jun 17 04:41:32 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-060197d2-35a8-4795-bce5-25bb95512348 tempest-SnapshotsActionsTest-1887161024 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-d34f5b5f-658b-4614-8fc4-5c5254fa49d1" returned: 0 in 0.627s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:41:32 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-060197d2-35a8-4795-bce5-25bb95512348 tempest-SnapshotsActionsTest-1887161024 None] Lock "cinder-quobyte-d34f5b5f-658b-4614-8fc4-5c5254fa49d1" released by "delete_volume" :: held 1.507s {{(pid=92060) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 04:41:32 devstack cinder-volume[92060]: DEBUG cinder.quota [None req-060197d2-35a8-4795-bce5-25bb95512348 tempest-SnapshotsActionsTest-1887161024 None] Created reservations ['cc8c5e51-4a57-4fc8-91a1-486b1a1b43db', '2cc98b2b-ccb1-4bd3-b69a-5ee65bf653ee', 'c2d6d5a8-5e40-4260-adf5-5a2e2e0e9701', 'b5c6c698-6ee5-4ded-938e-b74ecd8f2f84'] {{(pid=92060) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 17 04:41:32 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-060197d2-35a8-4795-bce5-25bb95512348 tempest-SnapshotsActionsTest-1887161024 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 04:41:32 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-060197d2-35a8-4795-bce5-25bb95512348 tempest-SnapshotsActionsTest-1887161024 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 04:41:32 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-060197d2-35a8-4795-bce5-25bb95512348 tempest-SnapshotsActionsTest-1887161024 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588': None} {{(pid=92060) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 17 04:41:32 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-060197d2-35a8-4795-bce5-25bb95512348 tempest-SnapshotsActionsTest-1887161024 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588'] {{(pid=92060) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 17 04:41:32 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-060197d2-35a8-4795-bce5-25bb95512348 tempest-SnapshotsActionsTest-1887161024 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 04:41:32 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-060197d2-35a8-4795-bce5-25bb95512348 tempest-SnapshotsActionsTest-1887161024 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:41:32 devstack sudo[98677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a Jun 17 04:41:32 devstack sudo[98677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:41:32 devstack sudo[98675]: pam_unix(sudo:session): session closed for user root Jun 17 04:41:32 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-66169bd8-f8b6-48a8-aa59-a81f95de2097 tempest-VolumeSnapshotQuotasNegativeTestJSON-43109603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8ff39ee1-6d15-4b8f-bd4d-8fbe19447d8b -F qcow2 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-8ff39ee1-6d15-4b8f-bd4d-8fbe19447d8b.4aa0b86f-9865-49f3-8911-caade952261d" returned: 0 in 0.704s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:41:32 devstack cinder-volume[92060]: WARNING cinder.volume.drivers.remotefs [None req-66169bd8-f8b6-48a8-aa59-a81f95de2097 tempest-VolumeSnapshotQuotasNegativeTestJSON-43109603 None] /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-8ff39ee1-6d15-4b8f-bd4d-8fbe19447d8b.4aa0b86f-9865-49f3-8911-caade952261d is being set with open permissions: ugo+rw Jun 17 04:41:32 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-66169bd8-f8b6-48a8-aa59-a81f95de2097 tempest-VolumeSnapshotQuotasNegativeTestJSON-43109603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-8ff39ee1-6d15-4b8f-bd4d-8fbe19447d8b.4aa0b86f-9865-49f3-8911-caade952261d {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:41:32 devstack sudo[98682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-8ff39ee1-6d15-4b8f-bd4d-8fbe19447d8b.4aa0b86f-9865-49f3-8911-caade952261d Jun 17 04:41:32 devstack sudo[98682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:41:33 devstack sudo[98677]: pam_unix(sudo:session): session closed for user root Jun 17 04:41:33 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-060197d2-35a8-4795-bce5-25bb95512348 tempest-SnapshotsActionsTest-1887161024 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a" returned: 0 in 0.685s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:41:33 devstack cinder-volume[92060]: DEBUG cinder.manager [None req-060197d2-35a8-4795-bce5-25bb95512348 tempest-SnapshotsActionsTest-1887161024 None] Notifying Schedulers of capabilities ... {{(pid=92060) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 17 04:41:33 devstack cinder-volume[92060]: INFO cinder.volume.manager [None req-060197d2-35a8-4795-bce5-25bb95512348 tempest-SnapshotsActionsTest-1887161024 None] Deleted volume successfully. Jun 17 04:41:33 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-060197d2-35a8-4795-bce5-25bb95512348 tempest-SnapshotsActionsTest-1887161024 None] Lock "cinder-d34f5b5f-658b-4614-8fc4-5c5254fa49d1-delete_volume" released by "delete_volume" :: held 2.439s {{(pid=92060) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 04:41:33 devstack sudo[98682]: pam_unix(sudo:session): session closed for user root Jun 17 04:41:33 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-66169bd8-f8b6-48a8-aa59-a81f95de2097 tempest-VolumeSnapshotQuotasNegativeTestJSON-43109603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-8ff39ee1-6d15-4b8f-bd4d-8fbe19447d8b.4aa0b86f-9865-49f3-8911-caade952261d" returned: 0 in 0.600s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:41:33 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-66169bd8-f8b6-48a8-aa59-a81f95de2097 tempest-VolumeSnapshotQuotasNegativeTestJSON-43109603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-8ff39ee1-6d15-4b8f-bd4d-8fbe19447d8b.info {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:41:33 devstack sudo[98686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-8ff39ee1-6d15-4b8f-bd4d-8fbe19447d8b.info Jun 17 04:41:33 devstack sudo[98686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:41:34 devstack sudo[98686]: pam_unix(sudo:session): session closed for user root Jun 17 04:41:34 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-66169bd8-f8b6-48a8-aa59-a81f95de2097 tempest-VolumeSnapshotQuotasNegativeTestJSON-43109603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-8ff39ee1-6d15-4b8f-bd4d-8fbe19447d8b.info" returned: 0 in 0.628s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:41:34 devstack cinder-volume[92060]: WARNING cinder.volume.drivers.remotefs [None req-66169bd8-f8b6-48a8-aa59-a81f95de2097 tempest-VolumeSnapshotQuotasNegativeTestJSON-43109603 None] /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-8ff39ee1-6d15-4b8f-bd4d-8fbe19447d8b.info is being set with open permissions: ugo+rw Jun 17 04:41:34 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-66169bd8-f8b6-48a8-aa59-a81f95de2097 tempest-VolumeSnapshotQuotasNegativeTestJSON-43109603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-8ff39ee1-6d15-4b8f-bd4d-8fbe19447d8b.info {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:41:34 devstack sudo[98689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-8ff39ee1-6d15-4b8f-bd4d-8fbe19447d8b.info Jun 17 04:41:34 devstack sudo[98689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:41:34 devstack sudo[98689]: pam_unix(sudo:session): session closed for user root Jun 17 04:41:34 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-66169bd8-f8b6-48a8-aa59-a81f95de2097 tempest-VolumeSnapshotQuotasNegativeTestJSON-43109603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-8ff39ee1-6d15-4b8f-bd4d-8fbe19447d8b.info" returned: 0 in 0.763s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:41:34 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-66169bd8-f8b6-48a8-aa59-a81f95de2097 tempest-VolumeSnapshotQuotasNegativeTestJSON-43109603 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.414s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 04:41:34 devstack cinder-volume[92060]: INFO cinder.volume.manager [None req-66169bd8-f8b6-48a8-aa59-a81f95de2097 tempest-VolumeSnapshotQuotasNegativeTestJSON-43109603 None] Create snapshot completed successfully Jun 17 04:41:35 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-55f54b93-ccee-40fb-ae58-cf603d1d57b7 tempest-AttachVolumeShelveTestJSON-134363980 None] Acquiring lock "cinder-0658b107-1fce-439f-a62e-8299bf3b43b8-delete_volume" by "delete_volume" {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 04:41:35 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-55f54b93-ccee-40fb-ae58-cf603d1d57b7 tempest-AttachVolumeShelveTestJSON-134363980 None] Lock "cinder-0658b107-1fce-439f-a62e-8299bf3b43b8-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 04:41:36 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-55f54b93-ccee-40fb-ae58-cf603d1d57b7 tempest-AttachVolumeShelveTestJSON-134363980 None] Acquiring lock "cinder-quobyte-0658b107-1fce-439f-a62e-8299bf3b43b8" by "delete_volume" {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 04:41:36 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-55f54b93-ccee-40fb-ae58-cf603d1d57b7 tempest-AttachVolumeShelveTestJSON-134363980 None] Lock "cinder-quobyte-0658b107-1fce-439f-a62e-8299bf3b43b8" acquired by "delete_volume" :: waited 0.023s {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 04:41:36 devstack cinder-volume[92060]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9106d73-61da-42da-a59d-2b7f26c2f4db]: (4, 'qcow2') {{(pid=93130) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 04:41:36 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-55f54b93-ccee-40fb-ae58-cf603d1d57b7 tempest-AttachVolumeShelveTestJSON-134363980 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-0658b107-1fce-439f-a62e-8299bf3b43b8 {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:41:36 devstack sudo[98692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-0658b107-1fce-439f-a62e-8299bf3b43b8 Jun 17 04:41:36 devstack sudo[98692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:41:36 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-118d9585-5214-4101-ac42-cf101753924f tempest-VolumeSnapshotQuotasNegativeTestJSON-43109603 None] Acquiring lock "cinder-4aa0b86f-9865-49f3-8911-caade952261d-delete_snapshot" by "delete_snapshot" {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 04:41:36 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-118d9585-5214-4101-ac42-cf101753924f tempest-VolumeSnapshotQuotasNegativeTestJSON-43109603 None] Lock "cinder-4aa0b86f-9865-49f3-8911-caade952261d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.097s {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 04:41:36 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-118d9585-5214-4101-ac42-cf101753924f tempest-VolumeSnapshotQuotasNegativeTestJSON-43109603 None] Acquiring lock "cinder-quobyte-8ff39ee1-6d15-4b8f-bd4d-8fbe19447d8b" by "delete_snapshot" {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 04:41:36 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-118d9585-5214-4101-ac42-cf101753924f tempest-VolumeSnapshotQuotasNegativeTestJSON-43109603 None] Lock "cinder-quobyte-8ff39ee1-6d15-4b8f-bd4d-8fbe19447d8b" acquired by "delete_snapshot" :: waited 0.045s {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 04:41:36 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-118d9585-5214-4101-ac42-cf101753924f tempest-VolumeSnapshotQuotasNegativeTestJSON-43109603 None] Acquiring lock "cinder-quobyte-4aa0b86f-9865-49f3-8911-caade952261d" by "_delete_snapshot" {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 04:41:36 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-118d9585-5214-4101-ac42-cf101753924f tempest-VolumeSnapshotQuotasNegativeTestJSON-43109603 None] Lock "cinder-quobyte-4aa0b86f-9865-49f3-8911-caade952261d" acquired by "_delete_snapshot" :: waited 0.051s {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 04:41:36 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.remotefs [None req-118d9585-5214-4101-ac42-cf101753924f tempest-VolumeSnapshotQuotasNegativeTestJSON-43109603 None] Deleting offline snapshot 4aa0b86f-9865-49f3-8911-caade952261d of volume 8ff39ee1-6d15-4b8f-bd4d-8fbe19447d8b {{(pid=92060) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 17 04:41:36 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.remotefs [None req-118d9585-5214-4101-ac42-cf101753924f tempest-VolumeSnapshotQuotasNegativeTestJSON-43109603 None] snapshot_file for this snap is: volume-8ff39ee1-6d15-4b8f-bd4d-8fbe19447d8b.4aa0b86f-9865-49f3-8911-caade952261d {{(pid=92060) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 17 04:41:36 devstack cinder-volume[92060]: DEBUG oslo.privsep.daemon [-] privsep: reply[037bf764-07d5-441d-9462-1fcc6b7ef916]: (4, 'qcow2') {{(pid=93130) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 04:41:36 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-118d9585-5214-4101-ac42-cf101753924f tempest-VolumeSnapshotQuotasNegativeTestJSON-43109603 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-8ff39ee1-6d15-4b8f-bd4d-8fbe19447d8b.4aa0b86f-9865-49f3-8911-caade952261d {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:41:36 devstack sudo[98732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-8ff39ee1-6d15-4b8f-bd4d-8fbe19447d8b.4aa0b86f-9865-49f3-8911-caade952261d Jun 17 04:41:36 devstack sudo[98732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:41:37 devstack sudo[98692]: pam_unix(sudo:session): session closed for user root Jun 17 04:41:37 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-55f54b93-ccee-40fb-ae58-cf603d1d57b7 tempest-AttachVolumeShelveTestJSON-134363980 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-0658b107-1fce-439f-a62e-8299bf3b43b8" returned: 0 in 1.160s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:41:37 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-55f54b93-ccee-40fb-ae58-cf603d1d57b7 tempest-AttachVolumeShelveTestJSON-134363980 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-0658b107-1fce-439f-a62e-8299bf3b43b8 {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:41:37 devstack sudo[98739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-0658b107-1fce-439f-a62e-8299bf3b43b8 Jun 17 04:41:37 devstack sudo[98739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:41:37 devstack sudo[98732]: pam_unix(sudo:session): session closed for user root Jun 17 04:41:37 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-118d9585-5214-4101-ac42-cf101753924f tempest-VolumeSnapshotQuotasNegativeTestJSON-43109603 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-8ff39ee1-6d15-4b8f-bd4d-8fbe19447d8b.4aa0b86f-9865-49f3-8911-caade952261d" returned: 0 in 1.017s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:41:37 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.remotefs [None req-118d9585-5214-4101-ac42-cf101753924f tempest-VolumeSnapshotQuotasNegativeTestJSON-43109603 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8ff39ee1-6d15-4b8f-bd4d-8fbe19447d8b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=92060) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 17 04:41:37 devstack cinder-volume[92060]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e7a449d-30b5-4043-9a1b-b49d8044fd18]: (4, 'qcow2') {{(pid=93130) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 04:41:37 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-118d9585-5214-4101-ac42-cf101753924f tempest-VolumeSnapshotQuotasNegativeTestJSON-43109603 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-8ff39ee1-6d15-4b8f-bd4d-8fbe19447d8b {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:41:37 devstack sudo[98745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-8ff39ee1-6d15-4b8f-bd4d-8fbe19447d8b Jun 17 04:41:37 devstack sudo[98745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:41:37 devstack sudo[98739]: pam_unix(sudo:session): session closed for user root Jun 17 04:41:37 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-55f54b93-ccee-40fb-ae58-cf603d1d57b7 tempest-AttachVolumeShelveTestJSON-134363980 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-0658b107-1fce-439f-a62e-8299bf3b43b8" returned: 0 in 0.677s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:41:37 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-55f54b93-ccee-40fb-ae58-cf603d1d57b7 tempest-AttachVolumeShelveTestJSON-134363980 None] Lock "cinder-quobyte-0658b107-1fce-439f-a62e-8299bf3b43b8" released by "delete_volume" :: held 1.898s {{(pid=92060) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 04:41:37 devstack cinder-volume[92060]: DEBUG cinder.quota [None req-55f54b93-ccee-40fb-ae58-cf603d1d57b7 tempest-AttachVolumeShelveTestJSON-134363980 None] Created reservations ['409110f4-31fd-4055-9e6c-8965c1c7e33a', 'b3508f54-cd5f-4ae1-a47f-a1c9c136c612', 'dd5f050e-40b5-4cc2-912f-d4fd3cbf87a7', 'c0645ac4-8cdf-4b4e-9b6a-72551e0d1632'] {{(pid=92060) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 17 04:41:38 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-55f54b93-ccee-40fb-ae58-cf603d1d57b7 tempest-AttachVolumeShelveTestJSON-134363980 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 04:41:38 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-55f54b93-ccee-40fb-ae58-cf603d1d57b7 tempest-AttachVolumeShelveTestJSON-134363980 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 04:41:38 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-55f54b93-ccee-40fb-ae58-cf603d1d57b7 tempest-AttachVolumeShelveTestJSON-134363980 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588': None} {{(pid=92060) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 17 04:41:38 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-55f54b93-ccee-40fb-ae58-cf603d1d57b7 tempest-AttachVolumeShelveTestJSON-134363980 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588'] {{(pid=92060) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 17 04:41:38 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-55f54b93-ccee-40fb-ae58-cf603d1d57b7 tempest-AttachVolumeShelveTestJSON-134363980 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 04:41:38 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-55f54b93-ccee-40fb-ae58-cf603d1d57b7 tempest-AttachVolumeShelveTestJSON-134363980 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:41:38 devstack sudo[98748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a Jun 17 04:41:38 devstack sudo[98748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:41:38 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-65a6ed75-4ca2-419f-8197-1ecf3bef6376 tempest-AttachVolumeShelveTestJSON-134363980 None] Acquiring lock "cinder-bf2eca3e-8c5a-4863-bbb8-1003435f17a2-delete_volume" by "delete_volume" {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 04:41:38 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-65a6ed75-4ca2-419f-8197-1ecf3bef6376 tempest-AttachVolumeShelveTestJSON-134363980 None] Lock "cinder-bf2eca3e-8c5a-4863-bbb8-1003435f17a2-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 04:41:38 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-65a6ed75-4ca2-419f-8197-1ecf3bef6376 tempest-AttachVolumeShelveTestJSON-134363980 None] Acquiring lock "cinder-quobyte-bf2eca3e-8c5a-4863-bbb8-1003435f17a2" by "delete_volume" {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 04:41:38 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-65a6ed75-4ca2-419f-8197-1ecf3bef6376 tempest-AttachVolumeShelveTestJSON-134363980 None] Lock "cinder-quobyte-bf2eca3e-8c5a-4863-bbb8-1003435f17a2" acquired by "delete_volume" :: waited 0.018s {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 04:41:38 devstack cinder-volume[92060]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a36612a-f991-4e63-9d14-b29bfa408d19]: (4, 'qcow2') {{(pid=93130) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 04:41:38 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-65a6ed75-4ca2-419f-8197-1ecf3bef6376 tempest-AttachVolumeShelveTestJSON-134363980 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-bf2eca3e-8c5a-4863-bbb8-1003435f17a2 {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:41:38 devstack sudo[98753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-bf2eca3e-8c5a-4863-bbb8-1003435f17a2 Jun 17 04:41:38 devstack sudo[98753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:41:38 devstack sudo[98745]: pam_unix(sudo:session): session closed for user root Jun 17 04:41:38 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-118d9585-5214-4101-ac42-cf101753924f tempest-VolumeSnapshotQuotasNegativeTestJSON-43109603 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-8ff39ee1-6d15-4b8f-bd4d-8fbe19447d8b" returned: 0 in 1.026s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:41:38 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-118d9585-5214-4101-ac42-cf101753924f tempest-VolumeSnapshotQuotasNegativeTestJSON-43109603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-8ff39ee1-6d15-4b8f-bd4d-8fbe19447d8b.4aa0b86f-9865-49f3-8911-caade952261d {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:41:38 devstack sudo[98755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-8ff39ee1-6d15-4b8f-bd4d-8fbe19447d8b.4aa0b86f-9865-49f3-8911-caade952261d Jun 17 04:41:38 devstack sudo[98755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:41:38 devstack sudo[98748]: pam_unix(sudo:session): session closed for user root Jun 17 04:41:38 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-55f54b93-ccee-40fb-ae58-cf603d1d57b7 tempest-AttachVolumeShelveTestJSON-134363980 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a" returned: 0 in 0.829s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:41:38 devstack cinder-volume[92060]: DEBUG cinder.manager [None req-55f54b93-ccee-40fb-ae58-cf603d1d57b7 tempest-AttachVolumeShelveTestJSON-134363980 None] Notifying Schedulers of capabilities ... {{(pid=92060) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 17 04:41:38 devstack cinder-volume[92060]: INFO cinder.volume.manager [None req-55f54b93-ccee-40fb-ae58-cf603d1d57b7 tempest-AttachVolumeShelveTestJSON-134363980 None] Deleted volume successfully. Jun 17 04:41:38 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-55f54b93-ccee-40fb-ae58-cf603d1d57b7 tempest-AttachVolumeShelveTestJSON-134363980 None] Lock "cinder-0658b107-1fce-439f-a62e-8299bf3b43b8-delete_volume" released by "delete_volume" :: held 2.987s {{(pid=92060) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 04:41:39 devstack sudo[98753]: pam_unix(sudo:session): session closed for user root Jun 17 04:41:39 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-65a6ed75-4ca2-419f-8197-1ecf3bef6376 tempest-AttachVolumeShelveTestJSON-134363980 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-bf2eca3e-8c5a-4863-bbb8-1003435f17a2" returned: 0 in 0.790s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:41:39 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-65a6ed75-4ca2-419f-8197-1ecf3bef6376 tempest-AttachVolumeShelveTestJSON-134363980 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-bf2eca3e-8c5a-4863-bbb8-1003435f17a2 {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:41:39 devstack sudo[98764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-bf2eca3e-8c5a-4863-bbb8-1003435f17a2 Jun 17 04:41:39 devstack sudo[98764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:41:39 devstack sudo[98755]: pam_unix(sudo:session): session closed for user root Jun 17 04:41:39 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-118d9585-5214-4101-ac42-cf101753924f tempest-VolumeSnapshotQuotasNegativeTestJSON-43109603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-8ff39ee1-6d15-4b8f-bd4d-8fbe19447d8b.4aa0b86f-9865-49f3-8911-caade952261d" returned: 0 in 0.801s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:41:39 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-118d9585-5214-4101-ac42-cf101753924f tempest-VolumeSnapshotQuotasNegativeTestJSON-43109603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-8ff39ee1-6d15-4b8f-bd4d-8fbe19447d8b.4aa0b86f-9865-49f3-8911-caade952261d {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:41:39 devstack sudo[98766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-8ff39ee1-6d15-4b8f-bd4d-8fbe19447d8b.4aa0b86f-9865-49f3-8911-caade952261d Jun 17 04:41:39 devstack sudo[98766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:41:40 devstack sudo[98764]: pam_unix(sudo:session): session closed for user root Jun 17 04:41:40 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-65a6ed75-4ca2-419f-8197-1ecf3bef6376 tempest-AttachVolumeShelveTestJSON-134363980 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-bf2eca3e-8c5a-4863-bbb8-1003435f17a2" returned: 0 in 0.721s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:41:40 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-65a6ed75-4ca2-419f-8197-1ecf3bef6376 tempest-AttachVolumeShelveTestJSON-134363980 None] Lock "cinder-quobyte-bf2eca3e-8c5a-4863-bbb8-1003435f17a2" released by "delete_volume" :: held 1.561s {{(pid=92060) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 04:41:40 devstack cinder-volume[92060]: DEBUG cinder.quota [None req-65a6ed75-4ca2-419f-8197-1ecf3bef6376 tempest-AttachVolumeShelveTestJSON-134363980 None] Created reservations ['bd75dba5-339a-4841-be49-33f44eab76b2', 'f966e9de-72cd-48c5-851c-bc45a68c77ad', 'a6c14e0d-7c23-4d6d-b07c-b8591ad09e97', 'f460e157-ac75-414a-9aa3-e4a051c9244e'] {{(pid=92060) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 17 04:41:40 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-65a6ed75-4ca2-419f-8197-1ecf3bef6376 tempest-AttachVolumeShelveTestJSON-134363980 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 04:41:40 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-65a6ed75-4ca2-419f-8197-1ecf3bef6376 tempest-AttachVolumeShelveTestJSON-134363980 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 04:41:40 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-65a6ed75-4ca2-419f-8197-1ecf3bef6376 tempest-AttachVolumeShelveTestJSON-134363980 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588': None} {{(pid=92060) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 17 04:41:40 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-65a6ed75-4ca2-419f-8197-1ecf3bef6376 tempest-AttachVolumeShelveTestJSON-134363980 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588'] {{(pid=92060) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 17 04:41:40 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-65a6ed75-4ca2-419f-8197-1ecf3bef6376 tempest-AttachVolumeShelveTestJSON-134363980 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 04:41:40 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-65a6ed75-4ca2-419f-8197-1ecf3bef6376 tempest-AttachVolumeShelveTestJSON-134363980 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:41:40 devstack sudo[98770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a Jun 17 04:41:40 devstack sudo[98770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:41:40 devstack sudo[98766]: pam_unix(sudo:session): session closed for user root Jun 17 04:41:40 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-118d9585-5214-4101-ac42-cf101753924f tempest-VolumeSnapshotQuotasNegativeTestJSON-43109603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-8ff39ee1-6d15-4b8f-bd4d-8fbe19447d8b.4aa0b86f-9865-49f3-8911-caade952261d" returned: 0 in 0.780s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:41:40 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-118d9585-5214-4101-ac42-cf101753924f tempest-VolumeSnapshotQuotasNegativeTestJSON-43109603 None] Lock "cinder-quobyte-4aa0b86f-9865-49f3-8911-caade952261d" released by "_delete_snapshot" :: held 3.870s {{(pid=92060) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 04:41:40 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-118d9585-5214-4101-ac42-cf101753924f tempest-VolumeSnapshotQuotasNegativeTestJSON-43109603 None] Lock "cinder-quobyte-8ff39ee1-6d15-4b8f-bd4d-8fbe19447d8b" released by "delete_snapshot" :: held 3.930s {{(pid=92060) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 04:41:40 devstack cinder-volume[92060]: DEBUG cinder.quota [None req-118d9585-5214-4101-ac42-cf101753924f tempest-VolumeSnapshotQuotasNegativeTestJSON-43109603 None] Created reservations ['348eca11-7715-42a9-9329-31a933f8e46f', 'd78e4c42-9490-47b9-a149-ff1928c44619', '8fc86289-c595-4821-bd19-a101cf702178', '9d887e44-5fa1-467a-96d8-1ed60da51e56'] {{(pid=92060) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 17 04:41:40 devstack cinder-volume[92060]: INFO cinder.volume.manager [None req-118d9585-5214-4101-ac42-cf101753924f tempest-VolumeSnapshotQuotasNegativeTestJSON-43109603 None] Delete snapshot completed successfully. Jun 17 04:41:40 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-118d9585-5214-4101-ac42-cf101753924f tempest-VolumeSnapshotQuotasNegativeTestJSON-43109603 None] Lock "cinder-4aa0b86f-9865-49f3-8911-caade952261d-delete_snapshot" released by "delete_snapshot" :: held 4.108s {{(pid=92060) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 04:41:40 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-98a139ef-056d-42ec-838e-bfcf9c647156 tempest-VolumeSnapshotQuotasNegativeTestJSON-43109603 None] Acquiring lock "cinder-8ff39ee1-6d15-4b8f-bd4d-8fbe19447d8b-delete_volume" by "delete_volume" {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 04:41:40 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-98a139ef-056d-42ec-838e-bfcf9c647156 tempest-VolumeSnapshotQuotasNegativeTestJSON-43109603 None] Lock "cinder-8ff39ee1-6d15-4b8f-bd4d-8fbe19447d8b-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 04:41:40 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-98a139ef-056d-42ec-838e-bfcf9c647156 tempest-VolumeSnapshotQuotasNegativeTestJSON-43109603 None] Acquiring lock "cinder-quobyte-8ff39ee1-6d15-4b8f-bd4d-8fbe19447d8b" by "delete_volume" {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 04:41:40 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-98a139ef-056d-42ec-838e-bfcf9c647156 tempest-VolumeSnapshotQuotasNegativeTestJSON-43109603 None] Lock "cinder-quobyte-8ff39ee1-6d15-4b8f-bd4d-8fbe19447d8b" acquired by "delete_volume" :: waited 0.027s {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 04:41:40 devstack cinder-volume[92060]: DEBUG oslo.privsep.daemon [-] privsep: reply[13c7bf6a-ae04-46c5-8ae7-788784b129ac]: (4, 'qcow2') {{(pid=93130) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 04:41:40 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-98a139ef-056d-42ec-838e-bfcf9c647156 tempest-VolumeSnapshotQuotasNegativeTestJSON-43109603 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-8ff39ee1-6d15-4b8f-bd4d-8fbe19447d8b {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:41:41 devstack sudo[98770]: pam_unix(sudo:session): session closed for user root Jun 17 04:41:41 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-65a6ed75-4ca2-419f-8197-1ecf3bef6376 tempest-AttachVolumeShelveTestJSON-134363980 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a" returned: 0 in 0.859s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:41:41 devstack cinder-volume[92060]: DEBUG cinder.manager [None req-65a6ed75-4ca2-419f-8197-1ecf3bef6376 tempest-AttachVolumeShelveTestJSON-134363980 None] Notifying Schedulers of capabilities ... {{(pid=92060) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 17 04:41:41 devstack cinder-volume[92060]: INFO cinder.volume.manager [None req-65a6ed75-4ca2-419f-8197-1ecf3bef6376 tempest-AttachVolumeShelveTestJSON-134363980 None] Deleted volume successfully. Jun 17 04:41:41 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-65a6ed75-4ca2-419f-8197-1ecf3bef6376 tempest-AttachVolumeShelveTestJSON-134363980 None] Lock "cinder-bf2eca3e-8c5a-4863-bbb8-1003435f17a2-delete_volume" released by "delete_volume" :: held 2.678s {{(pid=92060) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 04:41:41 devstack sudo[98774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-8ff39ee1-6d15-4b8f-bd4d-8fbe19447d8b Jun 17 04:41:41 devstack sudo[98774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:41:41 devstack sudo[98774]: pam_unix(sudo:session): session closed for user root Jun 17 04:41:41 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-98a139ef-056d-42ec-838e-bfcf9c647156 tempest-VolumeSnapshotQuotasNegativeTestJSON-43109603 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-8ff39ee1-6d15-4b8f-bd4d-8fbe19447d8b" returned: 0 in 0.926s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:41:41 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-98a139ef-056d-42ec-838e-bfcf9c647156 tempest-VolumeSnapshotQuotasNegativeTestJSON-43109603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-8ff39ee1-6d15-4b8f-bd4d-8fbe19447d8b {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:41:41 devstack sudo[98780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-8ff39ee1-6d15-4b8f-bd4d-8fbe19447d8b Jun 17 04:41:41 devstack sudo[98780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:41:42 devstack sudo[98780]: pam_unix(sudo:session): session closed for user root Jun 17 04:41:42 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-98a139ef-056d-42ec-838e-bfcf9c647156 tempest-VolumeSnapshotQuotasNegativeTestJSON-43109603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-8ff39ee1-6d15-4b8f-bd4d-8fbe19447d8b" returned: 0 in 0.655s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:41:42 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-98a139ef-056d-42ec-838e-bfcf9c647156 tempest-VolumeSnapshotQuotasNegativeTestJSON-43109603 None] Lock "cinder-quobyte-8ff39ee1-6d15-4b8f-bd4d-8fbe19447d8b" released by "delete_volume" :: held 1.673s {{(pid=92060) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 04:41:42 devstack cinder-volume[92060]: DEBUG cinder.quota [None req-98a139ef-056d-42ec-838e-bfcf9c647156 tempest-VolumeSnapshotQuotasNegativeTestJSON-43109603 None] Created reservations ['2aa0db31-3482-4ff1-ac53-ff98641ccffa', 'e0fd8496-7a4b-4bbe-9180-ea45e753f95c', '61c2a92e-192c-4cc0-9300-525b71d0e4a4', '74c4748a-c9ea-4b98-8a47-eb61c01178ef'] {{(pid=92060) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 17 04:41:42 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-98a139ef-056d-42ec-838e-bfcf9c647156 tempest-VolumeSnapshotQuotasNegativeTestJSON-43109603 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 04:41:42 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-98a139ef-056d-42ec-838e-bfcf9c647156 tempest-VolumeSnapshotQuotasNegativeTestJSON-43109603 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 04:41:42 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-98a139ef-056d-42ec-838e-bfcf9c647156 tempest-VolumeSnapshotQuotasNegativeTestJSON-43109603 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588': None} {{(pid=92060) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 17 04:41:42 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-98a139ef-056d-42ec-838e-bfcf9c647156 tempest-VolumeSnapshotQuotasNegativeTestJSON-43109603 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588'] {{(pid=92060) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 17 04:41:42 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-98a139ef-056d-42ec-838e-bfcf9c647156 tempest-VolumeSnapshotQuotasNegativeTestJSON-43109603 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 04:41:42 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-98a139ef-056d-42ec-838e-bfcf9c647156 tempest-VolumeSnapshotQuotasNegativeTestJSON-43109603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:41:42 devstack sudo[98783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a Jun 17 04:41:42 devstack sudo[98783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:41:43 devstack sudo[98783]: pam_unix(sudo:session): session closed for user root Jun 17 04:41:43 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-98a139ef-056d-42ec-838e-bfcf9c647156 tempest-VolumeSnapshotQuotasNegativeTestJSON-43109603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a" returned: 0 in 0.807s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:41:43 devstack cinder-volume[92060]: DEBUG cinder.manager [None req-98a139ef-056d-42ec-838e-bfcf9c647156 tempest-VolumeSnapshotQuotasNegativeTestJSON-43109603 None] Notifying Schedulers of capabilities ... {{(pid=92060) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 17 04:41:43 devstack cinder-volume[92060]: INFO cinder.volume.manager [None req-98a139ef-056d-42ec-838e-bfcf9c647156 tempest-VolumeSnapshotQuotasNegativeTestJSON-43109603 None] Deleted volume successfully. Jun 17 04:41:43 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-98a139ef-056d-42ec-838e-bfcf9c647156 tempest-VolumeSnapshotQuotasNegativeTestJSON-43109603 None] Lock "cinder-8ff39ee1-6d15-4b8f-bd4d-8fbe19447d8b-delete_volume" released by "delete_volume" :: held 2.776s {{(pid=92060) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 04:41:44 devstack cinder-volume[92060]: DEBUG cinder.volume.flows.manager.create_volume [None req-9f964fba-7665-40f2-88be-50f6c5a7204d tempest-VolumesListAdminTestJSON-521676851 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92060) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 17 04:41:44 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-9f964fba-7665-40f2-88be-50f6c5a7204d tempest-VolumesListAdminTestJSON-521676851 None] Flow 'volume_create_manager' (3541cc68-85d2-4169-bd77-9bceb79bf3a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 17 04:41:44 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-9f964fba-7665-40f2-88be-50f6c5a7204d tempest-VolumesListAdminTestJSON-521676851 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8d7b3455-6a96-4a2c-928b-0cdc7160e900) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:41:44 devstack cinder-volume[92060]: DEBUG oslo_service.periodic_task [None req-60d279ad-ad8c-4d36-a4b8-f593e74fb922 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=92060) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 17 04:41:44 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-60d279ad-ad8c-4d36-a4b8-f593e74fb922 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 04:41:44 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-60d279ad-ad8c-4d36-a4b8-f593e74fb922 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 04:41:44 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-60d279ad-ad8c-4d36-a4b8-f593e74fb922 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588': None} {{(pid=92060) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 17 04:41:44 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-60d279ad-ad8c-4d36-a4b8-f593e74fb922 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588'] {{(pid=92060) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 17 04:41:44 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-60d279ad-ad8c-4d36-a4b8-f593e74fb922 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 04:41:44 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-60d279ad-ad8c-4d36-a4b8-f593e74fb922 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:41:44 devstack sudo[98879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a Jun 17 04:41:44 devstack sudo[98879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:41:44 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-9f964fba-7665-40f2-88be-50f6c5a7204d tempest-VolumesListAdminTestJSON-521676851 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8d7b3455-6a96-4a2c-928b-0cdc7160e900) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-17T02:41:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-200989369',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=01be3810-b641-494d-aae8-38e387256c02,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='49c232cdccf64c938086dfad17047b88',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T02:41:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T02:41:45Z,use_quota=True,user_id='88f21d6493e54c51953de6a6c261e110',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aad9ce24-93f9-41a6-baa1-5125964f96d1),volume_type_id=aad9ce24-93f9-41a6-baa1-5125964f96d1)' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:41:44 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-9f964fba-7665-40f2-88be-50f6c5a7204d tempest-VolumesListAdminTestJSON-521676851 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (23f61ee9-9480-48de-9a1a-ad99d9ade8c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:41:44 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-9f964fba-7665-40f2-88be-50f6c5a7204d tempest-VolumesListAdminTestJSON-521676851 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (23f61ee9-9480-48de-9a1a-ad99d9ade8c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:41:44 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-9f964fba-7665-40f2-88be-50f6c5a7204d tempest-VolumesListAdminTestJSON-521676851 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (da2a8df7-25b0-4fb9-a984-1973b4609a3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:41:44 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-9f964fba-7665-40f2-88be-50f6c5a7204d tempest-VolumesListAdminTestJSON-521676851 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (da2a8df7-25b0-4fb9-a984-1973b4609a3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '01be3810-b641-494d-aae8-38e387256c02', 'volume_name': 'volume-01be3810-b641-494d-aae8-38e387256c02', 'volume_size': 1}' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:41:45 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-9f964fba-7665-40f2-88be-50f6c5a7204d tempest-VolumesListAdminTestJSON-521676851 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e82db448-1a45-4795-8825-f2e21f7722fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:41:45 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-9f964fba-7665-40f2-88be-50f6c5a7204d tempest-VolumesListAdminTestJSON-521676851 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e82db448-1a45-4795-8825-f2e21f7722fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:41:45 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-9f964fba-7665-40f2-88be-50f6c5a7204d tempest-VolumesListAdminTestJSON-521676851 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (23aae5d5-6608-47d4-947c-66854d1737c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:41:45 devstack cinder-volume[92060]: INFO cinder.volume.flows.manager.create_volume [None req-9f964fba-7665-40f2-88be-50f6c5a7204d tempest-VolumesListAdminTestJSON-521676851 None] Volume 01be3810-b641-494d-aae8-38e387256c02: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-01be3810-b641-494d-aae8-38e387256c02', 'volume_size': 1} Jun 17 04:41:45 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-9f964fba-7665-40f2-88be-50f6c5a7204d tempest-VolumesListAdminTestJSON-521676851 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 04:41:45 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-9f964fba-7665-40f2-88be-50f6c5a7204d tempest-VolumesListAdminTestJSON-521676851 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 04:41:45 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-9f964fba-7665-40f2-88be-50f6c5a7204d tempest-VolumesListAdminTestJSON-521676851 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-17T02:41:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-200989369',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=01be3810-b641-494d-aae8-38e387256c02,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='49c232cdccf64c938086dfad17047b88',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T02:41:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T02:41:45Z,use_quota=True,user_id='88f21d6493e54c51953de6a6c261e110',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aad9ce24-93f9-41a6-baa1-5125964f96d1),volume_type_id=aad9ce24-93f9-41a6-baa1-5125964f96d1)}" {{(pid=92060) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 17 04:41:45 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.remotefs [None req-9f964fba-7665-40f2-88be-50f6c5a7204d tempest-VolumesListAdminTestJSON-521676851 None] Creating volume 01be3810-b641-494d-aae8-38e387256c02 {{(pid=92060) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 17 04:41:45 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-9f964fba-7665-40f2-88be-50f6c5a7204d tempest-VolumesListAdminTestJSON-521676851 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 04:41:45 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-9f964fba-7665-40f2-88be-50f6c5a7204d tempest-VolumesListAdminTestJSON-521676851 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 04:41:45 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-9f964fba-7665-40f2-88be-50f6c5a7204d tempest-VolumesListAdminTestJSON-521676851 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588': None} {{(pid=92060) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 17 04:41:45 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-9f964fba-7665-40f2-88be-50f6c5a7204d tempest-VolumesListAdminTestJSON-521676851 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588'] {{(pid=92060) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 17 04:41:45 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-9f964fba-7665-40f2-88be-50f6c5a7204d tempest-VolumesListAdminTestJSON-521676851 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 04:41:45 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-9f964fba-7665-40f2-88be-50f6c5a7204d tempest-VolumesListAdminTestJSON-521676851 None] Selected osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588 as target Quobyte volume. {{(pid=92060) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 17 04:41:45 devstack cinder-volume[92060]: INFO cinder.volume.drivers.remotefs [None req-9f964fba-7665-40f2-88be-50f6c5a7204d tempest-VolumesListAdminTestJSON-521676851 None] casted to osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588 Jun 17 04:41:45 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-9f964fba-7665-40f2-88be-50f6c5a7204d tempest-VolumesListAdminTestJSON-521676851 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-01be3810-b641-494d-aae8-38e387256c02 1073741824 {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:41:45 devstack sudo[98881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-01be3810-b641-494d-aae8-38e387256c02 1073741824 Jun 17 04:41:45 devstack sudo[98881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:41:45 devstack sudo[98879]: pam_unix(sudo:session): session closed for user root Jun 17 04:41:45 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-60d279ad-ad8c-4d36-a4b8-f593e74fb922 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a" returned: 0 in 0.768s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:41:45 devstack cinder-volume[92060]: DEBUG cinder.manager [None req-60d279ad-ad8c-4d36-a4b8-f593e74fb922 None None] Notifying Schedulers of capabilities ... {{(pid=92060) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 17 04:41:45 devstack cinder-volume[92060]: DEBUG oslo_service.periodic_task [None req-60d279ad-ad8c-4d36-a4b8-f593e74fb922 None None] Running periodic task VolumeManager._thread_info {{(pid=92060) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 17 04:41:45 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-60d279ad-ad8c-4d36-a4b8-f593e74fb922 None None] thread count: 8 {{(pid=92060) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 17 04:41:45 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-60d279ad-ad8c-4d36-a4b8-f593e74fb922 None None] thread info: [<_MainThread(MainThread, started 130061806440576)>, , , , , , , ] {{(pid=92060) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 17 04:41:46 devstack sudo[98881]: pam_unix(sudo:session): session closed for user root Jun 17 04:41:46 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-9f964fba-7665-40f2-88be-50f6c5a7204d tempest-VolumesListAdminTestJSON-521676851 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-01be3810-b641-494d-aae8-38e387256c02 1073741824" returned: 0 in 1.031s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:41:46 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-9f964fba-7665-40f2-88be-50f6c5a7204d tempest-VolumesListAdminTestJSON-521676851 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-01be3810-b641-494d-aae8-38e387256c02 {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:41:46 devstack sudo[98893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-01be3810-b641-494d-aae8-38e387256c02 Jun 17 04:41:46 devstack sudo[98893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:41:46 devstack sudo[98893]: pam_unix(sudo:session): session closed for user root Jun 17 04:41:46 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-9f964fba-7665-40f2-88be-50f6c5a7204d tempest-VolumesListAdminTestJSON-521676851 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-01be3810-b641-494d-aae8-38e387256c02" returned: 0 in 0.725s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:41:46 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-9f964fba-7665-40f2-88be-50f6c5a7204d tempest-VolumesListAdminTestJSON-521676851 None] <== create_volume: return (1823ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588'} {{(pid=92060) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 17 04:41:46 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-9f964fba-7665-40f2-88be-50f6c5a7204d tempest-VolumesListAdminTestJSON-521676851 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.829s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 04:41:46 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-9f964fba-7665-40f2-88be-50f6c5a7204d tempest-VolumesListAdminTestJSON-521676851 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (23aae5d5-6608-47d4-947c-66854d1737c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-01be3810-b641-494d-aae8-38e387256c02', 'volume_size': 1}' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:41:46 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-9f964fba-7665-40f2-88be-50f6c5a7204d tempest-VolumesListAdminTestJSON-521676851 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bbf7813e-16c7-4a1b-ad55-c89ac99f813d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:41:46 devstack cinder-volume[92060]: INFO cinder.volume.flows.manager.create_volume [None req-9f964fba-7665-40f2-88be-50f6c5a7204d tempest-VolumesListAdminTestJSON-521676851 None] Volume volume-01be3810-b641-494d-aae8-38e387256c02 (01be3810-b641-494d-aae8-38e387256c02): created successfully Jun 17 04:41:46 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-9f964fba-7665-40f2-88be-50f6c5a7204d tempest-VolumesListAdminTestJSON-521676851 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bbf7813e-16c7-4a1b-ad55-c89ac99f813d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:41:46 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-9f964fba-7665-40f2-88be-50f6c5a7204d tempest-VolumesListAdminTestJSON-521676851 None] Flow 'volume_create_manager' (3541cc68-85d2-4169-bd77-9bceb79bf3a8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92060) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 17 04:41:46 devstack cinder-volume[92060]: INFO cinder.volume.manager [None req-9f964fba-7665-40f2-88be-50f6c5a7204d tempest-VolumesListAdminTestJSON-521676851 None] Created volume successfully. Jun 17 04:41:47 devstack cinder-volume[92060]: DEBUG cinder.volume.flows.manager.create_volume [None req-133852ea-f3c1-49d2-97e1-a254af71f57d tempest-VolumesListAdminTestJSON-521676851 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92060) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 17 04:41:47 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-133852ea-f3c1-49d2-97e1-a254af71f57d tempest-VolumesListAdminTestJSON-521676851 None] Flow 'volume_create_manager' (1da68518-86aa-48ec-9865-54294d90cd5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 17 04:41:47 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-133852ea-f3c1-49d2-97e1-a254af71f57d tempest-VolumesListAdminTestJSON-521676851 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d524f080-1c59-44c7-9d46-d361f4edf043) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:41:47 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-133852ea-f3c1-49d2-97e1-a254af71f57d tempest-VolumesListAdminTestJSON-521676851 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d524f080-1c59-44c7-9d46-d361f4edf043) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-17T02:41:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-869748935',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4ac0bba8-38ff-4045-b42f-9612a20941d1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='49c232cdccf64c938086dfad17047b88',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T02:41:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T02:41:48Z,use_quota=True,user_id='88f21d6493e54c51953de6a6c261e110',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aad9ce24-93f9-41a6-baa1-5125964f96d1),volume_type_id=aad9ce24-93f9-41a6-baa1-5125964f96d1)' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:41:47 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-133852ea-f3c1-49d2-97e1-a254af71f57d tempest-VolumesListAdminTestJSON-521676851 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6c1e7128-4c03-4e77-b05b-c7586674a98e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:41:47 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-133852ea-f3c1-49d2-97e1-a254af71f57d tempest-VolumesListAdminTestJSON-521676851 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6c1e7128-4c03-4e77-b05b-c7586674a98e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:41:47 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-133852ea-f3c1-49d2-97e1-a254af71f57d tempest-VolumesListAdminTestJSON-521676851 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1e031673-7f60-41f4-aa96-727b1a6e40a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:41:47 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-133852ea-f3c1-49d2-97e1-a254af71f57d tempest-VolumesListAdminTestJSON-521676851 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1e031673-7f60-41f4-aa96-727b1a6e40a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4ac0bba8-38ff-4045-b42f-9612a20941d1', 'volume_name': 'volume-4ac0bba8-38ff-4045-b42f-9612a20941d1', 'volume_size': 1}' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:41:47 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-133852ea-f3c1-49d2-97e1-a254af71f57d tempest-VolumesListAdminTestJSON-521676851 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4984e0a2-e310-4659-a73d-667de1e7c15e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:41:47 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-133852ea-f3c1-49d2-97e1-a254af71f57d tempest-VolumesListAdminTestJSON-521676851 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4984e0a2-e310-4659-a73d-667de1e7c15e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:41:47 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-133852ea-f3c1-49d2-97e1-a254af71f57d tempest-VolumesListAdminTestJSON-521676851 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6396dd97-6e09-40c4-a6d5-f9cb08fef3e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:41:47 devstack cinder-volume[92060]: INFO cinder.volume.flows.manager.create_volume [None req-133852ea-f3c1-49d2-97e1-a254af71f57d tempest-VolumesListAdminTestJSON-521676851 None] Volume 4ac0bba8-38ff-4045-b42f-9612a20941d1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4ac0bba8-38ff-4045-b42f-9612a20941d1', 'volume_size': 1} Jun 17 04:41:47 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-133852ea-f3c1-49d2-97e1-a254af71f57d tempest-VolumesListAdminTestJSON-521676851 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 04:41:47 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-133852ea-f3c1-49d2-97e1-a254af71f57d tempest-VolumesListAdminTestJSON-521676851 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 04:41:47 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-133852ea-f3c1-49d2-97e1-a254af71f57d tempest-VolumesListAdminTestJSON-521676851 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-17T02:41:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-869748935',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4ac0bba8-38ff-4045-b42f-9612a20941d1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='49c232cdccf64c938086dfad17047b88',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T02:41:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T02:41:48Z,use_quota=True,user_id='88f21d6493e54c51953de6a6c261e110',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aad9ce24-93f9-41a6-baa1-5125964f96d1),volume_type_id=aad9ce24-93f9-41a6-baa1-5125964f96d1)}" {{(pid=92060) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 17 04:41:47 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.remotefs [None req-133852ea-f3c1-49d2-97e1-a254af71f57d tempest-VolumesListAdminTestJSON-521676851 None] Creating volume 4ac0bba8-38ff-4045-b42f-9612a20941d1 {{(pid=92060) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 17 04:41:47 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-133852ea-f3c1-49d2-97e1-a254af71f57d tempest-VolumesListAdminTestJSON-521676851 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 04:41:47 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-133852ea-f3c1-49d2-97e1-a254af71f57d tempest-VolumesListAdminTestJSON-521676851 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 04:41:47 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-133852ea-f3c1-49d2-97e1-a254af71f57d tempest-VolumesListAdminTestJSON-521676851 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588': None} {{(pid=92060) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 17 04:41:47 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-133852ea-f3c1-49d2-97e1-a254af71f57d tempest-VolumesListAdminTestJSON-521676851 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588'] {{(pid=92060) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 17 04:41:47 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-133852ea-f3c1-49d2-97e1-a254af71f57d tempest-VolumesListAdminTestJSON-521676851 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 04:41:47 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-133852ea-f3c1-49d2-97e1-a254af71f57d tempest-VolumesListAdminTestJSON-521676851 None] Selected osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588 as target Quobyte volume. {{(pid=92060) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 17 04:41:47 devstack cinder-volume[92060]: INFO cinder.volume.drivers.remotefs [None req-133852ea-f3c1-49d2-97e1-a254af71f57d tempest-VolumesListAdminTestJSON-521676851 None] casted to osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588 Jun 17 04:41:47 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-133852ea-f3c1-49d2-97e1-a254af71f57d tempest-VolumesListAdminTestJSON-521676851 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-4ac0bba8-38ff-4045-b42f-9612a20941d1 1073741824 {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:41:47 devstack sudo[99034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-4ac0bba8-38ff-4045-b42f-9612a20941d1 1073741824 Jun 17 04:41:47 devstack sudo[99034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:41:49 devstack sudo[99034]: pam_unix(sudo:session): session closed for user root Jun 17 04:41:49 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-133852ea-f3c1-49d2-97e1-a254af71f57d tempest-VolumesListAdminTestJSON-521676851 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-4ac0bba8-38ff-4045-b42f-9612a20941d1 1073741824" returned: 0 in 1.512s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:41:49 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-133852ea-f3c1-49d2-97e1-a254af71f57d tempest-VolumesListAdminTestJSON-521676851 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-4ac0bba8-38ff-4045-b42f-9612a20941d1 {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:41:49 devstack sudo[99289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-4ac0bba8-38ff-4045-b42f-9612a20941d1 Jun 17 04:41:49 devstack sudo[99289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:41:50 devstack sudo[99289]: pam_unix(sudo:session): session closed for user root Jun 17 04:41:50 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-133852ea-f3c1-49d2-97e1-a254af71f57d tempest-VolumesListAdminTestJSON-521676851 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-4ac0bba8-38ff-4045-b42f-9612a20941d1" returned: 0 in 0.934s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:41:50 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-133852ea-f3c1-49d2-97e1-a254af71f57d tempest-VolumesListAdminTestJSON-521676851 None] <== create_volume: return (2519ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588'} {{(pid=92060) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 17 04:41:50 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-133852ea-f3c1-49d2-97e1-a254af71f57d tempest-VolumesListAdminTestJSON-521676851 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.527s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 04:41:50 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-133852ea-f3c1-49d2-97e1-a254af71f57d tempest-VolumesListAdminTestJSON-521676851 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6396dd97-6e09-40c4-a6d5-f9cb08fef3e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4ac0bba8-38ff-4045-b42f-9612a20941d1', 'volume_size': 1}' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:41:50 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-133852ea-f3c1-49d2-97e1-a254af71f57d tempest-VolumesListAdminTestJSON-521676851 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (86504858-f36d-4512-b154-4d2beb506f71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:41:50 devstack cinder-volume[92060]: INFO cinder.volume.flows.manager.create_volume [None req-133852ea-f3c1-49d2-97e1-a254af71f57d tempest-VolumesListAdminTestJSON-521676851 None] Volume volume-4ac0bba8-38ff-4045-b42f-9612a20941d1 (4ac0bba8-38ff-4045-b42f-9612a20941d1): created successfully Jun 17 04:41:50 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-133852ea-f3c1-49d2-97e1-a254af71f57d tempest-VolumesListAdminTestJSON-521676851 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (86504858-f36d-4512-b154-4d2beb506f71) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:41:50 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-133852ea-f3c1-49d2-97e1-a254af71f57d tempest-VolumesListAdminTestJSON-521676851 None] Flow 'volume_create_manager' (1da68518-86aa-48ec-9865-54294d90cd5d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92060) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 17 04:41:50 devstack cinder-volume[92060]: INFO cinder.volume.manager [None req-133852ea-f3c1-49d2-97e1-a254af71f57d tempest-VolumesListAdminTestJSON-521676851 None] Created volume successfully. Jun 17 04:41:50 devstack cinder-volume[92060]: DEBUG cinder.volume.flows.manager.create_volume [req-e227d398-93b3-4d62-b628-444e3c537f3b req-2ecce15d-deab-4a7f-9eac-19414e31b0dd tempest-VolumesGetTestJSON-893491285 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92060) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 17 04:41:50 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [req-e227d398-93b3-4d62-b628-444e3c537f3b req-2ecce15d-deab-4a7f-9eac-19414e31b0dd tempest-VolumesGetTestJSON-893491285 None] Flow 'volume_create_manager' (f8d2903d-3de6-432f-a6a2-0ed0e54ee638) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 17 04:41:50 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [req-e227d398-93b3-4d62-b628-444e3c537f3b req-2ecce15d-deab-4a7f-9eac-19414e31b0dd tempest-VolumesGetTestJSON-893491285 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ec8ed369-ba70-413f-a2b1-82684c2c3cf8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:41:51 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [req-e227d398-93b3-4d62-b628-444e3c537f3b req-2ecce15d-deab-4a7f-9eac-19414e31b0dd tempest-VolumesGetTestJSON-893491285 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ec8ed369-ba70-413f-a2b1-82684c2c3cf8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-17T02:41:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-358460628',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ae94a402-3f02-4fe2-846e-5ac43ddcc644,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='dea1ffe19b0b41949fd36671f182ef96',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T02:41:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T02:41:51Z,use_quota=True,user_id='0d50c9d5ba2742059ed742964fd29bf1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aad9ce24-93f9-41a6-baa1-5125964f96d1),volume_type_id=aad9ce24-93f9-41a6-baa1-5125964f96d1)' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:41:51 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [req-e227d398-93b3-4d62-b628-444e3c537f3b req-2ecce15d-deab-4a7f-9eac-19414e31b0dd tempest-VolumesGetTestJSON-893491285 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0b13a3dd-edc7-47b7-bc78-25c515be4a09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:41:51 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [req-e227d398-93b3-4d62-b628-444e3c537f3b req-2ecce15d-deab-4a7f-9eac-19414e31b0dd tempest-VolumesGetTestJSON-893491285 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0b13a3dd-edc7-47b7-bc78-25c515be4a09) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:41:51 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [req-e227d398-93b3-4d62-b628-444e3c537f3b req-2ecce15d-deab-4a7f-9eac-19414e31b0dd tempest-VolumesGetTestJSON-893491285 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (58aa363d-11a5-4fce-af32-2321ba9fa80f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:41:51 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [req-e227d398-93b3-4d62-b628-444e3c537f3b req-2ecce15d-deab-4a7f-9eac-19414e31b0dd tempest-VolumesGetTestJSON-893491285 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (58aa363d-11a5-4fce-af32-2321ba9fa80f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ae94a402-3f02-4fe2-846e-5ac43ddcc644', 'volume_name': 'volume-ae94a402-3f02-4fe2-846e-5ac43ddcc644', 'volume_size': 1}' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:41:51 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [req-e227d398-93b3-4d62-b628-444e3c537f3b req-2ecce15d-deab-4a7f-9eac-19414e31b0dd tempest-VolumesGetTestJSON-893491285 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0d99097d-d8b7-4277-b14e-311569862e1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:41:51 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [req-e227d398-93b3-4d62-b628-444e3c537f3b req-2ecce15d-deab-4a7f-9eac-19414e31b0dd tempest-VolumesGetTestJSON-893491285 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0d99097d-d8b7-4277-b14e-311569862e1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:41:51 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [req-e227d398-93b3-4d62-b628-444e3c537f3b req-2ecce15d-deab-4a7f-9eac-19414e31b0dd tempest-VolumesGetTestJSON-893491285 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (90e80274-cd3f-41eb-aa54-86ecea2cb54c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:41:51 devstack cinder-volume[92060]: INFO cinder.volume.flows.manager.create_volume [req-e227d398-93b3-4d62-b628-444e3c537f3b req-2ecce15d-deab-4a7f-9eac-19414e31b0dd tempest-VolumesGetTestJSON-893491285 None] Volume ae94a402-3f02-4fe2-846e-5ac43ddcc644: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ae94a402-3f02-4fe2-846e-5ac43ddcc644', 'volume_size': 1} Jun 17 04:41:51 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [req-e227d398-93b3-4d62-b628-444e3c537f3b req-2ecce15d-deab-4a7f-9eac-19414e31b0dd tempest-VolumesGetTestJSON-893491285 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 04:41:51 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [req-e227d398-93b3-4d62-b628-444e3c537f3b req-2ecce15d-deab-4a7f-9eac-19414e31b0dd tempest-VolumesGetTestJSON-893491285 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 04:41:51 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [req-e227d398-93b3-4d62-b628-444e3c537f3b req-2ecce15d-deab-4a7f-9eac-19414e31b0dd tempest-VolumesGetTestJSON-893491285 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-17T02:41:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-358460628',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ae94a402-3f02-4fe2-846e-5ac43ddcc644,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='dea1ffe19b0b41949fd36671f182ef96',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T02:41:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T02:41:51Z,use_quota=True,user_id='0d50c9d5ba2742059ed742964fd29bf1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aad9ce24-93f9-41a6-baa1-5125964f96d1),volume_type_id=aad9ce24-93f9-41a6-baa1-5125964f96d1)}" {{(pid=92060) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 17 04:41:51 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.remotefs [req-e227d398-93b3-4d62-b628-444e3c537f3b req-2ecce15d-deab-4a7f-9eac-19414e31b0dd tempest-VolumesGetTestJSON-893491285 None] Creating volume ae94a402-3f02-4fe2-846e-5ac43ddcc644 {{(pid=92060) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 17 04:41:51 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [req-e227d398-93b3-4d62-b628-444e3c537f3b req-2ecce15d-deab-4a7f-9eac-19414e31b0dd tempest-VolumesGetTestJSON-893491285 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 04:41:51 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [req-e227d398-93b3-4d62-b628-444e3c537f3b req-2ecce15d-deab-4a7f-9eac-19414e31b0dd tempest-VolumesGetTestJSON-893491285 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 04:41:51 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [req-e227d398-93b3-4d62-b628-444e3c537f3b req-2ecce15d-deab-4a7f-9eac-19414e31b0dd tempest-VolumesGetTestJSON-893491285 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588': None} {{(pid=92060) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 17 04:41:51 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [req-e227d398-93b3-4d62-b628-444e3c537f3b req-2ecce15d-deab-4a7f-9eac-19414e31b0dd tempest-VolumesGetTestJSON-893491285 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588'] {{(pid=92060) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 17 04:41:51 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [req-e227d398-93b3-4d62-b628-444e3c537f3b req-2ecce15d-deab-4a7f-9eac-19414e31b0dd tempest-VolumesGetTestJSON-893491285 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 04:41:51 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [req-e227d398-93b3-4d62-b628-444e3c537f3b req-2ecce15d-deab-4a7f-9eac-19414e31b0dd tempest-VolumesGetTestJSON-893491285 None] Selected osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588 as target Quobyte volume. {{(pid=92060) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 17 04:41:51 devstack cinder-volume[92060]: INFO cinder.volume.drivers.remotefs [req-e227d398-93b3-4d62-b628-444e3c537f3b req-2ecce15d-deab-4a7f-9eac-19414e31b0dd tempest-VolumesGetTestJSON-893491285 None] casted to osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588 Jun 17 04:41:51 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [req-e227d398-93b3-4d62-b628-444e3c537f3b req-2ecce15d-deab-4a7f-9eac-19414e31b0dd tempest-VolumesGetTestJSON-893491285 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-ae94a402-3f02-4fe2-846e-5ac43ddcc644 1073741824 {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:41:51 devstack sudo[99295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-ae94a402-3f02-4fe2-846e-5ac43ddcc644 1073741824 Jun 17 04:41:51 devstack sudo[99295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:41:51 devstack cinder-volume[92060]: DEBUG cinder.volume.flows.manager.create_volume [None req-8dbd9ded-ab41-4f5b-badf-c016ddd81fb9 tempest-VolumeTypesAccessTest-1216824825 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92060) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 17 04:41:51 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-8dbd9ded-ab41-4f5b-badf-c016ddd81fb9 tempest-VolumeTypesAccessTest-1216824825 None] Flow 'volume_create_manager' (2a0f8a89-505e-4b20-8762-e11e6e684710) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 17 04:41:51 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-8dbd9ded-ab41-4f5b-badf-c016ddd81fb9 tempest-VolumeTypesAccessTest-1216824825 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3e783948-e143-4504-b43d-653d8a8d4b90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:41:51 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-8dbd9ded-ab41-4f5b-badf-c016ddd81fb9 tempest-VolumeTypesAccessTest-1216824825 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3e783948-e143-4504-b43d-653d8a8d4b90) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-17T02:41:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-1332801626',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=795153da-34d4-4f59-b0f3-72ac577e3ad8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='186858fcf57943bc81f3391376c25da3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T02:41:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T02:41:51Z,use_quota=True,user_id='543753a5495f43b988513840c0d30faa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0f5afa90-b565-4dde-a8c2-5980c64092ab),volume_type_id=0f5afa90-b565-4dde-a8c2-5980c64092ab)' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:41:51 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-8dbd9ded-ab41-4f5b-badf-c016ddd81fb9 tempest-VolumeTypesAccessTest-1216824825 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6117b238-4aa7-43ca-ab8d-534179ff787c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:41:51 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-8dbd9ded-ab41-4f5b-badf-c016ddd81fb9 tempest-VolumeTypesAccessTest-1216824825 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6117b238-4aa7-43ca-ab8d-534179ff787c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:41:51 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-8dbd9ded-ab41-4f5b-badf-c016ddd81fb9 tempest-VolumeTypesAccessTest-1216824825 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3455ece1-b938-45ec-8745-92e270e27f2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:41:51 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-8dbd9ded-ab41-4f5b-badf-c016ddd81fb9 tempest-VolumeTypesAccessTest-1216824825 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3455ece1-b938-45ec-8745-92e270e27f2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '795153da-34d4-4f59-b0f3-72ac577e3ad8', 'volume_name': 'volume-795153da-34d4-4f59-b0f3-72ac577e3ad8', 'volume_size': 1}' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:41:51 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-8dbd9ded-ab41-4f5b-badf-c016ddd81fb9 tempest-VolumeTypesAccessTest-1216824825 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (65b4ee22-adfc-4e23-82ce-f02f1c9d024f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:41:51 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-8dbd9ded-ab41-4f5b-badf-c016ddd81fb9 tempest-VolumeTypesAccessTest-1216824825 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (65b4ee22-adfc-4e23-82ce-f02f1c9d024f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:41:51 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-8dbd9ded-ab41-4f5b-badf-c016ddd81fb9 tempest-VolumeTypesAccessTest-1216824825 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (00592b66-3cc9-4878-8c48-73093375986a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:41:51 devstack cinder-volume[92060]: INFO cinder.volume.flows.manager.create_volume [None req-8dbd9ded-ab41-4f5b-badf-c016ddd81fb9 tempest-VolumeTypesAccessTest-1216824825 None] Volume 795153da-34d4-4f59-b0f3-72ac577e3ad8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-795153da-34d4-4f59-b0f3-72ac577e3ad8', 'volume_size': 1} Jun 17 04:41:51 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-8dbd9ded-ab41-4f5b-badf-c016ddd81fb9 tempest-VolumeTypesAccessTest-1216824825 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 04:41:51 devstack cinder-volume[92060]: DEBUG cinder.volume.flows.manager.create_volume [None req-eb24b3bb-7eee-4454-8f88-aec15b257c14 tempest-VolumesListAdminTestJSON-521676851 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92060) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 17 04:41:51 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-eb24b3bb-7eee-4454-8f88-aec15b257c14 tempest-VolumesListAdminTestJSON-521676851 None] Flow 'volume_create_manager' (53f2809b-f2d8-4ecd-bbb0-94937e6c834d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 17 04:41:51 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-eb24b3bb-7eee-4454-8f88-aec15b257c14 tempest-VolumesListAdminTestJSON-521676851 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fa7c3e91-c971-4606-ad03-8d2230eaafda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:41:51 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-eb24b3bb-7eee-4454-8f88-aec15b257c14 tempest-VolumesListAdminTestJSON-521676851 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fa7c3e91-c971-4606-ad03-8d2230eaafda) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-17T02:41:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-252935837',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=17ecca3f-742d-4766-92fe-7738cd40f744,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='49c232cdccf64c938086dfad17047b88',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T02:41:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T02:41:52Z,use_quota=True,user_id='88f21d6493e54c51953de6a6c261e110',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aad9ce24-93f9-41a6-baa1-5125964f96d1),volume_type_id=aad9ce24-93f9-41a6-baa1-5125964f96d1)' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:41:51 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-eb24b3bb-7eee-4454-8f88-aec15b257c14 tempest-VolumesListAdminTestJSON-521676851 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bb135a63-59dd-4e2f-847a-71f16d0e0433) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:41:51 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-eb24b3bb-7eee-4454-8f88-aec15b257c14 tempest-VolumesListAdminTestJSON-521676851 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bb135a63-59dd-4e2f-847a-71f16d0e0433) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:41:51 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-eb24b3bb-7eee-4454-8f88-aec15b257c14 tempest-VolumesListAdminTestJSON-521676851 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0314b2fb-a547-4b7e-a5ae-f30216f5aa45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:41:51 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-eb24b3bb-7eee-4454-8f88-aec15b257c14 tempest-VolumesListAdminTestJSON-521676851 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0314b2fb-a547-4b7e-a5ae-f30216f5aa45) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '17ecca3f-742d-4766-92fe-7738cd40f744', 'volume_name': 'volume-17ecca3f-742d-4766-92fe-7738cd40f744', 'volume_size': 1}' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:41:51 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-eb24b3bb-7eee-4454-8f88-aec15b257c14 tempest-VolumesListAdminTestJSON-521676851 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (372458d0-8b2d-4bc4-9671-9427593f6dfe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:41:51 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-eb24b3bb-7eee-4454-8f88-aec15b257c14 tempest-VolumesListAdminTestJSON-521676851 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (372458d0-8b2d-4bc4-9671-9427593f6dfe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:41:51 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-eb24b3bb-7eee-4454-8f88-aec15b257c14 tempest-VolumesListAdminTestJSON-521676851 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8d8cbf72-5898-40d5-b3b1-bb2270394025) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:41:51 devstack cinder-volume[92060]: INFO cinder.volume.flows.manager.create_volume [None req-eb24b3bb-7eee-4454-8f88-aec15b257c14 tempest-VolumesListAdminTestJSON-521676851 None] Volume 17ecca3f-742d-4766-92fe-7738cd40f744: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-17ecca3f-742d-4766-92fe-7738cd40f744', 'volume_size': 1} Jun 17 04:41:51 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-eb24b3bb-7eee-4454-8f88-aec15b257c14 tempest-VolumesListAdminTestJSON-521676851 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 04:41:52 devstack sudo[99295]: pam_unix(sudo:session): session closed for user root Jun 17 04:41:52 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [req-e227d398-93b3-4d62-b628-444e3c537f3b req-2ecce15d-deab-4a7f-9eac-19414e31b0dd tempest-VolumesGetTestJSON-893491285 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-ae94a402-3f02-4fe2-846e-5ac43ddcc644 1073741824" returned: 0 in 1.049s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:41:52 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [req-e227d398-93b3-4d62-b628-444e3c537f3b req-2ecce15d-deab-4a7f-9eac-19414e31b0dd tempest-VolumesGetTestJSON-893491285 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-ae94a402-3f02-4fe2-846e-5ac43ddcc644 {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:41:52 devstack sudo[99300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-ae94a402-3f02-4fe2-846e-5ac43ddcc644 Jun 17 04:41:52 devstack sudo[99300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:41:52 devstack sudo[99300]: pam_unix(sudo:session): session closed for user root Jun 17 04:41:52 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [req-e227d398-93b3-4d62-b628-444e3c537f3b req-2ecce15d-deab-4a7f-9eac-19414e31b0dd tempest-VolumesGetTestJSON-893491285 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-ae94a402-3f02-4fe2-846e-5ac43ddcc644" returned: 0 in 0.611s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:41:52 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [req-e227d398-93b3-4d62-b628-444e3c537f3b req-2ecce15d-deab-4a7f-9eac-19414e31b0dd tempest-VolumesGetTestJSON-893491285 None] <== create_volume: return (1725ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588'} {{(pid=92060) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 17 04:41:52 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [req-e227d398-93b3-4d62-b628-444e3c537f3b req-2ecce15d-deab-4a7f-9eac-19414e31b0dd tempest-VolumesGetTestJSON-893491285 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.728s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 04:41:52 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-8dbd9ded-ab41-4f5b-badf-c016ddd81fb9 tempest-VolumeTypesAccessTest-1216824825 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.370s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 04:41:52 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-8dbd9ded-ab41-4f5b-badf-c016ddd81fb9 tempest-VolumeTypesAccessTest-1216824825 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-17T02:41:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-1332801626',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=795153da-34d4-4f59-b0f3-72ac577e3ad8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='186858fcf57943bc81f3391376c25da3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T02:41:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T02:41:51Z,use_quota=True,user_id='543753a5495f43b988513840c0d30faa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0f5afa90-b565-4dde-a8c2-5980c64092ab),volume_type_id=0f5afa90-b565-4dde-a8c2-5980c64092ab)}" {{(pid=92060) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 17 04:41:52 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.remotefs [None req-8dbd9ded-ab41-4f5b-badf-c016ddd81fb9 tempest-VolumeTypesAccessTest-1216824825 None] Creating volume 795153da-34d4-4f59-b0f3-72ac577e3ad8 {{(pid=92060) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 17 04:41:52 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-8dbd9ded-ab41-4f5b-badf-c016ddd81fb9 tempest-VolumeTypesAccessTest-1216824825 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 04:41:52 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-8dbd9ded-ab41-4f5b-badf-c016ddd81fb9 tempest-VolumeTypesAccessTest-1216824825 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 04:41:52 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-8dbd9ded-ab41-4f5b-badf-c016ddd81fb9 tempest-VolumeTypesAccessTest-1216824825 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588': None} {{(pid=92060) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 17 04:41:52 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-8dbd9ded-ab41-4f5b-badf-c016ddd81fb9 tempest-VolumeTypesAccessTest-1216824825 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588'] {{(pid=92060) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 17 04:41:52 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-8dbd9ded-ab41-4f5b-badf-c016ddd81fb9 tempest-VolumeTypesAccessTest-1216824825 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 04:41:52 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-8dbd9ded-ab41-4f5b-badf-c016ddd81fb9 tempest-VolumeTypesAccessTest-1216824825 None] Selected osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588 as target Quobyte volume. {{(pid=92060) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 17 04:41:52 devstack cinder-volume[92060]: INFO cinder.volume.drivers.remotefs [None req-8dbd9ded-ab41-4f5b-badf-c016ddd81fb9 tempest-VolumeTypesAccessTest-1216824825 None] casted to osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588 Jun 17 04:41:52 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-8dbd9ded-ab41-4f5b-badf-c016ddd81fb9 tempest-VolumeTypesAccessTest-1216824825 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-795153da-34d4-4f59-b0f3-72ac577e3ad8 1073741824 {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:41:52 devstack sudo[99303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-795153da-34d4-4f59-b0f3-72ac577e3ad8 1073741824 Jun 17 04:41:52 devstack sudo[99303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:41:52 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [req-e227d398-93b3-4d62-b628-444e3c537f3b req-2ecce15d-deab-4a7f-9eac-19414e31b0dd tempest-VolumesGetTestJSON-893491285 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (90e80274-cd3f-41eb-aa54-86ecea2cb54c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ae94a402-3f02-4fe2-846e-5ac43ddcc644', 'volume_size': 1}' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:41:52 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [req-e227d398-93b3-4d62-b628-444e3c537f3b req-2ecce15d-deab-4a7f-9eac-19414e31b0dd tempest-VolumesGetTestJSON-893491285 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4b70a1f2-381f-4070-a685-f21f7fd09c15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:41:52 devstack cinder-volume[92060]: INFO cinder.volume.flows.manager.create_volume [req-e227d398-93b3-4d62-b628-444e3c537f3b req-2ecce15d-deab-4a7f-9eac-19414e31b0dd tempest-VolumesGetTestJSON-893491285 None] Volume volume-ae94a402-3f02-4fe2-846e-5ac43ddcc644 (ae94a402-3f02-4fe2-846e-5ac43ddcc644): created successfully Jun 17 04:41:52 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [req-e227d398-93b3-4d62-b628-444e3c537f3b req-2ecce15d-deab-4a7f-9eac-19414e31b0dd tempest-VolumesGetTestJSON-893491285 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4b70a1f2-381f-4070-a685-f21f7fd09c15) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:41:52 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [req-e227d398-93b3-4d62-b628-444e3c537f3b req-2ecce15d-deab-4a7f-9eac-19414e31b0dd tempest-VolumesGetTestJSON-893491285 None] Flow 'volume_create_manager' (f8d2903d-3de6-432f-a6a2-0ed0e54ee638) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92060) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 17 04:41:52 devstack cinder-volume[92060]: INFO cinder.volume.manager [req-e227d398-93b3-4d62-b628-444e3c537f3b req-2ecce15d-deab-4a7f-9eac-19414e31b0dd tempest-VolumesGetTestJSON-893491285 None] Created volume successfully. Jun 17 04:41:53 devstack cinder-volume[92060]: DEBUG cinder.coordination [req-2c80c8e1-4213-4359-9a2e-6dd0af37faf0 req-62ddb580-1711-49d1-b0b4-df6e5ed0276a tempest-VolumesGetTestJSON-893491285 None] Acquiring lock "cinder-ae94a402-3f02-4fe2-846e-5ac43ddcc644-delete_volume" by "delete_volume" {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 04:41:53 devstack cinder-volume[92060]: DEBUG cinder.coordination [req-2c80c8e1-4213-4359-9a2e-6dd0af37faf0 req-62ddb580-1711-49d1-b0b4-df6e5ed0276a tempest-VolumesGetTestJSON-893491285 None] Lock "cinder-ae94a402-3f02-4fe2-846e-5ac43ddcc644-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 04:41:53 devstack cinder-volume[92060]: DEBUG cinder.coordination [req-2c80c8e1-4213-4359-9a2e-6dd0af37faf0 req-62ddb580-1711-49d1-b0b4-df6e5ed0276a tempest-VolumesGetTestJSON-893491285 None] Acquiring lock "cinder-quobyte-ae94a402-3f02-4fe2-846e-5ac43ddcc644" by "delete_volume" {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 04:41:53 devstack cinder-volume[92060]: DEBUG cinder.coordination [req-2c80c8e1-4213-4359-9a2e-6dd0af37faf0 req-62ddb580-1711-49d1-b0b4-df6e5ed0276a tempest-VolumesGetTestJSON-893491285 None] Lock "cinder-quobyte-ae94a402-3f02-4fe2-846e-5ac43ddcc644" acquired by "delete_volume" :: waited 0.019s {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 04:41:53 devstack cinder-volume[92060]: DEBUG oslo.privsep.daemon [-] privsep: reply[8086d5ab-345a-4571-90df-1e82a09a88a5]: (4, 'qcow2') {{(pid=93130) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 04:41:53 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [req-2c80c8e1-4213-4359-9a2e-6dd0af37faf0 req-62ddb580-1711-49d1-b0b4-df6e5ed0276a tempest-VolumesGetTestJSON-893491285 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-ae94a402-3f02-4fe2-846e-5ac43ddcc644 {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:41:53 devstack sudo[99303]: pam_unix(sudo:session): session closed for user root Jun 17 04:41:53 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-8dbd9ded-ab41-4f5b-badf-c016ddd81fb9 tempest-VolumeTypesAccessTest-1216824825 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-795153da-34d4-4f59-b0f3-72ac577e3ad8 1073741824" returned: 0 in 0.838s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:41:53 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-8dbd9ded-ab41-4f5b-badf-c016ddd81fb9 tempest-VolumeTypesAccessTest-1216824825 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-795153da-34d4-4f59-b0f3-72ac577e3ad8 {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:41:53 devstack sudo[99310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-795153da-34d4-4f59-b0f3-72ac577e3ad8 Jun 17 04:41:53 devstack sudo[99310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:41:53 devstack sudo[99309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-ae94a402-3f02-4fe2-846e-5ac43ddcc644 Jun 17 04:41:53 devstack sudo[99309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:41:54 devstack sudo[99310]: pam_unix(sudo:session): session closed for user root Jun 17 04:41:54 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-8dbd9ded-ab41-4f5b-badf-c016ddd81fb9 tempest-VolumeTypesAccessTest-1216824825 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-795153da-34d4-4f59-b0f3-72ac577e3ad8" returned: 0 in 0.637s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:41:54 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-8dbd9ded-ab41-4f5b-badf-c016ddd81fb9 tempest-VolumeTypesAccessTest-1216824825 None] <== create_volume: return (1519ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588'} {{(pid=92060) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 17 04:41:54 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-8dbd9ded-ab41-4f5b-badf-c016ddd81fb9 tempest-VolumeTypesAccessTest-1216824825 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.522s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 04:41:54 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-eb24b3bb-7eee-4454-8f88-aec15b257c14 tempest-VolumesListAdminTestJSON-521676851 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.529s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 04:41:54 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-eb24b3bb-7eee-4454-8f88-aec15b257c14 tempest-VolumesListAdminTestJSON-521676851 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-17T02:41:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-252935837',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=17ecca3f-742d-4766-92fe-7738cd40f744,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='49c232cdccf64c938086dfad17047b88',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T02:41:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T02:41:52Z,use_quota=True,user_id='88f21d6493e54c51953de6a6c261e110',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aad9ce24-93f9-41a6-baa1-5125964f96d1),volume_type_id=aad9ce24-93f9-41a6-baa1-5125964f96d1)}" {{(pid=92060) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 17 04:41:54 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.remotefs [None req-eb24b3bb-7eee-4454-8f88-aec15b257c14 tempest-VolumesListAdminTestJSON-521676851 None] Creating volume 17ecca3f-742d-4766-92fe-7738cd40f744 {{(pid=92060) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 17 04:41:54 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-eb24b3bb-7eee-4454-8f88-aec15b257c14 tempest-VolumesListAdminTestJSON-521676851 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 04:41:54 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-eb24b3bb-7eee-4454-8f88-aec15b257c14 tempest-VolumesListAdminTestJSON-521676851 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 04:41:54 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-eb24b3bb-7eee-4454-8f88-aec15b257c14 tempest-VolumesListAdminTestJSON-521676851 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588': None} {{(pid=92060) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 17 04:41:54 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-eb24b3bb-7eee-4454-8f88-aec15b257c14 tempest-VolumesListAdminTestJSON-521676851 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588'] {{(pid=92060) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 17 04:41:54 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-eb24b3bb-7eee-4454-8f88-aec15b257c14 tempest-VolumesListAdminTestJSON-521676851 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 04:41:54 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-eb24b3bb-7eee-4454-8f88-aec15b257c14 tempest-VolumesListAdminTestJSON-521676851 None] Selected osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588 as target Quobyte volume. {{(pid=92060) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 17 04:41:54 devstack cinder-volume[92060]: INFO cinder.volume.drivers.remotefs [None req-eb24b3bb-7eee-4454-8f88-aec15b257c14 tempest-VolumesListAdminTestJSON-521676851 None] casted to osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588 Jun 17 04:41:54 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-eb24b3bb-7eee-4454-8f88-aec15b257c14 tempest-VolumesListAdminTestJSON-521676851 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-17ecca3f-742d-4766-92fe-7738cd40f744 1073741824 {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:41:54 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-8dbd9ded-ab41-4f5b-badf-c016ddd81fb9 tempest-VolumeTypesAccessTest-1216824825 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (00592b66-3cc9-4878-8c48-73093375986a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-795153da-34d4-4f59-b0f3-72ac577e3ad8', 'volume_size': 1}' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:41:54 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-8dbd9ded-ab41-4f5b-badf-c016ddd81fb9 tempest-VolumeTypesAccessTest-1216824825 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (46181ecb-c899-4fee-ae09-f8a7bae76076) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:41:54 devstack sudo[99318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-17ecca3f-742d-4766-92fe-7738cd40f744 1073741824 Jun 17 04:41:54 devstack cinder-volume[92060]: INFO cinder.volume.flows.manager.create_volume [None req-8dbd9ded-ab41-4f5b-badf-c016ddd81fb9 tempest-VolumeTypesAccessTest-1216824825 None] Volume volume-795153da-34d4-4f59-b0f3-72ac577e3ad8 (795153da-34d4-4f59-b0f3-72ac577e3ad8): created successfully Jun 17 04:41:54 devstack sudo[99318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:41:54 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-8dbd9ded-ab41-4f5b-badf-c016ddd81fb9 tempest-VolumeTypesAccessTest-1216824825 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (46181ecb-c899-4fee-ae09-f8a7bae76076) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:41:54 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-8dbd9ded-ab41-4f5b-badf-c016ddd81fb9 tempest-VolumeTypesAccessTest-1216824825 None] Flow 'volume_create_manager' (2a0f8a89-505e-4b20-8762-e11e6e684710) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92060) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 17 04:41:54 devstack cinder-volume[92060]: INFO cinder.volume.manager [None req-8dbd9ded-ab41-4f5b-badf-c016ddd81fb9 tempest-VolumeTypesAccessTest-1216824825 None] Created volume successfully. Jun 17 04:41:54 devstack sudo[99309]: pam_unix(sudo:session): session closed for user root Jun 17 04:41:54 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [req-2c80c8e1-4213-4359-9a2e-6dd0af37faf0 req-62ddb580-1711-49d1-b0b4-df6e5ed0276a tempest-VolumesGetTestJSON-893491285 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-ae94a402-3f02-4fe2-846e-5ac43ddcc644" returned: 0 in 0.819s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:41:54 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [req-2c80c8e1-4213-4359-9a2e-6dd0af37faf0 req-62ddb580-1711-49d1-b0b4-df6e5ed0276a tempest-VolumesGetTestJSON-893491285 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-ae94a402-3f02-4fe2-846e-5ac43ddcc644 {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:41:54 devstack sudo[99320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-ae94a402-3f02-4fe2-846e-5ac43ddcc644 Jun 17 04:41:54 devstack sudo[99320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:41:55 devstack sudo[99320]: pam_unix(sudo:session): session closed for user root Jun 17 04:41:55 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [req-2c80c8e1-4213-4359-9a2e-6dd0af37faf0 req-62ddb580-1711-49d1-b0b4-df6e5ed0276a tempest-VolumesGetTestJSON-893491285 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-ae94a402-3f02-4fe2-846e-5ac43ddcc644" returned: 0 in 0.638s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:41:55 devstack cinder-volume[92060]: DEBUG cinder.coordination [req-2c80c8e1-4213-4359-9a2e-6dd0af37faf0 req-62ddb580-1711-49d1-b0b4-df6e5ed0276a tempest-VolumesGetTestJSON-893491285 None] Lock "cinder-quobyte-ae94a402-3f02-4fe2-846e-5ac43ddcc644" released by "delete_volume" :: held 1.513s {{(pid=92060) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 04:41:55 devstack cinder-volume[92060]: DEBUG cinder.quota [req-2c80c8e1-4213-4359-9a2e-6dd0af37faf0 req-62ddb580-1711-49d1-b0b4-df6e5ed0276a tempest-VolumesGetTestJSON-893491285 None] Created reservations ['42477327-99eb-47c4-91ff-20d775dca447', '1118dbfe-5c8c-43d0-9633-40e369a21080', '49eb34a3-6df9-443f-926f-5cdfc14258c4', '061e8f89-4d36-468a-a4c1-f8c762604b84'] {{(pid=92060) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 17 04:41:55 devstack sudo[99318]: pam_unix(sudo:session): session closed for user root Jun 17 04:41:55 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-eb24b3bb-7eee-4454-8f88-aec15b257c14 tempest-VolumesListAdminTestJSON-521676851 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-17ecca3f-742d-4766-92fe-7738cd40f744 1073741824" returned: 0 in 0.842s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:41:55 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [req-2c80c8e1-4213-4359-9a2e-6dd0af37faf0 req-62ddb580-1711-49d1-b0b4-df6e5ed0276a tempest-VolumesGetTestJSON-893491285 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 04:41:55 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [req-2c80c8e1-4213-4359-9a2e-6dd0af37faf0 req-62ddb580-1711-49d1-b0b4-df6e5ed0276a tempest-VolumesGetTestJSON-893491285 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 04:41:55 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [req-2c80c8e1-4213-4359-9a2e-6dd0af37faf0 req-62ddb580-1711-49d1-b0b4-df6e5ed0276a tempest-VolumesGetTestJSON-893491285 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588': None} {{(pid=92060) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 17 04:41:55 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [req-2c80c8e1-4213-4359-9a2e-6dd0af37faf0 req-62ddb580-1711-49d1-b0b4-df6e5ed0276a tempest-VolumesGetTestJSON-893491285 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588'] {{(pid=92060) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 17 04:41:55 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [req-2c80c8e1-4213-4359-9a2e-6dd0af37faf0 req-62ddb580-1711-49d1-b0b4-df6e5ed0276a tempest-VolumesGetTestJSON-893491285 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 04:41:55 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [req-2c80c8e1-4213-4359-9a2e-6dd0af37faf0 req-62ddb580-1711-49d1-b0b4-df6e5ed0276a tempest-VolumesGetTestJSON-893491285 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:41:55 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-eb24b3bb-7eee-4454-8f88-aec15b257c14 tempest-VolumesListAdminTestJSON-521676851 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-17ecca3f-742d-4766-92fe-7738cd40f744 {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:41:55 devstack sudo[99326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a Jun 17 04:41:55 devstack sudo[99326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:41:55 devstack sudo[99327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-17ecca3f-742d-4766-92fe-7738cd40f744 Jun 17 04:41:55 devstack sudo[99327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:41:55 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-15568e3c-5fad-46e4-a43d-1085df88a80d tempest-VolumeTypesAccessTest-1216824825 None] Acquiring lock "cinder-795153da-34d4-4f59-b0f3-72ac577e3ad8-delete_volume" by "delete_volume" {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 04:41:55 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-15568e3c-5fad-46e4-a43d-1085df88a80d tempest-VolumeTypesAccessTest-1216824825 None] Lock "cinder-795153da-34d4-4f59-b0f3-72ac577e3ad8-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 04:41:55 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-15568e3c-5fad-46e4-a43d-1085df88a80d tempest-VolumeTypesAccessTest-1216824825 None] Acquiring lock "cinder-quobyte-795153da-34d4-4f59-b0f3-72ac577e3ad8" by "delete_volume" {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 04:41:55 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-15568e3c-5fad-46e4-a43d-1085df88a80d tempest-VolumeTypesAccessTest-1216824825 None] Lock "cinder-quobyte-795153da-34d4-4f59-b0f3-72ac577e3ad8" acquired by "delete_volume" :: waited 0.019s {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 04:41:55 devstack cinder-volume[92060]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e27128f-1b56-43e6-b048-7c59807dd542]: (4, 'qcow2') {{(pid=93130) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 04:41:55 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-15568e3c-5fad-46e4-a43d-1085df88a80d tempest-VolumeTypesAccessTest-1216824825 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-795153da-34d4-4f59-b0f3-72ac577e3ad8 {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:41:55 devstack sudo[99326]: pam_unix(sudo:session): session closed for user root Jun 17 04:41:55 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [req-2c80c8e1-4213-4359-9a2e-6dd0af37faf0 req-62ddb580-1711-49d1-b0b4-df6e5ed0276a tempest-VolumesGetTestJSON-893491285 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a" returned: 0 in 0.696s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:41:55 devstack cinder-volume[92060]: DEBUG cinder.manager [req-2c80c8e1-4213-4359-9a2e-6dd0af37faf0 req-62ddb580-1711-49d1-b0b4-df6e5ed0276a tempest-VolumesGetTestJSON-893491285 None] Notifying Schedulers of capabilities ... {{(pid=92060) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 17 04:41:55 devstack cinder-volume[92060]: INFO cinder.volume.manager [req-2c80c8e1-4213-4359-9a2e-6dd0af37faf0 req-62ddb580-1711-49d1-b0b4-df6e5ed0276a tempest-VolumesGetTestJSON-893491285 None] Deleted volume successfully. Jun 17 04:41:55 devstack sudo[99330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-795153da-34d4-4f59-b0f3-72ac577e3ad8 Jun 17 04:41:55 devstack sudo[99330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:41:55 devstack cinder-volume[92060]: DEBUG cinder.coordination [req-2c80c8e1-4213-4359-9a2e-6dd0af37faf0 req-62ddb580-1711-49d1-b0b4-df6e5ed0276a tempest-VolumesGetTestJSON-893491285 None] Lock "cinder-ae94a402-3f02-4fe2-846e-5ac43ddcc644-delete_volume" released by "delete_volume" :: held 2.454s {{(pid=92060) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 04:41:56 devstack sudo[99327]: pam_unix(sudo:session): session closed for user root Jun 17 04:41:56 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-eb24b3bb-7eee-4454-8f88-aec15b257c14 tempest-VolumesListAdminTestJSON-521676851 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-17ecca3f-742d-4766-92fe-7738cd40f744" returned: 0 in 0.881s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:41:56 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-eb24b3bb-7eee-4454-8f88-aec15b257c14 tempest-VolumesListAdminTestJSON-521676851 None] <== create_volume: return (1802ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588'} {{(pid=92060) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 17 04:41:56 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-eb24b3bb-7eee-4454-8f88-aec15b257c14 tempest-VolumesListAdminTestJSON-521676851 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.807s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 04:41:56 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-eb24b3bb-7eee-4454-8f88-aec15b257c14 tempest-VolumesListAdminTestJSON-521676851 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8d8cbf72-5898-40d5-b3b1-bb2270394025) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-17ecca3f-742d-4766-92fe-7738cd40f744', 'volume_size': 1}' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:41:56 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-eb24b3bb-7eee-4454-8f88-aec15b257c14 tempest-VolumesListAdminTestJSON-521676851 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f3e6a07a-83a3-43a4-906f-a4006c43ca4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:41:56 devstack cinder-volume[92060]: INFO cinder.volume.flows.manager.create_volume [None req-eb24b3bb-7eee-4454-8f88-aec15b257c14 tempest-VolumesListAdminTestJSON-521676851 None] Volume volume-17ecca3f-742d-4766-92fe-7738cd40f744 (17ecca3f-742d-4766-92fe-7738cd40f744): created successfully Jun 17 04:41:56 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-eb24b3bb-7eee-4454-8f88-aec15b257c14 tempest-VolumesListAdminTestJSON-521676851 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f3e6a07a-83a3-43a4-906f-a4006c43ca4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:41:56 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-eb24b3bb-7eee-4454-8f88-aec15b257c14 tempest-VolumesListAdminTestJSON-521676851 None] Flow 'volume_create_manager' (53f2809b-f2d8-4ecd-bbb0-94937e6c834d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92060) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 17 04:41:56 devstack cinder-volume[92060]: INFO cinder.volume.manager [None req-eb24b3bb-7eee-4454-8f88-aec15b257c14 tempest-VolumesListAdminTestJSON-521676851 None] Created volume successfully. Jun 17 04:41:56 devstack sudo[99330]: pam_unix(sudo:session): session closed for user root Jun 17 04:41:56 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-15568e3c-5fad-46e4-a43d-1085df88a80d tempest-VolumeTypesAccessTest-1216824825 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-795153da-34d4-4f59-b0f3-72ac577e3ad8" returned: 0 in 0.951s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:41:56 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-15568e3c-5fad-46e4-a43d-1085df88a80d tempest-VolumeTypesAccessTest-1216824825 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-795153da-34d4-4f59-b0f3-72ac577e3ad8 {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:41:56 devstack sudo[99337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-795153da-34d4-4f59-b0f3-72ac577e3ad8 Jun 17 04:41:56 devstack sudo[99337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:41:57 devstack sudo[99337]: pam_unix(sudo:session): session closed for user root Jun 17 04:41:57 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-15568e3c-5fad-46e4-a43d-1085df88a80d tempest-VolumeTypesAccessTest-1216824825 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-795153da-34d4-4f59-b0f3-72ac577e3ad8" returned: 0 in 0.772s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:41:57 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-15568e3c-5fad-46e4-a43d-1085df88a80d tempest-VolumeTypesAccessTest-1216824825 None] Lock "cinder-quobyte-795153da-34d4-4f59-b0f3-72ac577e3ad8" released by "delete_volume" :: held 1.790s {{(pid=92060) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 04:41:57 devstack cinder-volume[92060]: WARNING cinder.quota [None req-15568e3c-5fad-46e4-a43d-1085df88a80d tempest-VolumeTypesAccessTest-1216824825 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-1908046237 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-1908046237, it is now deprecated. Please use the default quota class for default quota. Jun 17 04:41:57 devstack cinder-volume[92060]: WARNING cinder.quota [None req-15568e3c-5fad-46e4-a43d-1085df88a80d tempest-VolumeTypesAccessTest-1216824825 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-1908046237 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-1908046237, it is now deprecated. Please use the default quota class for default quota. Jun 17 04:41:57 devstack cinder-volume[92060]: DEBUG cinder.quota [None req-15568e3c-5fad-46e4-a43d-1085df88a80d tempest-VolumeTypesAccessTest-1216824825 None] Created reservations ['780d294d-567e-4a9c-ade8-de18dedf3045', '487ca23a-954e-4a34-91d9-ebcd8ae59d90', 'e2da9b96-d983-484a-9bcc-b445320363b9', '490289b9-ae03-4831-975f-36e860204c12'] {{(pid=92060) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 17 04:41:57 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-15568e3c-5fad-46e4-a43d-1085df88a80d tempest-VolumeTypesAccessTest-1216824825 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 04:41:57 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-15568e3c-5fad-46e4-a43d-1085df88a80d tempest-VolumeTypesAccessTest-1216824825 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 04:41:57 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-15568e3c-5fad-46e4-a43d-1085df88a80d tempest-VolumeTypesAccessTest-1216824825 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588': None} {{(pid=92060) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 17 04:41:57 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-15568e3c-5fad-46e4-a43d-1085df88a80d tempest-VolumeTypesAccessTest-1216824825 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588'] {{(pid=92060) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 17 04:41:57 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-15568e3c-5fad-46e4-a43d-1085df88a80d tempest-VolumeTypesAccessTest-1216824825 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 04:41:57 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-15568e3c-5fad-46e4-a43d-1085df88a80d tempest-VolumeTypesAccessTest-1216824825 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:41:57 devstack sudo[99340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a Jun 17 04:41:57 devstack sudo[99340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:41:58 devstack cinder-volume[92060]: DEBUG cinder.volume.flows.manager.create_volume [None req-491e9873-a0b6-4bc9-9de7-ad5abdea0e56 tempest-VolumesListAdminTestJSON-1275727679 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92060) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 17 04:41:58 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-491e9873-a0b6-4bc9-9de7-ad5abdea0e56 tempest-VolumesListAdminTestJSON-1275727679 None] Flow 'volume_create_manager' (a9108ca3-471f-4769-b8be-b346f528ba4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 17 04:41:58 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-491e9873-a0b6-4bc9-9de7-ad5abdea0e56 tempest-VolumesListAdminTestJSON-1275727679 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5a7317e4-d83b-4e36-a356-dd0d07208a47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:41:58 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-491e9873-a0b6-4bc9-9de7-ad5abdea0e56 tempest-VolumesListAdminTestJSON-1275727679 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5a7317e4-d83b-4e36-a356-dd0d07208a47) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-17T02:41:58Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3745cc14-82ac-4cca-9643-bec17976c619,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fb9810fb635a4da9836c5c1bb6e7a7b3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T02:41:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T02:41:58Z,use_quota=True,user_id='a59aff5e390d4935afaf26d2caba1167',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aad9ce24-93f9-41a6-baa1-5125964f96d1),volume_type_id=aad9ce24-93f9-41a6-baa1-5125964f96d1)' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:41:58 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-491e9873-a0b6-4bc9-9de7-ad5abdea0e56 tempest-VolumesListAdminTestJSON-1275727679 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (023f356f-9eeb-4472-88ed-a7df11f68906) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:41:58 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-491e9873-a0b6-4bc9-9de7-ad5abdea0e56 tempest-VolumesListAdminTestJSON-1275727679 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (023f356f-9eeb-4472-88ed-a7df11f68906) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:41:58 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-491e9873-a0b6-4bc9-9de7-ad5abdea0e56 tempest-VolumesListAdminTestJSON-1275727679 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (699e1685-8e59-4908-ae22-721fe2c982b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:41:58 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-491e9873-a0b6-4bc9-9de7-ad5abdea0e56 tempest-VolumesListAdminTestJSON-1275727679 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (699e1685-8e59-4908-ae22-721fe2c982b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3745cc14-82ac-4cca-9643-bec17976c619', 'volume_name': 'volume-3745cc14-82ac-4cca-9643-bec17976c619', 'volume_size': 1}' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:41:58 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-491e9873-a0b6-4bc9-9de7-ad5abdea0e56 tempest-VolumesListAdminTestJSON-1275727679 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (60421824-bad4-4f34-b695-6eca0ec74d70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:41:58 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-491e9873-a0b6-4bc9-9de7-ad5abdea0e56 tempest-VolumesListAdminTestJSON-1275727679 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (60421824-bad4-4f34-b695-6eca0ec74d70) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:41:58 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-491e9873-a0b6-4bc9-9de7-ad5abdea0e56 tempest-VolumesListAdminTestJSON-1275727679 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8f547433-c715-4728-bfe9-3f7b3ab2a9dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:41:58 devstack cinder-volume[92060]: INFO cinder.volume.flows.manager.create_volume [None req-491e9873-a0b6-4bc9-9de7-ad5abdea0e56 tempest-VolumesListAdminTestJSON-1275727679 None] Volume 3745cc14-82ac-4cca-9643-bec17976c619: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3745cc14-82ac-4cca-9643-bec17976c619', 'volume_size': 1} Jun 17 04:41:58 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-491e9873-a0b6-4bc9-9de7-ad5abdea0e56 tempest-VolumesListAdminTestJSON-1275727679 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 04:41:58 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-491e9873-a0b6-4bc9-9de7-ad5abdea0e56 tempest-VolumesListAdminTestJSON-1275727679 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 04:41:58 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-491e9873-a0b6-4bc9-9de7-ad5abdea0e56 tempest-VolumesListAdminTestJSON-1275727679 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-17T02:41:58Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3745cc14-82ac-4cca-9643-bec17976c619,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fb9810fb635a4da9836c5c1bb6e7a7b3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T02:41:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T02:41:58Z,use_quota=True,user_id='a59aff5e390d4935afaf26d2caba1167',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aad9ce24-93f9-41a6-baa1-5125964f96d1),volume_type_id=aad9ce24-93f9-41a6-baa1-5125964f96d1)}" {{(pid=92060) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 17 04:41:58 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.remotefs [None req-491e9873-a0b6-4bc9-9de7-ad5abdea0e56 tempest-VolumesListAdminTestJSON-1275727679 None] Creating volume 3745cc14-82ac-4cca-9643-bec17976c619 {{(pid=92060) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 17 04:41:58 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-491e9873-a0b6-4bc9-9de7-ad5abdea0e56 tempest-VolumesListAdminTestJSON-1275727679 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 04:41:58 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-491e9873-a0b6-4bc9-9de7-ad5abdea0e56 tempest-VolumesListAdminTestJSON-1275727679 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 04:41:58 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-491e9873-a0b6-4bc9-9de7-ad5abdea0e56 tempest-VolumesListAdminTestJSON-1275727679 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588': None} {{(pid=92060) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 17 04:41:58 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-491e9873-a0b6-4bc9-9de7-ad5abdea0e56 tempest-VolumesListAdminTestJSON-1275727679 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588'] {{(pid=92060) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 17 04:41:58 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-491e9873-a0b6-4bc9-9de7-ad5abdea0e56 tempest-VolumesListAdminTestJSON-1275727679 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 04:41:58 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-491e9873-a0b6-4bc9-9de7-ad5abdea0e56 tempest-VolumesListAdminTestJSON-1275727679 None] Selected osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588 as target Quobyte volume. {{(pid=92060) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 17 04:41:58 devstack cinder-volume[92060]: INFO cinder.volume.drivers.remotefs [None req-491e9873-a0b6-4bc9-9de7-ad5abdea0e56 tempest-VolumesListAdminTestJSON-1275727679 None] casted to osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588 Jun 17 04:41:58 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-491e9873-a0b6-4bc9-9de7-ad5abdea0e56 tempest-VolumesListAdminTestJSON-1275727679 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-3745cc14-82ac-4cca-9643-bec17976c619 1073741824 {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:41:58 devstack sudo[99342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-3745cc14-82ac-4cca-9643-bec17976c619 1073741824 Jun 17 04:41:58 devstack sudo[99342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:41:58 devstack sudo[99340]: pam_unix(sudo:session): session closed for user root Jun 17 04:41:58 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-15568e3c-5fad-46e4-a43d-1085df88a80d tempest-VolumeTypesAccessTest-1216824825 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a" returned: 0 in 1.225s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:41:58 devstack cinder-volume[92060]: DEBUG cinder.manager [None req-15568e3c-5fad-46e4-a43d-1085df88a80d tempest-VolumeTypesAccessTest-1216824825 None] Notifying Schedulers of capabilities ... {{(pid=92060) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 17 04:41:58 devstack cinder-volume[92060]: INFO cinder.volume.manager [None req-15568e3c-5fad-46e4-a43d-1085df88a80d tempest-VolumeTypesAccessTest-1216824825 None] Deleted volume successfully. Jun 17 04:41:59 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-15568e3c-5fad-46e4-a43d-1085df88a80d tempest-VolumeTypesAccessTest-1216824825 None] Lock "cinder-795153da-34d4-4f59-b0f3-72ac577e3ad8-delete_volume" released by "delete_volume" :: held 3.374s {{(pid=92060) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 04:41:59 devstack sudo[99342]: pam_unix(sudo:session): session closed for user root Jun 17 04:41:59 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-491e9873-a0b6-4bc9-9de7-ad5abdea0e56 tempest-VolumesListAdminTestJSON-1275727679 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-3745cc14-82ac-4cca-9643-bec17976c619 1073741824" returned: 0 in 1.094s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:41:59 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-491e9873-a0b6-4bc9-9de7-ad5abdea0e56 tempest-VolumesListAdminTestJSON-1275727679 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-3745cc14-82ac-4cca-9643-bec17976c619 {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:41:59 devstack sudo[99348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-3745cc14-82ac-4cca-9643-bec17976c619 Jun 17 04:41:59 devstack sudo[99348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:42:00 devstack sudo[99348]: pam_unix(sudo:session): session closed for user root Jun 17 04:42:00 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-491e9873-a0b6-4bc9-9de7-ad5abdea0e56 tempest-VolumesListAdminTestJSON-1275727679 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-3745cc14-82ac-4cca-9643-bec17976c619" returned: 0 in 0.732s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:42:00 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-491e9873-a0b6-4bc9-9de7-ad5abdea0e56 tempest-VolumesListAdminTestJSON-1275727679 None] <== create_volume: return (1879ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588'} {{(pid=92060) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 17 04:42:00 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-491e9873-a0b6-4bc9-9de7-ad5abdea0e56 tempest-VolumesListAdminTestJSON-1275727679 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.884s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 04:42:00 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-491e9873-a0b6-4bc9-9de7-ad5abdea0e56 tempest-VolumesListAdminTestJSON-1275727679 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8f547433-c715-4728-bfe9-3f7b3ab2a9dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3745cc14-82ac-4cca-9643-bec17976c619', 'volume_size': 1}' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:42:00 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-491e9873-a0b6-4bc9-9de7-ad5abdea0e56 tempest-VolumesListAdminTestJSON-1275727679 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b7e77be5-68dd-4f52-9653-a4b5f324039d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:42:00 devstack cinder-volume[92060]: INFO cinder.volume.flows.manager.create_volume [None req-491e9873-a0b6-4bc9-9de7-ad5abdea0e56 tempest-VolumesListAdminTestJSON-1275727679 None] Volume volume-3745cc14-82ac-4cca-9643-bec17976c619 (3745cc14-82ac-4cca-9643-bec17976c619): created successfully Jun 17 04:42:00 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-491e9873-a0b6-4bc9-9de7-ad5abdea0e56 tempest-VolumesListAdminTestJSON-1275727679 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b7e77be5-68dd-4f52-9653-a4b5f324039d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:42:00 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-491e9873-a0b6-4bc9-9de7-ad5abdea0e56 tempest-VolumesListAdminTestJSON-1275727679 None] Flow 'volume_create_manager' (a9108ca3-471f-4769-b8be-b346f528ba4a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92060) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 17 04:42:00 devstack cinder-volume[92060]: INFO cinder.volume.manager [None req-491e9873-a0b6-4bc9-9de7-ad5abdea0e56 tempest-VolumesListAdminTestJSON-1275727679 None] Created volume successfully. Jun 17 04:42:01 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-8974ef29-0814-4103-9d35-0dad23ca2343 tempest-VolumesListAdminTestJSON-1275727679 None] Acquiring lock "cinder-3745cc14-82ac-4cca-9643-bec17976c619-delete_volume" by "delete_volume" {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 04:42:01 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-8974ef29-0814-4103-9d35-0dad23ca2343 tempest-VolumesListAdminTestJSON-1275727679 None] Lock "cinder-3745cc14-82ac-4cca-9643-bec17976c619-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 04:42:01 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-8974ef29-0814-4103-9d35-0dad23ca2343 tempest-VolumesListAdminTestJSON-1275727679 None] Acquiring lock "cinder-quobyte-3745cc14-82ac-4cca-9643-bec17976c619" by "delete_volume" {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 04:42:01 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-8974ef29-0814-4103-9d35-0dad23ca2343 tempest-VolumesListAdminTestJSON-1275727679 None] Lock "cinder-quobyte-3745cc14-82ac-4cca-9643-bec17976c619" acquired by "delete_volume" :: waited 0.047s {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 04:42:01 devstack cinder-volume[92060]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c27f28b-3af1-4bbe-96f5-3538e23992b1]: (4, 'qcow2') {{(pid=93130) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 04:42:01 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-8974ef29-0814-4103-9d35-0dad23ca2343 tempest-VolumesListAdminTestJSON-1275727679 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-3745cc14-82ac-4cca-9643-bec17976c619 {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:42:01 devstack cinder-volume[92060]: DEBUG cinder.volume.flows.manager.create_volume [None req-7b50f208-e604-4184-8c2a-00fd66a5989d tempest-VolumesTestJSON-786265671 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92060) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 17 04:42:01 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-7b50f208-e604-4184-8c2a-00fd66a5989d tempest-VolumesTestJSON-786265671 None] Flow 'volume_create_manager' (42580e79-c9a4-4d91-a00b-13768a67aae7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 17 04:42:01 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-7b50f208-e604-4184-8c2a-00fd66a5989d tempest-VolumesTestJSON-786265671 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (77b5b8a5-63d2-47c1-af1c-b312efd8dd0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:42:02 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-58fd64b7-8123-401d-9947-4eb58a6651f6 tempest-VolumesListAdminTestJSON-521676851 None] Acquiring lock "cinder-17ecca3f-742d-4766-92fe-7738cd40f744-delete_volume" by "delete_volume" {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 04:42:02 devstack cinder-volume[92060]: DEBUG dbcounter [-] [92060] Writing DB stats cinder:SELECT=113,cinder:UPDATE=138,cinder:INSERT=32,cinder:DELETE=9 {{(pid=92060) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 17 04:42:02 devstack sudo[99352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-3745cc14-82ac-4cca-9643-bec17976c619 Jun 17 04:42:02 devstack sudo[99352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:42:02 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-7b50f208-e604-4184-8c2a-00fd66a5989d tempest-VolumesTestJSON-786265671 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (77b5b8a5-63d2-47c1-af1c-b312efd8dd0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-17T02:42:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-146976643',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2012bf44-75b1-421c-a079-0aa042ea0988,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='293fee0569e0491a9fed38b04092c9e9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T02:42:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T02:42:02Z,use_quota=True,user_id='c5ebde65ae2347e29f7b3db239c44338',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aad9ce24-93f9-41a6-baa1-5125964f96d1),volume_type_id=aad9ce24-93f9-41a6-baa1-5125964f96d1)' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:42:02 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-7b50f208-e604-4184-8c2a-00fd66a5989d tempest-VolumesTestJSON-786265671 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (12af5eba-4eed-4c50-a44b-88aa3adabf3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:42:02 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-7b50f208-e604-4184-8c2a-00fd66a5989d tempest-VolumesTestJSON-786265671 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (12af5eba-4eed-4c50-a44b-88aa3adabf3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:42:02 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-7b50f208-e604-4184-8c2a-00fd66a5989d tempest-VolumesTestJSON-786265671 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ef320dee-1bdf-4651-a264-7f98dc6d4921) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:42:02 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-7b50f208-e604-4184-8c2a-00fd66a5989d tempest-VolumesTestJSON-786265671 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ef320dee-1bdf-4651-a264-7f98dc6d4921) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2012bf44-75b1-421c-a079-0aa042ea0988', 'volume_name': 'volume-2012bf44-75b1-421c-a079-0aa042ea0988', 'volume_size': 1}' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:42:02 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-7b50f208-e604-4184-8c2a-00fd66a5989d tempest-VolumesTestJSON-786265671 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9e7316fb-7849-4d20-b90f-bf5004ccb1e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:42:02 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-7b50f208-e604-4184-8c2a-00fd66a5989d tempest-VolumesTestJSON-786265671 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9e7316fb-7849-4d20-b90f-bf5004ccb1e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:42:02 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-7b50f208-e604-4184-8c2a-00fd66a5989d tempest-VolumesTestJSON-786265671 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0259ab99-d555-40eb-8183-9ceb8404ce96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:42:02 devstack cinder-volume[92060]: INFO cinder.volume.flows.manager.create_volume [None req-7b50f208-e604-4184-8c2a-00fd66a5989d tempest-VolumesTestJSON-786265671 None] Volume 2012bf44-75b1-421c-a079-0aa042ea0988: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2012bf44-75b1-421c-a079-0aa042ea0988', 'volume_size': 1} Jun 17 04:42:02 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-7b50f208-e604-4184-8c2a-00fd66a5989d tempest-VolumesTestJSON-786265671 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 04:42:02 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-7b50f208-e604-4184-8c2a-00fd66a5989d tempest-VolumesTestJSON-786265671 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 04:42:02 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-7b50f208-e604-4184-8c2a-00fd66a5989d tempest-VolumesTestJSON-786265671 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-17T02:42:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-146976643',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2012bf44-75b1-421c-a079-0aa042ea0988,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='293fee0569e0491a9fed38b04092c9e9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T02:42:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T02:42:02Z,use_quota=True,user_id='c5ebde65ae2347e29f7b3db239c44338',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aad9ce24-93f9-41a6-baa1-5125964f96d1),volume_type_id=aad9ce24-93f9-41a6-baa1-5125964f96d1)}" {{(pid=92060) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 17 04:42:02 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.remotefs [None req-7b50f208-e604-4184-8c2a-00fd66a5989d tempest-VolumesTestJSON-786265671 None] Creating volume 2012bf44-75b1-421c-a079-0aa042ea0988 {{(pid=92060) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 17 04:42:02 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-7b50f208-e604-4184-8c2a-00fd66a5989d tempest-VolumesTestJSON-786265671 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 04:42:02 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-7b50f208-e604-4184-8c2a-00fd66a5989d tempest-VolumesTestJSON-786265671 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 04:42:02 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-7b50f208-e604-4184-8c2a-00fd66a5989d tempest-VolumesTestJSON-786265671 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588': None} {{(pid=92060) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 17 04:42:02 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-7b50f208-e604-4184-8c2a-00fd66a5989d tempest-VolumesTestJSON-786265671 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588'] {{(pid=92060) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 17 04:42:02 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-7b50f208-e604-4184-8c2a-00fd66a5989d tempest-VolumesTestJSON-786265671 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 04:42:02 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-7b50f208-e604-4184-8c2a-00fd66a5989d tempest-VolumesTestJSON-786265671 None] Selected osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588 as target Quobyte volume. {{(pid=92060) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 17 04:42:02 devstack cinder-volume[92060]: INFO cinder.volume.drivers.remotefs [None req-7b50f208-e604-4184-8c2a-00fd66a5989d tempest-VolumesTestJSON-786265671 None] casted to osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588 Jun 17 04:42:02 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-7b50f208-e604-4184-8c2a-00fd66a5989d tempest-VolumesTestJSON-786265671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-2012bf44-75b1-421c-a079-0aa042ea0988 1073741824 {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:42:02 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-58fd64b7-8123-401d-9947-4eb58a6651f6 tempest-VolumesListAdminTestJSON-521676851 None] Lock "cinder-17ecca3f-742d-4766-92fe-7738cd40f744-delete_volume" acquired by "delete_volume" :: waited 0.099s {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 04:42:02 devstack sudo[99359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-2012bf44-75b1-421c-a079-0aa042ea0988 1073741824 Jun 17 04:42:02 devstack sudo[99359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:42:02 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-58fd64b7-8123-401d-9947-4eb58a6651f6 tempest-VolumesListAdminTestJSON-521676851 None] Acquiring lock "cinder-quobyte-17ecca3f-742d-4766-92fe-7738cd40f744" by "delete_volume" {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 04:42:02 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-58fd64b7-8123-401d-9947-4eb58a6651f6 tempest-VolumesListAdminTestJSON-521676851 None] Lock "cinder-quobyte-17ecca3f-742d-4766-92fe-7738cd40f744" acquired by "delete_volume" :: waited 0.025s {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 04:42:02 devstack cinder-volume[92060]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d086ab0-b8db-4daf-a1e9-d8af5351e488]: (4, 'qcow2') {{(pid=93130) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 04:42:02 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-58fd64b7-8123-401d-9947-4eb58a6651f6 tempest-VolumesListAdminTestJSON-521676851 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-17ecca3f-742d-4766-92fe-7738cd40f744 {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:42:02 devstack sudo[99361]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-17ecca3f-742d-4766-92fe-7738cd40f744 Jun 17 04:42:02 devstack sudo[99361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:42:03 devstack sudo[99352]: pam_unix(sudo:session): session closed for user root Jun 17 04:42:03 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-8974ef29-0814-4103-9d35-0dad23ca2343 tempest-VolumesListAdminTestJSON-1275727679 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-3745cc14-82ac-4cca-9643-bec17976c619" returned: 0 in 1.235s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:42:03 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-8974ef29-0814-4103-9d35-0dad23ca2343 tempest-VolumesListAdminTestJSON-1275727679 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-3745cc14-82ac-4cca-9643-bec17976c619 {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:42:03 devstack sudo[99373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-3745cc14-82ac-4cca-9643-bec17976c619 Jun 17 04:42:03 devstack sudo[99373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:42:03 devstack sudo[99361]: pam_unix(sudo:session): session closed for user root Jun 17 04:42:03 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-58fd64b7-8123-401d-9947-4eb58a6651f6 tempest-VolumesListAdminTestJSON-521676851 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-17ecca3f-742d-4766-92fe-7738cd40f744" returned: 0 in 1.043s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:42:03 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-58fd64b7-8123-401d-9947-4eb58a6651f6 tempest-VolumesListAdminTestJSON-521676851 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-17ecca3f-742d-4766-92fe-7738cd40f744 {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:42:03 devstack sudo[99376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-17ecca3f-742d-4766-92fe-7738cd40f744 Jun 17 04:42:03 devstack sudo[99376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:42:03 devstack sudo[99359]: pam_unix(sudo:session): session closed for user root Jun 17 04:42:03 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-7b50f208-e604-4184-8c2a-00fd66a5989d tempest-VolumesTestJSON-786265671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-2012bf44-75b1-421c-a079-0aa042ea0988 1073741824" returned: 0 in 1.269s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:42:03 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-7b50f208-e604-4184-8c2a-00fd66a5989d tempest-VolumesTestJSON-786265671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-2012bf44-75b1-421c-a079-0aa042ea0988 {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:42:03 devstack sudo[99378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-2012bf44-75b1-421c-a079-0aa042ea0988 Jun 17 04:42:03 devstack sudo[99378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:42:03 devstack sudo[99373]: pam_unix(sudo:session): session closed for user root Jun 17 04:42:03 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-8974ef29-0814-4103-9d35-0dad23ca2343 tempest-VolumesListAdminTestJSON-1275727679 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-3745cc14-82ac-4cca-9643-bec17976c619" returned: 0 in 0.753s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:42:03 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-8974ef29-0814-4103-9d35-0dad23ca2343 tempest-VolumesListAdminTestJSON-1275727679 None] Lock "cinder-quobyte-3745cc14-82ac-4cca-9643-bec17976c619" released by "delete_volume" :: held 2.064s {{(pid=92060) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 04:42:03 devstack cinder-volume[92060]: DEBUG cinder.quota [None req-8974ef29-0814-4103-9d35-0dad23ca2343 tempest-VolumesListAdminTestJSON-1275727679 None] Created reservations ['c9bf551d-8ae1-4327-9705-a9c3aa654a4c', 'c0a9e9bb-6e4d-41fc-87ea-8f15bcea1f74', '4bb7ab77-7fe4-4ace-ac86-406b765f1ddf', '980ec60f-69e2-4803-9183-625e9dc6449a'] {{(pid=92060) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 17 04:42:03 devstack sudo[99376]: pam_unix(sudo:session): session closed for user root Jun 17 04:42:03 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-58fd64b7-8123-401d-9947-4eb58a6651f6 tempest-VolumesListAdminTestJSON-521676851 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-17ecca3f-742d-4766-92fe-7738cd40f744" returned: 0 in 0.734s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:42:04 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-58fd64b7-8123-401d-9947-4eb58a6651f6 tempest-VolumesListAdminTestJSON-521676851 None] Lock "cinder-quobyte-17ecca3f-742d-4766-92fe-7738cd40f744" released by "delete_volume" :: held 1.835s {{(pid=92060) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 04:42:04 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-8974ef29-0814-4103-9d35-0dad23ca2343 tempest-VolumesListAdminTestJSON-1275727679 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 04:42:04 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-8974ef29-0814-4103-9d35-0dad23ca2343 tempest-VolumesListAdminTestJSON-1275727679 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 04:42:04 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-8974ef29-0814-4103-9d35-0dad23ca2343 tempest-VolumesListAdminTestJSON-1275727679 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588': None} {{(pid=92060) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 17 04:42:04 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-8974ef29-0814-4103-9d35-0dad23ca2343 tempest-VolumesListAdminTestJSON-1275727679 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588'] {{(pid=92060) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 17 04:42:04 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-8974ef29-0814-4103-9d35-0dad23ca2343 tempest-VolumesListAdminTestJSON-1275727679 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 04:42:04 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-8974ef29-0814-4103-9d35-0dad23ca2343 tempest-VolumesListAdminTestJSON-1275727679 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:42:04 devstack sudo[99383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a Jun 17 04:42:04 devstack sudo[99383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:42:04 devstack cinder-volume[92060]: DEBUG cinder.quota [None req-58fd64b7-8123-401d-9947-4eb58a6651f6 tempest-VolumesListAdminTestJSON-521676851 None] Created reservations ['ff9af063-59b4-46ce-a27b-41d14dea9b59', '47a35c35-a720-4ad0-8723-22f5d9b08ba8', 'a551333c-5165-4a37-b344-247f22bf3897', '5f38aeac-d7aa-41f7-a121-9452bd7a4719'] {{(pid=92060) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 17 04:42:04 devstack sudo[99378]: pam_unix(sudo:session): session closed for user root Jun 17 04:42:04 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-7b50f208-e604-4184-8c2a-00fd66a5989d tempest-VolumesTestJSON-786265671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-2012bf44-75b1-421c-a079-0aa042ea0988" returned: 0 in 0.742s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:42:04 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-7b50f208-e604-4184-8c2a-00fd66a5989d tempest-VolumesTestJSON-786265671 None] <== create_volume: return (2059ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588'} {{(pid=92060) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 17 04:42:04 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-7b50f208-e604-4184-8c2a-00fd66a5989d tempest-VolumesTestJSON-786265671 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.061s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 04:42:04 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-7b50f208-e604-4184-8c2a-00fd66a5989d tempest-VolumesTestJSON-786265671 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0259ab99-d555-40eb-8183-9ceb8404ce96) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2012bf44-75b1-421c-a079-0aa042ea0988', 'volume_size': 1}' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:42:04 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-7b50f208-e604-4184-8c2a-00fd66a5989d tempest-VolumesTestJSON-786265671 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2de0c33f-3cd1-434a-8ac0-3a16c3328645) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:42:04 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-58fd64b7-8123-401d-9947-4eb58a6651f6 tempest-VolumesListAdminTestJSON-521676851 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 04:42:04 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-58fd64b7-8123-401d-9947-4eb58a6651f6 tempest-VolumesListAdminTestJSON-521676851 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 04:42:04 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-58fd64b7-8123-401d-9947-4eb58a6651f6 tempest-VolumesListAdminTestJSON-521676851 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588': None} {{(pid=92060) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 17 04:42:04 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-58fd64b7-8123-401d-9947-4eb58a6651f6 tempest-VolumesListAdminTestJSON-521676851 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588'] {{(pid=92060) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 17 04:42:04 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-58fd64b7-8123-401d-9947-4eb58a6651f6 tempest-VolumesListAdminTestJSON-521676851 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 04:42:04 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-58fd64b7-8123-401d-9947-4eb58a6651f6 tempest-VolumesListAdminTestJSON-521676851 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:42:04 devstack cinder-volume[92060]: INFO cinder.volume.flows.manager.create_volume [None req-7b50f208-e604-4184-8c2a-00fd66a5989d tempest-VolumesTestJSON-786265671 None] Volume volume-2012bf44-75b1-421c-a079-0aa042ea0988 (2012bf44-75b1-421c-a079-0aa042ea0988): created successfully Jun 17 04:42:04 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-7b50f208-e604-4184-8c2a-00fd66a5989d tempest-VolumesTestJSON-786265671 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2de0c33f-3cd1-434a-8ac0-3a16c3328645) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:42:04 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-7b50f208-e604-4184-8c2a-00fd66a5989d tempest-VolumesTestJSON-786265671 None] Flow 'volume_create_manager' (42580e79-c9a4-4d91-a00b-13768a67aae7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92060) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 17 04:42:04 devstack sudo[99385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a Jun 17 04:42:04 devstack sudo[99385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:42:04 devstack cinder-volume[92060]: INFO cinder.volume.manager [None req-7b50f208-e604-4184-8c2a-00fd66a5989d tempest-VolumesTestJSON-786265671 None] Created volume successfully. Jun 17 04:42:04 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-138b1967-1bd0-446e-bde2-1fbeae74ec89 tempest-VolumesListAdminTestJSON-521676851 None] Acquiring lock "cinder-4ac0bba8-38ff-4045-b42f-9612a20941d1-delete_volume" by "delete_volume" {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 04:42:04 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-138b1967-1bd0-446e-bde2-1fbeae74ec89 tempest-VolumesListAdminTestJSON-521676851 None] Lock "cinder-4ac0bba8-38ff-4045-b42f-9612a20941d1-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 04:42:04 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-138b1967-1bd0-446e-bde2-1fbeae74ec89 tempest-VolumesListAdminTestJSON-521676851 None] Acquiring lock "cinder-quobyte-4ac0bba8-38ff-4045-b42f-9612a20941d1" by "delete_volume" {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 04:42:04 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-138b1967-1bd0-446e-bde2-1fbeae74ec89 tempest-VolumesListAdminTestJSON-521676851 None] Lock "cinder-quobyte-4ac0bba8-38ff-4045-b42f-9612a20941d1" acquired by "delete_volume" :: waited 0.025s {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 04:42:04 devstack cinder-volume[92060]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a62c7b3-8496-4b76-85b5-e0dffa5a02e8]: (4, 'qcow2') {{(pid=93130) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 04:42:04 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-138b1967-1bd0-446e-bde2-1fbeae74ec89 tempest-VolumesListAdminTestJSON-521676851 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-4ac0bba8-38ff-4045-b42f-9612a20941d1 {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:42:04 devstack sudo[99387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-4ac0bba8-38ff-4045-b42f-9612a20941d1 Jun 17 04:42:04 devstack sudo[99387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:42:04 devstack sudo[99383]: pam_unix(sudo:session): session closed for user root Jun 17 04:42:04 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-8974ef29-0814-4103-9d35-0dad23ca2343 tempest-VolumesListAdminTestJSON-1275727679 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a" returned: 0 in 0.746s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:42:04 devstack cinder-volume[92060]: DEBUG cinder.manager [None req-8974ef29-0814-4103-9d35-0dad23ca2343 tempest-VolumesListAdminTestJSON-1275727679 None] Notifying Schedulers of capabilities ... {{(pid=92060) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 17 04:42:04 devstack cinder-volume[92060]: INFO cinder.volume.manager [None req-8974ef29-0814-4103-9d35-0dad23ca2343 tempest-VolumesListAdminTestJSON-1275727679 None] Deleted volume successfully. Jun 17 04:42:04 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-8974ef29-0814-4103-9d35-0dad23ca2343 tempest-VolumesListAdminTestJSON-1275727679 None] Lock "cinder-3745cc14-82ac-4cca-9643-bec17976c619-delete_volume" released by "delete_volume" :: held 3.141s {{(pid=92060) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 04:42:04 devstack sudo[99385]: pam_unix(sudo:session): session closed for user root Jun 17 04:42:04 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-58fd64b7-8123-401d-9947-4eb58a6651f6 tempest-VolumesListAdminTestJSON-521676851 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a" returned: 0 in 0.769s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:42:04 devstack cinder-volume[92060]: DEBUG cinder.manager [None req-58fd64b7-8123-401d-9947-4eb58a6651f6 tempest-VolumesListAdminTestJSON-521676851 None] Notifying Schedulers of capabilities ... {{(pid=92060) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 17 04:42:04 devstack cinder-volume[92060]: INFO cinder.volume.manager [None req-58fd64b7-8123-401d-9947-4eb58a6651f6 tempest-VolumesListAdminTestJSON-521676851 None] Deleted volume successfully. Jun 17 04:42:05 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-58fd64b7-8123-401d-9947-4eb58a6651f6 tempest-VolumesListAdminTestJSON-521676851 None] Lock "cinder-17ecca3f-742d-4766-92fe-7738cd40f744-delete_volume" released by "delete_volume" :: held 2.914s {{(pid=92060) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 04:42:05 devstack sudo[99387]: pam_unix(sudo:session): session closed for user root Jun 17 04:42:05 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-138b1967-1bd0-446e-bde2-1fbeae74ec89 tempest-VolumesListAdminTestJSON-521676851 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-4ac0bba8-38ff-4045-b42f-9612a20941d1" returned: 0 in 0.818s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:42:05 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-138b1967-1bd0-446e-bde2-1fbeae74ec89 tempest-VolumesListAdminTestJSON-521676851 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-4ac0bba8-38ff-4045-b42f-9612a20941d1 {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:42:05 devstack sudo[99418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-4ac0bba8-38ff-4045-b42f-9612a20941d1 Jun 17 04:42:05 devstack sudo[99418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:42:05 devstack cinder-volume[92060]: DEBUG cinder.volume.flows.manager.create_volume [None req-b4ea80bf-39cd-4c9b-8a44-850b0219c7e1 tempest-VolumesTestJSON-786265671 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92060) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 17 04:42:05 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-b4ea80bf-39cd-4c9b-8a44-850b0219c7e1 tempest-VolumesTestJSON-786265671 None] Flow 'volume_create_manager' (b1df016a-1462-450d-8a70-8e0ea6baba34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 17 04:42:05 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-b4ea80bf-39cd-4c9b-8a44-850b0219c7e1 tempest-VolumesTestJSON-786265671 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (67acd046-c3b4-477d-867e-8fc89ee84846) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:42:05 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-b4ea80bf-39cd-4c9b-8a44-850b0219c7e1 tempest-VolumesTestJSON-786265671 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (67acd046-c3b4-477d-867e-8fc89ee84846) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-17T02:42:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-202094117',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=588d36cc-42a0-4600-a3a7-1c3ed7931505,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='293fee0569e0491a9fed38b04092c9e9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T02:42:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T02:42:06Z,use_quota=True,user_id='c5ebde65ae2347e29f7b3db239c44338',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aad9ce24-93f9-41a6-baa1-5125964f96d1),volume_type_id=aad9ce24-93f9-41a6-baa1-5125964f96d1)' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:42:05 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-b4ea80bf-39cd-4c9b-8a44-850b0219c7e1 tempest-VolumesTestJSON-786265671 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2da307ff-ddd6-49b8-8cbc-9c8c8525775b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:42:05 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-b4ea80bf-39cd-4c9b-8a44-850b0219c7e1 tempest-VolumesTestJSON-786265671 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2da307ff-ddd6-49b8-8cbc-9c8c8525775b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:42:05 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-b4ea80bf-39cd-4c9b-8a44-850b0219c7e1 tempest-VolumesTestJSON-786265671 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (579bcbcd-ea13-43f5-8c83-db6f95f20108) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:42:05 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-b4ea80bf-39cd-4c9b-8a44-850b0219c7e1 tempest-VolumesTestJSON-786265671 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (579bcbcd-ea13-43f5-8c83-db6f95f20108) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '588d36cc-42a0-4600-a3a7-1c3ed7931505', 'volume_name': 'volume-588d36cc-42a0-4600-a3a7-1c3ed7931505', 'volume_size': 1}' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:42:05 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-b4ea80bf-39cd-4c9b-8a44-850b0219c7e1 tempest-VolumesTestJSON-786265671 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (127af9b7-6eef-4e6b-b69e-12ea88751197) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:42:05 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-b4ea80bf-39cd-4c9b-8a44-850b0219c7e1 tempest-VolumesTestJSON-786265671 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (127af9b7-6eef-4e6b-b69e-12ea88751197) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:42:05 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-b4ea80bf-39cd-4c9b-8a44-850b0219c7e1 tempest-VolumesTestJSON-786265671 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (64acf606-7f65-4d3b-a1dd-d0190443e126) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:42:05 devstack cinder-volume[92060]: INFO cinder.volume.flows.manager.create_volume [None req-b4ea80bf-39cd-4c9b-8a44-850b0219c7e1 tempest-VolumesTestJSON-786265671 None] Volume 588d36cc-42a0-4600-a3a7-1c3ed7931505: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-588d36cc-42a0-4600-a3a7-1c3ed7931505', 'volume_size': 1} Jun 17 04:42:05 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-b4ea80bf-39cd-4c9b-8a44-850b0219c7e1 tempest-VolumesTestJSON-786265671 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 04:42:05 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-b4ea80bf-39cd-4c9b-8a44-850b0219c7e1 tempest-VolumesTestJSON-786265671 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 04:42:05 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-b4ea80bf-39cd-4c9b-8a44-850b0219c7e1 tempest-VolumesTestJSON-786265671 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-17T02:42:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-202094117',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=588d36cc-42a0-4600-a3a7-1c3ed7931505,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='293fee0569e0491a9fed38b04092c9e9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T02:42:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T02:42:06Z,use_quota=True,user_id='c5ebde65ae2347e29f7b3db239c44338',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aad9ce24-93f9-41a6-baa1-5125964f96d1),volume_type_id=aad9ce24-93f9-41a6-baa1-5125964f96d1)}" {{(pid=92060) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 17 04:42:05 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.remotefs [None req-b4ea80bf-39cd-4c9b-8a44-850b0219c7e1 tempest-VolumesTestJSON-786265671 None] Creating volume 588d36cc-42a0-4600-a3a7-1c3ed7931505 {{(pid=92060) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 17 04:42:05 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-b4ea80bf-39cd-4c9b-8a44-850b0219c7e1 tempest-VolumesTestJSON-786265671 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 04:42:05 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-b4ea80bf-39cd-4c9b-8a44-850b0219c7e1 tempest-VolumesTestJSON-786265671 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 04:42:05 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-b4ea80bf-39cd-4c9b-8a44-850b0219c7e1 tempest-VolumesTestJSON-786265671 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588': None} {{(pid=92060) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 17 04:42:05 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-b4ea80bf-39cd-4c9b-8a44-850b0219c7e1 tempest-VolumesTestJSON-786265671 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588'] {{(pid=92060) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 17 04:42:05 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-b4ea80bf-39cd-4c9b-8a44-850b0219c7e1 tempest-VolumesTestJSON-786265671 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 04:42:05 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-b4ea80bf-39cd-4c9b-8a44-850b0219c7e1 tempest-VolumesTestJSON-786265671 None] Selected osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588 as target Quobyte volume. {{(pid=92060) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 17 04:42:05 devstack cinder-volume[92060]: INFO cinder.volume.drivers.remotefs [None req-b4ea80bf-39cd-4c9b-8a44-850b0219c7e1 tempest-VolumesTestJSON-786265671 None] casted to osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588 Jun 17 04:42:05 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-b4ea80bf-39cd-4c9b-8a44-850b0219c7e1 tempest-VolumesTestJSON-786265671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-588d36cc-42a0-4600-a3a7-1c3ed7931505 1073741824 {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:42:05 devstack sudo[99420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-588d36cc-42a0-4600-a3a7-1c3ed7931505 1073741824 Jun 17 04:42:05 devstack sudo[99420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:42:06 devstack sudo[99418]: pam_unix(sudo:session): session closed for user root Jun 17 04:42:06 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-138b1967-1bd0-446e-bde2-1fbeae74ec89 tempest-VolumesListAdminTestJSON-521676851 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-4ac0bba8-38ff-4045-b42f-9612a20941d1" returned: 0 in 0.697s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:42:06 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-138b1967-1bd0-446e-bde2-1fbeae74ec89 tempest-VolumesListAdminTestJSON-521676851 None] Lock "cinder-quobyte-4ac0bba8-38ff-4045-b42f-9612a20941d1" released by "delete_volume" :: held 1.576s {{(pid=92060) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 04:42:06 devstack cinder-volume[92060]: DEBUG cinder.quota [None req-138b1967-1bd0-446e-bde2-1fbeae74ec89 tempest-VolumesListAdminTestJSON-521676851 None] Created reservations ['ee90226a-985c-4573-a435-13683737dc90', 'f553691d-da15-48b4-a176-27c606f9e0f1', '50f450ed-f55f-4b68-b1c6-23e8a19361f0', 'aed98e2c-371b-414a-b0c4-804fbd467e5f'] {{(pid=92060) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 17 04:42:06 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-138b1967-1bd0-446e-bde2-1fbeae74ec89 tempest-VolumesListAdminTestJSON-521676851 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 04:42:06 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-138b1967-1bd0-446e-bde2-1fbeae74ec89 tempest-VolumesListAdminTestJSON-521676851 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 04:42:06 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-138b1967-1bd0-446e-bde2-1fbeae74ec89 tempest-VolumesListAdminTestJSON-521676851 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588': None} {{(pid=92060) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 17 04:42:06 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-138b1967-1bd0-446e-bde2-1fbeae74ec89 tempest-VolumesListAdminTestJSON-521676851 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588'] {{(pid=92060) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 17 04:42:06 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-138b1967-1bd0-446e-bde2-1fbeae74ec89 tempest-VolumesListAdminTestJSON-521676851 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 04:42:06 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-138b1967-1bd0-446e-bde2-1fbeae74ec89 tempest-VolumesListAdminTestJSON-521676851 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:42:06 devstack sudo[99426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a Jun 17 04:42:06 devstack sudo[99426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:42:06 devstack sudo[99420]: pam_unix(sudo:session): session closed for user root Jun 17 04:42:06 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-b4ea80bf-39cd-4c9b-8a44-850b0219c7e1 tempest-VolumesTestJSON-786265671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-588d36cc-42a0-4600-a3a7-1c3ed7931505 1073741824" returned: 0 in 0.829s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:42:06 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-b4ea80bf-39cd-4c9b-8a44-850b0219c7e1 tempest-VolumesTestJSON-786265671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-588d36cc-42a0-4600-a3a7-1c3ed7931505 {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:42:06 devstack sudo[99429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-588d36cc-42a0-4600-a3a7-1c3ed7931505 Jun 17 04:42:06 devstack sudo[99429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:42:06 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-5cb29bb5-0c43-463c-9725-8e4445e8021a tempest-VolumesListAdminTestJSON-521676851 None] Acquiring lock "cinder-01be3810-b641-494d-aae8-38e387256c02-delete_volume" by "delete_volume" {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 04:42:06 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-5cb29bb5-0c43-463c-9725-8e4445e8021a tempest-VolumesListAdminTestJSON-521676851 None] Lock "cinder-01be3810-b641-494d-aae8-38e387256c02-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 04:42:06 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-5cb29bb5-0c43-463c-9725-8e4445e8021a tempest-VolumesListAdminTestJSON-521676851 None] Acquiring lock "cinder-quobyte-01be3810-b641-494d-aae8-38e387256c02" by "delete_volume" {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 04:42:06 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-5cb29bb5-0c43-463c-9725-8e4445e8021a tempest-VolumesListAdminTestJSON-521676851 None] Lock "cinder-quobyte-01be3810-b641-494d-aae8-38e387256c02" acquired by "delete_volume" :: waited 0.023s {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 04:42:06 devstack cinder-volume[92060]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8af271a-108d-4665-831c-be6585c19705]: (4, 'qcow2') {{(pid=93130) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 04:42:06 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-5cb29bb5-0c43-463c-9725-8e4445e8021a tempest-VolumesListAdminTestJSON-521676851 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-01be3810-b641-494d-aae8-38e387256c02 {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:42:07 devstack sudo[99426]: pam_unix(sudo:session): session closed for user root Jun 17 04:42:07 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-138b1967-1bd0-446e-bde2-1fbeae74ec89 tempest-VolumesListAdminTestJSON-521676851 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a" returned: 0 in 0.835s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:42:07 devstack cinder-volume[92060]: DEBUG cinder.manager [None req-138b1967-1bd0-446e-bde2-1fbeae74ec89 tempest-VolumesListAdminTestJSON-521676851 None] Notifying Schedulers of capabilities ... {{(pid=92060) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 17 04:42:07 devstack cinder-volume[92060]: INFO cinder.volume.manager [None req-138b1967-1bd0-446e-bde2-1fbeae74ec89 tempest-VolumesListAdminTestJSON-521676851 None] Deleted volume successfully. Jun 17 04:42:07 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-138b1967-1bd0-446e-bde2-1fbeae74ec89 tempest-VolumesListAdminTestJSON-521676851 None] Lock "cinder-4ac0bba8-38ff-4045-b42f-9612a20941d1-delete_volume" released by "delete_volume" :: held 2.679s {{(pid=92060) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 04:42:07 devstack sudo[99432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-01be3810-b641-494d-aae8-38e387256c02 Jun 17 04:42:07 devstack sudo[99432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:42:07 devstack sudo[99429]: pam_unix(sudo:session): session closed for user root Jun 17 04:42:07 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-b4ea80bf-39cd-4c9b-8a44-850b0219c7e1 tempest-VolumesTestJSON-786265671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-588d36cc-42a0-4600-a3a7-1c3ed7931505" returned: 0 in 0.737s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:42:07 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-b4ea80bf-39cd-4c9b-8a44-850b0219c7e1 tempest-VolumesTestJSON-786265671 None] <== create_volume: return (1624ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588'} {{(pid=92060) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 17 04:42:07 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-b4ea80bf-39cd-4c9b-8a44-850b0219c7e1 tempest-VolumesTestJSON-786265671 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.626s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 04:42:07 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-b4ea80bf-39cd-4c9b-8a44-850b0219c7e1 tempest-VolumesTestJSON-786265671 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (64acf606-7f65-4d3b-a1dd-d0190443e126) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-588d36cc-42a0-4600-a3a7-1c3ed7931505', 'volume_size': 1}' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:42:07 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-b4ea80bf-39cd-4c9b-8a44-850b0219c7e1 tempest-VolumesTestJSON-786265671 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0b7fca2d-0fbc-4d4c-bd64-0c0c59d796b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:42:07 devstack cinder-volume[92060]: INFO cinder.volume.flows.manager.create_volume [None req-b4ea80bf-39cd-4c9b-8a44-850b0219c7e1 tempest-VolumesTestJSON-786265671 None] Volume volume-588d36cc-42a0-4600-a3a7-1c3ed7931505 (588d36cc-42a0-4600-a3a7-1c3ed7931505): created successfully Jun 17 04:42:07 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-b4ea80bf-39cd-4c9b-8a44-850b0219c7e1 tempest-VolumesTestJSON-786265671 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0b7fca2d-0fbc-4d4c-bd64-0c0c59d796b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:42:07 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-b4ea80bf-39cd-4c9b-8a44-850b0219c7e1 tempest-VolumesTestJSON-786265671 None] Flow 'volume_create_manager' (b1df016a-1462-450d-8a70-8e0ea6baba34) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92060) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 17 04:42:07 devstack cinder-volume[92060]: INFO cinder.volume.manager [None req-b4ea80bf-39cd-4c9b-8a44-850b0219c7e1 tempest-VolumesTestJSON-786265671 None] Created volume successfully. Jun 17 04:42:07 devstack sudo[99432]: pam_unix(sudo:session): session closed for user root Jun 17 04:42:07 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-5cb29bb5-0c43-463c-9725-8e4445e8021a tempest-VolumesListAdminTestJSON-521676851 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-01be3810-b641-494d-aae8-38e387256c02" returned: 0 in 0.804s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:42:07 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-5cb29bb5-0c43-463c-9725-8e4445e8021a tempest-VolumesListAdminTestJSON-521676851 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-01be3810-b641-494d-aae8-38e387256c02 {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:42:07 devstack sudo[99446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-01be3810-b641-494d-aae8-38e387256c02 Jun 17 04:42:07 devstack sudo[99446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:42:08 devstack cinder-volume[92060]: DEBUG cinder.volume.flows.manager.create_volume [None req-e0e992ec-95ff-43d5-99b9-3be1602bd50d tempest-VolumesTestJSON-786265671 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92060) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 17 04:42:08 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-e0e992ec-95ff-43d5-99b9-3be1602bd50d tempest-VolumesTestJSON-786265671 None] Flow 'volume_create_manager' (f8342889-5a0e-46b6-9e42-1c35a2d6764d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 17 04:42:08 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-e0e992ec-95ff-43d5-99b9-3be1602bd50d tempest-VolumesTestJSON-786265671 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0d7598b9-4b03-4116-8206-58f245f3da43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:42:08 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-e0e992ec-95ff-43d5-99b9-3be1602bd50d tempest-VolumesTestJSON-786265671 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0d7598b9-4b03-4116-8206-58f245f3da43) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-17T02:42:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1209606250',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0db06ad9-98ae-4195-abb8-ad07cf9aefe8,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='293fee0569e0491a9fed38b04092c9e9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T02:42:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T02:42:08Z,use_quota=True,user_id='c5ebde65ae2347e29f7b3db239c44338',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aad9ce24-93f9-41a6-baa1-5125964f96d1),volume_type_id=aad9ce24-93f9-41a6-baa1-5125964f96d1)' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:42:08 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-e0e992ec-95ff-43d5-99b9-3be1602bd50d tempest-VolumesTestJSON-786265671 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fa66dcea-d626-45b0-aa50-46a7ec68c717) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:42:08 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-e0e992ec-95ff-43d5-99b9-3be1602bd50d tempest-VolumesTestJSON-786265671 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fa66dcea-d626-45b0-aa50-46a7ec68c717) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:42:08 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-e0e992ec-95ff-43d5-99b9-3be1602bd50d tempest-VolumesTestJSON-786265671 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d39906a5-665d-4187-8adb-e7d198bb00ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:42:08 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-e0e992ec-95ff-43d5-99b9-3be1602bd50d tempest-VolumesTestJSON-786265671 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d39906a5-665d-4187-8adb-e7d198bb00ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0db06ad9-98ae-4195-abb8-ad07cf9aefe8', 'volume_name': 'volume-0db06ad9-98ae-4195-abb8-ad07cf9aefe8', 'volume_size': 1}' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:42:08 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-e0e992ec-95ff-43d5-99b9-3be1602bd50d tempest-VolumesTestJSON-786265671 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (de733619-b00c-47ab-839d-78ad860ee014) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:42:08 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-e0e992ec-95ff-43d5-99b9-3be1602bd50d tempest-VolumesTestJSON-786265671 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (de733619-b00c-47ab-839d-78ad860ee014) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:42:08 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-e0e992ec-95ff-43d5-99b9-3be1602bd50d tempest-VolumesTestJSON-786265671 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (769310c8-b979-40da-92bf-0fd6fa0377a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:42:08 devstack cinder-volume[92060]: INFO cinder.volume.flows.manager.create_volume [None req-e0e992ec-95ff-43d5-99b9-3be1602bd50d tempest-VolumesTestJSON-786265671 None] Volume 0db06ad9-98ae-4195-abb8-ad07cf9aefe8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0db06ad9-98ae-4195-abb8-ad07cf9aefe8', 'volume_size': 1} Jun 17 04:42:08 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-e0e992ec-95ff-43d5-99b9-3be1602bd50d tempest-VolumesTestJSON-786265671 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 04:42:08 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-e0e992ec-95ff-43d5-99b9-3be1602bd50d tempest-VolumesTestJSON-786265671 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 04:42:08 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-e0e992ec-95ff-43d5-99b9-3be1602bd50d tempest-VolumesTestJSON-786265671 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-17T02:42:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1209606250',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0db06ad9-98ae-4195-abb8-ad07cf9aefe8,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='293fee0569e0491a9fed38b04092c9e9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T02:42:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T02:42:08Z,use_quota=True,user_id='c5ebde65ae2347e29f7b3db239c44338',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aad9ce24-93f9-41a6-baa1-5125964f96d1),volume_type_id=aad9ce24-93f9-41a6-baa1-5125964f96d1)}" {{(pid=92060) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 17 04:42:08 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.remotefs [None req-e0e992ec-95ff-43d5-99b9-3be1602bd50d tempest-VolumesTestJSON-786265671 None] Creating volume 0db06ad9-98ae-4195-abb8-ad07cf9aefe8 {{(pid=92060) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 17 04:42:08 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-e0e992ec-95ff-43d5-99b9-3be1602bd50d tempest-VolumesTestJSON-786265671 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 04:42:08 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-e0e992ec-95ff-43d5-99b9-3be1602bd50d tempest-VolumesTestJSON-786265671 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 04:42:08 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-e0e992ec-95ff-43d5-99b9-3be1602bd50d tempest-VolumesTestJSON-786265671 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588': None} {{(pid=92060) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 17 04:42:08 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-e0e992ec-95ff-43d5-99b9-3be1602bd50d tempest-VolumesTestJSON-786265671 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588'] {{(pid=92060) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 17 04:42:08 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-e0e992ec-95ff-43d5-99b9-3be1602bd50d tempest-VolumesTestJSON-786265671 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 04:42:08 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-e0e992ec-95ff-43d5-99b9-3be1602bd50d tempest-VolumesTestJSON-786265671 None] Selected osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588 as target Quobyte volume. {{(pid=92060) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 17 04:42:08 devstack cinder-volume[92060]: INFO cinder.volume.drivers.remotefs [None req-e0e992ec-95ff-43d5-99b9-3be1602bd50d tempest-VolumesTestJSON-786265671 None] casted to osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588 Jun 17 04:42:08 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-e0e992ec-95ff-43d5-99b9-3be1602bd50d tempest-VolumesTestJSON-786265671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-0db06ad9-98ae-4195-abb8-ad07cf9aefe8 1073741824 {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:42:08 devstack sudo[99449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-0db06ad9-98ae-4195-abb8-ad07cf9aefe8 1073741824 Jun 17 04:42:08 devstack sudo[99449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:42:08 devstack sudo[99446]: pam_unix(sudo:session): session closed for user root Jun 17 04:42:08 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-5cb29bb5-0c43-463c-9725-8e4445e8021a tempest-VolumesListAdminTestJSON-521676851 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-01be3810-b641-494d-aae8-38e387256c02" returned: 0 in 0.634s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:42:08 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-5cb29bb5-0c43-463c-9725-8e4445e8021a tempest-VolumesListAdminTestJSON-521676851 None] Lock "cinder-quobyte-01be3810-b641-494d-aae8-38e387256c02" released by "delete_volume" :: held 1.491s {{(pid=92060) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 04:42:08 devstack cinder-volume[92060]: DEBUG cinder.quota [None req-5cb29bb5-0c43-463c-9725-8e4445e8021a tempest-VolumesListAdminTestJSON-521676851 None] Created reservations ['c3f4a2be-0b57-4c38-baa2-1f71c8873a12', '52c1cb89-4cfe-43f0-ac8c-250f523e0b6e', 'ce0c976b-2cbf-4a4c-8220-6347063aadcf', '8a80d650-b072-47b2-aa2a-42766356e198'] {{(pid=92060) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 17 04:42:08 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-5cb29bb5-0c43-463c-9725-8e4445e8021a tempest-VolumesListAdminTestJSON-521676851 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 04:42:08 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-5cb29bb5-0c43-463c-9725-8e4445e8021a tempest-VolumesListAdminTestJSON-521676851 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 04:42:08 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-5cb29bb5-0c43-463c-9725-8e4445e8021a tempest-VolumesListAdminTestJSON-521676851 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588': None} {{(pid=92060) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 17 04:42:08 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-5cb29bb5-0c43-463c-9725-8e4445e8021a tempest-VolumesListAdminTestJSON-521676851 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588'] {{(pid=92060) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 17 04:42:08 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-5cb29bb5-0c43-463c-9725-8e4445e8021a tempest-VolumesListAdminTestJSON-521676851 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 04:42:08 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-5cb29bb5-0c43-463c-9725-8e4445e8021a tempest-VolumesListAdminTestJSON-521676851 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:42:08 devstack sudo[99451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a Jun 17 04:42:08 devstack sudo[99451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:42:09 devstack sudo[99449]: pam_unix(sudo:session): session closed for user root Jun 17 04:42:09 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-e0e992ec-95ff-43d5-99b9-3be1602bd50d tempest-VolumesTestJSON-786265671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-0db06ad9-98ae-4195-abb8-ad07cf9aefe8 1073741824" returned: 0 in 0.886s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:42:09 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-e0e992ec-95ff-43d5-99b9-3be1602bd50d tempest-VolumesTestJSON-786265671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-0db06ad9-98ae-4195-abb8-ad07cf9aefe8 {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:42:09 devstack sudo[99451]: pam_unix(sudo:session): session closed for user root Jun 17 04:42:09 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-5cb29bb5-0c43-463c-9725-8e4445e8021a tempest-VolumesListAdminTestJSON-521676851 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a" returned: 0 in 0.812s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:42:09 devstack cinder-volume[92060]: DEBUG cinder.manager [None req-5cb29bb5-0c43-463c-9725-8e4445e8021a tempest-VolumesListAdminTestJSON-521676851 None] Notifying Schedulers of capabilities ... {{(pid=92060) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 17 04:42:09 devstack sudo[99458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-0db06ad9-98ae-4195-abb8-ad07cf9aefe8 Jun 17 04:42:09 devstack sudo[99458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:42:09 devstack cinder-volume[92060]: DEBUG cinder.volume.flows.manager.create_volume [None req-2e5a156b-dfd5-40bb-b274-7cdb3bd686ac tempest-AbsoluteLimitsTests-470054067 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92060) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 17 04:42:09 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-2e5a156b-dfd5-40bb-b274-7cdb3bd686ac tempest-AbsoluteLimitsTests-470054067 None] Flow 'volume_create_manager' (b7fef8c1-c960-460d-8058-75769f3b6ad9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 17 04:42:09 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-2e5a156b-dfd5-40bb-b274-7cdb3bd686ac tempest-AbsoluteLimitsTests-470054067 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6713ec63-6797-4b9e-81a5-326b762002e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:42:09 devstack cinder-volume[92060]: INFO cinder.volume.manager [None req-5cb29bb5-0c43-463c-9725-8e4445e8021a tempest-VolumesListAdminTestJSON-521676851 None] Deleted volume successfully. Jun 17 04:42:09 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-2e5a156b-dfd5-40bb-b274-7cdb3bd686ac tempest-AbsoluteLimitsTests-470054067 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6713ec63-6797-4b9e-81a5-326b762002e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-17T02:42:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-396152520',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=336ea7ae-dff1-4a32-ba47-0c5440611d98,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c698d31e8fbc4b22a2baabdc989c5ba6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T02:42:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T02:42:09Z,use_quota=True,user_id='75000185a4e148e98d673574fe4242bf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aad9ce24-93f9-41a6-baa1-5125964f96d1),volume_type_id=aad9ce24-93f9-41a6-baa1-5125964f96d1)' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:42:09 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-2e5a156b-dfd5-40bb-b274-7cdb3bd686ac tempest-AbsoluteLimitsTests-470054067 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (880adc8f-1702-4130-bb71-d49f7ce7acc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:42:09 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-2e5a156b-dfd5-40bb-b274-7cdb3bd686ac tempest-AbsoluteLimitsTests-470054067 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (880adc8f-1702-4130-bb71-d49f7ce7acc8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:42:09 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-2e5a156b-dfd5-40bb-b274-7cdb3bd686ac tempest-AbsoluteLimitsTests-470054067 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fc973b1c-11f3-41cb-a300-dafa0f47ff41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:42:09 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-2e5a156b-dfd5-40bb-b274-7cdb3bd686ac tempest-AbsoluteLimitsTests-470054067 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fc973b1c-11f3-41cb-a300-dafa0f47ff41) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '336ea7ae-dff1-4a32-ba47-0c5440611d98', 'volume_name': 'volume-336ea7ae-dff1-4a32-ba47-0c5440611d98', 'volume_size': 1}' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:42:09 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-2e5a156b-dfd5-40bb-b274-7cdb3bd686ac tempest-AbsoluteLimitsTests-470054067 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0a3ed031-6616-4954-8ea6-4a08745960c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:42:09 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-2e5a156b-dfd5-40bb-b274-7cdb3bd686ac tempest-AbsoluteLimitsTests-470054067 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0a3ed031-6616-4954-8ea6-4a08745960c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:42:09 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-2e5a156b-dfd5-40bb-b274-7cdb3bd686ac tempest-AbsoluteLimitsTests-470054067 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cda6958a-55f8-40b9-ac74-5837d10a9c51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:42:09 devstack cinder-volume[92060]: INFO cinder.volume.flows.manager.create_volume [None req-2e5a156b-dfd5-40bb-b274-7cdb3bd686ac tempest-AbsoluteLimitsTests-470054067 None] Volume 336ea7ae-dff1-4a32-ba47-0c5440611d98: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-336ea7ae-dff1-4a32-ba47-0c5440611d98', 'volume_size': 1} Jun 17 04:42:09 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-2e5a156b-dfd5-40bb-b274-7cdb3bd686ac tempest-AbsoluteLimitsTests-470054067 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 04:42:09 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-5cb29bb5-0c43-463c-9725-8e4445e8021a tempest-VolumesListAdminTestJSON-521676851 None] Lock "cinder-01be3810-b641-494d-aae8-38e387256c02-delete_volume" released by "delete_volume" :: held 2.680s {{(pid=92060) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 04:42:09 devstack sudo[99458]: pam_unix(sudo:session): session closed for user root Jun 17 04:42:09 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-e0e992ec-95ff-43d5-99b9-3be1602bd50d tempest-VolumesTestJSON-786265671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-0db06ad9-98ae-4195-abb8-ad07cf9aefe8" returned: 0 in 0.648s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:42:09 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-e0e992ec-95ff-43d5-99b9-3be1602bd50d tempest-VolumesTestJSON-786265671 None] <== create_volume: return (1661ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588'} {{(pid=92060) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 17 04:42:09 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-e0e992ec-95ff-43d5-99b9-3be1602bd50d tempest-VolumesTestJSON-786265671 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.664s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 04:42:09 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-2e5a156b-dfd5-40bb-b274-7cdb3bd686ac tempest-AbsoluteLimitsTests-470054067 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.496s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 04:42:10 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-2e5a156b-dfd5-40bb-b274-7cdb3bd686ac tempest-AbsoluteLimitsTests-470054067 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-17T02:42:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-396152520',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=336ea7ae-dff1-4a32-ba47-0c5440611d98,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c698d31e8fbc4b22a2baabdc989c5ba6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T02:42:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T02:42:09Z,use_quota=True,user_id='75000185a4e148e98d673574fe4242bf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aad9ce24-93f9-41a6-baa1-5125964f96d1),volume_type_id=aad9ce24-93f9-41a6-baa1-5125964f96d1)}" {{(pid=92060) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 17 04:42:10 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.remotefs [None req-2e5a156b-dfd5-40bb-b274-7cdb3bd686ac tempest-AbsoluteLimitsTests-470054067 None] Creating volume 336ea7ae-dff1-4a32-ba47-0c5440611d98 {{(pid=92060) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 17 04:42:10 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-2e5a156b-dfd5-40bb-b274-7cdb3bd686ac tempest-AbsoluteLimitsTests-470054067 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 04:42:10 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-2e5a156b-dfd5-40bb-b274-7cdb3bd686ac tempest-AbsoluteLimitsTests-470054067 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 04:42:10 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-2e5a156b-dfd5-40bb-b274-7cdb3bd686ac tempest-AbsoluteLimitsTests-470054067 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588': None} {{(pid=92060) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 17 04:42:10 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-2e5a156b-dfd5-40bb-b274-7cdb3bd686ac tempest-AbsoluteLimitsTests-470054067 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588'] {{(pid=92060) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 17 04:42:10 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-2e5a156b-dfd5-40bb-b274-7cdb3bd686ac tempest-AbsoluteLimitsTests-470054067 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 04:42:10 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-2e5a156b-dfd5-40bb-b274-7cdb3bd686ac tempest-AbsoluteLimitsTests-470054067 None] Selected osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588 as target Quobyte volume. {{(pid=92060) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 17 04:42:10 devstack cinder-volume[92060]: INFO cinder.volume.drivers.remotefs [None req-2e5a156b-dfd5-40bb-b274-7cdb3bd686ac tempest-AbsoluteLimitsTests-470054067 None] casted to osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588 Jun 17 04:42:10 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-2e5a156b-dfd5-40bb-b274-7cdb3bd686ac tempest-AbsoluteLimitsTests-470054067 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-336ea7ae-dff1-4a32-ba47-0c5440611d98 1073741824 {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:42:10 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-e0e992ec-95ff-43d5-99b9-3be1602bd50d tempest-VolumesTestJSON-786265671 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (769310c8-b979-40da-92bf-0fd6fa0377a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0db06ad9-98ae-4195-abb8-ad07cf9aefe8', 'volume_size': 1}' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:42:10 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-e0e992ec-95ff-43d5-99b9-3be1602bd50d tempest-VolumesTestJSON-786265671 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e666a046-3935-463c-be67-67ca30cb545b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:42:10 devstack sudo[99461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-336ea7ae-dff1-4a32-ba47-0c5440611d98 1073741824 Jun 17 04:42:10 devstack sudo[99461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:42:10 devstack cinder-volume[92060]: INFO cinder.volume.flows.manager.create_volume [None req-e0e992ec-95ff-43d5-99b9-3be1602bd50d tempest-VolumesTestJSON-786265671 None] Volume volume-0db06ad9-98ae-4195-abb8-ad07cf9aefe8 (0db06ad9-98ae-4195-abb8-ad07cf9aefe8): created successfully Jun 17 04:42:10 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-e0e992ec-95ff-43d5-99b9-3be1602bd50d tempest-VolumesTestJSON-786265671 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e666a046-3935-463c-be67-67ca30cb545b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:42:10 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-e0e992ec-95ff-43d5-99b9-3be1602bd50d tempest-VolumesTestJSON-786265671 None] Flow 'volume_create_manager' (f8342889-5a0e-46b6-9e42-1c35a2d6764d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92060) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 17 04:42:10 devstack cinder-volume[92060]: INFO cinder.volume.manager [None req-e0e992ec-95ff-43d5-99b9-3be1602bd50d tempest-VolumesTestJSON-786265671 None] Created volume successfully. Jun 17 04:42:10 devstack sudo[99461]: pam_unix(sudo:session): session closed for user root Jun 17 04:42:10 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-2e5a156b-dfd5-40bb-b274-7cdb3bd686ac tempest-AbsoluteLimitsTests-470054067 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-336ea7ae-dff1-4a32-ba47-0c5440611d98 1073741824" returned: 0 in 0.896s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:42:10 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-2e5a156b-dfd5-40bb-b274-7cdb3bd686ac tempest-AbsoluteLimitsTests-470054067 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-336ea7ae-dff1-4a32-ba47-0c5440611d98 {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:42:10 devstack sudo[99468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-336ea7ae-dff1-4a32-ba47-0c5440611d98 Jun 17 04:42:10 devstack sudo[99468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:42:11 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-6315203b-a189-40a6-a8c2-c44d838623a5 tempest-VolumesTestJSON-786265671 None] Acquiring lock "cinder-0db06ad9-98ae-4195-abb8-ad07cf9aefe8-delete_volume" by "delete_volume" {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 04:42:11 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-6315203b-a189-40a6-a8c2-c44d838623a5 tempest-VolumesTestJSON-786265671 None] Lock "cinder-0db06ad9-98ae-4195-abb8-ad07cf9aefe8-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 04:42:11 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-6315203b-a189-40a6-a8c2-c44d838623a5 tempest-VolumesTestJSON-786265671 None] Acquiring lock "cinder-quobyte-0db06ad9-98ae-4195-abb8-ad07cf9aefe8" by "delete_volume" {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 04:42:11 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-6315203b-a189-40a6-a8c2-c44d838623a5 tempest-VolumesTestJSON-786265671 None] Lock "cinder-quobyte-0db06ad9-98ae-4195-abb8-ad07cf9aefe8" acquired by "delete_volume" :: waited 0.020s {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 04:42:11 devstack cinder-volume[92060]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9d338a0-9221-4734-abd2-9fb0584be1f9]: (4, 'qcow2') {{(pid=93130) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 04:42:11 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-6315203b-a189-40a6-a8c2-c44d838623a5 tempest-VolumesTestJSON-786265671 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-0db06ad9-98ae-4195-abb8-ad07cf9aefe8 {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:42:11 devstack sudo[99468]: pam_unix(sudo:session): session closed for user root Jun 17 04:42:11 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-2e5a156b-dfd5-40bb-b274-7cdb3bd686ac tempest-AbsoluteLimitsTests-470054067 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-336ea7ae-dff1-4a32-ba47-0c5440611d98" returned: 0 in 0.725s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:42:11 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-2e5a156b-dfd5-40bb-b274-7cdb3bd686ac tempest-AbsoluteLimitsTests-470054067 None] <== create_volume: return (1692ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588'} {{(pid=92060) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 17 04:42:11 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-2e5a156b-dfd5-40bb-b274-7cdb3bd686ac tempest-AbsoluteLimitsTests-470054067 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.697s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 04:42:11 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-2e5a156b-dfd5-40bb-b274-7cdb3bd686ac tempest-AbsoluteLimitsTests-470054067 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cda6958a-55f8-40b9-ac74-5837d10a9c51) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-336ea7ae-dff1-4a32-ba47-0c5440611d98', 'volume_size': 1}' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:42:11 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-2e5a156b-dfd5-40bb-b274-7cdb3bd686ac tempest-AbsoluteLimitsTests-470054067 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2e5ad76d-7821-4fc6-85c1-bff62320bb55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:42:11 devstack cinder-volume[92060]: INFO cinder.volume.flows.manager.create_volume [None req-2e5a156b-dfd5-40bb-b274-7cdb3bd686ac tempest-AbsoluteLimitsTests-470054067 None] Volume volume-336ea7ae-dff1-4a32-ba47-0c5440611d98 (336ea7ae-dff1-4a32-ba47-0c5440611d98): created successfully Jun 17 04:42:11 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-2e5a156b-dfd5-40bb-b274-7cdb3bd686ac tempest-AbsoluteLimitsTests-470054067 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2e5ad76d-7821-4fc6-85c1-bff62320bb55) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:42:11 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-2e5a156b-dfd5-40bb-b274-7cdb3bd686ac tempest-AbsoluteLimitsTests-470054067 None] Flow 'volume_create_manager' (b7fef8c1-c960-460d-8058-75769f3b6ad9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92060) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 17 04:42:11 devstack cinder-volume[92060]: INFO cinder.volume.manager [None req-2e5a156b-dfd5-40bb-b274-7cdb3bd686ac tempest-AbsoluteLimitsTests-470054067 None] Created volume successfully. Jun 17 04:42:11 devstack sudo[99471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-0db06ad9-98ae-4195-abb8-ad07cf9aefe8 Jun 17 04:42:11 devstack sudo[99471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:42:12 devstack sudo[99471]: pam_unix(sudo:session): session closed for user root Jun 17 04:42:12 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-6315203b-a189-40a6-a8c2-c44d838623a5 tempest-VolumesTestJSON-786265671 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-0db06ad9-98ae-4195-abb8-ad07cf9aefe8" returned: 0 in 0.759s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:42:12 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-6315203b-a189-40a6-a8c2-c44d838623a5 tempest-VolumesTestJSON-786265671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-0db06ad9-98ae-4195-abb8-ad07cf9aefe8 {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:42:12 devstack sudo[99479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-0db06ad9-98ae-4195-abb8-ad07cf9aefe8 Jun 17 04:42:12 devstack sudo[99479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:42:12 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-18de420c-2396-4109-bfe7-97d00a80ba18 tempest-AbsoluteLimitsTests-470054067 None] Acquiring lock "cinder-336ea7ae-dff1-4a32-ba47-0c5440611d98-delete_volume" by "delete_volume" {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 04:42:12 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-18de420c-2396-4109-bfe7-97d00a80ba18 tempest-AbsoluteLimitsTests-470054067 None] Lock "cinder-336ea7ae-dff1-4a32-ba47-0c5440611d98-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 04:42:12 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-18de420c-2396-4109-bfe7-97d00a80ba18 tempest-AbsoluteLimitsTests-470054067 None] Acquiring lock "cinder-quobyte-336ea7ae-dff1-4a32-ba47-0c5440611d98" by "delete_volume" {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 04:42:12 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-18de420c-2396-4109-bfe7-97d00a80ba18 tempest-AbsoluteLimitsTests-470054067 None] Lock "cinder-quobyte-336ea7ae-dff1-4a32-ba47-0c5440611d98" acquired by "delete_volume" :: waited 0.018s {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 04:42:12 devstack cinder-volume[92060]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f36779e-d6bc-48b0-859f-4b806e0466eb]: (4, 'qcow2') {{(pid=93130) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 04:42:12 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-18de420c-2396-4109-bfe7-97d00a80ba18 tempest-AbsoluteLimitsTests-470054067 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-336ea7ae-dff1-4a32-ba47-0c5440611d98 {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:42:12 devstack sudo[99481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-336ea7ae-dff1-4a32-ba47-0c5440611d98 Jun 17 04:42:12 devstack sudo[99481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:42:13 devstack sudo[99479]: pam_unix(sudo:session): session closed for user root Jun 17 04:42:13 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-6315203b-a189-40a6-a8c2-c44d838623a5 tempest-VolumesTestJSON-786265671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-0db06ad9-98ae-4195-abb8-ad07cf9aefe8" returned: 0 in 0.656s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:42:13 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-6315203b-a189-40a6-a8c2-c44d838623a5 tempest-VolumesTestJSON-786265671 None] Lock "cinder-quobyte-0db06ad9-98ae-4195-abb8-ad07cf9aefe8" released by "delete_volume" :: held 1.474s {{(pid=92060) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 04:42:13 devstack cinder-volume[92060]: DEBUG cinder.quota [None req-6315203b-a189-40a6-a8c2-c44d838623a5 tempest-VolumesTestJSON-786265671 None] Created reservations ['5f0fed8f-bd4c-437c-aa8e-308809eb8698', '4016b43b-ca61-485d-b46c-4953c9a8083e', 'c9b42ebd-cc3e-42cf-9efa-5f629dc86a9a', '47277fa6-18b9-41ad-8406-a09c9745d8ee'] {{(pid=92060) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 17 04:42:13 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-6315203b-a189-40a6-a8c2-c44d838623a5 tempest-VolumesTestJSON-786265671 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 04:42:13 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-6315203b-a189-40a6-a8c2-c44d838623a5 tempest-VolumesTestJSON-786265671 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 04:42:13 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-6315203b-a189-40a6-a8c2-c44d838623a5 tempest-VolumesTestJSON-786265671 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588': None} {{(pid=92060) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 17 04:42:13 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-6315203b-a189-40a6-a8c2-c44d838623a5 tempest-VolumesTestJSON-786265671 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588'] {{(pid=92060) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 17 04:42:13 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-6315203b-a189-40a6-a8c2-c44d838623a5 tempest-VolumesTestJSON-786265671 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 04:42:13 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-6315203b-a189-40a6-a8c2-c44d838623a5 tempest-VolumesTestJSON-786265671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:42:13 devstack sudo[99484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a Jun 17 04:42:13 devstack sudo[99484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:42:13 devstack sudo[99481]: pam_unix(sudo:session): session closed for user root Jun 17 04:42:13 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-18de420c-2396-4109-bfe7-97d00a80ba18 tempest-AbsoluteLimitsTests-470054067 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-336ea7ae-dff1-4a32-ba47-0c5440611d98" returned: 0 in 0.880s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:42:13 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-18de420c-2396-4109-bfe7-97d00a80ba18 tempest-AbsoluteLimitsTests-470054067 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-336ea7ae-dff1-4a32-ba47-0c5440611d98 {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:42:13 devstack sudo[99491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-336ea7ae-dff1-4a32-ba47-0c5440611d98 Jun 17 04:42:13 devstack sudo[99491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:42:13 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-1108e245-34d2-49de-b901-0146c0efb56e tempest-VolumesTestJSON-786265671 None] Acquiring lock "cinder-588d36cc-42a0-4600-a3a7-1c3ed7931505-delete_volume" by "delete_volume" {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 04:42:13 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-1108e245-34d2-49de-b901-0146c0efb56e tempest-VolumesTestJSON-786265671 None] Lock "cinder-588d36cc-42a0-4600-a3a7-1c3ed7931505-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 04:42:13 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-1108e245-34d2-49de-b901-0146c0efb56e tempest-VolumesTestJSON-786265671 None] Acquiring lock "cinder-quobyte-588d36cc-42a0-4600-a3a7-1c3ed7931505" by "delete_volume" {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 04:42:13 devstack cinder-volume[92060]: INFO cinder.volume.manager [req-53407ede-9471-448f-a50d-083a2713504e req-b5f3debf-f416-4fab-b65c-e40d93e340a8 tempest-AttachVolumeTestJSON-189381823 None] Terminate volume connection completed successfully. Jun 17 04:42:13 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [req-53407ede-9471-448f-a50d-083a2713504e req-b5f3debf-f416-4fab-b65c-e40d93e340a8 tempest-AttachVolumeTestJSON-189381823 None] Deleting attachment 5a16e487-677a-499d-832f-5c5df31c0e17. {{(pid=92060) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 17 04:42:13 devstack sudo[99484]: pam_unix(sudo:session): session closed for user root Jun 17 04:42:13 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-6315203b-a189-40a6-a8c2-c44d838623a5 tempest-VolumesTestJSON-786265671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a" returned: 0 in 0.735s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:42:13 devstack cinder-volume[92060]: DEBUG cinder.manager [None req-6315203b-a189-40a6-a8c2-c44d838623a5 tempest-VolumesTestJSON-786265671 None] Notifying Schedulers of capabilities ... {{(pid=92060) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 17 04:42:13 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-1108e245-34d2-49de-b901-0146c0efb56e tempest-VolumesTestJSON-786265671 None] Lock "cinder-quobyte-588d36cc-42a0-4600-a3a7-1c3ed7931505" acquired by "delete_volume" :: waited 0.027s {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 04:42:13 devstack cinder-volume[92060]: INFO cinder.volume.manager [None req-6315203b-a189-40a6-a8c2-c44d838623a5 tempest-VolumesTestJSON-786265671 None] Deleted volume successfully. Jun 17 04:42:13 devstack cinder-volume[92060]: DEBUG oslo.privsep.daemon [-] privsep: reply[90b27062-94b9-4b4c-b636-86fe5eadc4b2]: (4, 'qcow2') {{(pid=93130) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 04:42:13 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-1108e245-34d2-49de-b901-0146c0efb56e tempest-VolumesTestJSON-786265671 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-588d36cc-42a0-4600-a3a7-1c3ed7931505 {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:42:14 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-6315203b-a189-40a6-a8c2-c44d838623a5 tempest-VolumesTestJSON-786265671 None] Lock "cinder-0db06ad9-98ae-4195-abb8-ad07cf9aefe8-delete_volume" released by "delete_volume" :: held 2.437s {{(pid=92060) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 04:42:14 devstack sudo[99495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-588d36cc-42a0-4600-a3a7-1c3ed7931505 Jun 17 04:42:14 devstack sudo[99495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:42:14 devstack sudo[99491]: pam_unix(sudo:session): session closed for user root Jun 17 04:42:14 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-18de420c-2396-4109-bfe7-97d00a80ba18 tempest-AbsoluteLimitsTests-470054067 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-336ea7ae-dff1-4a32-ba47-0c5440611d98" returned: 0 in 0.703s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:42:14 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-18de420c-2396-4109-bfe7-97d00a80ba18 tempest-AbsoluteLimitsTests-470054067 None] Lock "cinder-quobyte-336ea7ae-dff1-4a32-ba47-0c5440611d98" released by "delete_volume" :: held 1.653s {{(pid=92060) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 04:42:14 devstack cinder-volume[92060]: DEBUG cinder.quota [None req-18de420c-2396-4109-bfe7-97d00a80ba18 tempest-AbsoluteLimitsTests-470054067 None] Created reservations ['9e1143aa-7e89-47b8-977b-4ecee906ec0e', '195605b1-2b7a-4dd2-834d-b57711a06122', '79834e6f-3bd7-4303-ba97-068c6e529e60', 'c0269a10-9952-4e6e-afd7-e3c4cbf7c003'] {{(pid=92060) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 17 04:42:14 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-18de420c-2396-4109-bfe7-97d00a80ba18 tempest-AbsoluteLimitsTests-470054067 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 04:42:14 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-18de420c-2396-4109-bfe7-97d00a80ba18 tempest-AbsoluteLimitsTests-470054067 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 04:42:14 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-18de420c-2396-4109-bfe7-97d00a80ba18 tempest-AbsoluteLimitsTests-470054067 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588': None} {{(pid=92060) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 17 04:42:14 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-18de420c-2396-4109-bfe7-97d00a80ba18 tempest-AbsoluteLimitsTests-470054067 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588'] {{(pid=92060) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 17 04:42:14 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-18de420c-2396-4109-bfe7-97d00a80ba18 tempest-AbsoluteLimitsTests-470054067 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 04:42:14 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-18de420c-2396-4109-bfe7-97d00a80ba18 tempest-AbsoluteLimitsTests-470054067 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:42:14 devstack sudo[99498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a Jun 17 04:42:14 devstack sudo[99498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:42:14 devstack cinder-volume[92060]: DEBUG cinder.volume.flows.manager.create_volume [None req-88a505e3-f7c9-4869-9ced-e8c764b60c47 tempest-VolumesImageMetadata-641798962 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92060) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 17 04:42:14 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-88a505e3-f7c9-4869-9ced-e8c764b60c47 tempest-VolumesImageMetadata-641798962 None] Flow 'volume_create_manager' (91ee8ba1-8567-483c-ab90-b8f3a4bf4750) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 17 04:42:14 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-88a505e3-f7c9-4869-9ced-e8c764b60c47 tempest-VolumesImageMetadata-641798962 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (549b689a-bdb2-4f78-bcc8-d9871944e88b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:42:14 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-88a505e3-f7c9-4869-9ced-e8c764b60c47 tempest-VolumesImageMetadata-641798962 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (549b689a-bdb2-4f78-bcc8-d9871944e88b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-17T02:42:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-272654087',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=412e64dd-2cc3-4deb-b25c-ff34b6f3f40d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9f0c3cb7114043919a829083ef4b10bd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T02:42:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T02:42:15Z,use_quota=True,user_id='2a7663da31b740f0a3ce85abd12d8960',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aad9ce24-93f9-41a6-baa1-5125964f96d1),volume_type_id=aad9ce24-93f9-41a6-baa1-5125964f96d1)' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:42:14 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-88a505e3-f7c9-4869-9ced-e8c764b60c47 tempest-VolumesImageMetadata-641798962 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5fc25310-8482-45ef-94bb-6ca011e3437d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:42:14 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-88a505e3-f7c9-4869-9ced-e8c764b60c47 tempest-VolumesImageMetadata-641798962 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5fc25310-8482-45ef-94bb-6ca011e3437d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:42:14 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-88a505e3-f7c9-4869-9ced-e8c764b60c47 tempest-VolumesImageMetadata-641798962 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fb235e0b-08ba-42d2-9241-c9e258edafd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:42:14 devstack cinder-volume[92060]: DEBUG cinder.image.glance [None req-88a505e3-f7c9-4869-9ced-e8c764b60c47 tempest-VolumesImageMetadata-641798962 None] Creating Keystone auth plugin from conf {{(pid=92060) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jun 17 04:42:14 devstack sudo[99495]: pam_unix(sudo:session): session closed for user root Jun 17 04:42:14 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-1108e245-34d2-49de-b901-0146c0efb56e tempest-VolumesTestJSON-786265671 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-588d36cc-42a0-4600-a3a7-1c3ed7931505" returned: 0 in 0.908s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:42:14 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-1108e245-34d2-49de-b901-0146c0efb56e tempest-VolumesTestJSON-786265671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-588d36cc-42a0-4600-a3a7-1c3ed7931505 {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:42:14 devstack sudo[99503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-588d36cc-42a0-4600-a3a7-1c3ed7931505 Jun 17 04:42:14 devstack sudo[99503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:42:15 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-88a505e3-f7c9-4869-9ced-e8c764b60c47 tempest-VolumesImageMetadata-641798962 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fb235e0b-08ba-42d2-9241-c9e258edafd7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '412e64dd-2cc3-4deb-b25c-ff34b6f3f40d', 'volume_name': 'volume-412e64dd-2cc3-4deb-b25c-ff34b6f3f40d', 'volume_size': 1, 'image_id': '5abcba5c-72fa-4ea5-881e-1f4f187259a5', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/5abcba5c-72fa-4ea5-881e-1f4f187259a5', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'ec7d18cca2734755a53ee22ace21508e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '5abcba5c-72fa-4ea5-881e-1f4f187259a5', 'created_at': datetime.datetime(2026, 6, 17, 2, 29, 47, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 17, 2, 29, 49, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/5abcba5c-72fa-4ea5-881e-1f4f187259a5/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:42:15 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-88a505e3-f7c9-4869-9ced-e8c764b60c47 tempest-VolumesImageMetadata-641798962 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ba672b06-9f86-4935-9a7c-667768650e13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:42:15 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-88a505e3-f7c9-4869-9ced-e8c764b60c47 tempest-VolumesImageMetadata-641798962 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ba672b06-9f86-4935-9a7c-667768650e13) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:42:15 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-88a505e3-f7c9-4869-9ced-e8c764b60c47 tempest-VolumesImageMetadata-641798962 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d14a52ec-74ae-4c24-a697-3b2749acf531) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:42:15 devstack cinder-volume[92060]: INFO cinder.volume.flows.manager.create_volume [None req-88a505e3-f7c9-4869-9ced-e8c764b60c47 tempest-VolumesImageMetadata-641798962 None] Volume 412e64dd-2cc3-4deb-b25c-ff34b6f3f40d: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-412e64dd-2cc3-4deb-b25c-ff34b6f3f40d', 'volume_size': 1, 'image_id': '5abcba5c-72fa-4ea5-881e-1f4f187259a5', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/5abcba5c-72fa-4ea5-881e-1f4f187259a5', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'ec7d18cca2734755a53ee22ace21508e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '5abcba5c-72fa-4ea5-881e-1f4f187259a5', 'created_at': datetime.datetime(2026, 6, 17, 2, 29, 47, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 17, 2, 29, 49, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/5abcba5c-72fa-4ea5-881e-1f4f187259a5/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jun 17 04:42:15 devstack cinder-volume[92060]: DEBUG cinder.volume.flows.manager.create_volume [None req-88a505e3-f7c9-4869-9ced-e8c764b60c47 tempest-VolumesImageMetadata-641798962 None] Trying to clone 412e64dd-2cc3-4deb-b25c-ff34b6f3f40d from image 5abcba5c-72fa-4ea5-881e-1f4f187259a5 at location (None, [{'url': 'file:///opt/stack/data/glance/images/5abcba5c-72fa-4ea5-881e-1f4f187259a5', 'metadata': {}}]). {{(pid=92060) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jun 17 04:42:15 devstack sudo[99498]: pam_unix(sudo:session): session closed for user root Jun 17 04:42:15 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-18de420c-2396-4109-bfe7-97d00a80ba18 tempest-AbsoluteLimitsTests-470054067 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a" returned: 0 in 0.698s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:42:15 devstack cinder-volume[92060]: DEBUG cinder.manager [None req-18de420c-2396-4109-bfe7-97d00a80ba18 tempest-AbsoluteLimitsTests-470054067 None] Notifying Schedulers of capabilities ... {{(pid=92060) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 17 04:42:15 devstack cinder-volume[92060]: INFO cinder.volume.manager [None req-18de420c-2396-4109-bfe7-97d00a80ba18 tempest-AbsoluteLimitsTests-470054067 None] Deleted volume successfully. Jun 17 04:42:15 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-18de420c-2396-4109-bfe7-97d00a80ba18 tempest-AbsoluteLimitsTests-470054067 None] Lock "cinder-336ea7ae-dff1-4a32-ba47-0c5440611d98-delete_volume" released by "delete_volume" :: held 2.667s {{(pid=92060) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 04:42:15 devstack sudo[99503]: pam_unix(sudo:session): session closed for user root Jun 17 04:42:15 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-1108e245-34d2-49de-b901-0146c0efb56e tempest-VolumesTestJSON-786265671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-588d36cc-42a0-4600-a3a7-1c3ed7931505" returned: 0 in 0.661s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:42:15 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-1108e245-34d2-49de-b901-0146c0efb56e tempest-VolumesTestJSON-786265671 None] Lock "cinder-quobyte-588d36cc-42a0-4600-a3a7-1c3ed7931505" released by "delete_volume" :: held 1.631s {{(pid=92060) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 04:42:15 devstack cinder-volume[92060]: DEBUG cinder.image.image_utils [None req-88a505e3-f7c9-4869-9ced-e8c764b60c47 tempest-VolumesImageMetadata-641798962 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_5abcba5c-72fa-4ea5-881e-1f4f187259a5_0uvb04vcdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=92060) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jun 17 04:42:15 devstack cinder-volume[92060]: INFO cinder.image.image_utils [None req-88a505e3-f7c9-4869-9ced-e8c764b60c47 tempest-VolumesImageMetadata-641798962 None] Image download 20.69 MB at 20.69 MB/s Jun 17 04:42:15 devstack cinder-volume[92060]: DEBUG cinder.quota [None req-1108e245-34d2-49de-b901-0146c0efb56e tempest-VolumesTestJSON-786265671 None] Created reservations ['2c5ef1d5-5c75-44c7-ab01-dbf73223ab6c', '97f3171f-5ad8-48b6-94c4-81cd0937ef8c', 'b157bcd9-ee0d-48bb-9ba0-c1f959628751', 'bccf9879-8aff-401c-8c85-ee18a4547fa2'] {{(pid=92060) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 17 04:42:15 devstack cinder-volume[92060]: DEBUG oslo.privsep.daemon [-] privsep: reply[25b24726-e5eb-4876-a30a-a1cff65cc067]: (4, 'qcow2') {{(pid=93130) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 04:42:15 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-88a505e3-f7c9-4869-9ced-e8c764b60c47 tempest-VolumesImageMetadata-641798962 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5abcba5c-72fa-4ea5-881e-1f4f187259a5_0uvb04vcdevstack@QuobyteHD {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:42:15 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-1108e245-34d2-49de-b901-0146c0efb56e tempest-VolumesTestJSON-786265671 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 04:42:15 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-1108e245-34d2-49de-b901-0146c0efb56e tempest-VolumesTestJSON-786265671 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 04:42:15 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-1108e245-34d2-49de-b901-0146c0efb56e tempest-VolumesTestJSON-786265671 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588': None} {{(pid=92060) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 17 04:42:15 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-1108e245-34d2-49de-b901-0146c0efb56e tempest-VolumesTestJSON-786265671 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588'] {{(pid=92060) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 17 04:42:15 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-1108e245-34d2-49de-b901-0146c0efb56e tempest-VolumesTestJSON-786265671 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 04:42:15 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-1108e245-34d2-49de-b901-0146c0efb56e tempest-VolumesTestJSON-786265671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:42:15 devstack sudo[99529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a Jun 17 04:42:15 devstack sudo[99529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:42:15 devstack sudo[99528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5abcba5c-72fa-4ea5-881e-1f4f187259a5_0uvb04vcdevstack@QuobyteHD Jun 17 04:42:15 devstack sudo[99528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:42:16 devstack sudo[99529]: pam_unix(sudo:session): session closed for user root Jun 17 04:42:16 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-1108e245-34d2-49de-b901-0146c0efb56e tempest-VolumesTestJSON-786265671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a" returned: 0 in 0.928s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:42:16 devstack cinder-volume[92060]: DEBUG cinder.manager [None req-1108e245-34d2-49de-b901-0146c0efb56e tempest-VolumesTestJSON-786265671 None] Notifying Schedulers of capabilities ... {{(pid=92060) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 17 04:42:16 devstack sudo[99528]: pam_unix(sudo:session): session closed for user root Jun 17 04:42:16 devstack cinder-volume[92060]: INFO cinder.volume.manager [None req-1108e245-34d2-49de-b901-0146c0efb56e tempest-VolumesTestJSON-786265671 None] Deleted volume successfully. Jun 17 04:42:16 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-88a505e3-f7c9-4869-9ced-e8c764b60c47 tempest-VolumesImageMetadata-641798962 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5abcba5c-72fa-4ea5-881e-1f4f187259a5_0uvb04vcdevstack@QuobyteHD" returned: 0 in 1.059s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:42:16 devstack cinder-volume[92060]: DEBUG cinder.image.image_utils [None req-88a505e3-f7c9-4869-9ced-e8c764b60c47 tempest-VolumesImageMetadata-641798962 None] Temporary image 5abcba5c-72fa-4ea5-881e-1f4f187259a5 is fetched for user 2a7663da31b740f0a3ce85abd12d8960. {{(pid=92060) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jun 17 04:42:16 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-1108e245-34d2-49de-b901-0146c0efb56e tempest-VolumesTestJSON-786265671 None] Lock "cinder-588d36cc-42a0-4600-a3a7-1c3ed7931505-delete_volume" released by "delete_volume" :: held 3.068s {{(pid=92060) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 04:42:17 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-f4aa354e-0385-4de7-84c5-e4a12fbcae90 tempest-VolumesTestJSON-786265671 None] Acquiring lock "cinder-2012bf44-75b1-421c-a079-0aa042ea0988-delete_volume" by "delete_volume" {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 04:42:17 devstack cinder-volume[92060]: DEBUG dbcounter [-] [92060] Writing DB stats cinder:SELECT=136,cinder:INSERT=39,cinder:UPDATE=169,cinder:DELETE=16 {{(pid=92060) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 17 04:42:17 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-f4aa354e-0385-4de7-84c5-e4a12fbcae90 tempest-VolumesTestJSON-786265671 None] Lock "cinder-2012bf44-75b1-421c-a079-0aa042ea0988-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 04:42:17 devstack cinder-volume[92060]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca00124a-d6cc-4fc0-922d-824aa858c6c3]: (4, 'qcow2') {{(pid=93130) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 04:42:17 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-88a505e3-f7c9-4869-9ced-e8c764b60c47 tempest-VolumesImageMetadata-641798962 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5abcba5c-72fa-4ea5-881e-1f4f187259a5_0uvb04vcdevstack@QuobyteHD {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:42:17 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-f4aa354e-0385-4de7-84c5-e4a12fbcae90 tempest-VolumesTestJSON-786265671 None] Acquiring lock "cinder-quobyte-2012bf44-75b1-421c-a079-0aa042ea0988" by "delete_volume" {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 04:42:17 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-f4aa354e-0385-4de7-84c5-e4a12fbcae90 tempest-VolumesTestJSON-786265671 None] Lock "cinder-quobyte-2012bf44-75b1-421c-a079-0aa042ea0988" acquired by "delete_volume" :: waited 0.023s {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 04:42:17 devstack cinder-volume[92060]: DEBUG oslo.privsep.daemon [-] privsep: reply[adeba7a3-5da1-4f58-a5fb-274a04bbed15]: (4, 'qcow2') {{(pid=93130) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 04:42:17 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-f4aa354e-0385-4de7-84c5-e4a12fbcae90 tempest-VolumesTestJSON-786265671 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-2012bf44-75b1-421c-a079-0aa042ea0988 {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:42:17 devstack sudo[99606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5abcba5c-72fa-4ea5-881e-1f4f187259a5_0uvb04vcdevstack@QuobyteHD Jun 17 04:42:17 devstack sudo[99606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:42:17 devstack sudo[99608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-2012bf44-75b1-421c-a079-0aa042ea0988 Jun 17 04:42:17 devstack sudo[99608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:42:17 devstack sudo[99606]: pam_unix(sudo:session): session closed for user root Jun 17 04:42:17 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-88a505e3-f7c9-4869-9ced-e8c764b60c47 tempest-VolumesImageMetadata-641798962 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5abcba5c-72fa-4ea5-881e-1f4f187259a5_0uvb04vcdevstack@QuobyteHD" returned: 0 in 0.851s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:42:17 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-88a505e3-f7c9-4869-9ced-e8c764b60c47 tempest-VolumesImageMetadata-641798962 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 04:42:17 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-88a505e3-f7c9-4869-9ced-e8c764b60c47 tempest-VolumesImageMetadata-641798962 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.004s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 04:42:17 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-88a505e3-f7c9-4869-9ced-e8c764b60c47 tempest-VolumesImageMetadata-641798962 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-17T02:42:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-272654087',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=412e64dd-2cc3-4deb-b25c-ff34b6f3f40d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9f0c3cb7114043919a829083ef4b10bd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T02:42:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T02:42:15Z,use_quota=True,user_id='2a7663da31b740f0a3ce85abd12d8960',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aad9ce24-93f9-41a6-baa1-5125964f96d1),volume_type_id=aad9ce24-93f9-41a6-baa1-5125964f96d1)}" {{(pid=92060) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 17 04:42:17 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.remotefs [None req-88a505e3-f7c9-4869-9ced-e8c764b60c47 tempest-VolumesImageMetadata-641798962 None] Creating volume 412e64dd-2cc3-4deb-b25c-ff34b6f3f40d {{(pid=92060) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 17 04:42:17 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-88a505e3-f7c9-4869-9ced-e8c764b60c47 tempest-VolumesImageMetadata-641798962 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 04:42:17 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-88a505e3-f7c9-4869-9ced-e8c764b60c47 tempest-VolumesImageMetadata-641798962 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 04:42:17 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-88a505e3-f7c9-4869-9ced-e8c764b60c47 tempest-VolumesImageMetadata-641798962 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588': None} {{(pid=92060) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 17 04:42:17 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-88a505e3-f7c9-4869-9ced-e8c764b60c47 tempest-VolumesImageMetadata-641798962 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588'] {{(pid=92060) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 17 04:42:17 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-88a505e3-f7c9-4869-9ced-e8c764b60c47 tempest-VolumesImageMetadata-641798962 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 04:42:17 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-88a505e3-f7c9-4869-9ced-e8c764b60c47 tempest-VolumesImageMetadata-641798962 None] Selected osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588 as target Quobyte volume. {{(pid=92060) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 17 04:42:17 devstack cinder-volume[92060]: INFO cinder.volume.drivers.remotefs [None req-88a505e3-f7c9-4869-9ced-e8c764b60c47 tempest-VolumesImageMetadata-641798962 None] casted to osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588 Jun 17 04:42:17 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-88a505e3-f7c9-4869-9ced-e8c764b60c47 tempest-VolumesImageMetadata-641798962 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-412e64dd-2cc3-4deb-b25c-ff34b6f3f40d 1073741824 {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:42:17 devstack sudo[99618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-412e64dd-2cc3-4deb-b25c-ff34b6f3f40d 1073741824 Jun 17 04:42:17 devstack sudo[99618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:42:18 devstack sudo[99608]: pam_unix(sudo:session): session closed for user root Jun 17 04:42:18 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-f4aa354e-0385-4de7-84c5-e4a12fbcae90 tempest-VolumesTestJSON-786265671 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-2012bf44-75b1-421c-a079-0aa042ea0988" returned: 0 in 0.893s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:42:18 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-f4aa354e-0385-4de7-84c5-e4a12fbcae90 tempest-VolumesTestJSON-786265671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-2012bf44-75b1-421c-a079-0aa042ea0988 {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:42:18 devstack sudo[99620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-2012bf44-75b1-421c-a079-0aa042ea0988 Jun 17 04:42:18 devstack sudo[99620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:42:18 devstack sudo[99620]: pam_unix(sudo:session): session closed for user root Jun 17 04:42:18 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-f4aa354e-0385-4de7-84c5-e4a12fbcae90 tempest-VolumesTestJSON-786265671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-2012bf44-75b1-421c-a079-0aa042ea0988" returned: 0 in 0.673s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:42:18 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-f4aa354e-0385-4de7-84c5-e4a12fbcae90 tempest-VolumesTestJSON-786265671 None] Lock "cinder-quobyte-2012bf44-75b1-421c-a079-0aa042ea0988" released by "delete_volume" :: held 1.628s {{(pid=92060) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 04:42:18 devstack cinder-volume[92060]: DEBUG cinder.quota [None req-f4aa354e-0385-4de7-84c5-e4a12fbcae90 tempest-VolumesTestJSON-786265671 None] Created reservations ['94852ec0-b9cf-4c10-85df-22c83ee94633', '4f50708c-a6f8-4227-bdce-f859e2ec18d6', 'ffafb9b8-5450-4b4d-be01-3bd405135287', 'f5e93e29-b59e-4259-a472-c0cef145dd11'] {{(pid=92060) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 17 04:42:18 devstack sudo[99618]: pam_unix(sudo:session): session closed for user root Jun 17 04:42:18 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-88a505e3-f7c9-4869-9ced-e8c764b60c47 tempest-VolumesImageMetadata-641798962 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-412e64dd-2cc3-4deb-b25c-ff34b6f3f40d 1073741824" returned: 0 in 0.932s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:42:18 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-88a505e3-f7c9-4869-9ced-e8c764b60c47 tempest-VolumesImageMetadata-641798962 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-412e64dd-2cc3-4deb-b25c-ff34b6f3f40d {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:42:18 devstack sudo[99627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-412e64dd-2cc3-4deb-b25c-ff34b6f3f40d Jun 17 04:42:18 devstack sudo[99627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:42:18 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-f4aa354e-0385-4de7-84c5-e4a12fbcae90 tempest-VolumesTestJSON-786265671 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 04:42:18 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-f4aa354e-0385-4de7-84c5-e4a12fbcae90 tempest-VolumesTestJSON-786265671 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 04:42:18 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-f4aa354e-0385-4de7-84c5-e4a12fbcae90 tempest-VolumesTestJSON-786265671 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588': None} {{(pid=92060) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 17 04:42:18 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-f4aa354e-0385-4de7-84c5-e4a12fbcae90 tempest-VolumesTestJSON-786265671 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588'] {{(pid=92060) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 17 04:42:18 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-f4aa354e-0385-4de7-84c5-e4a12fbcae90 tempest-VolumesTestJSON-786265671 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 04:42:18 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-f4aa354e-0385-4de7-84c5-e4a12fbcae90 tempest-VolumesTestJSON-786265671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:42:19 devstack sudo[99629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a Jun 17 04:42:19 devstack sudo[99629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:42:19 devstack sudo[99627]: pam_unix(sudo:session): session closed for user root Jun 17 04:42:19 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-88a505e3-f7c9-4869-9ced-e8c764b60c47 tempest-VolumesImageMetadata-641798962 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-412e64dd-2cc3-4deb-b25c-ff34b6f3f40d" returned: 0 in 0.875s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:42:19 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-88a505e3-f7c9-4869-9ced-e8c764b60c47 tempest-VolumesImageMetadata-641798962 None] <== create_volume: return (1864ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588'} {{(pid=92060) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 17 04:42:19 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-88a505e3-f7c9-4869-9ced-e8c764b60c47 tempest-VolumesImageMetadata-641798962 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.868s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 04:42:19 devstack cinder-volume[92060]: DEBUG cinder.volume.volume_utils [None req-88a505e3-f7c9-4869-9ced-e8c764b60c47 tempest-VolumesImageMetadata-641798962 None] Attempting download of 5abcba5c-72fa-4ea5-881e-1f4f187259a5 ((None, [{'url': 'file:///opt/stack/data/glance/images/5abcba5c-72fa-4ea5-881e-1f4f187259a5', 'metadata': {}}])) to volume 412e64dd-2cc3-4deb-b25c-ff34b6f3f40d. {{(pid=92060) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jun 17 04:42:19 devstack sudo[99629]: pam_unix(sudo:session): session closed for user root Jun 17 04:42:19 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-f4aa354e-0385-4de7-84c5-e4a12fbcae90 tempest-VolumesTestJSON-786265671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a" returned: 0 in 0.924s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:42:19 devstack cinder-volume[92060]: DEBUG cinder.manager [None req-f4aa354e-0385-4de7-84c5-e4a12fbcae90 tempest-VolumesTestJSON-786265671 None] Notifying Schedulers of capabilities ... {{(pid=92060) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 17 04:42:19 devstack cinder-volume[92060]: INFO cinder.volume.manager [None req-f4aa354e-0385-4de7-84c5-e4a12fbcae90 tempest-VolumesTestJSON-786265671 None] Deleted volume successfully. Jun 17 04:42:19 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-f4aa354e-0385-4de7-84c5-e4a12fbcae90 tempest-VolumesTestJSON-786265671 None] Lock "cinder-2012bf44-75b1-421c-a079-0aa042ea0988-delete_volume" released by "delete_volume" :: held 2.886s {{(pid=92060) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 04:42:19 devstack cinder-volume[92060]: DEBUG oslo.privsep.daemon [-] privsep: reply[11577c72-1d1f-4920-b47c-adfb724fdc08]: (4, 'raw') {{(pid=93130) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 04:42:19 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-88a505e3-f7c9-4869-9ced-e8c764b60c47 tempest-VolumesImageMetadata-641798962 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_5abcba5c-72fa-4ea5-881e-1f4f187259a5_owxulvjq {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:42:20 devstack sudo[99633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_5abcba5c-72fa-4ea5-881e-1f4f187259a5_owxulvjq Jun 17 04:42:20 devstack sudo[99633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:42:20 devstack sudo[99633]: pam_unix(sudo:session): session closed for user root Jun 17 04:42:20 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-88a505e3-f7c9-4869-9ced-e8c764b60c47 tempest-VolumesImageMetadata-641798962 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_5abcba5c-72fa-4ea5-881e-1f4f187259a5_owxulvjq" returned: 0 in 0.769s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:42:20 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-88a505e3-f7c9-4869-9ced-e8c764b60c47 tempest-VolumesImageMetadata-641798962 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5abcba5c-72fa-4ea5-881e-1f4f187259a5_owxulvjq {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:42:20 devstack sudo[99638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5abcba5c-72fa-4ea5-881e-1f4f187259a5_owxulvjq Jun 17 04:42:20 devstack sudo[99638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:42:21 devstack sudo[99638]: pam_unix(sudo:session): session closed for user root Jun 17 04:42:21 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-88a505e3-f7c9-4869-9ced-e8c764b60c47 tempest-VolumesImageMetadata-641798962 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5abcba5c-72fa-4ea5-881e-1f4f187259a5_owxulvjq" returned: 1 in 0.779s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:42:21 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-88a505e3-f7c9-4869-9ced-e8c764b60c47 tempest-VolumesImageMetadata-641798962 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5abcba5c-72fa-4ea5-881e-1f4f187259a5_owxulvjq' failed. Not Retrying. {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 17 04:42:21 devstack cinder-volume[92060]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c896ae2-f1d7-4bf3-ad7d-7ec7e6a985f1]: (4, 'qcow2') {{(pid=93130) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 04:42:21 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-88a505e3-f7c9-4869-9ced-e8c764b60c47 tempest-VolumesImageMetadata-641798962 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5abcba5c-72fa-4ea5-881e-1f4f187259a5_0uvb04vcdevstack@QuobyteHD {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:42:21 devstack sudo[99642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5abcba5c-72fa-4ea5-881e-1f4f187259a5_0uvb04vcdevstack@QuobyteHD Jun 17 04:42:21 devstack sudo[99642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:42:21 devstack cinder-volume[92060]: DEBUG cinder.volume.flows.manager.create_volume [None req-01a7cf71-a1ea-4c87-8726-5954d09c4843 tempest-VolumesMetadataTest-954173709 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92060) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 17 04:42:21 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-01a7cf71-a1ea-4c87-8726-5954d09c4843 tempest-VolumesMetadataTest-954173709 None] Flow 'volume_create_manager' (bb0a63a4-d2a5-4d1f-b282-bcbc1dbdf959) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 17 04:42:21 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-01a7cf71-a1ea-4c87-8726-5954d09c4843 tempest-VolumesMetadataTest-954173709 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ff57d7c9-309b-429c-86d1-aa04337c4498) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:42:21 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-01a7cf71-a1ea-4c87-8726-5954d09c4843 tempest-VolumesMetadataTest-954173709 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ff57d7c9-309b-429c-86d1-aa04337c4498) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-17T02:42:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-684071799',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=198f60f3-372a-430d-af6f-816022564988,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d09e112ee85a42c683e699b52a0873eb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T02:42:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T02:42:22Z,use_quota=True,user_id='fcb3bde33e1e4cebb3859becaa6e0dc5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aad9ce24-93f9-41a6-baa1-5125964f96d1),volume_type_id=aad9ce24-93f9-41a6-baa1-5125964f96d1)' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:42:21 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-01a7cf71-a1ea-4c87-8726-5954d09c4843 tempest-VolumesMetadataTest-954173709 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7a382d8d-9f3b-4604-98f5-2a699159e9c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:42:21 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-01a7cf71-a1ea-4c87-8726-5954d09c4843 tempest-VolumesMetadataTest-954173709 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7a382d8d-9f3b-4604-98f5-2a699159e9c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:42:21 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-01a7cf71-a1ea-4c87-8726-5954d09c4843 tempest-VolumesMetadataTest-954173709 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b0145dad-72a6-4bf9-8fe0-dcd1c8319943) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:42:21 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-01a7cf71-a1ea-4c87-8726-5954d09c4843 tempest-VolumesMetadataTest-954173709 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b0145dad-72a6-4bf9-8fe0-dcd1c8319943) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '198f60f3-372a-430d-af6f-816022564988', 'volume_name': 'volume-198f60f3-372a-430d-af6f-816022564988', 'volume_size': 1}' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:42:21 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-01a7cf71-a1ea-4c87-8726-5954d09c4843 tempest-VolumesMetadataTest-954173709 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8a5859c8-8ac1-49ac-82bf-81913616f508) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:42:21 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-01a7cf71-a1ea-4c87-8726-5954d09c4843 tempest-VolumesMetadataTest-954173709 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8a5859c8-8ac1-49ac-82bf-81913616f508) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:42:21 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-01a7cf71-a1ea-4c87-8726-5954d09c4843 tempest-VolumesMetadataTest-954173709 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ab320b23-7bb3-4cc5-ae67-781b859b6dca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:42:21 devstack cinder-volume[92060]: INFO cinder.volume.flows.manager.create_volume [None req-01a7cf71-a1ea-4c87-8726-5954d09c4843 tempest-VolumesMetadataTest-954173709 None] Volume 198f60f3-372a-430d-af6f-816022564988: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-198f60f3-372a-430d-af6f-816022564988', 'volume_size': 1} Jun 17 04:42:21 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-01a7cf71-a1ea-4c87-8726-5954d09c4843 tempest-VolumesMetadataTest-954173709 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 04:42:21 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-01a7cf71-a1ea-4c87-8726-5954d09c4843 tempest-VolumesMetadataTest-954173709 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 04:42:21 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-01a7cf71-a1ea-4c87-8726-5954d09c4843 tempest-VolumesMetadataTest-954173709 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-17T02:42:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-684071799',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=198f60f3-372a-430d-af6f-816022564988,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d09e112ee85a42c683e699b52a0873eb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T02:42:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T02:42:22Z,use_quota=True,user_id='fcb3bde33e1e4cebb3859becaa6e0dc5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aad9ce24-93f9-41a6-baa1-5125964f96d1),volume_type_id=aad9ce24-93f9-41a6-baa1-5125964f96d1)}" {{(pid=92060) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 17 04:42:21 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.remotefs [None req-01a7cf71-a1ea-4c87-8726-5954d09c4843 tempest-VolumesMetadataTest-954173709 None] Creating volume 198f60f3-372a-430d-af6f-816022564988 {{(pid=92060) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 17 04:42:21 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-01a7cf71-a1ea-4c87-8726-5954d09c4843 tempest-VolumesMetadataTest-954173709 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 04:42:21 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-01a7cf71-a1ea-4c87-8726-5954d09c4843 tempest-VolumesMetadataTest-954173709 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 04:42:21 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-01a7cf71-a1ea-4c87-8726-5954d09c4843 tempest-VolumesMetadataTest-954173709 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588': None} {{(pid=92060) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 17 04:42:21 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-01a7cf71-a1ea-4c87-8726-5954d09c4843 tempest-VolumesMetadataTest-954173709 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588'] {{(pid=92060) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 17 04:42:21 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-01a7cf71-a1ea-4c87-8726-5954d09c4843 tempest-VolumesMetadataTest-954173709 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 04:42:21 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-01a7cf71-a1ea-4c87-8726-5954d09c4843 tempest-VolumesMetadataTest-954173709 None] Selected osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588 as target Quobyte volume. {{(pid=92060) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 17 04:42:21 devstack cinder-volume[92060]: INFO cinder.volume.drivers.remotefs [None req-01a7cf71-a1ea-4c87-8726-5954d09c4843 tempest-VolumesMetadataTest-954173709 None] casted to osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588 Jun 17 04:42:22 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-01a7cf71-a1ea-4c87-8726-5954d09c4843 tempest-VolumesMetadataTest-954173709 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-198f60f3-372a-430d-af6f-816022564988 1073741824 {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:42:22 devstack sudo[99646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-198f60f3-372a-430d-af6f-816022564988 1073741824 Jun 17 04:42:22 devstack sudo[99646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:42:22 devstack sudo[99642]: pam_unix(sudo:session): session closed for user root Jun 17 04:42:22 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-88a505e3-f7c9-4869-9ced-e8c764b60c47 tempest-VolumesImageMetadata-641798962 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5abcba5c-72fa-4ea5-881e-1f4f187259a5_0uvb04vcdevstack@QuobyteHD" returned: 0 in 0.893s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:42:22 devstack cinder-volume[92060]: DEBUG cinder.image.image_utils [None req-88a505e3-f7c9-4869-9ced-e8c764b60c47 tempest-VolumesImageMetadata-641798962 None] 5abcba5c-72fa-4ea5-881e-1f4f187259a5 was qcow2, converting to raw {{(pid=92060) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jun 17 04:42:22 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-88a505e3-f7c9-4869-9ced-e8c764b60c47 tempest-VolumesImageMetadata-641798962 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_5abcba5c-72fa-4ea5-881e-1f4f187259a5_0uvb04vcdevstack@QuobyteHD /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-412e64dd-2cc3-4deb-b25c-ff34b6f3f40d {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:42:22 devstack sudo[99651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_5abcba5c-72fa-4ea5-881e-1f4f187259a5_0uvb04vcdevstack@QuobyteHD /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-412e64dd-2cc3-4deb-b25c-ff34b6f3f40d Jun 17 04:42:22 devstack sudo[99651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:42:22 devstack sudo[99646]: pam_unix(sudo:session): session closed for user root Jun 17 04:42:22 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-01a7cf71-a1ea-4c87-8726-5954d09c4843 tempest-VolumesMetadataTest-954173709 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-198f60f3-372a-430d-af6f-816022564988 1073741824" returned: 0 in 0.922s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:42:22 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-01a7cf71-a1ea-4c87-8726-5954d09c4843 tempest-VolumesMetadataTest-954173709 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-198f60f3-372a-430d-af6f-816022564988 {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:42:22 devstack sudo[99657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-198f60f3-372a-430d-af6f-816022564988 Jun 17 04:42:22 devstack sudo[99657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:42:23 devstack sudo[99657]: pam_unix(sudo:session): session closed for user root Jun 17 04:42:23 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-01a7cf71-a1ea-4c87-8726-5954d09c4843 tempest-VolumesMetadataTest-954173709 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-198f60f3-372a-430d-af6f-816022564988" returned: 0 in 0.711s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:42:23 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-01a7cf71-a1ea-4c87-8726-5954d09c4843 tempest-VolumesMetadataTest-954173709 None] <== create_volume: return (1683ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588'} {{(pid=92060) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 17 04:42:23 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-01a7cf71-a1ea-4c87-8726-5954d09c4843 tempest-VolumesMetadataTest-954173709 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.685s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 04:42:23 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-01a7cf71-a1ea-4c87-8726-5954d09c4843 tempest-VolumesMetadataTest-954173709 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ab320b23-7bb3-4cc5-ae67-781b859b6dca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-198f60f3-372a-430d-af6f-816022564988', 'volume_size': 1}' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:42:23 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-01a7cf71-a1ea-4c87-8726-5954d09c4843 tempest-VolumesMetadataTest-954173709 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6f677478-08d8-41f7-a966-6a6588fd871f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:42:23 devstack cinder-volume[92060]: INFO cinder.volume.flows.manager.create_volume [None req-01a7cf71-a1ea-4c87-8726-5954d09c4843 tempest-VolumesMetadataTest-954173709 None] Volume volume-198f60f3-372a-430d-af6f-816022564988 (198f60f3-372a-430d-af6f-816022564988): created successfully Jun 17 04:42:23 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-01a7cf71-a1ea-4c87-8726-5954d09c4843 tempest-VolumesMetadataTest-954173709 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6f677478-08d8-41f7-a966-6a6588fd871f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:42:23 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-01a7cf71-a1ea-4c87-8726-5954d09c4843 tempest-VolumesMetadataTest-954173709 None] Flow 'volume_create_manager' (bb0a63a4-d2a5-4d1f-b282-bcbc1dbdf959) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92060) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 17 04:42:23 devstack cinder-volume[92060]: INFO cinder.volume.manager [None req-01a7cf71-a1ea-4c87-8726-5954d09c4843 tempest-VolumesMetadataTest-954173709 None] Created volume successfully. Jun 17 04:42:24 devstack sudo[99651]: pam_unix(sudo:session): session closed for user root Jun 17 04:42:24 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-88a505e3-f7c9-4869-9ced-e8c764b60c47 tempest-VolumesImageMetadata-641798962 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_5abcba5c-72fa-4ea5-881e-1f4f187259a5_0uvb04vcdevstack@QuobyteHD /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-412e64dd-2cc3-4deb-b25c-ff34b6f3f40d" returned: 0 in 2.223s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:42:24 devstack cinder-volume[92060]: DEBUG cinder.image.image_utils [None req-88a505e3-f7c9-4869-9ced-e8c764b60c47 tempest-VolumesImageMetadata-641798962 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_5abcba5c-72fa-4ea5-881e-1f4f187259a5_0uvb04vcdevstack@QuobyteHD, size 112.00 MB, duration 2.22 sec, destination /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-412e64dd-2cc3-4deb-b25c-ff34b6f3f40d {{(pid=92060) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 17 04:42:24 devstack cinder-volume[92060]: INFO cinder.image.image_utils [None req-88a505e3-f7c9-4869-9ced-e8c764b60c47 tempest-VolumesImageMetadata-641798962 None] Converted 112.00 MB image at 50.36 MB/s Jun 17 04:42:24 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-88a505e3-f7c9-4869-9ced-e8c764b60c47 tempest-VolumesImageMetadata-641798962 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-412e64dd-2cc3-4deb-b25c-ff34b6f3f40d 1G {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:42:24 devstack sudo[99668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-412e64dd-2cc3-4deb-b25c-ff34b6f3f40d 1G Jun 17 04:42:24 devstack sudo[99668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:42:24 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-f308ce83-9808-4a35-8e01-6a1ef17b4cab tempest-VolumesMetadataTest-954173709 None] Acquiring lock "cinder-198f60f3-372a-430d-af6f-816022564988-delete_volume" by "delete_volume" {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 04:42:24 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-f308ce83-9808-4a35-8e01-6a1ef17b4cab tempest-VolumesMetadataTest-954173709 None] Lock "cinder-198f60f3-372a-430d-af6f-816022564988-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 04:42:24 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-f308ce83-9808-4a35-8e01-6a1ef17b4cab tempest-VolumesMetadataTest-954173709 None] Acquiring lock "cinder-quobyte-198f60f3-372a-430d-af6f-816022564988" by "delete_volume" {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 04:42:24 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-f308ce83-9808-4a35-8e01-6a1ef17b4cab tempest-VolumesMetadataTest-954173709 None] Lock "cinder-quobyte-198f60f3-372a-430d-af6f-816022564988" acquired by "delete_volume" :: waited 0.025s {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 04:42:25 devstack cinder-volume[92060]: DEBUG oslo.privsep.daemon [-] privsep: reply[7beac0a0-7743-4e55-bb93-7daf50fd24c4]: (4, 'qcow2') {{(pid=93130) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 04:42:25 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-f308ce83-9808-4a35-8e01-6a1ef17b4cab tempest-VolumesMetadataTest-954173709 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-198f60f3-372a-430d-af6f-816022564988 {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:42:25 devstack sudo[99670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-198f60f3-372a-430d-af6f-816022564988 Jun 17 04:42:25 devstack sudo[99670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:42:25 devstack sudo[99668]: pam_unix(sudo:session): session closed for user root Jun 17 04:42:25 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-88a505e3-f7c9-4869-9ced-e8c764b60c47 tempest-VolumesImageMetadata-641798962 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-412e64dd-2cc3-4deb-b25c-ff34b6f3f40d 1G" returned: 0 in 0.802s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:42:25 devstack cinder-volume[92060]: DEBUG oslo.privsep.daemon [-] privsep: reply[66e9bc76-3919-418d-b1f5-b2b74d9c5465]: (4, 'raw') {{(pid=93130) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 04:42:25 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-88a505e3-f7c9-4869-9ced-e8c764b60c47 tempest-VolumesImageMetadata-641798962 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-412e64dd-2cc3-4deb-b25c-ff34b6f3f40d {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:42:25 devstack sudo[99675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-412e64dd-2cc3-4deb-b25c-ff34b6f3f40d Jun 17 04:42:25 devstack sudo[99675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:42:25 devstack sudo[99670]: pam_unix(sudo:session): session closed for user root Jun 17 04:42:25 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-f308ce83-9808-4a35-8e01-6a1ef17b4cab tempest-VolumesMetadataTest-954173709 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-198f60f3-372a-430d-af6f-816022564988" returned: 0 in 0.822s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:42:25 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-f308ce83-9808-4a35-8e01-6a1ef17b4cab tempest-VolumesMetadataTest-954173709 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-198f60f3-372a-430d-af6f-816022564988 {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:42:25 devstack sudo[99680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-198f60f3-372a-430d-af6f-816022564988 Jun 17 04:42:25 devstack sudo[99680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:42:26 devstack sudo[99675]: pam_unix(sudo:session): session closed for user root Jun 17 04:42:26 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-88a505e3-f7c9-4869-9ced-e8c764b60c47 tempest-VolumesImageMetadata-641798962 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-412e64dd-2cc3-4deb-b25c-ff34b6f3f40d" returned: 0 in 0.863s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:42:26 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-88a505e3-f7c9-4869-9ced-e8c764b60c47 tempest-VolumesImageMetadata-641798962 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-412e64dd-2cc3-4deb-b25c-ff34b6f3f40d {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:42:26 devstack sudo[99689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-412e64dd-2cc3-4deb-b25c-ff34b6f3f40d Jun 17 04:42:26 devstack sudo[99689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:42:26 devstack sudo[99680]: pam_unix(sudo:session): session closed for user root Jun 17 04:42:26 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-f308ce83-9808-4a35-8e01-6a1ef17b4cab tempest-VolumesMetadataTest-954173709 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-198f60f3-372a-430d-af6f-816022564988" returned: 0 in 0.686s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:42:26 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-f308ce83-9808-4a35-8e01-6a1ef17b4cab tempest-VolumesMetadataTest-954173709 None] Lock "cinder-quobyte-198f60f3-372a-430d-af6f-816022564988" released by "delete_volume" :: held 1.573s {{(pid=92060) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 04:42:26 devstack cinder-volume[92060]: DEBUG cinder.quota [None req-f308ce83-9808-4a35-8e01-6a1ef17b4cab tempest-VolumesMetadataTest-954173709 None] Created reservations ['2a9bf850-932e-46cb-bf7d-5e6214000409', 'c89456b7-8830-4049-97fd-3ff22a047889', '33e59e5b-a0d3-4103-899b-61d9a6663352', '23f48d3e-ec9d-410b-9b51-9527f5b02e8c'] {{(pid=92060) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 17 04:42:26 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-f308ce83-9808-4a35-8e01-6a1ef17b4cab tempest-VolumesMetadataTest-954173709 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 04:42:26 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-f308ce83-9808-4a35-8e01-6a1ef17b4cab tempest-VolumesMetadataTest-954173709 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 04:42:26 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-f308ce83-9808-4a35-8e01-6a1ef17b4cab tempest-VolumesMetadataTest-954173709 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588': None} {{(pid=92060) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 17 04:42:26 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-f308ce83-9808-4a35-8e01-6a1ef17b4cab tempest-VolumesMetadataTest-954173709 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588'] {{(pid=92060) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 17 04:42:26 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-f308ce83-9808-4a35-8e01-6a1ef17b4cab tempest-VolumesMetadataTest-954173709 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 04:42:26 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-f308ce83-9808-4a35-8e01-6a1ef17b4cab tempest-VolumesMetadataTest-954173709 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:42:26 devstack sudo[99697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a Jun 17 04:42:26 devstack sudo[99697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:42:27 devstack sudo[99689]: pam_unix(sudo:session): session closed for user root Jun 17 04:42:27 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-88a505e3-f7c9-4869-9ced-e8c764b60c47 tempest-VolumesImageMetadata-641798962 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-412e64dd-2cc3-4deb-b25c-ff34b6f3f40d" returned: 1 in 0.958s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:42:27 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-88a505e3-f7c9-4869-9ced-e8c764b60c47 tempest-VolumesImageMetadata-641798962 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-412e64dd-2cc3-4deb-b25c-ff34b6f3f40d' failed. Not Retrying. {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 17 04:42:27 devstack cinder-volume[92060]: DEBUG cinder.volume.volume_utils [None req-88a505e3-f7c9-4869-9ced-e8c764b60c47 tempest-VolumesImageMetadata-641798962 None] Downloaded image 5abcba5c-72fa-4ea5-881e-1f4f187259a5 ((None, [{'url': 'file:///opt/stack/data/glance/images/5abcba5c-72fa-4ea5-881e-1f4f187259a5', 'metadata': {}}])) to volume 412e64dd-2cc3-4deb-b25c-ff34b6f3f40d successfully. {{(pid=92060) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jun 17 04:42:27 devstack cinder-volume[92060]: DEBUG cinder.image.image_utils [None req-88a505e3-f7c9-4869-9ced-e8c764b60c47 tempest-VolumesImageMetadata-641798962 None] Temporary image 5abcba5c-72fa-4ea5-881e-1f4f187259a5 for user 2a7663da31b740f0a3ce85abd12d8960 is deleted. {{(pid=92060) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jun 17 04:42:27 devstack cinder-volume[92060]: DEBUG cinder.volume.volume_utils [None req-88a505e3-f7c9-4869-9ced-e8c764b60c47 tempest-VolumesImageMetadata-641798962 None] Marking volume 412e64dd-2cc3-4deb-b25c-ff34b6f3f40d as bootable. {{(pid=92060) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jun 17 04:42:27 devstack cinder-volume[92060]: DEBUG cinder.volume.flows.manager.create_volume [None req-88a505e3-f7c9-4869-9ced-e8c764b60c47 tempest-VolumesImageMetadata-641798962 None] Copying metadata from image 5abcba5c-72fa-4ea5-881e-1f4f187259a5 to 412e64dd-2cc3-4deb-b25c-ff34b6f3f40d. {{(pid=92060) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jun 17 04:42:27 devstack cinder-volume[92060]: DEBUG cinder.volume.flows.manager.create_volume [None req-88a505e3-f7c9-4869-9ced-e8c764b60c47 tempest-VolumesImageMetadata-641798962 None] Creating volume glance metadata for volume 412e64dd-2cc3-4deb-b25c-ff34b6f3f40d backed by image 5abcba5c-72fa-4ea5-881e-1f4f187259a5 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '5abcba5c-72fa-4ea5-881e-1f4f187259a5', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=92060) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jun 17 04:42:27 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-88a505e3-f7c9-4869-9ced-e8c764b60c47 tempest-VolumesImageMetadata-641798962 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d14a52ec-74ae-4c24-a697-3b2749acf531) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-412e64dd-2cc3-4deb-b25c-ff34b6f3f40d', 'volume_size': 1, 'image_id': '5abcba5c-72fa-4ea5-881e-1f4f187259a5', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/5abcba5c-72fa-4ea5-881e-1f4f187259a5', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'ec7d18cca2734755a53ee22ace21508e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '5abcba5c-72fa-4ea5-881e-1f4f187259a5', 'created_at': datetime.datetime(2026, 6, 17, 2, 29, 47, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 17, 2, 29, 49, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/5abcba5c-72fa-4ea5-881e-1f4f187259a5/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:42:27 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-88a505e3-f7c9-4869-9ced-e8c764b60c47 tempest-VolumesImageMetadata-641798962 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (94fc9209-b6e9-4fca-80e5-4469a730d9f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:42:27 devstack cinder-volume[92060]: INFO cinder.volume.flows.manager.create_volume [None req-88a505e3-f7c9-4869-9ced-e8c764b60c47 tempest-VolumesImageMetadata-641798962 None] Volume volume-412e64dd-2cc3-4deb-b25c-ff34b6f3f40d (412e64dd-2cc3-4deb-b25c-ff34b6f3f40d): created successfully Jun 17 04:42:27 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-88a505e3-f7c9-4869-9ced-e8c764b60c47 tempest-VolumesImageMetadata-641798962 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (94fc9209-b6e9-4fca-80e5-4469a730d9f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:42:27 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-88a505e3-f7c9-4869-9ced-e8c764b60c47 tempest-VolumesImageMetadata-641798962 None] Flow 'volume_create_manager' (91ee8ba1-8567-483c-ab90-b8f3a4bf4750) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92060) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 17 04:42:27 devstack cinder-volume[92060]: INFO cinder.volume.manager [None req-88a505e3-f7c9-4869-9ced-e8c764b60c47 tempest-VolumesImageMetadata-641798962 None] Created volume successfully. Jun 17 04:42:27 devstack sudo[99697]: pam_unix(sudo:session): session closed for user root Jun 17 04:42:27 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-f308ce83-9808-4a35-8e01-6a1ef17b4cab tempest-VolumesMetadataTest-954173709 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a" returned: 0 in 0.847s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:42:27 devstack cinder-volume[92060]: DEBUG cinder.manager [None req-f308ce83-9808-4a35-8e01-6a1ef17b4cab tempest-VolumesMetadataTest-954173709 None] Notifying Schedulers of capabilities ... {{(pid=92060) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 17 04:42:27 devstack cinder-volume[92060]: INFO cinder.volume.manager [None req-f308ce83-9808-4a35-8e01-6a1ef17b4cab tempest-VolumesMetadataTest-954173709 None] Deleted volume successfully. Jun 17 04:42:27 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-f308ce83-9808-4a35-8e01-6a1ef17b4cab tempest-VolumesMetadataTest-954173709 None] Lock "cinder-198f60f3-372a-430d-af6f-816022564988-delete_volume" released by "delete_volume" :: held 2.751s {{(pid=92060) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 04:42:28 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-43704a6c-ea5f-4e04-90e6-7bdacf28f07b tempest-VolumesImageMetadata-641798962 None] Acquiring lock "cinder-412e64dd-2cc3-4deb-b25c-ff34b6f3f40d-delete_volume" by "delete_volume" {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 04:42:28 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-43704a6c-ea5f-4e04-90e6-7bdacf28f07b tempest-VolumesImageMetadata-641798962 None] Lock "cinder-412e64dd-2cc3-4deb-b25c-ff34b6f3f40d-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 04:42:28 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-43704a6c-ea5f-4e04-90e6-7bdacf28f07b tempest-VolumesImageMetadata-641798962 None] Acquiring lock "cinder-quobyte-412e64dd-2cc3-4deb-b25c-ff34b6f3f40d" by "delete_volume" {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 04:42:28 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-43704a6c-ea5f-4e04-90e6-7bdacf28f07b tempest-VolumesImageMetadata-641798962 None] Lock "cinder-quobyte-412e64dd-2cc3-4deb-b25c-ff34b6f3f40d" acquired by "delete_volume" :: waited 0.031s {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 04:42:28 devstack cinder-volume[92060]: DEBUG oslo.privsep.daemon [-] privsep: reply[47ec32f5-f5f8-4787-9055-3a7f4fe4cb38]: (4, 'raw') {{(pid=93130) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 04:42:28 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-43704a6c-ea5f-4e04-90e6-7bdacf28f07b tempest-VolumesImageMetadata-641798962 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-412e64dd-2cc3-4deb-b25c-ff34b6f3f40d {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:42:29 devstack sudo[99772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-412e64dd-2cc3-4deb-b25c-ff34b6f3f40d Jun 17 04:42:29 devstack sudo[99772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:42:30 devstack sudo[99772]: pam_unix(sudo:session): session closed for user root Jun 17 04:42:30 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-43704a6c-ea5f-4e04-90e6-7bdacf28f07b tempest-VolumesImageMetadata-641798962 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-412e64dd-2cc3-4deb-b25c-ff34b6f3f40d" returned: 0 in 1.216s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:42:30 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-43704a6c-ea5f-4e04-90e6-7bdacf28f07b tempest-VolumesImageMetadata-641798962 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-412e64dd-2cc3-4deb-b25c-ff34b6f3f40d {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:42:30 devstack sudo[99783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-412e64dd-2cc3-4deb-b25c-ff34b6f3f40d Jun 17 04:42:30 devstack sudo[99783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:42:31 devstack sudo[99783]: pam_unix(sudo:session): session closed for user root Jun 17 04:42:31 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-43704a6c-ea5f-4e04-90e6-7bdacf28f07b tempest-VolumesImageMetadata-641798962 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-412e64dd-2cc3-4deb-b25c-ff34b6f3f40d" returned: 1 in 1.184s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:42:31 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-43704a6c-ea5f-4e04-90e6-7bdacf28f07b tempest-VolumesImageMetadata-641798962 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-412e64dd-2cc3-4deb-b25c-ff34b6f3f40d' failed. Not Retrying. {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 17 04:42:31 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-43704a6c-ea5f-4e04-90e6-7bdacf28f07b tempest-VolumesImageMetadata-641798962 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-412e64dd-2cc3-4deb-b25c-ff34b6f3f40d {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:42:31 devstack sudo[99789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-412e64dd-2cc3-4deb-b25c-ff34b6f3f40d Jun 17 04:42:31 devstack sudo[99789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:42:32 devstack sudo[99789]: pam_unix(sudo:session): session closed for user root Jun 17 04:42:32 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-43704a6c-ea5f-4e04-90e6-7bdacf28f07b tempest-VolumesImageMetadata-641798962 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-412e64dd-2cc3-4deb-b25c-ff34b6f3f40d" returned: 0 in 0.923s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:42:32 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-43704a6c-ea5f-4e04-90e6-7bdacf28f07b tempest-VolumesImageMetadata-641798962 None] Lock "cinder-quobyte-412e64dd-2cc3-4deb-b25c-ff34b6f3f40d" released by "delete_volume" :: held 3.449s {{(pid=92060) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 04:42:32 devstack cinder-volume[92060]: DEBUG cinder.quota [None req-43704a6c-ea5f-4e04-90e6-7bdacf28f07b tempest-VolumesImageMetadata-641798962 None] Created reservations ['669718f9-7419-4764-96d7-f1c1b70d9023', 'db881a6c-bda8-4ee2-99f3-0ede1ef72b58', 'c6903866-b7f9-4595-921f-b602adf80cdb', 'b77d8ef4-19b1-4309-8479-5aab65cf42d2'] {{(pid=92060) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 17 04:42:32 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-43704a6c-ea5f-4e04-90e6-7bdacf28f07b tempest-VolumesImageMetadata-641798962 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 04:42:32 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-43704a6c-ea5f-4e04-90e6-7bdacf28f07b tempest-VolumesImageMetadata-641798962 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 04:42:32 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-43704a6c-ea5f-4e04-90e6-7bdacf28f07b tempest-VolumesImageMetadata-641798962 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588': None} {{(pid=92060) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 17 04:42:32 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-43704a6c-ea5f-4e04-90e6-7bdacf28f07b tempest-VolumesImageMetadata-641798962 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588'] {{(pid=92060) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 17 04:42:32 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-43704a6c-ea5f-4e04-90e6-7bdacf28f07b tempest-VolumesImageMetadata-641798962 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 04:42:32 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-43704a6c-ea5f-4e04-90e6-7bdacf28f07b tempest-VolumesImageMetadata-641798962 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:42:32 devstack sudo[99792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a Jun 17 04:42:32 devstack sudo[99792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:42:33 devstack sudo[99792]: pam_unix(sudo:session): session closed for user root Jun 17 04:42:33 devstack cinder-volume[92060]: DEBUG cinder.volume.flows.manager.create_volume [None req-14b1b42f-92a6-4904-a5a8-6286683a383c tempest-VolumeQuotasAdminTestJSON-337010830 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92060) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 17 04:42:33 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-14b1b42f-92a6-4904-a5a8-6286683a383c tempest-VolumeQuotasAdminTestJSON-337010830 None] Flow 'volume_create_manager' (4bb85732-e4ea-4534-9d43-b0f23566b21f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 17 04:42:33 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-14b1b42f-92a6-4904-a5a8-6286683a383c tempest-VolumeQuotasAdminTestJSON-337010830 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (140800fd-8389-41cd-994f-be036c641b94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:42:33 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-43704a6c-ea5f-4e04-90e6-7bdacf28f07b tempest-VolumesImageMetadata-641798962 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a" returned: 0 in 0.792s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:42:33 devstack cinder-volume[92060]: DEBUG cinder.manager [None req-43704a6c-ea5f-4e04-90e6-7bdacf28f07b tempest-VolumesImageMetadata-641798962 None] Notifying Schedulers of capabilities ... {{(pid=92060) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 17 04:42:33 devstack cinder-volume[92060]: INFO cinder.volume.manager [None req-43704a6c-ea5f-4e04-90e6-7bdacf28f07b tempest-VolumesImageMetadata-641798962 None] Deleted volume successfully. Jun 17 04:42:33 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-14b1b42f-92a6-4904-a5a8-6286683a383c tempest-VolumeQuotasAdminTestJSON-337010830 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (140800fd-8389-41cd-994f-be036c641b94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-17T02:42:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-35333246',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fb2b5c64-2bbd-455e-84c9-7a077f448347,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='afb960af481441f78270780b014393a1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T02:42:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T02:42:33Z,use_quota=True,user_id='1cc50e9492f44661b7e84db4f0932ba7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aad9ce24-93f9-41a6-baa1-5125964f96d1),volume_type_id=aad9ce24-93f9-41a6-baa1-5125964f96d1)' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:42:33 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-14b1b42f-92a6-4904-a5a8-6286683a383c tempest-VolumeQuotasAdminTestJSON-337010830 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f6cb15e5-99e6-4c51-bcf7-20c8bd0cd48c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:42:33 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-14b1b42f-92a6-4904-a5a8-6286683a383c tempest-VolumeQuotasAdminTestJSON-337010830 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f6cb15e5-99e6-4c51-bcf7-20c8bd0cd48c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:42:33 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-14b1b42f-92a6-4904-a5a8-6286683a383c tempest-VolumeQuotasAdminTestJSON-337010830 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9259e16b-fcc5-461a-ad2a-20a905454892) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:42:33 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-14b1b42f-92a6-4904-a5a8-6286683a383c tempest-VolumeQuotasAdminTestJSON-337010830 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9259e16b-fcc5-461a-ad2a-20a905454892) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fb2b5c64-2bbd-455e-84c9-7a077f448347', 'volume_name': 'volume-fb2b5c64-2bbd-455e-84c9-7a077f448347', 'volume_size': 1}' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:42:33 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-14b1b42f-92a6-4904-a5a8-6286683a383c tempest-VolumeQuotasAdminTestJSON-337010830 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (540058ad-2793-45d0-8071-3252b1543c4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:42:33 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-14b1b42f-92a6-4904-a5a8-6286683a383c tempest-VolumeQuotasAdminTestJSON-337010830 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (540058ad-2793-45d0-8071-3252b1543c4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:42:33 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-14b1b42f-92a6-4904-a5a8-6286683a383c tempest-VolumeQuotasAdminTestJSON-337010830 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (83e0a3c2-18fe-4abd-8eb2-32369cf7e393) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:42:33 devstack cinder-volume[92060]: INFO cinder.volume.flows.manager.create_volume [None req-14b1b42f-92a6-4904-a5a8-6286683a383c tempest-VolumeQuotasAdminTestJSON-337010830 None] Volume fb2b5c64-2bbd-455e-84c9-7a077f448347: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fb2b5c64-2bbd-455e-84c9-7a077f448347', 'volume_size': 1} Jun 17 04:42:33 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-14b1b42f-92a6-4904-a5a8-6286683a383c tempest-VolumeQuotasAdminTestJSON-337010830 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 04:42:33 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-14b1b42f-92a6-4904-a5a8-6286683a383c tempest-VolumeQuotasAdminTestJSON-337010830 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.004s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 04:42:33 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-14b1b42f-92a6-4904-a5a8-6286683a383c tempest-VolumeQuotasAdminTestJSON-337010830 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-17T02:42:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-35333246',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fb2b5c64-2bbd-455e-84c9-7a077f448347,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='afb960af481441f78270780b014393a1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T02:42:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T02:42:33Z,use_quota=True,user_id='1cc50e9492f44661b7e84db4f0932ba7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aad9ce24-93f9-41a6-baa1-5125964f96d1),volume_type_id=aad9ce24-93f9-41a6-baa1-5125964f96d1)}" {{(pid=92060) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 17 04:42:33 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.remotefs [None req-14b1b42f-92a6-4904-a5a8-6286683a383c tempest-VolumeQuotasAdminTestJSON-337010830 None] Creating volume fb2b5c64-2bbd-455e-84c9-7a077f448347 {{(pid=92060) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 17 04:42:33 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-14b1b42f-92a6-4904-a5a8-6286683a383c tempest-VolumeQuotasAdminTestJSON-337010830 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 04:42:33 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-14b1b42f-92a6-4904-a5a8-6286683a383c tempest-VolumeQuotasAdminTestJSON-337010830 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 04:42:33 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-14b1b42f-92a6-4904-a5a8-6286683a383c tempest-VolumeQuotasAdminTestJSON-337010830 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588': None} {{(pid=92060) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 17 04:42:33 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-14b1b42f-92a6-4904-a5a8-6286683a383c tempest-VolumeQuotasAdminTestJSON-337010830 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588'] {{(pid=92060) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 17 04:42:33 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-14b1b42f-92a6-4904-a5a8-6286683a383c tempest-VolumeQuotasAdminTestJSON-337010830 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 04:42:33 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-14b1b42f-92a6-4904-a5a8-6286683a383c tempest-VolumeQuotasAdminTestJSON-337010830 None] Selected osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588 as target Quobyte volume. {{(pid=92060) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 17 04:42:33 devstack cinder-volume[92060]: INFO cinder.volume.drivers.remotefs [None req-14b1b42f-92a6-4904-a5a8-6286683a383c tempest-VolumeQuotasAdminTestJSON-337010830 None] casted to osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588 Jun 17 04:42:33 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-14b1b42f-92a6-4904-a5a8-6286683a383c tempest-VolumeQuotasAdminTestJSON-337010830 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-fb2b5c64-2bbd-455e-84c9-7a077f448347 1073741824 {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:42:33 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-43704a6c-ea5f-4e04-90e6-7bdacf28f07b tempest-VolumesImageMetadata-641798962 None] Lock "cinder-412e64dd-2cc3-4deb-b25c-ff34b6f3f40d-delete_volume" released by "delete_volume" :: held 4.618s {{(pid=92060) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 04:42:33 devstack sudo[99795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-fb2b5c64-2bbd-455e-84c9-7a077f448347 1073741824 Jun 17 04:42:33 devstack sudo[99795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:42:34 devstack sudo[99795]: pam_unix(sudo:session): session closed for user root Jun 17 04:42:34 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-14b1b42f-92a6-4904-a5a8-6286683a383c tempest-VolumeQuotasAdminTestJSON-337010830 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-fb2b5c64-2bbd-455e-84c9-7a077f448347 1073741824" returned: 0 in 1.003s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:42:34 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-14b1b42f-92a6-4904-a5a8-6286683a383c tempest-VolumeQuotasAdminTestJSON-337010830 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-fb2b5c64-2bbd-455e-84c9-7a077f448347 {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:42:34 devstack sudo[99801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-fb2b5c64-2bbd-455e-84c9-7a077f448347 Jun 17 04:42:34 devstack sudo[99801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:42:34 devstack cinder-volume[92060]: DEBUG cinder.volume.flows.manager.create_volume [None req-c22e42ff-c816-4de3-a5ee-289ce5789652 tempest-VolumesTransfersTest-680980744 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92060) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 17 04:42:34 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-c22e42ff-c816-4de3-a5ee-289ce5789652 tempest-VolumesTransfersTest-680980744 None] Flow 'volume_create_manager' (39274744-2133-46e8-a01c-60891f92a223) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 17 04:42:34 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-c22e42ff-c816-4de3-a5ee-289ce5789652 tempest-VolumesTransfersTest-680980744 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bcfe74f8-a356-47b0-bb28-4610e7f75836) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:42:34 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-c22e42ff-c816-4de3-a5ee-289ce5789652 tempest-VolumesTransfersTest-680980744 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bcfe74f8-a356-47b0-bb28-4610e7f75836) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-17T02:42:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-213694372',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=46b74e5a-a7bb-4c17-aa22-2dd43c085993,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c390126f54f14bb98dbc66f3b11d79e0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T02:42:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T02:42:35Z,use_quota=True,user_id='a2dce25e9b7f433e86db8b81fe3d413b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aad9ce24-93f9-41a6-baa1-5125964f96d1),volume_type_id=aad9ce24-93f9-41a6-baa1-5125964f96d1)' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:42:34 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-c22e42ff-c816-4de3-a5ee-289ce5789652 tempest-VolumesTransfersTest-680980744 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (46df24c6-48be-4b48-b686-1c7a30a8c179) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:42:34 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-c22e42ff-c816-4de3-a5ee-289ce5789652 tempest-VolumesTransfersTest-680980744 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (46df24c6-48be-4b48-b686-1c7a30a8c179) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:42:34 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-c22e42ff-c816-4de3-a5ee-289ce5789652 tempest-VolumesTransfersTest-680980744 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1bde5f60-98c5-450c-84da-9ade8477f7ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:42:34 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-c22e42ff-c816-4de3-a5ee-289ce5789652 tempest-VolumesTransfersTest-680980744 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1bde5f60-98c5-450c-84da-9ade8477f7ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '46b74e5a-a7bb-4c17-aa22-2dd43c085993', 'volume_name': 'volume-46b74e5a-a7bb-4c17-aa22-2dd43c085993', 'volume_size': 1}' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:42:34 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-c22e42ff-c816-4de3-a5ee-289ce5789652 tempest-VolumesTransfersTest-680980744 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cb628799-abc3-4b01-aa8e-53e8b23456c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:42:34 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-c22e42ff-c816-4de3-a5ee-289ce5789652 tempest-VolumesTransfersTest-680980744 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cb628799-abc3-4b01-aa8e-53e8b23456c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:42:34 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-c22e42ff-c816-4de3-a5ee-289ce5789652 tempest-VolumesTransfersTest-680980744 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (42903dbb-899c-48b2-9899-4910c8ce9011) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:42:34 devstack cinder-volume[92060]: INFO cinder.volume.flows.manager.create_volume [None req-c22e42ff-c816-4de3-a5ee-289ce5789652 tempest-VolumesTransfersTest-680980744 None] Volume 46b74e5a-a7bb-4c17-aa22-2dd43c085993: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-46b74e5a-a7bb-4c17-aa22-2dd43c085993', 'volume_size': 1} Jun 17 04:42:34 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-c22e42ff-c816-4de3-a5ee-289ce5789652 tempest-VolumesTransfersTest-680980744 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 04:42:35 devstack sudo[99801]: pam_unix(sudo:session): session closed for user root Jun 17 04:42:35 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-14b1b42f-92a6-4904-a5a8-6286683a383c tempest-VolumeQuotasAdminTestJSON-337010830 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-fb2b5c64-2bbd-455e-84c9-7a077f448347" returned: 0 in 0.781s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:42:35 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-14b1b42f-92a6-4904-a5a8-6286683a383c tempest-VolumeQuotasAdminTestJSON-337010830 None] <== create_volume: return (1843ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588'} {{(pid=92060) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 17 04:42:35 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-14b1b42f-92a6-4904-a5a8-6286683a383c tempest-VolumeQuotasAdminTestJSON-337010830 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.848s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 04:42:35 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-c22e42ff-c816-4de3-a5ee-289ce5789652 tempest-VolumesTransfersTest-680980744 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.269s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 04:42:35 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-c22e42ff-c816-4de3-a5ee-289ce5789652 tempest-VolumesTransfersTest-680980744 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-17T02:42:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-213694372',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=46b74e5a-a7bb-4c17-aa22-2dd43c085993,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c390126f54f14bb98dbc66f3b11d79e0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T02:42:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T02:42:35Z,use_quota=True,user_id='a2dce25e9b7f433e86db8b81fe3d413b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aad9ce24-93f9-41a6-baa1-5125964f96d1),volume_type_id=aad9ce24-93f9-41a6-baa1-5125964f96d1)}" {{(pid=92060) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 17 04:42:35 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.remotefs [None req-c22e42ff-c816-4de3-a5ee-289ce5789652 tempest-VolumesTransfersTest-680980744 None] Creating volume 46b74e5a-a7bb-4c17-aa22-2dd43c085993 {{(pid=92060) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 17 04:42:35 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-c22e42ff-c816-4de3-a5ee-289ce5789652 tempest-VolumesTransfersTest-680980744 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 04:42:35 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-c22e42ff-c816-4de3-a5ee-289ce5789652 tempest-VolumesTransfersTest-680980744 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 04:42:35 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-c22e42ff-c816-4de3-a5ee-289ce5789652 tempest-VolumesTransfersTest-680980744 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588': None} {{(pid=92060) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 17 04:42:35 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-c22e42ff-c816-4de3-a5ee-289ce5789652 tempest-VolumesTransfersTest-680980744 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588'] {{(pid=92060) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 17 04:42:35 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-c22e42ff-c816-4de3-a5ee-289ce5789652 tempest-VolumesTransfersTest-680980744 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 04:42:35 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-c22e42ff-c816-4de3-a5ee-289ce5789652 tempest-VolumesTransfersTest-680980744 None] Selected osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588 as target Quobyte volume. {{(pid=92060) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 17 04:42:35 devstack cinder-volume[92060]: INFO cinder.volume.drivers.remotefs [None req-c22e42ff-c816-4de3-a5ee-289ce5789652 tempest-VolumesTransfersTest-680980744 None] casted to osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588 Jun 17 04:42:35 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-c22e42ff-c816-4de3-a5ee-289ce5789652 tempest-VolumesTransfersTest-680980744 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-46b74e5a-a7bb-4c17-aa22-2dd43c085993 1073741824 {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:42:35 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-14b1b42f-92a6-4904-a5a8-6286683a383c tempest-VolumeQuotasAdminTestJSON-337010830 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (83e0a3c2-18fe-4abd-8eb2-32369cf7e393) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fb2b5c64-2bbd-455e-84c9-7a077f448347', 'volume_size': 1}' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:42:35 devstack sudo[99804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-46b74e5a-a7bb-4c17-aa22-2dd43c085993 1073741824 Jun 17 04:42:35 devstack sudo[99804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:42:35 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-14b1b42f-92a6-4904-a5a8-6286683a383c tempest-VolumeQuotasAdminTestJSON-337010830 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bdb39e9b-a709-44f4-bccd-34ac6f84e9b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:42:35 devstack cinder-volume[92060]: INFO cinder.volume.flows.manager.create_volume [None req-14b1b42f-92a6-4904-a5a8-6286683a383c tempest-VolumeQuotasAdminTestJSON-337010830 None] Volume volume-fb2b5c64-2bbd-455e-84c9-7a077f448347 (fb2b5c64-2bbd-455e-84c9-7a077f448347): created successfully Jun 17 04:42:35 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-14b1b42f-92a6-4904-a5a8-6286683a383c tempest-VolumeQuotasAdminTestJSON-337010830 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bdb39e9b-a709-44f4-bccd-34ac6f84e9b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:42:35 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-14b1b42f-92a6-4904-a5a8-6286683a383c tempest-VolumeQuotasAdminTestJSON-337010830 None] Flow 'volume_create_manager' (4bb85732-e4ea-4534-9d43-b0f23566b21f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92060) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 17 04:42:35 devstack cinder-volume[92060]: INFO cinder.volume.manager [None req-14b1b42f-92a6-4904-a5a8-6286683a383c tempest-VolumeQuotasAdminTestJSON-337010830 None] Created volume successfully. Jun 17 04:42:35 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-8123e0c6-2988-4149-a0de-18d6d8478e7f tempest-VolumeQuotasAdminTestJSON-337010830 None] Acquiring lock "cinder-fb2b5c64-2bbd-455e-84c9-7a077f448347-delete_volume" by "delete_volume" {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 04:42:35 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-8123e0c6-2988-4149-a0de-18d6d8478e7f tempest-VolumeQuotasAdminTestJSON-337010830 None] Lock "cinder-fb2b5c64-2bbd-455e-84c9-7a077f448347-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 04:42:35 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-8123e0c6-2988-4149-a0de-18d6d8478e7f tempest-VolumeQuotasAdminTestJSON-337010830 None] Acquiring lock "cinder-quobyte-fb2b5c64-2bbd-455e-84c9-7a077f448347" by "delete_volume" {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 04:42:35 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-8123e0c6-2988-4149-a0de-18d6d8478e7f tempest-VolumeQuotasAdminTestJSON-337010830 None] Lock "cinder-quobyte-fb2b5c64-2bbd-455e-84c9-7a077f448347" acquired by "delete_volume" :: waited 0.053s {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 04:42:35 devstack cinder-volume[92060]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8980ded-3554-423c-a605-a04c4f40eba0]: (4, 'qcow2') {{(pid=93130) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 04:42:35 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-8123e0c6-2988-4149-a0de-18d6d8478e7f tempest-VolumeQuotasAdminTestJSON-337010830 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-fb2b5c64-2bbd-455e-84c9-7a077f448347 {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:42:35 devstack sudo[99806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-fb2b5c64-2bbd-455e-84c9-7a077f448347 Jun 17 04:42:35 devstack sudo[99806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:42:36 devstack sudo[99804]: pam_unix(sudo:session): session closed for user root Jun 17 04:42:36 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-c22e42ff-c816-4de3-a5ee-289ce5789652 tempest-VolumesTransfersTest-680980744 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-46b74e5a-a7bb-4c17-aa22-2dd43c085993 1073741824" returned: 0 in 1.121s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:42:36 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-c22e42ff-c816-4de3-a5ee-289ce5789652 tempest-VolumesTransfersTest-680980744 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-46b74e5a-a7bb-4c17-aa22-2dd43c085993 {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:42:36 devstack sudo[99812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-46b74e5a-a7bb-4c17-aa22-2dd43c085993 Jun 17 04:42:36 devstack sudo[99812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:42:36 devstack sudo[99806]: pam_unix(sudo:session): session closed for user root Jun 17 04:42:36 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-8123e0c6-2988-4149-a0de-18d6d8478e7f tempest-VolumeQuotasAdminTestJSON-337010830 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-fb2b5c64-2bbd-455e-84c9-7a077f448347" returned: 0 in 1.050s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:42:36 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-8123e0c6-2988-4149-a0de-18d6d8478e7f tempest-VolumeQuotasAdminTestJSON-337010830 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-fb2b5c64-2bbd-455e-84c9-7a077f448347 {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:42:36 devstack sudo[99818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-fb2b5c64-2bbd-455e-84c9-7a077f448347 Jun 17 04:42:36 devstack sudo[99818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:42:37 devstack sudo[99812]: pam_unix(sudo:session): session closed for user root Jun 17 04:42:37 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-c22e42ff-c816-4de3-a5ee-289ce5789652 tempest-VolumesTransfersTest-680980744 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-46b74e5a-a7bb-4c17-aa22-2dd43c085993" returned: 0 in 0.864s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:42:37 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-c22e42ff-c816-4de3-a5ee-289ce5789652 tempest-VolumesTransfersTest-680980744 None] <== create_volume: return (2038ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588'} {{(pid=92060) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 17 04:42:37 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-c22e42ff-c816-4de3-a5ee-289ce5789652 tempest-VolumesTransfersTest-680980744 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.042s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 04:42:37 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-c22e42ff-c816-4de3-a5ee-289ce5789652 tempest-VolumesTransfersTest-680980744 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (42903dbb-899c-48b2-9899-4910c8ce9011) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-46b74e5a-a7bb-4c17-aa22-2dd43c085993', 'volume_size': 1}' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:42:37 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-c22e42ff-c816-4de3-a5ee-289ce5789652 tempest-VolumesTransfersTest-680980744 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bad8c5f7-f025-4cf4-a917-02e11cf2fd1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:42:37 devstack cinder-volume[92060]: INFO cinder.volume.flows.manager.create_volume [None req-c22e42ff-c816-4de3-a5ee-289ce5789652 tempest-VolumesTransfersTest-680980744 None] Volume volume-46b74e5a-a7bb-4c17-aa22-2dd43c085993 (46b74e5a-a7bb-4c17-aa22-2dd43c085993): created successfully Jun 17 04:42:37 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-c22e42ff-c816-4de3-a5ee-289ce5789652 tempest-VolumesTransfersTest-680980744 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bad8c5f7-f025-4cf4-a917-02e11cf2fd1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:42:37 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-c22e42ff-c816-4de3-a5ee-289ce5789652 tempest-VolumesTransfersTest-680980744 None] Flow 'volume_create_manager' (39274744-2133-46e8-a01c-60891f92a223) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92060) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 17 04:42:37 devstack cinder-volume[92060]: INFO cinder.volume.manager [None req-c22e42ff-c816-4de3-a5ee-289ce5789652 tempest-VolumesTransfersTest-680980744 None] Created volume successfully. Jun 17 04:42:37 devstack sudo[99818]: pam_unix(sudo:session): session closed for user root Jun 17 04:42:37 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-8123e0c6-2988-4149-a0de-18d6d8478e7f tempest-VolumeQuotasAdminTestJSON-337010830 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-fb2b5c64-2bbd-455e-84c9-7a077f448347" returned: 0 in 0.735s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:42:37 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-8123e0c6-2988-4149-a0de-18d6d8478e7f tempest-VolumeQuotasAdminTestJSON-337010830 None] Lock "cinder-quobyte-fb2b5c64-2bbd-455e-84c9-7a077f448347" released by "delete_volume" :: held 1.850s {{(pid=92060) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 04:42:37 devstack cinder-volume[92060]: DEBUG cinder.quota [None req-8123e0c6-2988-4149-a0de-18d6d8478e7f tempest-VolumeQuotasAdminTestJSON-337010830 None] Created reservations ['bb02d2f6-f86b-4923-a189-8729fdab46dc', '46ac02f8-bdf6-4d7b-b27d-8043de1c78dd', '9d35cb95-25b8-4fbc-a269-bccf7f6a1ddc', '63ba9053-3360-40fb-8efe-13007caa72b8'] {{(pid=92060) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 17 04:42:37 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-8123e0c6-2988-4149-a0de-18d6d8478e7f tempest-VolumeQuotasAdminTestJSON-337010830 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 04:42:37 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-8123e0c6-2988-4149-a0de-18d6d8478e7f tempest-VolumeQuotasAdminTestJSON-337010830 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 04:42:37 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-8123e0c6-2988-4149-a0de-18d6d8478e7f tempest-VolumeQuotasAdminTestJSON-337010830 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588': None} {{(pid=92060) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 17 04:42:37 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-8123e0c6-2988-4149-a0de-18d6d8478e7f tempest-VolumeQuotasAdminTestJSON-337010830 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588'] {{(pid=92060) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 17 04:42:37 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-8123e0c6-2988-4149-a0de-18d6d8478e7f tempest-VolumeQuotasAdminTestJSON-337010830 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 04:42:37 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-8123e0c6-2988-4149-a0de-18d6d8478e7f tempest-VolumeQuotasAdminTestJSON-337010830 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:42:37 devstack sudo[99822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a Jun 17 04:42:37 devstack sudo[99822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:42:38 devstack sudo[99822]: pam_unix(sudo:session): session closed for user root Jun 17 04:42:38 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-8123e0c6-2988-4149-a0de-18d6d8478e7f tempest-VolumeQuotasAdminTestJSON-337010830 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a" returned: 0 in 0.857s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:42:38 devstack cinder-volume[92060]: DEBUG cinder.manager [None req-8123e0c6-2988-4149-a0de-18d6d8478e7f tempest-VolumeQuotasAdminTestJSON-337010830 None] Notifying Schedulers of capabilities ... {{(pid=92060) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 17 04:42:38 devstack cinder-volume[92060]: INFO cinder.volume.manager [None req-8123e0c6-2988-4149-a0de-18d6d8478e7f tempest-VolumeQuotasAdminTestJSON-337010830 None] Deleted volume successfully. Jun 17 04:42:38 devstack cinder-volume[92060]: DEBUG cinder.volume.flows.manager.create_volume [None req-ebfa40fe-6be7-460a-bbeb-173e8ef4163f tempest-VolumesTransfersV357Test-794589489 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92060) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 17 04:42:38 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-ebfa40fe-6be7-460a-bbeb-173e8ef4163f tempest-VolumesTransfersV357Test-794589489 None] Flow 'volume_create_manager' (de75b574-d318-4ff0-ac95-5d065e1536d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 17 04:42:38 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-ebfa40fe-6be7-460a-bbeb-173e8ef4163f tempest-VolumesTransfersV357Test-794589489 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4a0370e9-d47e-4304-b85e-034d71a58337) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:42:38 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-8123e0c6-2988-4149-a0de-18d6d8478e7f tempest-VolumeQuotasAdminTestJSON-337010830 None] Lock "cinder-fb2b5c64-2bbd-455e-84c9-7a077f448347-delete_volume" released by "delete_volume" :: held 3.075s {{(pid=92060) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 04:42:38 devstack cinder-volume[92060]: DEBUG cinder.volume.flows.manager.create_volume [None req-4fc4c587-2337-46b3-a7f4-674ef065e435 tempest-VolumeQuotasAdminTestJSON-337010830 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92060) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 17 04:42:38 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-4fc4c587-2337-46b3-a7f4-674ef065e435 tempest-VolumeQuotasAdminTestJSON-337010830 None] Flow 'volume_create_manager' (ad4dc957-637d-4d05-8259-98726ed0120c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 17 04:42:38 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-4fc4c587-2337-46b3-a7f4-674ef065e435 tempest-VolumeQuotasAdminTestJSON-337010830 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e312bf9c-c14e-4924-a8fb-4ac0350dcce7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:42:38 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-ebfa40fe-6be7-460a-bbeb-173e8ef4163f tempest-VolumesTransfersV357Test-794589489 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4a0370e9-d47e-4304-b85e-034d71a58337) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-17T02:42:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-721673613',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1b5fd73e-67ec-4742-a75e-5e4ea363dabd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cebc2762dd174eb0b54ef663c32d6b98',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T02:42:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T02:42:39Z,use_quota=True,user_id='c91e5ab188094832b054e00f540545de',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aad9ce24-93f9-41a6-baa1-5125964f96d1),volume_type_id=aad9ce24-93f9-41a6-baa1-5125964f96d1)' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:42:38 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-ebfa40fe-6be7-460a-bbeb-173e8ef4163f tempest-VolumesTransfersV357Test-794589489 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (95d08e70-c06a-42be-8868-af6273fc4314) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:42:38 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-ebfa40fe-6be7-460a-bbeb-173e8ef4163f tempest-VolumesTransfersV357Test-794589489 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (95d08e70-c06a-42be-8868-af6273fc4314) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:42:38 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-ebfa40fe-6be7-460a-bbeb-173e8ef4163f tempest-VolumesTransfersV357Test-794589489 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (058d9688-dbd1-429f-b8e2-f765a0f87386) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:42:38 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-ebfa40fe-6be7-460a-bbeb-173e8ef4163f tempest-VolumesTransfersV357Test-794589489 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (058d9688-dbd1-429f-b8e2-f765a0f87386) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1b5fd73e-67ec-4742-a75e-5e4ea363dabd', 'volume_name': 'volume-1b5fd73e-67ec-4742-a75e-5e4ea363dabd', 'volume_size': 1}' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:42:38 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-ebfa40fe-6be7-460a-bbeb-173e8ef4163f tempest-VolumesTransfersV357Test-794589489 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (832d96fb-3efe-464e-9db2-2892096f9b94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:42:38 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-ebfa40fe-6be7-460a-bbeb-173e8ef4163f tempest-VolumesTransfersV357Test-794589489 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (832d96fb-3efe-464e-9db2-2892096f9b94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:42:38 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-ebfa40fe-6be7-460a-bbeb-173e8ef4163f tempest-VolumesTransfersV357Test-794589489 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b375883f-bc50-4fe7-ada1-f5b8c7b8305c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:42:38 devstack cinder-volume[92060]: INFO cinder.volume.flows.manager.create_volume [None req-ebfa40fe-6be7-460a-bbeb-173e8ef4163f tempest-VolumesTransfersV357Test-794589489 None] Volume 1b5fd73e-67ec-4742-a75e-5e4ea363dabd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1b5fd73e-67ec-4742-a75e-5e4ea363dabd', 'volume_size': 1} Jun 17 04:42:38 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-ebfa40fe-6be7-460a-bbeb-173e8ef4163f tempest-VolumesTransfersV357Test-794589489 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 04:42:38 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-ebfa40fe-6be7-460a-bbeb-173e8ef4163f tempest-VolumesTransfersV357Test-794589489 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 04:42:38 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-ebfa40fe-6be7-460a-bbeb-173e8ef4163f tempest-VolumesTransfersV357Test-794589489 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-17T02:42:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-721673613',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1b5fd73e-67ec-4742-a75e-5e4ea363dabd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cebc2762dd174eb0b54ef663c32d6b98',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T02:42:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T02:42:39Z,use_quota=True,user_id='c91e5ab188094832b054e00f540545de',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aad9ce24-93f9-41a6-baa1-5125964f96d1),volume_type_id=aad9ce24-93f9-41a6-baa1-5125964f96d1)}" {{(pid=92060) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 17 04:42:38 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.remotefs [None req-ebfa40fe-6be7-460a-bbeb-173e8ef4163f tempest-VolumesTransfersV357Test-794589489 None] Creating volume 1b5fd73e-67ec-4742-a75e-5e4ea363dabd {{(pid=92060) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 17 04:42:38 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-ebfa40fe-6be7-460a-bbeb-173e8ef4163f tempest-VolumesTransfersV357Test-794589489 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 04:42:38 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-ebfa40fe-6be7-460a-bbeb-173e8ef4163f tempest-VolumesTransfersV357Test-794589489 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 04:42:38 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-ebfa40fe-6be7-460a-bbeb-173e8ef4163f tempest-VolumesTransfersV357Test-794589489 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588': None} {{(pid=92060) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 17 04:42:38 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-ebfa40fe-6be7-460a-bbeb-173e8ef4163f tempest-VolumesTransfersV357Test-794589489 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588'] {{(pid=92060) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 17 04:42:38 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-ebfa40fe-6be7-460a-bbeb-173e8ef4163f tempest-VolumesTransfersV357Test-794589489 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 04:42:38 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-ebfa40fe-6be7-460a-bbeb-173e8ef4163f tempest-VolumesTransfersV357Test-794589489 None] Selected osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588 as target Quobyte volume. {{(pid=92060) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 17 04:42:38 devstack cinder-volume[92060]: INFO cinder.volume.drivers.remotefs [None req-ebfa40fe-6be7-460a-bbeb-173e8ef4163f tempest-VolumesTransfersV357Test-794589489 None] casted to osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588 Jun 17 04:42:38 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-ebfa40fe-6be7-460a-bbeb-173e8ef4163f tempest-VolumesTransfersV357Test-794589489 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-1b5fd73e-67ec-4742-a75e-5e4ea363dabd 1073741824 {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:42:38 devstack sudo[99828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-1b5fd73e-67ec-4742-a75e-5e4ea363dabd 1073741824 Jun 17 04:42:38 devstack sudo[99828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:42:38 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-4fc4c587-2337-46b3-a7f4-674ef065e435 tempest-VolumeQuotasAdminTestJSON-337010830 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e312bf9c-c14e-4924-a8fb-4ac0350dcce7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-17T02:42:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1139821622',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2bd7c010-4574-43d5-8866-7576c3ec3914,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='afb960af481441f78270780b014393a1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T02:42:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T02:42:39Z,use_quota=True,user_id='1cc50e9492f44661b7e84db4f0932ba7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aad9ce24-93f9-41a6-baa1-5125964f96d1),volume_type_id=aad9ce24-93f9-41a6-baa1-5125964f96d1)' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:42:38 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-4fc4c587-2337-46b3-a7f4-674ef065e435 tempest-VolumeQuotasAdminTestJSON-337010830 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (df2c499c-cb20-4e40-b2d0-9ff53984a8aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:42:38 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-4fc4c587-2337-46b3-a7f4-674ef065e435 tempest-VolumeQuotasAdminTestJSON-337010830 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (df2c499c-cb20-4e40-b2d0-9ff53984a8aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:42:38 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-4fc4c587-2337-46b3-a7f4-674ef065e435 tempest-VolumeQuotasAdminTestJSON-337010830 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (09bb9950-b69c-433e-888d-6f8582247344) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:42:38 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-4fc4c587-2337-46b3-a7f4-674ef065e435 tempest-VolumeQuotasAdminTestJSON-337010830 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (09bb9950-b69c-433e-888d-6f8582247344) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2bd7c010-4574-43d5-8866-7576c3ec3914', 'volume_name': 'volume-2bd7c010-4574-43d5-8866-7576c3ec3914', 'volume_size': 1}' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:42:38 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-4fc4c587-2337-46b3-a7f4-674ef065e435 tempest-VolumeQuotasAdminTestJSON-337010830 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4ad83084-510e-44bb-8351-e75daa9d5feb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:42:38 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-4fc4c587-2337-46b3-a7f4-674ef065e435 tempest-VolumeQuotasAdminTestJSON-337010830 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4ad83084-510e-44bb-8351-e75daa9d5feb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:42:38 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-4fc4c587-2337-46b3-a7f4-674ef065e435 tempest-VolumeQuotasAdminTestJSON-337010830 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ecd41172-5cd8-4928-bd3f-fad90a458af2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:42:38 devstack cinder-volume[92060]: INFO cinder.volume.flows.manager.create_volume [None req-4fc4c587-2337-46b3-a7f4-674ef065e435 tempest-VolumeQuotasAdminTestJSON-337010830 None] Volume 2bd7c010-4574-43d5-8866-7576c3ec3914: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2bd7c010-4574-43d5-8866-7576c3ec3914', 'volume_size': 1} Jun 17 04:42:38 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-4fc4c587-2337-46b3-a7f4-674ef065e435 tempest-VolumeQuotasAdminTestJSON-337010830 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 04:42:39 devstack cinder-volume[92060]: INFO cinder.volume.manager [None req-04aa5143-b940-4a70-a733-cf3ae57766ec tempest-VolumesTransfersTest-1488922635 None] Transfer volume completed successfully. Jun 17 04:42:39 devstack sudo[99828]: pam_unix(sudo:session): session closed for user root Jun 17 04:42:39 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-ebfa40fe-6be7-460a-bbeb-173e8ef4163f tempest-VolumesTransfersV357Test-794589489 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-1b5fd73e-67ec-4742-a75e-5e4ea363dabd 1073741824" returned: 0 in 0.823s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:42:39 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-ebfa40fe-6be7-460a-bbeb-173e8ef4163f tempest-VolumesTransfersV357Test-794589489 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-1b5fd73e-67ec-4742-a75e-5e4ea363dabd {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:42:39 devstack sudo[99833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-1b5fd73e-67ec-4742-a75e-5e4ea363dabd Jun 17 04:42:39 devstack sudo[99833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:42:40 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-f1cb6be6-f99a-49df-9e17-a5ee3921559d tempest-VolumesTransfersTest-235508039 None] Acquiring lock "cinder-46b74e5a-a7bb-4c17-aa22-2dd43c085993-delete_volume" by "delete_volume" {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 04:42:40 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-f1cb6be6-f99a-49df-9e17-a5ee3921559d tempest-VolumesTransfersTest-235508039 None] Lock "cinder-46b74e5a-a7bb-4c17-aa22-2dd43c085993-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 04:42:40 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-f1cb6be6-f99a-49df-9e17-a5ee3921559d tempest-VolumesTransfersTest-235508039 None] Acquiring lock "cinder-quobyte-46b74e5a-a7bb-4c17-aa22-2dd43c085993" by "delete_volume" {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 04:42:40 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-f1cb6be6-f99a-49df-9e17-a5ee3921559d tempest-VolumesTransfersTest-235508039 None] Lock "cinder-quobyte-46b74e5a-a7bb-4c17-aa22-2dd43c085993" acquired by "delete_volume" :: waited 0.018s {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 04:42:40 devstack cinder-volume[92060]: DEBUG oslo.privsep.daemon [-] privsep: reply[e66bac78-73a0-41ac-a546-7d0b60fd7b2e]: (4, 'qcow2') {{(pid=93130) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 04:42:40 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-f1cb6be6-f99a-49df-9e17-a5ee3921559d tempest-VolumesTransfersTest-235508039 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-46b74e5a-a7bb-4c17-aa22-2dd43c085993 {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:42:40 devstack sudo[99833]: pam_unix(sudo:session): session closed for user root Jun 17 04:42:40 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-ebfa40fe-6be7-460a-bbeb-173e8ef4163f tempest-VolumesTransfersV357Test-794589489 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-1b5fd73e-67ec-4742-a75e-5e4ea363dabd" returned: 0 in 0.730s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:42:40 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-ebfa40fe-6be7-460a-bbeb-173e8ef4163f tempest-VolumesTransfersV357Test-794589489 None] <== create_volume: return (1598ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588'} {{(pid=92060) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 17 04:42:40 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-ebfa40fe-6be7-460a-bbeb-173e8ef4163f tempest-VolumesTransfersV357Test-794589489 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.600s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 04:42:40 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-4fc4c587-2337-46b3-a7f4-674ef065e435 tempest-VolumeQuotasAdminTestJSON-337010830 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.499s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 04:42:40 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-4fc4c587-2337-46b3-a7f4-674ef065e435 tempest-VolumeQuotasAdminTestJSON-337010830 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-17T02:42:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1139821622',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2bd7c010-4574-43d5-8866-7576c3ec3914,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='afb960af481441f78270780b014393a1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T02:42:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T02:42:39Z,use_quota=True,user_id='1cc50e9492f44661b7e84db4f0932ba7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aad9ce24-93f9-41a6-baa1-5125964f96d1),volume_type_id=aad9ce24-93f9-41a6-baa1-5125964f96d1)}" {{(pid=92060) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 17 04:42:40 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.remotefs [None req-4fc4c587-2337-46b3-a7f4-674ef065e435 tempest-VolumeQuotasAdminTestJSON-337010830 None] Creating volume 2bd7c010-4574-43d5-8866-7576c3ec3914 {{(pid=92060) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 17 04:42:40 devstack sudo[99836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-46b74e5a-a7bb-4c17-aa22-2dd43c085993 Jun 17 04:42:40 devstack sudo[99836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:42:40 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-4fc4c587-2337-46b3-a7f4-674ef065e435 tempest-VolumeQuotasAdminTestJSON-337010830 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 04:42:40 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-4fc4c587-2337-46b3-a7f4-674ef065e435 tempest-VolumeQuotasAdminTestJSON-337010830 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 04:42:40 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-4fc4c587-2337-46b3-a7f4-674ef065e435 tempest-VolumeQuotasAdminTestJSON-337010830 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588': None} {{(pid=92060) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 17 04:42:40 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-4fc4c587-2337-46b3-a7f4-674ef065e435 tempest-VolumeQuotasAdminTestJSON-337010830 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588'] {{(pid=92060) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 17 04:42:40 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-4fc4c587-2337-46b3-a7f4-674ef065e435 tempest-VolumeQuotasAdminTestJSON-337010830 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 04:42:40 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-4fc4c587-2337-46b3-a7f4-674ef065e435 tempest-VolumeQuotasAdminTestJSON-337010830 None] Selected osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588 as target Quobyte volume. {{(pid=92060) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 17 04:42:40 devstack cinder-volume[92060]: INFO cinder.volume.drivers.remotefs [None req-4fc4c587-2337-46b3-a7f4-674ef065e435 tempest-VolumeQuotasAdminTestJSON-337010830 None] casted to osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588 Jun 17 04:42:40 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-4fc4c587-2337-46b3-a7f4-674ef065e435 tempest-VolumeQuotasAdminTestJSON-337010830 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-2bd7c010-4574-43d5-8866-7576c3ec3914 1073741824 {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:42:40 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-ebfa40fe-6be7-460a-bbeb-173e8ef4163f tempest-VolumesTransfersV357Test-794589489 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b375883f-bc50-4fe7-ada1-f5b8c7b8305c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1b5fd73e-67ec-4742-a75e-5e4ea363dabd', 'volume_size': 1}' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:42:40 devstack sudo[99838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-2bd7c010-4574-43d5-8866-7576c3ec3914 1073741824 Jun 17 04:42:40 devstack sudo[99838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:42:40 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-ebfa40fe-6be7-460a-bbeb-173e8ef4163f tempest-VolumesTransfersV357Test-794589489 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (958d27b2-39a0-48c6-8754-ee2c69ff5643) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:42:40 devstack cinder-volume[92060]: INFO cinder.volume.flows.manager.create_volume [None req-ebfa40fe-6be7-460a-bbeb-173e8ef4163f tempest-VolumesTransfersV357Test-794589489 None] Volume volume-1b5fd73e-67ec-4742-a75e-5e4ea363dabd (1b5fd73e-67ec-4742-a75e-5e4ea363dabd): created successfully Jun 17 04:42:40 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-ebfa40fe-6be7-460a-bbeb-173e8ef4163f tempest-VolumesTransfersV357Test-794589489 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (958d27b2-39a0-48c6-8754-ee2c69ff5643) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:42:40 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-ebfa40fe-6be7-460a-bbeb-173e8ef4163f tempest-VolumesTransfersV357Test-794589489 None] Flow 'volume_create_manager' (de75b574-d318-4ff0-ac95-5d065e1536d3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92060) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 17 04:42:40 devstack cinder-volume[92060]: INFO cinder.volume.manager [None req-ebfa40fe-6be7-460a-bbeb-173e8ef4163f tempest-VolumesTransfersV357Test-794589489 None] Created volume successfully. Jun 17 04:42:41 devstack sudo[99836]: pam_unix(sudo:session): session closed for user root Jun 17 04:42:41 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-f1cb6be6-f99a-49df-9e17-a5ee3921559d tempest-VolumesTransfersTest-235508039 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-46b74e5a-a7bb-4c17-aa22-2dd43c085993" returned: 0 in 0.866s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:42:41 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-f1cb6be6-f99a-49df-9e17-a5ee3921559d tempest-VolumesTransfersTest-235508039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-46b74e5a-a7bb-4c17-aa22-2dd43c085993 {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:42:41 devstack sudo[99848]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-46b74e5a-a7bb-4c17-aa22-2dd43c085993 Jun 17 04:42:41 devstack sudo[99848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:42:41 devstack sudo[99838]: pam_unix(sudo:session): session closed for user root Jun 17 04:42:41 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-4fc4c587-2337-46b3-a7f4-674ef065e435 tempest-VolumeQuotasAdminTestJSON-337010830 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-2bd7c010-4574-43d5-8866-7576c3ec3914 1073741824" returned: 0 in 0.992s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:42:41 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-4fc4c587-2337-46b3-a7f4-674ef065e435 tempest-VolumeQuotasAdminTestJSON-337010830 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-2bd7c010-4574-43d5-8866-7576c3ec3914 {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:42:41 devstack sudo[99850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-2bd7c010-4574-43d5-8866-7576c3ec3914 Jun 17 04:42:41 devstack sudo[99850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:42:41 devstack cinder-volume[92060]: INFO cinder.volume.manager [None req-25814e9a-b4d4-430f-9b5f-d91ce50e7bfe tempest-VolumesTransfersV357Test-1665946469 None] Transfer volume completed successfully. Jun 17 04:42:41 devstack sudo[99848]: pam_unix(sudo:session): session closed for user root Jun 17 04:42:41 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-f1cb6be6-f99a-49df-9e17-a5ee3921559d tempest-VolumesTransfersTest-235508039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-46b74e5a-a7bb-4c17-aa22-2dd43c085993" returned: 0 in 0.760s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:42:41 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-f1cb6be6-f99a-49df-9e17-a5ee3921559d tempest-VolumesTransfersTest-235508039 None] Lock "cinder-quobyte-46b74e5a-a7bb-4c17-aa22-2dd43c085993" released by "delete_volume" :: held 1.694s {{(pid=92060) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 04:42:41 devstack cinder-volume[92060]: DEBUG cinder.quota [None req-f1cb6be6-f99a-49df-9e17-a5ee3921559d tempest-VolumesTransfersTest-235508039 None] Created reservations ['8d21ae78-2974-436b-b63a-9318aa883de9', 'a6f2c8d7-ff60-4f64-9fe6-a048eee7d8f0', '6f9485a2-c493-4a51-bf0a-9bf918c676e5', '4dbad060-3f97-466f-b9c7-d00c75c94bad'] {{(pid=92060) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 17 04:42:42 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-f1cb6be6-f99a-49df-9e17-a5ee3921559d tempest-VolumesTransfersTest-235508039 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 04:42:42 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-f1cb6be6-f99a-49df-9e17-a5ee3921559d tempest-VolumesTransfersTest-235508039 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 04:42:42 devstack sudo[99850]: pam_unix(sudo:session): session closed for user root Jun 17 04:42:42 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-f1cb6be6-f99a-49df-9e17-a5ee3921559d tempest-VolumesTransfersTest-235508039 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588': None} {{(pid=92060) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 17 04:42:42 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-f1cb6be6-f99a-49df-9e17-a5ee3921559d tempest-VolumesTransfersTest-235508039 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588'] {{(pid=92060) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 17 04:42:42 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-f1cb6be6-f99a-49df-9e17-a5ee3921559d tempest-VolumesTransfersTest-235508039 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 04:42:42 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-f1cb6be6-f99a-49df-9e17-a5ee3921559d tempest-VolumesTransfersTest-235508039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:42:42 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-4fc4c587-2337-46b3-a7f4-674ef065e435 tempest-VolumeQuotasAdminTestJSON-337010830 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-2bd7c010-4574-43d5-8866-7576c3ec3914" returned: 0 in 0.675s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:42:42 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-4fc4c587-2337-46b3-a7f4-674ef065e435 tempest-VolumeQuotasAdminTestJSON-337010830 None] <== create_volume: return (1715ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588'} {{(pid=92060) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 17 04:42:42 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-4fc4c587-2337-46b3-a7f4-674ef065e435 tempest-VolumeQuotasAdminTestJSON-337010830 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.718s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 04:42:42 devstack sudo[99855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a Jun 17 04:42:42 devstack sudo[99855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:42:42 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-4fc4c587-2337-46b3-a7f4-674ef065e435 tempest-VolumeQuotasAdminTestJSON-337010830 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ecd41172-5cd8-4928-bd3f-fad90a458af2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2bd7c010-4574-43d5-8866-7576c3ec3914', 'volume_size': 1}' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:42:42 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-4fc4c587-2337-46b3-a7f4-674ef065e435 tempest-VolumeQuotasAdminTestJSON-337010830 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dcc1cfd4-71fa-48a9-976f-971b8f01833d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:42:42 devstack cinder-volume[92060]: INFO cinder.volume.flows.manager.create_volume [None req-4fc4c587-2337-46b3-a7f4-674ef065e435 tempest-VolumeQuotasAdminTestJSON-337010830 None] Volume volume-2bd7c010-4574-43d5-8866-7576c3ec3914 (2bd7c010-4574-43d5-8866-7576c3ec3914): created successfully Jun 17 04:42:42 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-4fc4c587-2337-46b3-a7f4-674ef065e435 tempest-VolumeQuotasAdminTestJSON-337010830 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dcc1cfd4-71fa-48a9-976f-971b8f01833d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:42:42 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-4fc4c587-2337-46b3-a7f4-674ef065e435 tempest-VolumeQuotasAdminTestJSON-337010830 None] Flow 'volume_create_manager' (ad4dc957-637d-4d05-8259-98726ed0120c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92060) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 17 04:42:42 devstack cinder-volume[92060]: INFO cinder.volume.manager [None req-4fc4c587-2337-46b3-a7f4-674ef065e435 tempest-VolumeQuotasAdminTestJSON-337010830 None] Created volume successfully. Jun 17 04:42:42 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-0d25fad8-bb74-4bc9-ae96-f4ad83665d6b tempest-VolumesTransfersV357Test-1973163403 None] Acquiring lock "cinder-1b5fd73e-67ec-4742-a75e-5e4ea363dabd-delete_volume" by "delete_volume" {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 04:42:42 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-0d25fad8-bb74-4bc9-ae96-f4ad83665d6b tempest-VolumesTransfersV357Test-1973163403 None] Lock "cinder-1b5fd73e-67ec-4742-a75e-5e4ea363dabd-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 04:42:42 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-0d25fad8-bb74-4bc9-ae96-f4ad83665d6b tempest-VolumesTransfersV357Test-1973163403 None] Acquiring lock "cinder-quobyte-1b5fd73e-67ec-4742-a75e-5e4ea363dabd" by "delete_volume" {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 04:42:42 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-0d25fad8-bb74-4bc9-ae96-f4ad83665d6b tempest-VolumesTransfersV357Test-1973163403 None] Lock "cinder-quobyte-1b5fd73e-67ec-4742-a75e-5e4ea363dabd" acquired by "delete_volume" :: waited 0.017s {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 04:42:42 devstack cinder-volume[92060]: DEBUG oslo.privsep.daemon [-] privsep: reply[25ba963a-5299-46be-bcba-63df49324b5a]: (4, 'qcow2') {{(pid=93130) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 04:42:42 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-0d25fad8-bb74-4bc9-ae96-f4ad83665d6b tempest-VolumesTransfersV357Test-1973163403 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-1b5fd73e-67ec-4742-a75e-5e4ea363dabd {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:42:42 devstack sudo[99857]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-1b5fd73e-67ec-4742-a75e-5e4ea363dabd Jun 17 04:42:42 devstack sudo[99857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:42:42 devstack sudo[99855]: pam_unix(sudo:session): session closed for user root Jun 17 04:42:42 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-f1cb6be6-f99a-49df-9e17-a5ee3921559d tempest-VolumesTransfersTest-235508039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a" returned: 0 in 0.609s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:42:42 devstack cinder-volume[92060]: DEBUG cinder.manager [None req-f1cb6be6-f99a-49df-9e17-a5ee3921559d tempest-VolumesTransfersTest-235508039 None] Notifying Schedulers of capabilities ... {{(pid=92060) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 17 04:42:42 devstack cinder-volume[92060]: INFO cinder.volume.manager [None req-f1cb6be6-f99a-49df-9e17-a5ee3921559d tempest-VolumesTransfersTest-235508039 None] Deleted volume successfully. Jun 17 04:42:42 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-f1cb6be6-f99a-49df-9e17-a5ee3921559d tempest-VolumesTransfersTest-235508039 None] Lock "cinder-46b74e5a-a7bb-4c17-aa22-2dd43c085993-delete_volume" released by "delete_volume" :: held 2.557s {{(pid=92060) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 04:42:42 devstack cinder-volume[92060]: DEBUG cinder.volume.flows.manager.create_volume [None req-3d886934-59ec-4bad-8301-724a592721a2 tempest-VolumesTransfersTest-680980744 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92060) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 17 04:42:42 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-3d886934-59ec-4bad-8301-724a592721a2 tempest-VolumesTransfersTest-680980744 None] Flow 'volume_create_manager' (5e07523a-3dc5-424c-9592-3d591d7f5b92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 17 04:42:42 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-3d886934-59ec-4bad-8301-724a592721a2 tempest-VolumesTransfersTest-680980744 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5dd6ed5b-8d40-44b6-9f68-dd945f016c29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:42:42 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-3d886934-59ec-4bad-8301-724a592721a2 tempest-VolumesTransfersTest-680980744 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5dd6ed5b-8d40-44b6-9f68-dd945f016c29) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-17T02:42:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-290746236',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6cfca391-11fe-42c5-bad5-26e47dfd873a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c390126f54f14bb98dbc66f3b11d79e0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T02:42:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T02:42:43Z,use_quota=True,user_id='a2dce25e9b7f433e86db8b81fe3d413b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aad9ce24-93f9-41a6-baa1-5125964f96d1),volume_type_id=aad9ce24-93f9-41a6-baa1-5125964f96d1)' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:42:42 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-3d886934-59ec-4bad-8301-724a592721a2 tempest-VolumesTransfersTest-680980744 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (82f3a189-bb9b-465e-b0d4-1aeb105b57f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:42:43 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-3d886934-59ec-4bad-8301-724a592721a2 tempest-VolumesTransfersTest-680980744 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (82f3a189-bb9b-465e-b0d4-1aeb105b57f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:42:43 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-3d886934-59ec-4bad-8301-724a592721a2 tempest-VolumesTransfersTest-680980744 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3e1f7b84-2f43-445d-8cb7-7ad0b3b51a76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:42:43 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-3d886934-59ec-4bad-8301-724a592721a2 tempest-VolumesTransfersTest-680980744 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3e1f7b84-2f43-445d-8cb7-7ad0b3b51a76) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6cfca391-11fe-42c5-bad5-26e47dfd873a', 'volume_name': 'volume-6cfca391-11fe-42c5-bad5-26e47dfd873a', 'volume_size': 1}' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:42:43 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-3d886934-59ec-4bad-8301-724a592721a2 tempest-VolumesTransfersTest-680980744 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (10b9193b-f65f-4f36-b26e-bd92c82f0ee4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:42:43 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-3d886934-59ec-4bad-8301-724a592721a2 tempest-VolumesTransfersTest-680980744 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (10b9193b-f65f-4f36-b26e-bd92c82f0ee4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:42:43 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-3d886934-59ec-4bad-8301-724a592721a2 tempest-VolumesTransfersTest-680980744 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f895b971-7eda-4d86-929e-92744d29b003) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:42:43 devstack cinder-volume[92060]: INFO cinder.volume.flows.manager.create_volume [None req-3d886934-59ec-4bad-8301-724a592721a2 tempest-VolumesTransfersTest-680980744 None] Volume 6cfca391-11fe-42c5-bad5-26e47dfd873a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6cfca391-11fe-42c5-bad5-26e47dfd873a', 'volume_size': 1} Jun 17 04:42:43 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-3d886934-59ec-4bad-8301-724a592721a2 tempest-VolumesTransfersTest-680980744 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 04:42:43 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-3d886934-59ec-4bad-8301-724a592721a2 tempest-VolumesTransfersTest-680980744 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 04:42:43 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-3d886934-59ec-4bad-8301-724a592721a2 tempest-VolumesTransfersTest-680980744 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-17T02:42:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-290746236',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6cfca391-11fe-42c5-bad5-26e47dfd873a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c390126f54f14bb98dbc66f3b11d79e0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T02:42:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T02:42:43Z,use_quota=True,user_id='a2dce25e9b7f433e86db8b81fe3d413b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aad9ce24-93f9-41a6-baa1-5125964f96d1),volume_type_id=aad9ce24-93f9-41a6-baa1-5125964f96d1)}" {{(pid=92060) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 17 04:42:43 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.remotefs [None req-3d886934-59ec-4bad-8301-724a592721a2 tempest-VolumesTransfersTest-680980744 None] Creating volume 6cfca391-11fe-42c5-bad5-26e47dfd873a {{(pid=92060) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 17 04:42:43 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-3d886934-59ec-4bad-8301-724a592721a2 tempest-VolumesTransfersTest-680980744 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 04:42:43 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-3d886934-59ec-4bad-8301-724a592721a2 tempest-VolumesTransfersTest-680980744 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 04:42:43 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-3d886934-59ec-4bad-8301-724a592721a2 tempest-VolumesTransfersTest-680980744 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588': None} {{(pid=92060) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 17 04:42:43 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-3d886934-59ec-4bad-8301-724a592721a2 tempest-VolumesTransfersTest-680980744 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588'] {{(pid=92060) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 17 04:42:43 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-3d886934-59ec-4bad-8301-724a592721a2 tempest-VolumesTransfersTest-680980744 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 04:42:43 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-3d886934-59ec-4bad-8301-724a592721a2 tempest-VolumesTransfersTest-680980744 None] Selected osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588 as target Quobyte volume. {{(pid=92060) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 17 04:42:43 devstack cinder-volume[92060]: INFO cinder.volume.drivers.remotefs [None req-3d886934-59ec-4bad-8301-724a592721a2 tempest-VolumesTransfersTest-680980744 None] casted to osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588 Jun 17 04:42:43 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-3d886934-59ec-4bad-8301-724a592721a2 tempest-VolumesTransfersTest-680980744 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-6cfca391-11fe-42c5-bad5-26e47dfd873a 1073741824 {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:42:43 devstack sudo[99860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-6cfca391-11fe-42c5-bad5-26e47dfd873a 1073741824 Jun 17 04:42:43 devstack sudo[99860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:42:43 devstack sudo[99857]: pam_unix(sudo:session): session closed for user root Jun 17 04:42:43 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-0d25fad8-bb74-4bc9-ae96-f4ad83665d6b tempest-VolumesTransfersV357Test-1973163403 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-1b5fd73e-67ec-4742-a75e-5e4ea363dabd" returned: 0 in 0.809s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:42:43 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-0d25fad8-bb74-4bc9-ae96-f4ad83665d6b tempest-VolumesTransfersV357Test-1973163403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-1b5fd73e-67ec-4742-a75e-5e4ea363dabd {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:42:43 devstack sudo[99865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-1b5fd73e-67ec-4742-a75e-5e4ea363dabd Jun 17 04:42:43 devstack sudo[99865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:42:43 devstack cinder-volume[92060]: INFO cinder.volume.manager [None req-36230db2-70d7-40aa-b2dc-6b1c6b9c159d tempest-VolumeQuotasAdminTestJSON-1694694038 None] Transfer volume completed successfully. Jun 17 04:42:43 devstack sudo[99860]: pam_unix(sudo:session): session closed for user root Jun 17 04:42:43 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-3d886934-59ec-4bad-8301-724a592721a2 tempest-VolumesTransfersTest-680980744 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-6cfca391-11fe-42c5-bad5-26e47dfd873a 1073741824" returned: 0 in 0.841s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:42:43 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-3d886934-59ec-4bad-8301-724a592721a2 tempest-VolumesTransfersTest-680980744 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-6cfca391-11fe-42c5-bad5-26e47dfd873a {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:42:43 devstack sudo[99871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-6cfca391-11fe-42c5-bad5-26e47dfd873a Jun 17 04:42:43 devstack sudo[99871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:42:44 devstack sudo[99865]: pam_unix(sudo:session): session closed for user root Jun 17 04:42:44 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-0d25fad8-bb74-4bc9-ae96-f4ad83665d6b tempest-VolumesTransfersV357Test-1973163403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-1b5fd73e-67ec-4742-a75e-5e4ea363dabd" returned: 0 in 0.639s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:42:44 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-0d25fad8-bb74-4bc9-ae96-f4ad83665d6b tempest-VolumesTransfersV357Test-1973163403 None] Lock "cinder-quobyte-1b5fd73e-67ec-4742-a75e-5e4ea363dabd" released by "delete_volume" :: held 1.495s {{(pid=92060) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 04:42:44 devstack cinder-volume[92060]: DEBUG cinder.quota [None req-0d25fad8-bb74-4bc9-ae96-f4ad83665d6b tempest-VolumesTransfersV357Test-1973163403 None] Created reservations ['32262913-340f-4acc-bba9-edc536de3886', 'fbff53d4-d12b-4f42-938e-3eea7f8f7ffe', '3dd59407-53b0-413a-a639-7ab64bed4adc', '3c821077-ad30-4a6c-9408-51000f5f4154'] {{(pid=92060) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 17 04:42:44 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-0d25fad8-bb74-4bc9-ae96-f4ad83665d6b tempest-VolumesTransfersV357Test-1973163403 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 04:42:44 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-0d25fad8-bb74-4bc9-ae96-f4ad83665d6b tempest-VolumesTransfersV357Test-1973163403 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 04:42:44 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-0d25fad8-bb74-4bc9-ae96-f4ad83665d6b tempest-VolumesTransfersV357Test-1973163403 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588': None} {{(pid=92060) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 17 04:42:44 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-0d25fad8-bb74-4bc9-ae96-f4ad83665d6b tempest-VolumesTransfersV357Test-1973163403 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588'] {{(pid=92060) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 17 04:42:44 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-0d25fad8-bb74-4bc9-ae96-f4ad83665d6b tempest-VolumesTransfersV357Test-1973163403 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 04:42:44 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-0d25fad8-bb74-4bc9-ae96-f4ad83665d6b tempest-VolumesTransfersV357Test-1973163403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:42:44 devstack sudo[99873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a Jun 17 04:42:44 devstack sudo[99873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:42:44 devstack sudo[99871]: pam_unix(sudo:session): session closed for user root Jun 17 04:42:44 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-3d886934-59ec-4bad-8301-724a592721a2 tempest-VolumesTransfersTest-680980744 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-6cfca391-11fe-42c5-bad5-26e47dfd873a" returned: 0 in 0.629s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:42:44 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-3d886934-59ec-4bad-8301-724a592721a2 tempest-VolumesTransfersTest-680980744 None] <== create_volume: return (1523ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588'} {{(pid=92060) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 17 04:42:44 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-3d886934-59ec-4bad-8301-724a592721a2 tempest-VolumesTransfersTest-680980744 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.527s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 04:42:44 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-3d886934-59ec-4bad-8301-724a592721a2 tempest-VolumesTransfersTest-680980744 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f895b971-7eda-4d86-929e-92744d29b003) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6cfca391-11fe-42c5-bad5-26e47dfd873a', 'volume_size': 1}' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:42:44 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-3d886934-59ec-4bad-8301-724a592721a2 tempest-VolumesTransfersTest-680980744 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1056f32a-37b3-421b-a165-374e3c3a5bd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:42:44 devstack cinder-volume[92060]: INFO cinder.volume.flows.manager.create_volume [None req-3d886934-59ec-4bad-8301-724a592721a2 tempest-VolumesTransfersTest-680980744 None] Volume volume-6cfca391-11fe-42c5-bad5-26e47dfd873a (6cfca391-11fe-42c5-bad5-26e47dfd873a): created successfully Jun 17 04:42:44 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-3d886934-59ec-4bad-8301-724a592721a2 tempest-VolumesTransfersTest-680980744 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1056f32a-37b3-421b-a165-374e3c3a5bd0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:42:44 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-3d886934-59ec-4bad-8301-724a592721a2 tempest-VolumesTransfersTest-680980744 None] Flow 'volume_create_manager' (5e07523a-3dc5-424c-9592-3d591d7f5b92) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92060) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 17 04:42:44 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-08968768-e267-4072-a5d4-1fbf94a13262 tempest-VolumeQuotasAdminTestJSON-1944958724 None] Acquiring lock "cinder-2bd7c010-4574-43d5-8866-7576c3ec3914-delete_volume" by "delete_volume" {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 04:42:44 devstack cinder-volume[92060]: INFO cinder.volume.manager [None req-3d886934-59ec-4bad-8301-724a592721a2 tempest-VolumesTransfersTest-680980744 None] Created volume successfully. Jun 17 04:42:44 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-08968768-e267-4072-a5d4-1fbf94a13262 tempest-VolumeQuotasAdminTestJSON-1944958724 None] Lock "cinder-2bd7c010-4574-43d5-8866-7576c3ec3914-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 04:42:44 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-08968768-e267-4072-a5d4-1fbf94a13262 tempest-VolumeQuotasAdminTestJSON-1944958724 None] Acquiring lock "cinder-quobyte-2bd7c010-4574-43d5-8866-7576c3ec3914" by "delete_volume" {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 04:42:44 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-08968768-e267-4072-a5d4-1fbf94a13262 tempest-VolumeQuotasAdminTestJSON-1944958724 None] Lock "cinder-quobyte-2bd7c010-4574-43d5-8866-7576c3ec3914" acquired by "delete_volume" :: waited 0.022s {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 04:42:44 devstack cinder-volume[92060]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d972b7d-f9d4-4811-b443-7037aa92b79a]: (4, 'qcow2') {{(pid=93130) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 04:42:44 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-08968768-e267-4072-a5d4-1fbf94a13262 tempest-VolumeQuotasAdminTestJSON-1944958724 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-2bd7c010-4574-43d5-8866-7576c3ec3914 {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:42:44 devstack sudo[99873]: pam_unix(sudo:session): session closed for user root Jun 17 04:42:44 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-0d25fad8-bb74-4bc9-ae96-f4ad83665d6b tempest-VolumesTransfersV357Test-1973163403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a" returned: 0 in 0.646s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:42:44 devstack cinder-volume[92060]: DEBUG cinder.manager [None req-0d25fad8-bb74-4bc9-ae96-f4ad83665d6b tempest-VolumesTransfersV357Test-1973163403 None] Notifying Schedulers of capabilities ... {{(pid=92060) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 17 04:42:44 devstack cinder-volume[92060]: INFO cinder.volume.manager [None req-0d25fad8-bb74-4bc9-ae96-f4ad83665d6b tempest-VolumesTransfersV357Test-1973163403 None] Deleted volume successfully. Jun 17 04:42:44 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-0d25fad8-bb74-4bc9-ae96-f4ad83665d6b tempest-VolumesTransfersV357Test-1973163403 None] Lock "cinder-1b5fd73e-67ec-4742-a75e-5e4ea363dabd-delete_volume" released by "delete_volume" :: held 2.355s {{(pid=92060) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 04:42:44 devstack sudo[99877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-2bd7c010-4574-43d5-8866-7576c3ec3914 Jun 17 04:42:44 devstack sudo[99877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:42:44 devstack cinder-volume[92060]: DEBUG oslo_service.periodic_task [None req-60d279ad-ad8c-4d36-a4b8-f593e74fb922 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=92060) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 17 04:42:44 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-60d279ad-ad8c-4d36-a4b8-f593e74fb922 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 04:42:44 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-60d279ad-ad8c-4d36-a4b8-f593e74fb922 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 04:42:44 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-60d279ad-ad8c-4d36-a4b8-f593e74fb922 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588': None} {{(pid=92060) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 17 04:42:44 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-60d279ad-ad8c-4d36-a4b8-f593e74fb922 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588'] {{(pid=92060) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 17 04:42:44 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-60d279ad-ad8c-4d36-a4b8-f593e74fb922 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 04:42:44 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-60d279ad-ad8c-4d36-a4b8-f593e74fb922 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:42:44 devstack sudo[99879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a Jun 17 04:42:44 devstack sudo[99879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:42:45 devstack cinder-volume[92060]: DEBUG cinder.volume.flows.manager.create_volume [None req-8feaf8d9-3c15-4f20-bad7-b544e92e001b tempest-VolumesTransfersV357Test-794589489 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92060) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 17 04:42:45 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-8feaf8d9-3c15-4f20-bad7-b544e92e001b tempest-VolumesTransfersV357Test-794589489 None] Flow 'volume_create_manager' (d7a2463e-adf7-42f1-ae89-46d8475162c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 17 04:42:45 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-8feaf8d9-3c15-4f20-bad7-b544e92e001b tempest-VolumesTransfersV357Test-794589489 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5efba452-83ee-4d7c-ba5e-2b8e3083ce45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:42:45 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-8feaf8d9-3c15-4f20-bad7-b544e92e001b tempest-VolumesTransfersV357Test-794589489 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5efba452-83ee-4d7c-ba5e-2b8e3083ce45) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-17T02:42:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1917619792',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=01e02703-431f-4815-a504-b1eaf777894e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cebc2762dd174eb0b54ef663c32d6b98',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T02:42:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T02:42:45Z,use_quota=True,user_id='c91e5ab188094832b054e00f540545de',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aad9ce24-93f9-41a6-baa1-5125964f96d1),volume_type_id=aad9ce24-93f9-41a6-baa1-5125964f96d1)' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:42:45 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-8feaf8d9-3c15-4f20-bad7-b544e92e001b tempest-VolumesTransfersV357Test-794589489 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (92ea6e8d-0e78-438e-8da1-633fb5c323ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:42:45 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-8feaf8d9-3c15-4f20-bad7-b544e92e001b tempest-VolumesTransfersV357Test-794589489 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (92ea6e8d-0e78-438e-8da1-633fb5c323ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:42:45 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-8feaf8d9-3c15-4f20-bad7-b544e92e001b tempest-VolumesTransfersV357Test-794589489 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6d402a2c-566c-4e02-8c79-c0c19d6290ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:42:45 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-8feaf8d9-3c15-4f20-bad7-b544e92e001b tempest-VolumesTransfersV357Test-794589489 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6d402a2c-566c-4e02-8c79-c0c19d6290ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '01e02703-431f-4815-a504-b1eaf777894e', 'volume_name': 'volume-01e02703-431f-4815-a504-b1eaf777894e', 'volume_size': 1}' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:42:45 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-8feaf8d9-3c15-4f20-bad7-b544e92e001b tempest-VolumesTransfersV357Test-794589489 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (48d912b7-1fac-4e5e-abd5-88196076d47b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:42:45 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-8feaf8d9-3c15-4f20-bad7-b544e92e001b tempest-VolumesTransfersV357Test-794589489 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (48d912b7-1fac-4e5e-abd5-88196076d47b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:42:45 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-8feaf8d9-3c15-4f20-bad7-b544e92e001b tempest-VolumesTransfersV357Test-794589489 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b16d5632-54f5-4623-bf07-14a705a62a99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:42:45 devstack cinder-volume[92060]: INFO cinder.volume.flows.manager.create_volume [None req-8feaf8d9-3c15-4f20-bad7-b544e92e001b tempest-VolumesTransfersV357Test-794589489 None] Volume 01e02703-431f-4815-a504-b1eaf777894e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-01e02703-431f-4815-a504-b1eaf777894e', 'volume_size': 1} Jun 17 04:42:45 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-8feaf8d9-3c15-4f20-bad7-b544e92e001b tempest-VolumesTransfersV357Test-794589489 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 04:42:45 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-8feaf8d9-3c15-4f20-bad7-b544e92e001b tempest-VolumesTransfersV357Test-794589489 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 04:42:45 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-8feaf8d9-3c15-4f20-bad7-b544e92e001b tempest-VolumesTransfersV357Test-794589489 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-17T02:42:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1917619792',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=01e02703-431f-4815-a504-b1eaf777894e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cebc2762dd174eb0b54ef663c32d6b98',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T02:42:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T02:42:45Z,use_quota=True,user_id='c91e5ab188094832b054e00f540545de',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aad9ce24-93f9-41a6-baa1-5125964f96d1),volume_type_id=aad9ce24-93f9-41a6-baa1-5125964f96d1)}" {{(pid=92060) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 17 04:42:45 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.remotefs [None req-8feaf8d9-3c15-4f20-bad7-b544e92e001b tempest-VolumesTransfersV357Test-794589489 None] Creating volume 01e02703-431f-4815-a504-b1eaf777894e {{(pid=92060) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 17 04:42:45 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-8feaf8d9-3c15-4f20-bad7-b544e92e001b tempest-VolumesTransfersV357Test-794589489 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 04:42:45 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-8feaf8d9-3c15-4f20-bad7-b544e92e001b tempest-VolumesTransfersV357Test-794589489 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 04:42:45 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-8feaf8d9-3c15-4f20-bad7-b544e92e001b tempest-VolumesTransfersV357Test-794589489 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588': None} {{(pid=92060) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 17 04:42:45 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-8feaf8d9-3c15-4f20-bad7-b544e92e001b tempest-VolumesTransfersV357Test-794589489 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588'] {{(pid=92060) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 17 04:42:45 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-8feaf8d9-3c15-4f20-bad7-b544e92e001b tempest-VolumesTransfersV357Test-794589489 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 04:42:45 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-8feaf8d9-3c15-4f20-bad7-b544e92e001b tempest-VolumesTransfersV357Test-794589489 None] Selected osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588 as target Quobyte volume. {{(pid=92060) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 17 04:42:45 devstack cinder-volume[92060]: INFO cinder.volume.drivers.remotefs [None req-8feaf8d9-3c15-4f20-bad7-b544e92e001b tempest-VolumesTransfersV357Test-794589489 None] casted to osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588 Jun 17 04:42:45 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-8feaf8d9-3c15-4f20-bad7-b544e92e001b tempest-VolumesTransfersV357Test-794589489 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-01e02703-431f-4815-a504-b1eaf777894e 1073741824 {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:42:45 devstack sudo[99881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-01e02703-431f-4815-a504-b1eaf777894e 1073741824 Jun 17 04:42:45 devstack sudo[99881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:42:45 devstack sudo[99877]: pam_unix(sudo:session): session closed for user root Jun 17 04:42:45 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-dbc5d7e3-7852-4520-b17a-9d726f033eff tempest-VolumesTransfersTest-235508039 None] Acquiring lock "cinder-6cfca391-11fe-42c5-bad5-26e47dfd873a-delete_volume" by "delete_volume" {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 04:42:45 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-08968768-e267-4072-a5d4-1fbf94a13262 tempest-VolumeQuotasAdminTestJSON-1944958724 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-2bd7c010-4574-43d5-8866-7576c3ec3914" returned: 0 in 0.795s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:42:45 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-08968768-e267-4072-a5d4-1fbf94a13262 tempest-VolumeQuotasAdminTestJSON-1944958724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-2bd7c010-4574-43d5-8866-7576c3ec3914 {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:42:45 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-dbc5d7e3-7852-4520-b17a-9d726f033eff tempest-VolumesTransfersTest-235508039 None] Lock "cinder-6cfca391-11fe-42c5-bad5-26e47dfd873a-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 04:42:45 devstack sudo[99887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-2bd7c010-4574-43d5-8866-7576c3ec3914 Jun 17 04:42:45 devstack sudo[99887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:42:45 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-dbc5d7e3-7852-4520-b17a-9d726f033eff tempest-VolumesTransfersTest-235508039 None] Acquiring lock "cinder-quobyte-6cfca391-11fe-42c5-bad5-26e47dfd873a" by "delete_volume" {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 04:42:45 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-dbc5d7e3-7852-4520-b17a-9d726f033eff tempest-VolumesTransfersTest-235508039 None] Lock "cinder-quobyte-6cfca391-11fe-42c5-bad5-26e47dfd873a" acquired by "delete_volume" :: waited 0.016s {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 04:42:45 devstack cinder-volume[92060]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9823d18-9864-495a-9303-413170b3f197]: (4, 'qcow2') {{(pid=93130) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 04:42:45 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-dbc5d7e3-7852-4520-b17a-9d726f033eff tempest-VolumesTransfersTest-235508039 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-6cfca391-11fe-42c5-bad5-26e47dfd873a {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:42:45 devstack sudo[99879]: pam_unix(sudo:session): session closed for user root Jun 17 04:42:45 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-60d279ad-ad8c-4d36-a4b8-f593e74fb922 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a" returned: 0 in 0.832s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:42:45 devstack cinder-volume[92060]: DEBUG cinder.manager [None req-60d279ad-ad8c-4d36-a4b8-f593e74fb922 None None] Notifying Schedulers of capabilities ... {{(pid=92060) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 17 04:42:45 devstack cinder-volume[92060]: DEBUG oslo_service.periodic_task [None req-60d279ad-ad8c-4d36-a4b8-f593e74fb922 None None] Running periodic task VolumeManager._thread_info {{(pid=92060) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 17 04:42:45 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-60d279ad-ad8c-4d36-a4b8-f593e74fb922 None None] thread count: 28 {{(pid=92060) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 17 04:42:45 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-60d279ad-ad8c-4d36-a4b8-f593e74fb922 None None] thread info: [<_MainThread(MainThread, started 130061806440576)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=92060) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 17 04:42:45 devstack sudo[99890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-6cfca391-11fe-42c5-bad5-26e47dfd873a Jun 17 04:42:45 devstack sudo[99890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:42:46 devstack sudo[99881]: pam_unix(sudo:session): session closed for user root Jun 17 04:42:46 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-8feaf8d9-3c15-4f20-bad7-b544e92e001b tempest-VolumesTransfersV357Test-794589489 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-01e02703-431f-4815-a504-b1eaf777894e 1073741824" returned: 0 in 0.903s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:42:46 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-8feaf8d9-3c15-4f20-bad7-b544e92e001b tempest-VolumesTransfersV357Test-794589489 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-01e02703-431f-4815-a504-b1eaf777894e {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:42:46 devstack sudo[99887]: pam_unix(sudo:session): session closed for user root Jun 17 04:42:46 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-08968768-e267-4072-a5d4-1fbf94a13262 tempest-VolumeQuotasAdminTestJSON-1944958724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-2bd7c010-4574-43d5-8866-7576c3ec3914" returned: 0 in 0.696s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:42:46 devstack sudo[99896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-01e02703-431f-4815-a504-b1eaf777894e Jun 17 04:42:46 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-08968768-e267-4072-a5d4-1fbf94a13262 tempest-VolumeQuotasAdminTestJSON-1944958724 None] Lock "cinder-quobyte-2bd7c010-4574-43d5-8866-7576c3ec3914" released by "delete_volume" :: held 1.540s {{(pid=92060) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 04:42:46 devstack sudo[99896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:42:46 devstack cinder-volume[92060]: DEBUG cinder.quota [None req-08968768-e267-4072-a5d4-1fbf94a13262 tempest-VolumeQuotasAdminTestJSON-1944958724 None] Created reservations ['c389a191-2f34-4f34-88da-2dea406b615f', '419ef299-3013-40cf-ab43-9863926d98e0', '421fee21-d13e-414c-ac1a-647038b3622b', '871a06a5-0a23-4eca-8129-8e109c30b543'] {{(pid=92060) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 17 04:42:46 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-08968768-e267-4072-a5d4-1fbf94a13262 tempest-VolumeQuotasAdminTestJSON-1944958724 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 04:42:46 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-08968768-e267-4072-a5d4-1fbf94a13262 tempest-VolumeQuotasAdminTestJSON-1944958724 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 04:42:46 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-08968768-e267-4072-a5d4-1fbf94a13262 tempest-VolumeQuotasAdminTestJSON-1944958724 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588': None} {{(pid=92060) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 17 04:42:46 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-08968768-e267-4072-a5d4-1fbf94a13262 tempest-VolumeQuotasAdminTestJSON-1944958724 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588'] {{(pid=92060) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 17 04:42:46 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-08968768-e267-4072-a5d4-1fbf94a13262 tempest-VolumeQuotasAdminTestJSON-1944958724 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 04:42:46 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-08968768-e267-4072-a5d4-1fbf94a13262 tempest-VolumeQuotasAdminTestJSON-1944958724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:42:46 devstack sudo[99901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a Jun 17 04:42:46 devstack sudo[99901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:42:46 devstack sudo[99890]: pam_unix(sudo:session): session closed for user root Jun 17 04:42:46 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-dbc5d7e3-7852-4520-b17a-9d726f033eff tempest-VolumesTransfersTest-235508039 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-6cfca391-11fe-42c5-bad5-26e47dfd873a" returned: 0 in 0.810s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:42:46 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-dbc5d7e3-7852-4520-b17a-9d726f033eff tempest-VolumesTransfersTest-235508039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-6cfca391-11fe-42c5-bad5-26e47dfd873a {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:42:46 devstack sudo[99903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-6cfca391-11fe-42c5-bad5-26e47dfd873a Jun 17 04:42:46 devstack sudo[99903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:42:46 devstack sudo[99896]: pam_unix(sudo:session): session closed for user root Jun 17 04:42:46 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-8feaf8d9-3c15-4f20-bad7-b544e92e001b tempest-VolumesTransfersV357Test-794589489 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-01e02703-431f-4815-a504-b1eaf777894e" returned: 0 in 0.602s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:42:46 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-8feaf8d9-3c15-4f20-bad7-b544e92e001b tempest-VolumesTransfersV357Test-794589489 None] <== create_volume: return (1545ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588'} {{(pid=92060) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 17 04:42:46 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-8feaf8d9-3c15-4f20-bad7-b544e92e001b tempest-VolumesTransfersV357Test-794589489 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.548s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 04:42:46 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-8feaf8d9-3c15-4f20-bad7-b544e92e001b tempest-VolumesTransfersV357Test-794589489 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b16d5632-54f5-4623-bf07-14a705a62a99) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-01e02703-431f-4815-a504-b1eaf777894e', 'volume_size': 1}' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:42:46 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-8feaf8d9-3c15-4f20-bad7-b544e92e001b tempest-VolumesTransfersV357Test-794589489 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6fa62c06-cc66-41e8-8ec0-853bd50af3d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:42:46 devstack cinder-volume[92060]: INFO cinder.volume.flows.manager.create_volume [None req-8feaf8d9-3c15-4f20-bad7-b544e92e001b tempest-VolumesTransfersV357Test-794589489 None] Volume volume-01e02703-431f-4815-a504-b1eaf777894e (01e02703-431f-4815-a504-b1eaf777894e): created successfully Jun 17 04:42:46 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-8feaf8d9-3c15-4f20-bad7-b544e92e001b tempest-VolumesTransfersV357Test-794589489 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6fa62c06-cc66-41e8-8ec0-853bd50af3d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:42:46 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-8feaf8d9-3c15-4f20-bad7-b544e92e001b tempest-VolumesTransfersV357Test-794589489 None] Flow 'volume_create_manager' (d7a2463e-adf7-42f1-ae89-46d8475162c9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92060) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 17 04:42:46 devstack cinder-volume[92060]: INFO cinder.volume.manager [None req-8feaf8d9-3c15-4f20-bad7-b544e92e001b tempest-VolumesTransfersV357Test-794589489 None] Created volume successfully. Jun 17 04:42:47 devstack sudo[99901]: pam_unix(sudo:session): session closed for user root Jun 17 04:42:47 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-08968768-e267-4072-a5d4-1fbf94a13262 tempest-VolumeQuotasAdminTestJSON-1944958724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a" returned: 0 in 0.632s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:42:47 devstack cinder-volume[92060]: DEBUG cinder.manager [None req-08968768-e267-4072-a5d4-1fbf94a13262 tempest-VolumeQuotasAdminTestJSON-1944958724 None] Notifying Schedulers of capabilities ... {{(pid=92060) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 17 04:42:47 devstack cinder-volume[92060]: INFO cinder.volume.manager [None req-08968768-e267-4072-a5d4-1fbf94a13262 tempest-VolumeQuotasAdminTestJSON-1944958724 None] Deleted volume successfully. Jun 17 04:42:47 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-08968768-e267-4072-a5d4-1fbf94a13262 tempest-VolumeQuotasAdminTestJSON-1944958724 None] Lock "cinder-2bd7c010-4574-43d5-8866-7576c3ec3914-delete_volume" released by "delete_volume" :: held 2.407s {{(pid=92060) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 04:42:47 devstack sudo[99903]: pam_unix(sudo:session): session closed for user root Jun 17 04:42:47 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-dbc5d7e3-7852-4520-b17a-9d726f033eff tempest-VolumesTransfersTest-235508039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-6cfca391-11fe-42c5-bad5-26e47dfd873a" returned: 0 in 0.671s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:42:47 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-dbc5d7e3-7852-4520-b17a-9d726f033eff tempest-VolumesTransfersTest-235508039 None] Lock "cinder-quobyte-6cfca391-11fe-42c5-bad5-26e47dfd873a" released by "delete_volume" :: held 1.528s {{(pid=92060) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 04:42:47 devstack cinder-volume[92060]: DEBUG cinder.quota [None req-dbc5d7e3-7852-4520-b17a-9d726f033eff tempest-VolumesTransfersTest-235508039 None] Created reservations ['ea35351a-ec75-4042-9979-4495c4af5841', '5a3547f9-f69d-47fd-adfa-7a5c429f21d5', 'e73eab7a-1b2f-435c-9e28-8f9facecb832', 'e95e90b7-57d3-4670-8484-f3e64b0f27c4'] {{(pid=92060) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 17 04:42:47 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-dbc5d7e3-7852-4520-b17a-9d726f033eff tempest-VolumesTransfersTest-235508039 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 04:42:47 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-dbc5d7e3-7852-4520-b17a-9d726f033eff tempest-VolumesTransfersTest-235508039 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 04:42:47 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-dbc5d7e3-7852-4520-b17a-9d726f033eff tempest-VolumesTransfersTest-235508039 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588': None} {{(pid=92060) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 17 04:42:47 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-dbc5d7e3-7852-4520-b17a-9d726f033eff tempest-VolumesTransfersTest-235508039 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588'] {{(pid=92060) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 17 04:42:47 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-dbc5d7e3-7852-4520-b17a-9d726f033eff tempest-VolumesTransfersTest-235508039 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 04:42:47 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-dbc5d7e3-7852-4520-b17a-9d726f033eff tempest-VolumesTransfersTest-235508039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:42:47 devstack sudo[99908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a Jun 17 04:42:47 devstack sudo[99908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:42:47 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-1d6a8dee-1d42-4072-8064-57a8771a0bea tempest-VolumesTransfersV357Test-1973163403 None] Acquiring lock "cinder-01e02703-431f-4815-a504-b1eaf777894e-delete_volume" by "delete_volume" {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 04:42:47 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-1d6a8dee-1d42-4072-8064-57a8771a0bea tempest-VolumesTransfersV357Test-1973163403 None] Lock "cinder-01e02703-431f-4815-a504-b1eaf777894e-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 04:42:47 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-1d6a8dee-1d42-4072-8064-57a8771a0bea tempest-VolumesTransfersV357Test-1973163403 None] Acquiring lock "cinder-quobyte-01e02703-431f-4815-a504-b1eaf777894e" by "delete_volume" {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 04:42:47 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-1d6a8dee-1d42-4072-8064-57a8771a0bea tempest-VolumesTransfersV357Test-1973163403 None] Lock "cinder-quobyte-01e02703-431f-4815-a504-b1eaf777894e" acquired by "delete_volume" :: waited 0.025s {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 04:42:47 devstack cinder-volume[92060]: DEBUG oslo.privsep.daemon [-] privsep: reply[02d1dae6-ac9e-4449-ba49-b05572584fe3]: (4, 'qcow2') {{(pid=93130) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 04:42:47 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-1d6a8dee-1d42-4072-8064-57a8771a0bea tempest-VolumesTransfersV357Test-1973163403 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-01e02703-431f-4815-a504-b1eaf777894e {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:42:48 devstack sudo[99910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-01e02703-431f-4815-a504-b1eaf777894e Jun 17 04:42:48 devstack sudo[99910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:42:48 devstack sudo[99908]: pam_unix(sudo:session): session closed for user root Jun 17 04:42:48 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-dbc5d7e3-7852-4520-b17a-9d726f033eff tempest-VolumesTransfersTest-235508039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a" returned: 0 in 0.714s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:42:48 devstack cinder-volume[92060]: DEBUG cinder.manager [None req-dbc5d7e3-7852-4520-b17a-9d726f033eff tempest-VolumesTransfersTest-235508039 None] Notifying Schedulers of capabilities ... {{(pid=92060) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 17 04:42:48 devstack cinder-volume[92060]: INFO cinder.volume.manager [None req-dbc5d7e3-7852-4520-b17a-9d726f033eff tempest-VolumesTransfersTest-235508039 None] Deleted volume successfully. Jun 17 04:42:48 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-dbc5d7e3-7852-4520-b17a-9d726f033eff tempest-VolumesTransfersTest-235508039 None] Lock "cinder-6cfca391-11fe-42c5-bad5-26e47dfd873a-delete_volume" released by "delete_volume" :: held 2.463s {{(pid=92060) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 04:42:48 devstack sudo[99910]: pam_unix(sudo:session): session closed for user root Jun 17 04:42:48 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-1d6a8dee-1d42-4072-8064-57a8771a0bea tempest-VolumesTransfersV357Test-1973163403 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-01e02703-431f-4815-a504-b1eaf777894e" returned: 0 in 0.789s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:42:48 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-1d6a8dee-1d42-4072-8064-57a8771a0bea tempest-VolumesTransfersV357Test-1973163403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-01e02703-431f-4815-a504-b1eaf777894e {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:42:48 devstack sudo[99916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-01e02703-431f-4815-a504-b1eaf777894e Jun 17 04:42:48 devstack sudo[99916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:42:49 devstack sudo[99916]: pam_unix(sudo:session): session closed for user root Jun 17 04:42:49 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-1d6a8dee-1d42-4072-8064-57a8771a0bea tempest-VolumesTransfersV357Test-1973163403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-01e02703-431f-4815-a504-b1eaf777894e" returned: 0 in 0.749s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:42:49 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-1d6a8dee-1d42-4072-8064-57a8771a0bea tempest-VolumesTransfersV357Test-1973163403 None] Lock "cinder-quobyte-01e02703-431f-4815-a504-b1eaf777894e" released by "delete_volume" :: held 1.641s {{(pid=92060) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 04:42:49 devstack cinder-volume[92060]: DEBUG cinder.quota [None req-1d6a8dee-1d42-4072-8064-57a8771a0bea tempest-VolumesTransfersV357Test-1973163403 None] Created reservations ['1d51ef58-d2ce-4c2b-8823-8fbc499a39dc', 'e4aae7d1-a211-4832-a61a-40830b07da1d', '79999870-fd8d-4426-a9ae-7aeb5681fba2', 'd3bd9860-3906-4c00-9075-75a589b77e1e'] {{(pid=92060) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 17 04:42:49 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-1d6a8dee-1d42-4072-8064-57a8771a0bea tempest-VolumesTransfersV357Test-1973163403 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 04:42:49 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-1d6a8dee-1d42-4072-8064-57a8771a0bea tempest-VolumesTransfersV357Test-1973163403 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 04:42:49 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-1d6a8dee-1d42-4072-8064-57a8771a0bea tempest-VolumesTransfersV357Test-1973163403 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588': None} {{(pid=92060) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 17 04:42:49 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-1d6a8dee-1d42-4072-8064-57a8771a0bea tempest-VolumesTransfersV357Test-1973163403 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588'] {{(pid=92060) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 17 04:42:49 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-1d6a8dee-1d42-4072-8064-57a8771a0bea tempest-VolumesTransfersV357Test-1973163403 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 04:42:49 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-1d6a8dee-1d42-4072-8064-57a8771a0bea tempest-VolumesTransfersV357Test-1973163403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:42:49 devstack sudo[99920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a Jun 17 04:42:49 devstack sudo[99920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:42:50 devstack sudo[99920]: pam_unix(sudo:session): session closed for user root Jun 17 04:42:50 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-1d6a8dee-1d42-4072-8064-57a8771a0bea tempest-VolumesTransfersV357Test-1973163403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a" returned: 0 in 0.875s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:42:50 devstack cinder-volume[92060]: DEBUG cinder.manager [None req-1d6a8dee-1d42-4072-8064-57a8771a0bea tempest-VolumesTransfersV357Test-1973163403 None] Notifying Schedulers of capabilities ... {{(pid=92060) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 17 04:42:50 devstack cinder-volume[92060]: INFO cinder.volume.manager [None req-1d6a8dee-1d42-4072-8064-57a8771a0bea tempest-VolumesTransfersV357Test-1973163403 None] Deleted volume successfully. Jun 17 04:42:50 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-1d6a8dee-1d42-4072-8064-57a8771a0bea tempest-VolumesTransfersV357Test-1973163403 None] Lock "cinder-01e02703-431f-4815-a504-b1eaf777894e-delete_volume" released by "delete_volume" :: held 2.797s {{(pid=92060) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 04:42:57 devstack cinder-volume[92060]: DEBUG cinder.volume.flows.manager.create_volume [None req-1682e6d7-c43d-4e79-bb1c-dcc860335404 tempest-VolumesCloneTest-982203748 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92060) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 17 04:42:57 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-1682e6d7-c43d-4e79-bb1c-dcc860335404 tempest-VolumesCloneTest-982203748 None] Flow 'volume_create_manager' (1296cd75-86d2-490a-bb5a-42c7cca95fb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 17 04:42:57 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-1682e6d7-c43d-4e79-bb1c-dcc860335404 tempest-VolumesCloneTest-982203748 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3911e16c-8dc4-4c80-8330-9c47d37db67e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:42:57 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-1682e6d7-c43d-4e79-bb1c-dcc860335404 tempest-VolumesCloneTest-982203748 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3911e16c-8dc4-4c80-8330-9c47d37db67e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-17T02:42:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-396536131',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8abb92ad-3196-49df-977b-0a2ffc4b7d2c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='90d3f172a51b4bd5b0a597f79cee89e3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T02:42:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T02:42:58Z,use_quota=True,user_id='f2ca720ae0494c109c8786638949dacb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aad9ce24-93f9-41a6-baa1-5125964f96d1),volume_type_id=aad9ce24-93f9-41a6-baa1-5125964f96d1)' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:42:57 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-1682e6d7-c43d-4e79-bb1c-dcc860335404 tempest-VolumesCloneTest-982203748 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b60ffa4e-c578-4812-b924-df1b80585f1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:42:57 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-1682e6d7-c43d-4e79-bb1c-dcc860335404 tempest-VolumesCloneTest-982203748 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b60ffa4e-c578-4812-b924-df1b80585f1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:42:57 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-1682e6d7-c43d-4e79-bb1c-dcc860335404 tempest-VolumesCloneTest-982203748 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0b2e11cd-a5cc-4169-8504-f94b33b6d3a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:42:57 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-1682e6d7-c43d-4e79-bb1c-dcc860335404 tempest-VolumesCloneTest-982203748 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0b2e11cd-a5cc-4169-8504-f94b33b6d3a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8abb92ad-3196-49df-977b-0a2ffc4b7d2c', 'volume_name': 'volume-8abb92ad-3196-49df-977b-0a2ffc4b7d2c', 'volume_size': 1}' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:42:57 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-1682e6d7-c43d-4e79-bb1c-dcc860335404 tempest-VolumesCloneTest-982203748 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b0a66a36-9dff-463c-b4a4-fdfe24d50852) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:42:57 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-1682e6d7-c43d-4e79-bb1c-dcc860335404 tempest-VolumesCloneTest-982203748 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b0a66a36-9dff-463c-b4a4-fdfe24d50852) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:42:57 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-1682e6d7-c43d-4e79-bb1c-dcc860335404 tempest-VolumesCloneTest-982203748 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (85f96aba-8747-4648-9934-90665435b696) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:42:57 devstack cinder-volume[92060]: INFO cinder.volume.flows.manager.create_volume [None req-1682e6d7-c43d-4e79-bb1c-dcc860335404 tempest-VolumesCloneTest-982203748 None] Volume 8abb92ad-3196-49df-977b-0a2ffc4b7d2c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8abb92ad-3196-49df-977b-0a2ffc4b7d2c', 'volume_size': 1} Jun 17 04:42:57 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-1682e6d7-c43d-4e79-bb1c-dcc860335404 tempest-VolumesCloneTest-982203748 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 04:42:57 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-1682e6d7-c43d-4e79-bb1c-dcc860335404 tempest-VolumesCloneTest-982203748 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 04:42:57 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-1682e6d7-c43d-4e79-bb1c-dcc860335404 tempest-VolumesCloneTest-982203748 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-17T02:42:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-396536131',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8abb92ad-3196-49df-977b-0a2ffc4b7d2c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='90d3f172a51b4bd5b0a597f79cee89e3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T02:42:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T02:42:58Z,use_quota=True,user_id='f2ca720ae0494c109c8786638949dacb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aad9ce24-93f9-41a6-baa1-5125964f96d1),volume_type_id=aad9ce24-93f9-41a6-baa1-5125964f96d1)}" {{(pid=92060) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 17 04:42:57 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.remotefs [None req-1682e6d7-c43d-4e79-bb1c-dcc860335404 tempest-VolumesCloneTest-982203748 None] Creating volume 8abb92ad-3196-49df-977b-0a2ffc4b7d2c {{(pid=92060) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 17 04:42:57 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-1682e6d7-c43d-4e79-bb1c-dcc860335404 tempest-VolumesCloneTest-982203748 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 04:42:57 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-1682e6d7-c43d-4e79-bb1c-dcc860335404 tempest-VolumesCloneTest-982203748 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 04:42:57 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-1682e6d7-c43d-4e79-bb1c-dcc860335404 tempest-VolumesCloneTest-982203748 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588': None} {{(pid=92060) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 17 04:42:57 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-1682e6d7-c43d-4e79-bb1c-dcc860335404 tempest-VolumesCloneTest-982203748 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588'] {{(pid=92060) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 17 04:42:57 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-1682e6d7-c43d-4e79-bb1c-dcc860335404 tempest-VolumesCloneTest-982203748 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 04:42:57 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-1682e6d7-c43d-4e79-bb1c-dcc860335404 tempest-VolumesCloneTest-982203748 None] Selected osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588 as target Quobyte volume. {{(pid=92060) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 17 04:42:57 devstack cinder-volume[92060]: INFO cinder.volume.drivers.remotefs [None req-1682e6d7-c43d-4e79-bb1c-dcc860335404 tempest-VolumesCloneTest-982203748 None] casted to osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588 Jun 17 04:42:57 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-1682e6d7-c43d-4e79-bb1c-dcc860335404 tempest-VolumesCloneTest-982203748 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-8abb92ad-3196-49df-977b-0a2ffc4b7d2c 1073741824 {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:42:57 devstack cinder-volume[92060]: DEBUG cinder.volume.flows.manager.create_volume [None req-8748570f-1c61-46da-bed3-0e5a580da5f5 tempest-VolumesTransfersV355Test-1302747316 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92060) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 17 04:42:58 devstack sudo[99968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-8abb92ad-3196-49df-977b-0a2ffc4b7d2c 1073741824 Jun 17 04:42:58 devstack sudo[99968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:42:58 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-8748570f-1c61-46da-bed3-0e5a580da5f5 tempest-VolumesTransfersV355Test-1302747316 None] Flow 'volume_create_manager' (ea56ca1a-2a8f-4a7c-9645-61c1ac36d7dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 17 04:42:58 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-8748570f-1c61-46da-bed3-0e5a580da5f5 tempest-VolumesTransfersV355Test-1302747316 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ddc38522-26c9-4f2a-9da9-93b6329d18cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:42:58 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-8748570f-1c61-46da-bed3-0e5a580da5f5 tempest-VolumesTransfersV355Test-1302747316 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ddc38522-26c9-4f2a-9da9-93b6329d18cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-17T02:42:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-663153977',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=55f359cb-746f-44f5-b340-a413b556652f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='89a28ce39d844caeab832cd25116cd66',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T02:42:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T02:42:58Z,use_quota=True,user_id='4eaa446391bd4526a83f842d8cf2263d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aad9ce24-93f9-41a6-baa1-5125964f96d1),volume_type_id=aad9ce24-93f9-41a6-baa1-5125964f96d1)' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:42:58 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-8748570f-1c61-46da-bed3-0e5a580da5f5 tempest-VolumesTransfersV355Test-1302747316 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a9d02163-f7d9-4471-b9ca-be48db95539d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:42:58 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-8748570f-1c61-46da-bed3-0e5a580da5f5 tempest-VolumesTransfersV355Test-1302747316 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a9d02163-f7d9-4471-b9ca-be48db95539d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:42:58 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-8748570f-1c61-46da-bed3-0e5a580da5f5 tempest-VolumesTransfersV355Test-1302747316 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (26cbaf1e-ed3e-4669-994f-dd0fa4ee92dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:42:58 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-8748570f-1c61-46da-bed3-0e5a580da5f5 tempest-VolumesTransfersV355Test-1302747316 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (26cbaf1e-ed3e-4669-994f-dd0fa4ee92dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '55f359cb-746f-44f5-b340-a413b556652f', 'volume_name': 'volume-55f359cb-746f-44f5-b340-a413b556652f', 'volume_size': 1}' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:42:58 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-8748570f-1c61-46da-bed3-0e5a580da5f5 tempest-VolumesTransfersV355Test-1302747316 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (30919c44-6076-4d36-9142-e42e2080cbed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:42:58 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-8748570f-1c61-46da-bed3-0e5a580da5f5 tempest-VolumesTransfersV355Test-1302747316 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (30919c44-6076-4d36-9142-e42e2080cbed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:42:58 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-8748570f-1c61-46da-bed3-0e5a580da5f5 tempest-VolumesTransfersV355Test-1302747316 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8dfa2555-fe5a-4d9a-b626-2fb1b10d232d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:42:58 devstack cinder-volume[92060]: INFO cinder.volume.flows.manager.create_volume [None req-8748570f-1c61-46da-bed3-0e5a580da5f5 tempest-VolumesTransfersV355Test-1302747316 None] Volume 55f359cb-746f-44f5-b340-a413b556652f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-55f359cb-746f-44f5-b340-a413b556652f', 'volume_size': 1} Jun 17 04:42:58 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-8748570f-1c61-46da-bed3-0e5a580da5f5 tempest-VolumesTransfersV355Test-1302747316 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 04:42:58 devstack sudo[99968]: pam_unix(sudo:session): session closed for user root Jun 17 04:42:58 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-1682e6d7-c43d-4e79-bb1c-dcc860335404 tempest-VolumesCloneTest-982203748 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-8abb92ad-3196-49df-977b-0a2ffc4b7d2c 1073741824" returned: 0 in 0.909s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:42:58 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-1682e6d7-c43d-4e79-bb1c-dcc860335404 tempest-VolumesCloneTest-982203748 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-8abb92ad-3196-49df-977b-0a2ffc4b7d2c {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:42:58 devstack sudo[99974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-8abb92ad-3196-49df-977b-0a2ffc4b7d2c Jun 17 04:42:58 devstack sudo[99974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:42:59 devstack sudo[99974]: pam_unix(sudo:session): session closed for user root Jun 17 04:42:59 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-1682e6d7-c43d-4e79-bb1c-dcc860335404 tempest-VolumesCloneTest-982203748 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-8abb92ad-3196-49df-977b-0a2ffc4b7d2c" returned: 0 in 0.612s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:42:59 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-1682e6d7-c43d-4e79-bb1c-dcc860335404 tempest-VolumesCloneTest-982203748 None] <== create_volume: return (1571ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588'} {{(pid=92060) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 17 04:42:59 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-1682e6d7-c43d-4e79-bb1c-dcc860335404 tempest-VolumesCloneTest-982203748 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.574s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 04:42:59 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-8748570f-1c61-46da-bed3-0e5a580da5f5 tempest-VolumesTransfersV355Test-1302747316 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.459s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 04:42:59 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-8748570f-1c61-46da-bed3-0e5a580da5f5 tempest-VolumesTransfersV355Test-1302747316 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-17T02:42:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-663153977',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=55f359cb-746f-44f5-b340-a413b556652f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='89a28ce39d844caeab832cd25116cd66',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T02:42:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T02:42:58Z,use_quota=True,user_id='4eaa446391bd4526a83f842d8cf2263d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aad9ce24-93f9-41a6-baa1-5125964f96d1),volume_type_id=aad9ce24-93f9-41a6-baa1-5125964f96d1)}" {{(pid=92060) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 17 04:42:59 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.remotefs [None req-8748570f-1c61-46da-bed3-0e5a580da5f5 tempest-VolumesTransfersV355Test-1302747316 None] Creating volume 55f359cb-746f-44f5-b340-a413b556652f {{(pid=92060) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 17 04:42:59 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-8748570f-1c61-46da-bed3-0e5a580da5f5 tempest-VolumesTransfersV355Test-1302747316 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 04:42:59 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-8748570f-1c61-46da-bed3-0e5a580da5f5 tempest-VolumesTransfersV355Test-1302747316 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 04:42:59 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-8748570f-1c61-46da-bed3-0e5a580da5f5 tempest-VolumesTransfersV355Test-1302747316 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588': None} {{(pid=92060) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 17 04:42:59 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-8748570f-1c61-46da-bed3-0e5a580da5f5 tempest-VolumesTransfersV355Test-1302747316 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588'] {{(pid=92060) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 17 04:42:59 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-8748570f-1c61-46da-bed3-0e5a580da5f5 tempest-VolumesTransfersV355Test-1302747316 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 04:42:59 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-8748570f-1c61-46da-bed3-0e5a580da5f5 tempest-VolumesTransfersV355Test-1302747316 None] Selected osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588 as target Quobyte volume. {{(pid=92060) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 17 04:42:59 devstack cinder-volume[92060]: INFO cinder.volume.drivers.remotefs [None req-8748570f-1c61-46da-bed3-0e5a580da5f5 tempest-VolumesTransfersV355Test-1302747316 None] casted to osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588 Jun 17 04:42:59 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-8748570f-1c61-46da-bed3-0e5a580da5f5 tempest-VolumesTransfersV355Test-1302747316 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-55f359cb-746f-44f5-b340-a413b556652f 1073741824 {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:42:59 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-1682e6d7-c43d-4e79-bb1c-dcc860335404 tempest-VolumesCloneTest-982203748 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (85f96aba-8747-4648-9934-90665435b696) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8abb92ad-3196-49df-977b-0a2ffc4b7d2c', 'volume_size': 1}' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:42:59 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-1682e6d7-c43d-4e79-bb1c-dcc860335404 tempest-VolumesCloneTest-982203748 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (63fc476b-b42e-4b26-b856-b35bf76339c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:42:59 devstack sudo[99977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-55f359cb-746f-44f5-b340-a413b556652f 1073741824 Jun 17 04:42:59 devstack cinder-volume[92060]: INFO cinder.volume.flows.manager.create_volume [None req-1682e6d7-c43d-4e79-bb1c-dcc860335404 tempest-VolumesCloneTest-982203748 None] Volume volume-8abb92ad-3196-49df-977b-0a2ffc4b7d2c (8abb92ad-3196-49df-977b-0a2ffc4b7d2c): created successfully Jun 17 04:42:59 devstack sudo[99977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:42:59 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-1682e6d7-c43d-4e79-bb1c-dcc860335404 tempest-VolumesCloneTest-982203748 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (63fc476b-b42e-4b26-b856-b35bf76339c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:42:59 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-1682e6d7-c43d-4e79-bb1c-dcc860335404 tempest-VolumesCloneTest-982203748 None] Flow 'volume_create_manager' (1296cd75-86d2-490a-bb5a-42c7cca95fb3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92060) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 17 04:42:59 devstack cinder-volume[92060]: INFO cinder.volume.manager [None req-1682e6d7-c43d-4e79-bb1c-dcc860335404 tempest-VolumesCloneTest-982203748 None] Created volume successfully. Jun 17 04:43:00 devstack cinder-volume[92060]: DEBUG cinder.volume.flows.manager.create_volume [None req-6a4af64b-d11f-4971-b0b6-50dc7d4c07e4 tempest-VolumesCloneTest-982203748 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92060) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 17 04:43:00 devstack sudo[99977]: pam_unix(sudo:session): session closed for user root Jun 17 04:43:00 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-6a4af64b-d11f-4971-b0b6-50dc7d4c07e4 tempest-VolumesCloneTest-982203748 None] Flow 'volume_create_manager' (a90506b1-9c4a-403b-a9bf-e5c3dba19859) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 17 04:43:00 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-6a4af64b-d11f-4971-b0b6-50dc7d4c07e4 tempest-VolumesCloneTest-982203748 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (49ec9d68-e78a-49a6-97f1-af41459ab353) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:43:00 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-8748570f-1c61-46da-bed3-0e5a580da5f5 tempest-VolumesTransfersV355Test-1302747316 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-55f359cb-746f-44f5-b340-a413b556652f 1073741824" returned: 0 in 0.969s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:43:00 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-6a4af64b-d11f-4971-b0b6-50dc7d4c07e4 tempest-VolumesCloneTest-982203748 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (49ec9d68-e78a-49a6-97f1-af41459ab353) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-17T02:43:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-777762280',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=74ec7ab9-46e8-4061-90bc-2b4a62144394,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='90d3f172a51b4bd5b0a597f79cee89e3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T02:43:00Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=8abb92ad-3196-49df-977b-0a2ffc4b7d2c,status='creating',terminated_at=None,updated_at=2026-06-17T02:43:00Z,use_quota=True,user_id='f2ca720ae0494c109c8786638949dacb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aad9ce24-93f9-41a6-baa1-5125964f96d1),volume_type_id=aad9ce24-93f9-41a6-baa1-5125964f96d1)' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:43:00 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-6a4af64b-d11f-4971-b0b6-50dc7d4c07e4 tempest-VolumesCloneTest-982203748 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ccb8a2bc-dd6e-406e-915b-03670f61a12a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:43:00 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-6a4af64b-d11f-4971-b0b6-50dc7d4c07e4 tempest-VolumesCloneTest-982203748 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ccb8a2bc-dd6e-406e-915b-03670f61a12a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:43:00 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-6a4af64b-d11f-4971-b0b6-50dc7d4c07e4 tempest-VolumesCloneTest-982203748 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5b466174-e1c8-41c5-8ac0-c28aeb4eba46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:43:00 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-6a4af64b-d11f-4971-b0b6-50dc7d4c07e4 tempest-VolumesCloneTest-982203748 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5b466174-e1c8-41c5-8ac0-c28aeb4eba46) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '74ec7ab9-46e8-4061-90bc-2b4a62144394', 'volume_name': 'volume-74ec7ab9-46e8-4061-90bc-2b4a62144394', 'volume_size': 2, 'source_volid': '8abb92ad-3196-49df-977b-0a2ffc4b7d2c', 'source_volstatus': 'available'}' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:43:00 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-6a4af64b-d11f-4971-b0b6-50dc7d4c07e4 tempest-VolumesCloneTest-982203748 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a4856e71-5be6-4866-a510-7645e065bece) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:43:00 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-6a4af64b-d11f-4971-b0b6-50dc7d4c07e4 tempest-VolumesCloneTest-982203748 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a4856e71-5be6-4866-a510-7645e065bece) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:43:00 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-6a4af64b-d11f-4971-b0b6-50dc7d4c07e4 tempest-VolumesCloneTest-982203748 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f9a0dfe3-765f-4150-a3d8-158776caac4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:43:00 devstack cinder-volume[92060]: INFO cinder.volume.flows.manager.create_volume [None req-6a4af64b-d11f-4971-b0b6-50dc7d4c07e4 tempest-VolumesCloneTest-982203748 None] Volume 74ec7ab9-46e8-4061-90bc-2b4a62144394: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-74ec7ab9-46e8-4061-90bc-2b4a62144394', 'volume_size': 2, 'source_volid': '8abb92ad-3196-49df-977b-0a2ffc4b7d2c', 'source_volstatus': 'available'} Jun 17 04:43:00 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-8748570f-1c61-46da-bed3-0e5a580da5f5 tempest-VolumesTransfersV355Test-1302747316 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-55f359cb-746f-44f5-b340-a413b556652f {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:43:00 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-6a4af64b-d11f-4971-b0b6-50dc7d4c07e4 tempest-VolumesCloneTest-982203748 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 04:43:00 devstack sudo[99983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-55f359cb-746f-44f5-b340-a413b556652f Jun 17 04:43:00 devstack sudo[99983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:43:01 devstack sudo[99983]: pam_unix(sudo:session): session closed for user root Jun 17 04:43:01 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-8748570f-1c61-46da-bed3-0e5a580da5f5 tempest-VolumesTransfersV355Test-1302747316 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-55f359cb-746f-44f5-b340-a413b556652f" returned: 0 in 0.632s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:43:01 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-8748570f-1c61-46da-bed3-0e5a580da5f5 tempest-VolumesTransfersV355Test-1302747316 None] <== create_volume: return (1706ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588'} {{(pid=92060) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 17 04:43:01 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-8748570f-1c61-46da-bed3-0e5a580da5f5 tempest-VolumesTransfersV355Test-1302747316 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.708s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 04:43:01 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-6a4af64b-d11f-4971-b0b6-50dc7d4c07e4 tempest-VolumesCloneTest-982203748 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.624s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 04:43:01 devstack cinder-volume[92060]: INFO cinder.volume.drivers.remotefs [None req-6a4af64b-d11f-4971-b0b6-50dc7d4c07e4 tempest-VolumesCloneTest-982203748 None] Cloning volume 8abb92ad-3196-49df-977b-0a2ffc4b7d2c to volume 74ec7ab9-46e8-4061-90bc-2b4a62144394 Jun 17 04:43:01 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-8748570f-1c61-46da-bed3-0e5a580da5f5 tempest-VolumesTransfersV355Test-1302747316 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8dfa2555-fe5a-4d9a-b626-2fb1b10d232d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-55f359cb-746f-44f5-b340-a413b556652f', 'volume_size': 1}' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:43:01 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-8748570f-1c61-46da-bed3-0e5a580da5f5 tempest-VolumesTransfersV355Test-1302747316 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (10411cd8-8770-4b86-b125-61195a2c72d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:43:01 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.remotefs [None req-6a4af64b-d11f-4971-b0b6-50dc7d4c07e4 tempest-VolumesCloneTest-982203748 None] Creating offline snapshot 844a2385-027b-4380-b8aa-892331c55bfe of volume 8abb92ad-3196-49df-977b-0a2ffc4b7d2c {{(pid=92060) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 17 04:43:01 devstack cinder-volume[92060]: INFO cinder.volume.flows.manager.create_volume [None req-8748570f-1c61-46da-bed3-0e5a580da5f5 tempest-VolumesTransfersV355Test-1302747316 None] Volume volume-55f359cb-746f-44f5-b340-a413b556652f (55f359cb-746f-44f5-b340-a413b556652f): created successfully Jun 17 04:43:01 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-8748570f-1c61-46da-bed3-0e5a580da5f5 tempest-VolumesTransfersV355Test-1302747316 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (10411cd8-8770-4b86-b125-61195a2c72d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:43:01 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-8748570f-1c61-46da-bed3-0e5a580da5f5 tempest-VolumesTransfersV355Test-1302747316 None] Flow 'volume_create_manager' (ea56ca1a-2a8f-4a7c-9645-61c1ac36d7dc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92060) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 17 04:43:01 devstack cinder-volume[92060]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd6ad964-3be0-45aa-9eb4-9e67e536bf18]: (4, 'qcow2') {{(pid=93130) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 04:43:01 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-6a4af64b-d11f-4971-b0b6-50dc7d4c07e4 tempest-VolumesCloneTest-982203748 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-8abb92ad-3196-49df-977b-0a2ffc4b7d2c {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:43:01 devstack cinder-volume[92060]: INFO cinder.volume.manager [None req-8748570f-1c61-46da-bed3-0e5a580da5f5 tempest-VolumesTransfersV355Test-1302747316 None] Created volume successfully. Jun 17 04:43:01 devstack sudo[99987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-8abb92ad-3196-49df-977b-0a2ffc4b7d2c Jun 17 04:43:01 devstack sudo[99987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:43:02 devstack sudo[99987]: pam_unix(sudo:session): session closed for user root Jun 17 04:43:02 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-6a4af64b-d11f-4971-b0b6-50dc7d4c07e4 tempest-VolumesCloneTest-982203748 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-8abb92ad-3196-49df-977b-0a2ffc4b7d2c" returned: 0 in 0.788s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:43:02 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-6a4af64b-d11f-4971-b0b6-50dc7d4c07e4 tempest-VolumesCloneTest-982203748 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-8abb92ad-3196-49df-977b-0a2ffc4b7d2c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-8abb92ad-3196-49df-977b-0a2ffc4b7d2c.844a2385-027b-4380-b8aa-892331c55bfe 1G {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:43:02 devstack sudo[99992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-8abb92ad-3196-49df-977b-0a2ffc4b7d2c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-8abb92ad-3196-49df-977b-0a2ffc4b7d2c.844a2385-027b-4380-b8aa-892331c55bfe 1G Jun 17 04:43:02 devstack sudo[99992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:43:03 devstack cinder-volume[92060]: INFO cinder.volume.manager [None req-ad4f85a4-9ce7-4444-a4e5-e9792f7fccc0 tempest-VolumesTransfersV355Test-1391213335 None] Transfer volume completed successfully. Jun 17 04:43:03 devstack sudo[99992]: pam_unix(sudo:session): session closed for user root Jun 17 04:43:03 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-6a4af64b-d11f-4971-b0b6-50dc7d4c07e4 tempest-VolumesCloneTest-982203748 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-8abb92ad-3196-49df-977b-0a2ffc4b7d2c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-8abb92ad-3196-49df-977b-0a2ffc4b7d2c.844a2385-027b-4380-b8aa-892331c55bfe 1G" returned: 0 in 0.997s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:43:03 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-6a4af64b-d11f-4971-b0b6-50dc7d4c07e4 tempest-VolumesCloneTest-982203748 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8abb92ad-3196-49df-977b-0a2ffc4b7d2c -F qcow2 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-8abb92ad-3196-49df-977b-0a2ffc4b7d2c.844a2385-027b-4380-b8aa-892331c55bfe {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:43:03 devstack sudo[99998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8abb92ad-3196-49df-977b-0a2ffc4b7d2c -F qcow2 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-8abb92ad-3196-49df-977b-0a2ffc4b7d2c.844a2385-027b-4380-b8aa-892331c55bfe Jun 17 04:43:03 devstack sudo[99998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:43:03 devstack sudo[99998]: pam_unix(sudo:session): session closed for user root Jun 17 04:43:03 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-6a4af64b-d11f-4971-b0b6-50dc7d4c07e4 tempest-VolumesCloneTest-982203748 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8abb92ad-3196-49df-977b-0a2ffc4b7d2c -F qcow2 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-8abb92ad-3196-49df-977b-0a2ffc4b7d2c.844a2385-027b-4380-b8aa-892331c55bfe" returned: 0 in 0.808s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:43:03 devstack cinder-volume[92060]: WARNING cinder.volume.drivers.remotefs [None req-6a4af64b-d11f-4971-b0b6-50dc7d4c07e4 tempest-VolumesCloneTest-982203748 None] /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-8abb92ad-3196-49df-977b-0a2ffc4b7d2c.844a2385-027b-4380-b8aa-892331c55bfe is being set with open permissions: ugo+rw Jun 17 04:43:03 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-6a4af64b-d11f-4971-b0b6-50dc7d4c07e4 tempest-VolumesCloneTest-982203748 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-8abb92ad-3196-49df-977b-0a2ffc4b7d2c.844a2385-027b-4380-b8aa-892331c55bfe {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:43:03 devstack sudo[100003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-8abb92ad-3196-49df-977b-0a2ffc4b7d2c.844a2385-027b-4380-b8aa-892331c55bfe Jun 17 04:43:03 devstack sudo[100003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:43:04 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-9d9da61a-d451-4501-8f12-f198c66ef8ee tempest-VolumesTransfersV355Test-1080086179 None] Acquiring lock "cinder-55f359cb-746f-44f5-b340-a413b556652f-delete_volume" by "delete_volume" {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 04:43:04 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-9d9da61a-d451-4501-8f12-f198c66ef8ee tempest-VolumesTransfersV355Test-1080086179 None] Lock "cinder-55f359cb-746f-44f5-b340-a413b556652f-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 04:43:04 devstack cinder-volume[92060]: DEBUG dbcounter [-] [92060] Writing DB stats cinder:UPDATE=173,cinder:SELECT=121,cinder:INSERT=48,cinder:DELETE=12 {{(pid=92060) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 17 04:43:04 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-9d9da61a-d451-4501-8f12-f198c66ef8ee tempest-VolumesTransfersV355Test-1080086179 None] Acquiring lock "cinder-quobyte-55f359cb-746f-44f5-b340-a413b556652f" by "delete_volume" {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 04:43:04 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-9d9da61a-d451-4501-8f12-f198c66ef8ee tempest-VolumesTransfersV355Test-1080086179 None] Lock "cinder-quobyte-55f359cb-746f-44f5-b340-a413b556652f" acquired by "delete_volume" :: waited 0.014s {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 04:43:04 devstack cinder-volume[92060]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2159bac-87fb-4fb4-8814-7050a6e3e5a8]: (4, 'qcow2') {{(pid=93130) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 04:43:04 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-9d9da61a-d451-4501-8f12-f198c66ef8ee tempest-VolumesTransfersV355Test-1080086179 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-55f359cb-746f-44f5-b340-a413b556652f {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:43:04 devstack sudo[100005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-55f359cb-746f-44f5-b340-a413b556652f Jun 17 04:43:04 devstack sudo[100005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:43:04 devstack sudo[100003]: pam_unix(sudo:session): session closed for user root Jun 17 04:43:04 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-6a4af64b-d11f-4971-b0b6-50dc7d4c07e4 tempest-VolumesCloneTest-982203748 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-8abb92ad-3196-49df-977b-0a2ffc4b7d2c.844a2385-027b-4380-b8aa-892331c55bfe" returned: 0 in 0.738s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:43:04 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-6a4af64b-d11f-4971-b0b6-50dc7d4c07e4 tempest-VolumesCloneTest-982203748 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-8abb92ad-3196-49df-977b-0a2ffc4b7d2c.info {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:43:04 devstack sudo[100008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-8abb92ad-3196-49df-977b-0a2ffc4b7d2c.info Jun 17 04:43:04 devstack sudo[100008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:43:05 devstack sudo[100005]: pam_unix(sudo:session): session closed for user root Jun 17 04:43:05 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-9d9da61a-d451-4501-8f12-f198c66ef8ee tempest-VolumesTransfersV355Test-1080086179 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-55f359cb-746f-44f5-b340-a413b556652f" returned: 0 in 0.906s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:43:05 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-9d9da61a-d451-4501-8f12-f198c66ef8ee tempest-VolumesTransfersV355Test-1080086179 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-55f359cb-746f-44f5-b340-a413b556652f {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:43:05 devstack sudo[100013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-55f359cb-746f-44f5-b340-a413b556652f Jun 17 04:43:05 devstack sudo[100013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:43:05 devstack sudo[100008]: pam_unix(sudo:session): session closed for user root Jun 17 04:43:05 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-6a4af64b-d11f-4971-b0b6-50dc7d4c07e4 tempest-VolumesCloneTest-982203748 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-8abb92ad-3196-49df-977b-0a2ffc4b7d2c.info" returned: 0 in 0.827s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:43:05 devstack cinder-volume[92060]: WARNING cinder.volume.drivers.remotefs [None req-6a4af64b-d11f-4971-b0b6-50dc7d4c07e4 tempest-VolumesCloneTest-982203748 None] /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-8abb92ad-3196-49df-977b-0a2ffc4b7d2c.info is being set with open permissions: ugo+rw Jun 17 04:43:05 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-6a4af64b-d11f-4971-b0b6-50dc7d4c07e4 tempest-VolumesCloneTest-982203748 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-8abb92ad-3196-49df-977b-0a2ffc4b7d2c.info {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:43:05 devstack sudo[100017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-8abb92ad-3196-49df-977b-0a2ffc4b7d2c.info Jun 17 04:43:05 devstack sudo[100017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:43:06 devstack sudo[100013]: pam_unix(sudo:session): session closed for user root Jun 17 04:43:06 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-9d9da61a-d451-4501-8f12-f198c66ef8ee tempest-VolumesTransfersV355Test-1080086179 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-55f359cb-746f-44f5-b340-a413b556652f" returned: 0 in 0.721s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:43:06 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-9d9da61a-d451-4501-8f12-f198c66ef8ee tempest-VolumesTransfersV355Test-1080086179 None] Lock "cinder-quobyte-55f359cb-746f-44f5-b340-a413b556652f" released by "delete_volume" :: held 1.686s {{(pid=92060) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 04:43:06 devstack cinder-volume[92060]: DEBUG cinder.quota [None req-9d9da61a-d451-4501-8f12-f198c66ef8ee tempest-VolumesTransfersV355Test-1080086179 None] Created reservations ['ffc39cb5-35a6-440f-99e9-7eb326d9e1ad', '81724c26-7e25-416b-9534-44478207372e', '5028e997-a49a-48a7-a4dd-e92f20f43740', '334762a7-c11b-4270-877c-0fa67f5f9171'] {{(pid=92060) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 17 04:43:06 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-9d9da61a-d451-4501-8f12-f198c66ef8ee tempest-VolumesTransfersV355Test-1080086179 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 04:43:06 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-9d9da61a-d451-4501-8f12-f198c66ef8ee tempest-VolumesTransfersV355Test-1080086179 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 04:43:06 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-9d9da61a-d451-4501-8f12-f198c66ef8ee tempest-VolumesTransfersV355Test-1080086179 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588': None} {{(pid=92060) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 17 04:43:06 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-9d9da61a-d451-4501-8f12-f198c66ef8ee tempest-VolumesTransfersV355Test-1080086179 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588'] {{(pid=92060) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 17 04:43:06 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-9d9da61a-d451-4501-8f12-f198c66ef8ee tempest-VolumesTransfersV355Test-1080086179 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 04:43:06 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-9d9da61a-d451-4501-8f12-f198c66ef8ee tempest-VolumesTransfersV355Test-1080086179 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:43:06 devstack sudo[100022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a Jun 17 04:43:06 devstack sudo[100022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:43:06 devstack sudo[100017]: pam_unix(sudo:session): session closed for user root Jun 17 04:43:06 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-6a4af64b-d11f-4971-b0b6-50dc7d4c07e4 tempest-VolumesCloneTest-982203748 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-8abb92ad-3196-49df-977b-0a2ffc4b7d2c.info" returned: 0 in 0.826s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:43:06 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-6a4af64b-d11f-4971-b0b6-50dc7d4c07e4 tempest-VolumesCloneTest-982203748 None] Acquiring lock "cinder-quobyte-74ec7ab9-46e8-4061-90bc-2b4a62144394" by "_copy_volume_from_snapshot" {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 04:43:06 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-6a4af64b-d11f-4971-b0b6-50dc7d4c07e4 tempest-VolumesCloneTest-982203748 None] Lock "cinder-quobyte-74ec7ab9-46e8-4061-90bc-2b4a62144394" acquired by "_copy_volume_from_snapshot" :: waited 0.020s {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 04:43:06 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-6a4af64b-d11f-4971-b0b6-50dc7d4c07e4 tempest-VolumesCloneTest-982203748 None] snapshot: 844a2385-027b-4380-b8aa-892331c55bfe, volume: 74ec7ab9-46e8-4061-90bc-2b4a62144394, {{(pid=92060) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jun 17 04:43:06 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-6a4af64b-d11f-4971-b0b6-50dc7d4c07e4 tempest-VolumesCloneTest-982203748 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 04:43:06 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-6a4af64b-d11f-4971-b0b6-50dc7d4c07e4 tempest-VolumesCloneTest-982203748 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 04:43:06 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-6a4af64b-d11f-4971-b0b6-50dc7d4c07e4 tempest-VolumesCloneTest-982203748 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588': None} {{(pid=92060) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 17 04:43:06 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-6a4af64b-d11f-4971-b0b6-50dc7d4c07e4 tempest-VolumesCloneTest-982203748 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588'] {{(pid=92060) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 17 04:43:06 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-6a4af64b-d11f-4971-b0b6-50dc7d4c07e4 tempest-VolumesCloneTest-982203748 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 04:43:06 devstack cinder-volume[92060]: DEBUG oslo.privsep.daemon [-] privsep: reply[a18e75c8-8c6a-4b0c-b192-d415342647ee]: (4, 'qcow2') {{(pid=93130) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 04:43:06 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-6a4af64b-d11f-4971-b0b6-50dc7d4c07e4 tempest-VolumesCloneTest-982203748 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-8abb92ad-3196-49df-977b-0a2ffc4b7d2c.844a2385-027b-4380-b8aa-892331c55bfe {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:43:06 devstack sudo[100024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-8abb92ad-3196-49df-977b-0a2ffc4b7d2c.844a2385-027b-4380-b8aa-892331c55bfe Jun 17 04:43:06 devstack sudo[100024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:43:07 devstack sudo[100022]: pam_unix(sudo:session): session closed for user root Jun 17 04:43:07 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-9d9da61a-d451-4501-8f12-f198c66ef8ee tempest-VolumesTransfersV355Test-1080086179 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a" returned: 0 in 0.915s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:43:07 devstack cinder-volume[92060]: DEBUG cinder.manager [None req-9d9da61a-d451-4501-8f12-f198c66ef8ee tempest-VolumesTransfersV355Test-1080086179 None] Notifying Schedulers of capabilities ... {{(pid=92060) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 17 04:43:07 devstack cinder-volume[92060]: INFO cinder.volume.manager [None req-9d9da61a-d451-4501-8f12-f198c66ef8ee tempest-VolumesTransfersV355Test-1080086179 None] Deleted volume successfully. Jun 17 04:43:07 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-9d9da61a-d451-4501-8f12-f198c66ef8ee tempest-VolumesTransfersV355Test-1080086179 None] Lock "cinder-55f359cb-746f-44f5-b340-a413b556652f-delete_volume" released by "delete_volume" :: held 2.874s {{(pid=92060) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 04:43:07 devstack cinder-volume[92060]: DEBUG cinder.volume.flows.manager.create_volume [None req-38d9bb8b-dfa8-4033-bfbb-4ebb50a0509e tempest-VolumesTransfersV355Test-1302747316 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92060) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 17 04:43:07 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-38d9bb8b-dfa8-4033-bfbb-4ebb50a0509e tempest-VolumesTransfersV355Test-1302747316 None] Flow 'volume_create_manager' (54eba707-c102-4f98-867c-4a35f4fba122) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 17 04:43:07 devstack sudo[100024]: pam_unix(sudo:session): session closed for user root Jun 17 04:43:07 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-38d9bb8b-dfa8-4033-bfbb-4ebb50a0509e tempest-VolumesTransfersV355Test-1302747316 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cfd65ef6-a8b5-4f45-8578-5db17e29ff51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:43:07 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-6a4af64b-d11f-4971-b0b6-50dc7d4c07e4 tempest-VolumesCloneTest-982203748 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-8abb92ad-3196-49df-977b-0a2ffc4b7d2c.844a2385-027b-4380-b8aa-892331c55bfe" returned: 0 in 0.912s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:43:07 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.remotefs [None req-6a4af64b-d11f-4971-b0b6-50dc7d4c07e4 tempest-VolumesCloneTest-982203748 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8abb92ad-3196-49df-977b-0a2ffc4b7d2c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=92060) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 17 04:43:07 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-6a4af64b-d11f-4971-b0b6-50dc7d4c07e4 tempest-VolumesCloneTest-982203748 None] will copy from snapshot at /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-8abb92ad-3196-49df-977b-0a2ffc4b7d2c {{(pid=92060) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jun 17 04:43:07 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-6a4af64b-d11f-4971-b0b6-50dc7d4c07e4 tempest-VolumesCloneTest-982203748 None] Creating direct copy from snapshot {{(pid=92060) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jun 17 04:43:07 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-38d9bb8b-dfa8-4033-bfbb-4ebb50a0509e tempest-VolumesTransfersV355Test-1302747316 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cfd65ef6-a8b5-4f45-8578-5db17e29ff51) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-17T02:43:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1790040660',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=97307288-da6a-4f15-85a1-67d5fa704a43,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='89a28ce39d844caeab832cd25116cd66',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T02:43:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T02:43:07Z,use_quota=True,user_id='4eaa446391bd4526a83f842d8cf2263d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aad9ce24-93f9-41a6-baa1-5125964f96d1),volume_type_id=aad9ce24-93f9-41a6-baa1-5125964f96d1)' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:43:07 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-38d9bb8b-dfa8-4033-bfbb-4ebb50a0509e tempest-VolumesTransfersV355Test-1302747316 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ba7f49ab-8650-4c9b-9f43-501446e6fe29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:43:07 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-38d9bb8b-dfa8-4033-bfbb-4ebb50a0509e tempest-VolumesTransfersV355Test-1302747316 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ba7f49ab-8650-4c9b-9f43-501446e6fe29) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:43:07 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-38d9bb8b-dfa8-4033-bfbb-4ebb50a0509e tempest-VolumesTransfersV355Test-1302747316 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9538bd6f-0158-4b19-bd16-83cfcf54523d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:43:07 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-38d9bb8b-dfa8-4033-bfbb-4ebb50a0509e tempest-VolumesTransfersV355Test-1302747316 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9538bd6f-0158-4b19-bd16-83cfcf54523d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '97307288-da6a-4f15-85a1-67d5fa704a43', 'volume_name': 'volume-97307288-da6a-4f15-85a1-67d5fa704a43', 'volume_size': 1}' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:43:07 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-38d9bb8b-dfa8-4033-bfbb-4ebb50a0509e tempest-VolumesTransfersV355Test-1302747316 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (86cfb7ce-bdac-4733-912c-3c1c694f4cb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:43:07 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-38d9bb8b-dfa8-4033-bfbb-4ebb50a0509e tempest-VolumesTransfersV355Test-1302747316 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (86cfb7ce-bdac-4733-912c-3c1c694f4cb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:43:07 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-38d9bb8b-dfa8-4033-bfbb-4ebb50a0509e tempest-VolumesTransfersV355Test-1302747316 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a4fc2e36-0c35-45bf-8fcd-0b924e59e8b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:43:07 devstack cinder-volume[92060]: INFO cinder.volume.flows.manager.create_volume [None req-38d9bb8b-dfa8-4033-bfbb-4ebb50a0509e tempest-VolumesTransfersV355Test-1302747316 None] Volume 97307288-da6a-4f15-85a1-67d5fa704a43: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-97307288-da6a-4f15-85a1-67d5fa704a43', 'volume_size': 1} Jun 17 04:43:07 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-38d9bb8b-dfa8-4033-bfbb-4ebb50a0509e tempest-VolumesTransfersV355Test-1302747316 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 04:43:07 devstack cinder-volume[92060]: DEBUG oslo.privsep.daemon [-] privsep: reply[3723fefb-df57-44fb-9df3-106e126274b9]: (4, 'qcow2') {{(pid=93130) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 04:43:07 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-6a4af64b-d11f-4971-b0b6-50dc7d4c07e4 tempest-VolumesCloneTest-982203748 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-8abb92ad-3196-49df-977b-0a2ffc4b7d2c {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:43:07 devstack sudo[100030]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-8abb92ad-3196-49df-977b-0a2ffc4b7d2c Jun 17 04:43:07 devstack sudo[100030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:43:08 devstack sudo[100030]: pam_unix(sudo:session): session closed for user root Jun 17 04:43:08 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-6a4af64b-d11f-4971-b0b6-50dc7d4c07e4 tempest-VolumesCloneTest-982203748 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-8abb92ad-3196-49df-977b-0a2ffc4b7d2c" returned: 0 in 0.767s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:43:08 devstack cinder-volume[92060]: DEBUG cinder.utils [None req-6a4af64b-d11f-4971-b0b6-50dc7d4c07e4 tempest-VolumesCloneTest-982203748 None] Path /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-74ec7ab9-46e8-4061-90bc-2b4a62144394 not found in is_blk_device check {{(pid=92060) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jun 17 04:43:08 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-6a4af64b-d11f-4971-b0b6-50dc7d4c07e4 tempest-VolumesCloneTest-982203748 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-8abb92ad-3196-49df-977b-0a2ffc4b7d2c /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-74ec7ab9-46e8-4061-90bc-2b4a62144394 {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:43:08 devstack sudo[100041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-8abb92ad-3196-49df-977b-0a2ffc4b7d2c /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-74ec7ab9-46e8-4061-90bc-2b4a62144394 Jun 17 04:43:08 devstack sudo[100041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:43:14 devstack sudo[100041]: pam_unix(sudo:session): session closed for user root Jun 17 04:43:14 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-6a4af64b-d11f-4971-b0b6-50dc7d4c07e4 tempest-VolumesCloneTest-982203748 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-8abb92ad-3196-49df-977b-0a2ffc4b7d2c /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-74ec7ab9-46e8-4061-90bc-2b4a62144394" returned: 0 in 6.426s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:43:14 devstack cinder-volume[92060]: DEBUG oslo.privsep.daemon [-] privsep: reply[b826d1fb-04ec-460c-85c7-f44bcdb10d87]: (4, 'qcow2') {{(pid=93130) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 04:43:14 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-6a4af64b-d11f-4971-b0b6-50dc7d4c07e4 tempest-VolumesCloneTest-982203748 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-8abb92ad-3196-49df-977b-0a2ffc4b7d2c {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:43:14 devstack sudo[100070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-8abb92ad-3196-49df-977b-0a2ffc4b7d2c Jun 17 04:43:14 devstack sudo[100070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:43:15 devstack sudo[100070]: pam_unix(sudo:session): session closed for user root Jun 17 04:43:15 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-6a4af64b-d11f-4971-b0b6-50dc7d4c07e4 tempest-VolumesCloneTest-982203748 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-8abb92ad-3196-49df-977b-0a2ffc4b7d2c" returned: 0 in 0.950s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:43:15 devstack cinder-volume[92060]: DEBUG cinder.image.image_utils [None req-6a4af64b-d11f-4971-b0b6-50dc7d4c07e4 tempest-VolumesCloneTest-982203748 None] Image conversion details: src /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-8abb92ad-3196-49df-977b-0a2ffc4b7d2c, size 1024.00 MB, duration 6.43 sec, destination /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-74ec7ab9-46e8-4061-90bc-2b4a62144394 {{(pid=92060) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 17 04:43:15 devstack cinder-volume[92060]: INFO cinder.image.image_utils [None req-6a4af64b-d11f-4971-b0b6-50dc7d4c07e4 tempest-VolumesCloneTest-982203748 None] Converted 1024.00 MB image at 159.29 MB/s Jun 17 04:43:15 devstack cinder-volume[92060]: WARNING cinder.volume.drivers.remotefs [None req-6a4af64b-d11f-4971-b0b6-50dc7d4c07e4 tempest-VolumesCloneTest-982203748 None] /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-74ec7ab9-46e8-4061-90bc-2b4a62144394 is being set with open permissions: ugo+rw Jun 17 04:43:15 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-6a4af64b-d11f-4971-b0b6-50dc7d4c07e4 tempest-VolumesCloneTest-982203748 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-74ec7ab9-46e8-4061-90bc-2b4a62144394 {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:43:15 devstack sudo[100076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-74ec7ab9-46e8-4061-90bc-2b4a62144394 Jun 17 04:43:15 devstack sudo[100076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:43:16 devstack sudo[100076]: pam_unix(sudo:session): session closed for user root Jun 17 04:43:16 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-6a4af64b-d11f-4971-b0b6-50dc7d4c07e4 tempest-VolumesCloneTest-982203748 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-74ec7ab9-46e8-4061-90bc-2b4a62144394" returned: 0 in 0.595s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:43:16 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-6a4af64b-d11f-4971-b0b6-50dc7d4c07e4 tempest-VolumesCloneTest-982203748 None] Lock "cinder-quobyte-74ec7ab9-46e8-4061-90bc-2b4a62144394" released by "_copy_volume_from_snapshot" :: held 9.806s {{(pid=92060) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 04:43:16 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-6a4af64b-d11f-4971-b0b6-50dc7d4c07e4 tempest-VolumesCloneTest-982203748 None] Acquiring lock "cinder-quobyte-844a2385-027b-4380-b8aa-892331c55bfe" by "_delete_snapshot" {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 04:43:16 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-6a4af64b-d11f-4971-b0b6-50dc7d4c07e4 tempest-VolumesCloneTest-982203748 None] Lock "cinder-quobyte-844a2385-027b-4380-b8aa-892331c55bfe" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 04:43:16 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.remotefs [None req-6a4af64b-d11f-4971-b0b6-50dc7d4c07e4 tempest-VolumesCloneTest-982203748 None] Deleting offline snapshot 844a2385-027b-4380-b8aa-892331c55bfe of volume 8abb92ad-3196-49df-977b-0a2ffc4b7d2c {{(pid=92060) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 17 04:43:16 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.remotefs [None req-6a4af64b-d11f-4971-b0b6-50dc7d4c07e4 tempest-VolumesCloneTest-982203748 None] snapshot_file for this snap is: volume-8abb92ad-3196-49df-977b-0a2ffc4b7d2c.844a2385-027b-4380-b8aa-892331c55bfe {{(pid=92060) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 17 04:43:16 devstack cinder-volume[92060]: DEBUG oslo.privsep.daemon [-] privsep: reply[6dd3aa12-d989-439d-a49f-c382ee937c92]: (4, 'qcow2') {{(pid=93130) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 04:43:16 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-6a4af64b-d11f-4971-b0b6-50dc7d4c07e4 tempest-VolumesCloneTest-982203748 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-8abb92ad-3196-49df-977b-0a2ffc4b7d2c.844a2385-027b-4380-b8aa-892331c55bfe {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:43:16 devstack sudo[100079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-8abb92ad-3196-49df-977b-0a2ffc4b7d2c.844a2385-027b-4380-b8aa-892331c55bfe Jun 17 04:43:16 devstack sudo[100079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:43:16 devstack cinder-volume[92060]: DEBUG cinder.volume.flows.manager.create_volume [None req-892a87cb-b593-4264-81eb-8654c42dbf94 tempest-SnapshotMetadataTestJSON-1672378877 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92060) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 17 04:43:16 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-892a87cb-b593-4264-81eb-8654c42dbf94 tempest-SnapshotMetadataTestJSON-1672378877 None] Flow 'volume_create_manager' (829260e4-111c-4cfe-a0c2-e25c196d9d54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 17 04:43:16 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-892a87cb-b593-4264-81eb-8654c42dbf94 tempest-SnapshotMetadataTestJSON-1672378877 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f533a58b-72af-4203-b337-359270d1254f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:43:16 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-892a87cb-b593-4264-81eb-8654c42dbf94 tempest-SnapshotMetadataTestJSON-1672378877 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f533a58b-72af-4203-b337-359270d1254f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-17T02:43:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-1326793413',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c25d447d-4fda-4ad5-9b16-598b1b29dc1c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='24748f0b365d492f9462c1c46c6da535',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T02:43:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T02:43:17Z,use_quota=True,user_id='1e896a992c504e65ba48c53d79d65c03',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aad9ce24-93f9-41a6-baa1-5125964f96d1),volume_type_id=aad9ce24-93f9-41a6-baa1-5125964f96d1)' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:43:16 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-892a87cb-b593-4264-81eb-8654c42dbf94 tempest-SnapshotMetadataTestJSON-1672378877 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (509e65ae-5fc4-4c18-b822-46633d035025) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:43:16 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-892a87cb-b593-4264-81eb-8654c42dbf94 tempest-SnapshotMetadataTestJSON-1672378877 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (509e65ae-5fc4-4c18-b822-46633d035025) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:43:16 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-892a87cb-b593-4264-81eb-8654c42dbf94 tempest-SnapshotMetadataTestJSON-1672378877 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (16e154fe-ec36-4e71-9785-8a269e05b39a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:43:16 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-892a87cb-b593-4264-81eb-8654c42dbf94 tempest-SnapshotMetadataTestJSON-1672378877 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (16e154fe-ec36-4e71-9785-8a269e05b39a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c25d447d-4fda-4ad5-9b16-598b1b29dc1c', 'volume_name': 'volume-c25d447d-4fda-4ad5-9b16-598b1b29dc1c', 'volume_size': 1}' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:43:16 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-892a87cb-b593-4264-81eb-8654c42dbf94 tempest-SnapshotMetadataTestJSON-1672378877 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (98ed77e2-f281-4854-bf69-01750c458489) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:43:16 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-892a87cb-b593-4264-81eb-8654c42dbf94 tempest-SnapshotMetadataTestJSON-1672378877 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (98ed77e2-f281-4854-bf69-01750c458489) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:43:16 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-892a87cb-b593-4264-81eb-8654c42dbf94 tempest-SnapshotMetadataTestJSON-1672378877 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f2e5997f-2d06-4f01-825f-3865590941d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:43:16 devstack cinder-volume[92060]: INFO cinder.volume.flows.manager.create_volume [None req-892a87cb-b593-4264-81eb-8654c42dbf94 tempest-SnapshotMetadataTestJSON-1672378877 None] Volume c25d447d-4fda-4ad5-9b16-598b1b29dc1c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c25d447d-4fda-4ad5-9b16-598b1b29dc1c', 'volume_size': 1} Jun 17 04:43:16 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-892a87cb-b593-4264-81eb-8654c42dbf94 tempest-SnapshotMetadataTestJSON-1672378877 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 04:43:17 devstack sudo[100079]: pam_unix(sudo:session): session closed for user root Jun 17 04:43:17 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-6a4af64b-d11f-4971-b0b6-50dc7d4c07e4 tempest-VolumesCloneTest-982203748 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-8abb92ad-3196-49df-977b-0a2ffc4b7d2c.844a2385-027b-4380-b8aa-892331c55bfe" returned: 0 in 0.774s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:43:17 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.remotefs [None req-6a4af64b-d11f-4971-b0b6-50dc7d4c07e4 tempest-VolumesCloneTest-982203748 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8abb92ad-3196-49df-977b-0a2ffc4b7d2c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=92060) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 17 04:43:17 devstack cinder-volume[92060]: DEBUG oslo.privsep.daemon [-] privsep: reply[05fbcbc0-64ad-42d9-8e31-b8cdac06cb10]: (4, 'qcow2') {{(pid=93130) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 04:43:17 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-6a4af64b-d11f-4971-b0b6-50dc7d4c07e4 tempest-VolumesCloneTest-982203748 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-8abb92ad-3196-49df-977b-0a2ffc4b7d2c {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:43:17 devstack sudo[100084]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-8abb92ad-3196-49df-977b-0a2ffc4b7d2c Jun 17 04:43:17 devstack sudo[100084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:43:17 devstack sudo[100084]: pam_unix(sudo:session): session closed for user root Jun 17 04:43:17 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-6a4af64b-d11f-4971-b0b6-50dc7d4c07e4 tempest-VolumesCloneTest-982203748 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-8abb92ad-3196-49df-977b-0a2ffc4b7d2c" returned: 0 in 0.728s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:43:17 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-6a4af64b-d11f-4971-b0b6-50dc7d4c07e4 tempest-VolumesCloneTest-982203748 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-8abb92ad-3196-49df-977b-0a2ffc4b7d2c.844a2385-027b-4380-b8aa-892331c55bfe {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:43:17 devstack sudo[100125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-8abb92ad-3196-49df-977b-0a2ffc4b7d2c.844a2385-027b-4380-b8aa-892331c55bfe Jun 17 04:43:17 devstack sudo[100125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:43:18 devstack sudo[100125]: pam_unix(sudo:session): session closed for user root Jun 17 04:43:18 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-6a4af64b-d11f-4971-b0b6-50dc7d4c07e4 tempest-VolumesCloneTest-982203748 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-8abb92ad-3196-49df-977b-0a2ffc4b7d2c.844a2385-027b-4380-b8aa-892331c55bfe" returned: 0 in 0.676s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:43:18 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-6a4af64b-d11f-4971-b0b6-50dc7d4c07e4 tempest-VolumesCloneTest-982203748 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-8abb92ad-3196-49df-977b-0a2ffc4b7d2c.844a2385-027b-4380-b8aa-892331c55bfe {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:43:18 devstack sudo[100134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-8abb92ad-3196-49df-977b-0a2ffc4b7d2c.844a2385-027b-4380-b8aa-892331c55bfe Jun 17 04:43:18 devstack sudo[100134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:43:19 devstack sudo[100134]: pam_unix(sudo:session): session closed for user root Jun 17 04:43:19 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-6a4af64b-d11f-4971-b0b6-50dc7d4c07e4 tempest-VolumesCloneTest-982203748 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-8abb92ad-3196-49df-977b-0a2ffc4b7d2c.844a2385-027b-4380-b8aa-892331c55bfe" returned: 0 in 0.587s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:43:19 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-6a4af64b-d11f-4971-b0b6-50dc7d4c07e4 tempest-VolumesCloneTest-982203748 None] Lock "cinder-quobyte-844a2385-027b-4380-b8aa-892331c55bfe" released by "_delete_snapshot" :: held 2.859s {{(pid=92060) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 04:43:19 devstack cinder-volume[92060]: DEBUG dbcounter [-] [92060] Writing DB stats cinder:SELECT=79,cinder:INSERT=33,cinder:UPDATE=118,cinder:DELETE=13 {{(pid=92060) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 17 04:43:19 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-6a4af64b-d11f-4971-b0b6-50dc7d4c07e4 tempest-VolumesCloneTest-982203748 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 17.900s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 04:43:19 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-38d9bb8b-dfa8-4033-bfbb-4ebb50a0509e tempest-VolumesTransfersV355Test-1302747316 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 11.710s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 04:43:19 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-38d9bb8b-dfa8-4033-bfbb-4ebb50a0509e tempest-VolumesTransfersV355Test-1302747316 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-17T02:43:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1790040660',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=97307288-da6a-4f15-85a1-67d5fa704a43,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='89a28ce39d844caeab832cd25116cd66',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T02:43:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T02:43:07Z,use_quota=True,user_id='4eaa446391bd4526a83f842d8cf2263d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aad9ce24-93f9-41a6-baa1-5125964f96d1),volume_type_id=aad9ce24-93f9-41a6-baa1-5125964f96d1)}" {{(pid=92060) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 17 04:43:19 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.remotefs [None req-38d9bb8b-dfa8-4033-bfbb-4ebb50a0509e tempest-VolumesTransfersV355Test-1302747316 None] Creating volume 97307288-da6a-4f15-85a1-67d5fa704a43 {{(pid=92060) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 17 04:43:19 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-38d9bb8b-dfa8-4033-bfbb-4ebb50a0509e tempest-VolumesTransfersV355Test-1302747316 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 04:43:19 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-38d9bb8b-dfa8-4033-bfbb-4ebb50a0509e tempest-VolumesTransfersV355Test-1302747316 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 04:43:19 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-38d9bb8b-dfa8-4033-bfbb-4ebb50a0509e tempest-VolumesTransfersV355Test-1302747316 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588': None} {{(pid=92060) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 17 04:43:19 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-38d9bb8b-dfa8-4033-bfbb-4ebb50a0509e tempest-VolumesTransfersV355Test-1302747316 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588'] {{(pid=92060) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 17 04:43:19 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-38d9bb8b-dfa8-4033-bfbb-4ebb50a0509e tempest-VolumesTransfersV355Test-1302747316 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 04:43:19 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-38d9bb8b-dfa8-4033-bfbb-4ebb50a0509e tempest-VolumesTransfersV355Test-1302747316 None] Selected osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588 as target Quobyte volume. {{(pid=92060) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 17 04:43:19 devstack cinder-volume[92060]: INFO cinder.volume.drivers.remotefs [None req-38d9bb8b-dfa8-4033-bfbb-4ebb50a0509e tempest-VolumesTransfersV355Test-1302747316 None] casted to osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588 Jun 17 04:43:19 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-38d9bb8b-dfa8-4033-bfbb-4ebb50a0509e tempest-VolumesTransfersV355Test-1302747316 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-97307288-da6a-4f15-85a1-67d5fa704a43 1073741824 {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:43:19 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-6a4af64b-d11f-4971-b0b6-50dc7d4c07e4 tempest-VolumesCloneTest-982203748 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f9a0dfe3-765f-4150-a3d8-158776caac4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-74ec7ab9-46e8-4061-90bc-2b4a62144394', 'volume_size': 2, 'source_volid': '8abb92ad-3196-49df-977b-0a2ffc4b7d2c', 'source_volstatus': 'available'}' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:43:19 devstack sudo[100138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-97307288-da6a-4f15-85a1-67d5fa704a43 1073741824 Jun 17 04:43:19 devstack sudo[100138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:43:19 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-6a4af64b-d11f-4971-b0b6-50dc7d4c07e4 tempest-VolumesCloneTest-982203748 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6ff10348-f8c0-4373-a49f-866c244e9f0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:43:19 devstack cinder-volume[92060]: INFO cinder.volume.flows.manager.create_volume [None req-6a4af64b-d11f-4971-b0b6-50dc7d4c07e4 tempest-VolumesCloneTest-982203748 None] Volume volume-74ec7ab9-46e8-4061-90bc-2b4a62144394 (74ec7ab9-46e8-4061-90bc-2b4a62144394): created successfully Jun 17 04:43:19 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-6a4af64b-d11f-4971-b0b6-50dc7d4c07e4 tempest-VolumesCloneTest-982203748 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6ff10348-f8c0-4373-a49f-866c244e9f0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:43:19 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-6a4af64b-d11f-4971-b0b6-50dc7d4c07e4 tempest-VolumesCloneTest-982203748 None] Flow 'volume_create_manager' (a90506b1-9c4a-403b-a9bf-e5c3dba19859) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92060) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 17 04:43:19 devstack cinder-volume[92060]: INFO cinder.volume.manager [None req-6a4af64b-d11f-4971-b0b6-50dc7d4c07e4 tempest-VolumesCloneTest-982203748 None] Created volume successfully. Jun 17 04:43:19 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-b5f4e36f-6afa-4fa0-ae64-698c4c175e94 tempest-VolumesCloneTest-982203748 None] Acquiring lock "cinder-74ec7ab9-46e8-4061-90bc-2b4a62144394-delete_volume" by "delete_volume" {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 04:43:19 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-b5f4e36f-6afa-4fa0-ae64-698c4c175e94 tempest-VolumesCloneTest-982203748 None] Lock "cinder-74ec7ab9-46e8-4061-90bc-2b4a62144394-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 04:43:19 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-b5f4e36f-6afa-4fa0-ae64-698c4c175e94 tempest-VolumesCloneTest-982203748 None] Acquiring lock "cinder-quobyte-74ec7ab9-46e8-4061-90bc-2b4a62144394" by "delete_volume" {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 04:43:19 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-b5f4e36f-6afa-4fa0-ae64-698c4c175e94 tempest-VolumesCloneTest-982203748 None] Lock "cinder-quobyte-74ec7ab9-46e8-4061-90bc-2b4a62144394" acquired by "delete_volume" :: waited 0.017s {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 04:43:19 devstack cinder-volume[92060]: DEBUG oslo.privsep.daemon [-] privsep: reply[74dd62e7-480e-42f9-9330-a8c96320fb7e]: (4, 'qcow2') {{(pid=93130) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 04:43:19 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-b5f4e36f-6afa-4fa0-ae64-698c4c175e94 tempest-VolumesCloneTest-982203748 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-74ec7ab9-46e8-4061-90bc-2b4a62144394 {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:43:19 devstack sudo[100140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-74ec7ab9-46e8-4061-90bc-2b4a62144394 Jun 17 04:43:19 devstack sudo[100140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:43:20 devstack sudo[100138]: pam_unix(sudo:session): session closed for user root Jun 17 04:43:20 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-38d9bb8b-dfa8-4033-bfbb-4ebb50a0509e tempest-VolumesTransfersV355Test-1302747316 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-97307288-da6a-4f15-85a1-67d5fa704a43 1073741824" returned: 0 in 1.116s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:43:20 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-38d9bb8b-dfa8-4033-bfbb-4ebb50a0509e tempest-VolumesTransfersV355Test-1302747316 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-97307288-da6a-4f15-85a1-67d5fa704a43 {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:43:20 devstack sudo[100196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-97307288-da6a-4f15-85a1-67d5fa704a43 Jun 17 04:43:20 devstack sudo[100196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:43:20 devstack sudo[100140]: pam_unix(sudo:session): session closed for user root Jun 17 04:43:20 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-b5f4e36f-6afa-4fa0-ae64-698c4c175e94 tempest-VolumesCloneTest-982203748 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-74ec7ab9-46e8-4061-90bc-2b4a62144394" returned: 0 in 1.173s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:43:20 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-b5f4e36f-6afa-4fa0-ae64-698c4c175e94 tempest-VolumesCloneTest-982203748 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-74ec7ab9-46e8-4061-90bc-2b4a62144394 {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:43:20 devstack sudo[100209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-74ec7ab9-46e8-4061-90bc-2b4a62144394 Jun 17 04:43:20 devstack sudo[100209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:43:21 devstack sudo[100196]: pam_unix(sudo:session): session closed for user root Jun 17 04:43:21 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-38d9bb8b-dfa8-4033-bfbb-4ebb50a0509e tempest-VolumesTransfersV355Test-1302747316 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-97307288-da6a-4f15-85a1-67d5fa704a43" returned: 0 in 0.926s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:43:21 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-38d9bb8b-dfa8-4033-bfbb-4ebb50a0509e tempest-VolumesTransfersV355Test-1302747316 None] <== create_volume: return (2123ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588'} {{(pid=92060) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 17 04:43:21 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-38d9bb8b-dfa8-4033-bfbb-4ebb50a0509e tempest-VolumesTransfersV355Test-1302747316 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.126s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 04:43:21 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-892a87cb-b593-4264-81eb-8654c42dbf94 tempest-SnapshotMetadataTestJSON-1672378877 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.336s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 04:43:21 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-892a87cb-b593-4264-81eb-8654c42dbf94 tempest-SnapshotMetadataTestJSON-1672378877 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-17T02:43:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-1326793413',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c25d447d-4fda-4ad5-9b16-598b1b29dc1c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='24748f0b365d492f9462c1c46c6da535',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T02:43:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T02:43:17Z,use_quota=True,user_id='1e896a992c504e65ba48c53d79d65c03',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aad9ce24-93f9-41a6-baa1-5125964f96d1),volume_type_id=aad9ce24-93f9-41a6-baa1-5125964f96d1)}" {{(pid=92060) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 17 04:43:21 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.remotefs [None req-892a87cb-b593-4264-81eb-8654c42dbf94 tempest-SnapshotMetadataTestJSON-1672378877 None] Creating volume c25d447d-4fda-4ad5-9b16-598b1b29dc1c {{(pid=92060) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 17 04:43:21 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-892a87cb-b593-4264-81eb-8654c42dbf94 tempest-SnapshotMetadataTestJSON-1672378877 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 04:43:21 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-892a87cb-b593-4264-81eb-8654c42dbf94 tempest-SnapshotMetadataTestJSON-1672378877 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 04:43:21 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-892a87cb-b593-4264-81eb-8654c42dbf94 tempest-SnapshotMetadataTestJSON-1672378877 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588': None} {{(pid=92060) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 17 04:43:21 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-892a87cb-b593-4264-81eb-8654c42dbf94 tempest-SnapshotMetadataTestJSON-1672378877 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588'] {{(pid=92060) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 17 04:43:21 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-892a87cb-b593-4264-81eb-8654c42dbf94 tempest-SnapshotMetadataTestJSON-1672378877 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 04:43:21 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-892a87cb-b593-4264-81eb-8654c42dbf94 tempest-SnapshotMetadataTestJSON-1672378877 None] Selected osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588 as target Quobyte volume. {{(pid=92060) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 17 04:43:21 devstack cinder-volume[92060]: INFO cinder.volume.drivers.remotefs [None req-892a87cb-b593-4264-81eb-8654c42dbf94 tempest-SnapshotMetadataTestJSON-1672378877 None] casted to osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588 Jun 17 04:43:21 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-892a87cb-b593-4264-81eb-8654c42dbf94 tempest-SnapshotMetadataTestJSON-1672378877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-c25d447d-4fda-4ad5-9b16-598b1b29dc1c 1073741824 {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:43:21 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-38d9bb8b-dfa8-4033-bfbb-4ebb50a0509e tempest-VolumesTransfersV355Test-1302747316 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a4fc2e36-0c35-45bf-8fcd-0b924e59e8b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-97307288-da6a-4f15-85a1-67d5fa704a43', 'volume_size': 1}' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:43:21 devstack sudo[100218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-c25d447d-4fda-4ad5-9b16-598b1b29dc1c 1073741824 Jun 17 04:43:21 devstack sudo[100218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:43:21 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-38d9bb8b-dfa8-4033-bfbb-4ebb50a0509e tempest-VolumesTransfersV355Test-1302747316 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (87967da0-0aca-48e1-95f7-0541badd9777) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:43:21 devstack cinder-volume[92060]: INFO cinder.volume.flows.manager.create_volume [None req-38d9bb8b-dfa8-4033-bfbb-4ebb50a0509e tempest-VolumesTransfersV355Test-1302747316 None] Volume volume-97307288-da6a-4f15-85a1-67d5fa704a43 (97307288-da6a-4f15-85a1-67d5fa704a43): created successfully Jun 17 04:43:21 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-38d9bb8b-dfa8-4033-bfbb-4ebb50a0509e tempest-VolumesTransfersV355Test-1302747316 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (87967da0-0aca-48e1-95f7-0541badd9777) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:43:21 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-38d9bb8b-dfa8-4033-bfbb-4ebb50a0509e tempest-VolumesTransfersV355Test-1302747316 None] Flow 'volume_create_manager' (54eba707-c102-4f98-867c-4a35f4fba122) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92060) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 17 04:43:21 devstack cinder-volume[92060]: INFO cinder.volume.manager [None req-38d9bb8b-dfa8-4033-bfbb-4ebb50a0509e tempest-VolumesTransfersV355Test-1302747316 None] Created volume successfully. Jun 17 04:43:21 devstack sudo[100209]: pam_unix(sudo:session): session closed for user root Jun 17 04:43:21 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-b5f4e36f-6afa-4fa0-ae64-698c4c175e94 tempest-VolumesCloneTest-982203748 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-74ec7ab9-46e8-4061-90bc-2b4a62144394" returned: 0 in 0.785s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:43:21 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-b5f4e36f-6afa-4fa0-ae64-698c4c175e94 tempest-VolumesCloneTest-982203748 None] Lock "cinder-quobyte-74ec7ab9-46e8-4061-90bc-2b4a62144394" released by "delete_volume" :: held 2.003s {{(pid=92060) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 04:43:21 devstack cinder-volume[92060]: DEBUG cinder.quota [None req-b5f4e36f-6afa-4fa0-ae64-698c4c175e94 tempest-VolumesCloneTest-982203748 None] Created reservations ['e811500f-5971-417b-a693-3afed0ef0136', 'd90b55dd-d4dc-4841-811c-2ab745777e6a', '100ea937-bb1f-4a8a-a270-d2758de444c2', '6569625c-5f30-4416-a6de-c40372c8d7fc'] {{(pid=92060) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 17 04:43:21 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-b5f4e36f-6afa-4fa0-ae64-698c4c175e94 tempest-VolumesCloneTest-982203748 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 04:43:21 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-b5f4e36f-6afa-4fa0-ae64-698c4c175e94 tempest-VolumesCloneTest-982203748 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 04:43:21 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-b5f4e36f-6afa-4fa0-ae64-698c4c175e94 tempest-VolumesCloneTest-982203748 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588': None} {{(pid=92060) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 17 04:43:21 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-b5f4e36f-6afa-4fa0-ae64-698c4c175e94 tempest-VolumesCloneTest-982203748 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588'] {{(pid=92060) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 17 04:43:21 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-b5f4e36f-6afa-4fa0-ae64-698c4c175e94 tempest-VolumesCloneTest-982203748 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 04:43:21 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-b5f4e36f-6afa-4fa0-ae64-698c4c175e94 tempest-VolumesCloneTest-982203748 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:43:21 devstack sudo[100223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a Jun 17 04:43:21 devstack sudo[100223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:43:22 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-789c0588-6663-4b15-8647-41ad9e53b7a7 tempest-VolumesCloneTest-982203748 None] Acquiring lock "cinder-8abb92ad-3196-49df-977b-0a2ffc4b7d2c-delete_volume" by "delete_volume" {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 04:43:22 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-789c0588-6663-4b15-8647-41ad9e53b7a7 tempest-VolumesCloneTest-982203748 None] Lock "cinder-8abb92ad-3196-49df-977b-0a2ffc4b7d2c-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 04:43:22 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-789c0588-6663-4b15-8647-41ad9e53b7a7 tempest-VolumesCloneTest-982203748 None] Acquiring lock "cinder-quobyte-8abb92ad-3196-49df-977b-0a2ffc4b7d2c" by "delete_volume" {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 04:43:22 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-789c0588-6663-4b15-8647-41ad9e53b7a7 tempest-VolumesCloneTest-982203748 None] Lock "cinder-quobyte-8abb92ad-3196-49df-977b-0a2ffc4b7d2c" acquired by "delete_volume" :: waited 0.024s {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 04:43:22 devstack cinder-volume[92060]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdeb50c4-3fe8-41b8-84b1-1f7d0ef2b077]: (4, 'qcow2') {{(pid=93130) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 04:43:22 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-789c0588-6663-4b15-8647-41ad9e53b7a7 tempest-VolumesCloneTest-982203748 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-8abb92ad-3196-49df-977b-0a2ffc4b7d2c {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:43:22 devstack sudo[100227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-8abb92ad-3196-49df-977b-0a2ffc4b7d2c Jun 17 04:43:22 devstack sudo[100227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:43:22 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-c505fa05-53e4-49cd-be34-4dceb4d63e83 tempest-VolumesTransfersV355Test-1080086179 None] Acquiring lock "cinder-97307288-da6a-4f15-85a1-67d5fa704a43-delete_volume" by "delete_volume" {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 04:43:22 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-c505fa05-53e4-49cd-be34-4dceb4d63e83 tempest-VolumesTransfersV355Test-1080086179 None] Lock "cinder-97307288-da6a-4f15-85a1-67d5fa704a43-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 04:43:22 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-c505fa05-53e4-49cd-be34-4dceb4d63e83 tempest-VolumesTransfersV355Test-1080086179 None] Acquiring lock "cinder-quobyte-97307288-da6a-4f15-85a1-67d5fa704a43" by "delete_volume" {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 04:43:22 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-c505fa05-53e4-49cd-be34-4dceb4d63e83 tempest-VolumesTransfersV355Test-1080086179 None] Lock "cinder-quobyte-97307288-da6a-4f15-85a1-67d5fa704a43" acquired by "delete_volume" :: waited 0.030s {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 04:43:22 devstack cinder-volume[92060]: DEBUG oslo.privsep.daemon [-] privsep: reply[44190ab0-48e0-42d9-ae9f-92cd3fe61927]: (4, 'qcow2') {{(pid=93130) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 04:43:22 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-c505fa05-53e4-49cd-be34-4dceb4d63e83 tempest-VolumesTransfersV355Test-1080086179 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-97307288-da6a-4f15-85a1-67d5fa704a43 {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:43:22 devstack sudo[100230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-97307288-da6a-4f15-85a1-67d5fa704a43 Jun 17 04:43:22 devstack sudo[100230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:43:22 devstack sudo[100218]: pam_unix(sudo:session): session closed for user root Jun 17 04:43:22 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-892a87cb-b593-4264-81eb-8654c42dbf94 tempest-SnapshotMetadataTestJSON-1672378877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-c25d447d-4fda-4ad5-9b16-598b1b29dc1c 1073741824" returned: 0 in 1.670s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:43:23 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-892a87cb-b593-4264-81eb-8654c42dbf94 tempest-SnapshotMetadataTestJSON-1672378877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-c25d447d-4fda-4ad5-9b16-598b1b29dc1c {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:43:23 devstack sudo[100233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-c25d447d-4fda-4ad5-9b16-598b1b29dc1c Jun 17 04:43:23 devstack sudo[100233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:43:23 devstack sudo[100223]: pam_unix(sudo:session): session closed for user root Jun 17 04:43:23 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-b5f4e36f-6afa-4fa0-ae64-698c4c175e94 tempest-VolumesCloneTest-982203748 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a" returned: 0 in 1.479s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:43:23 devstack cinder-volume[92060]: DEBUG cinder.manager [None req-b5f4e36f-6afa-4fa0-ae64-698c4c175e94 tempest-VolumesCloneTest-982203748 None] Notifying Schedulers of capabilities ... {{(pid=92060) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 17 04:43:23 devstack cinder-volume[92060]: INFO cinder.volume.manager [None req-b5f4e36f-6afa-4fa0-ae64-698c4c175e94 tempest-VolumesCloneTest-982203748 None] Deleted volume successfully. Jun 17 04:43:23 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-b5f4e36f-6afa-4fa0-ae64-698c4c175e94 tempest-VolumesCloneTest-982203748 None] Lock "cinder-74ec7ab9-46e8-4061-90bc-2b4a62144394-delete_volume" released by "delete_volume" :: held 3.699s {{(pid=92060) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 04:43:23 devstack sudo[100227]: pam_unix(sudo:session): session closed for user root Jun 17 04:43:23 devstack sudo[100233]: pam_unix(sudo:session): session closed for user root Jun 17 04:43:23 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-892a87cb-b593-4264-81eb-8654c42dbf94 tempest-SnapshotMetadataTestJSON-1672378877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-c25d447d-4fda-4ad5-9b16-598b1b29dc1c" returned: 0 in 0.909s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:43:23 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-892a87cb-b593-4264-81eb-8654c42dbf94 tempest-SnapshotMetadataTestJSON-1672378877 None] <== create_volume: return (2650ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588'} {{(pid=92060) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 17 04:43:23 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-892a87cb-b593-4264-81eb-8654c42dbf94 tempest-SnapshotMetadataTestJSON-1672378877 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.652s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 04:43:23 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-789c0588-6663-4b15-8647-41ad9e53b7a7 tempest-VolumesCloneTest-982203748 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-8abb92ad-3196-49df-977b-0a2ffc4b7d2c" returned: 0 in 1.671s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:43:23 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-789c0588-6663-4b15-8647-41ad9e53b7a7 tempest-VolumesCloneTest-982203748 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-8abb92ad-3196-49df-977b-0a2ffc4b7d2c {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:43:24 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-892a87cb-b593-4264-81eb-8654c42dbf94 tempest-SnapshotMetadataTestJSON-1672378877 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f2e5997f-2d06-4f01-825f-3865590941d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c25d447d-4fda-4ad5-9b16-598b1b29dc1c', 'volume_size': 1}' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:43:24 devstack sudo[100242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-8abb92ad-3196-49df-977b-0a2ffc4b7d2c Jun 17 04:43:24 devstack sudo[100242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:43:24 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-892a87cb-b593-4264-81eb-8654c42dbf94 tempest-SnapshotMetadataTestJSON-1672378877 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a834192f-f35c-428f-95f3-5f6919251925) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:43:24 devstack sudo[100230]: pam_unix(sudo:session): session closed for user root Jun 17 04:43:24 devstack cinder-volume[92060]: INFO cinder.volume.flows.manager.create_volume [None req-892a87cb-b593-4264-81eb-8654c42dbf94 tempest-SnapshotMetadataTestJSON-1672378877 None] Volume volume-c25d447d-4fda-4ad5-9b16-598b1b29dc1c (c25d447d-4fda-4ad5-9b16-598b1b29dc1c): created successfully Jun 17 04:43:24 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-892a87cb-b593-4264-81eb-8654c42dbf94 tempest-SnapshotMetadataTestJSON-1672378877 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a834192f-f35c-428f-95f3-5f6919251925) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:43:24 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-892a87cb-b593-4264-81eb-8654c42dbf94 tempest-SnapshotMetadataTestJSON-1672378877 None] Flow 'volume_create_manager' (829260e4-111c-4cfe-a0c2-e25c196d9d54) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92060) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 17 04:43:24 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-c505fa05-53e4-49cd-be34-4dceb4d63e83 tempest-VolumesTransfersV355Test-1080086179 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-97307288-da6a-4f15-85a1-67d5fa704a43" returned: 0 in 1.269s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:43:24 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-c505fa05-53e4-49cd-be34-4dceb4d63e83 tempest-VolumesTransfersV355Test-1080086179 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-97307288-da6a-4f15-85a1-67d5fa704a43 {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:43:24 devstack cinder-volume[92060]: INFO cinder.volume.manager [None req-892a87cb-b593-4264-81eb-8654c42dbf94 tempest-SnapshotMetadataTestJSON-1672378877 None] Created volume successfully. Jun 17 04:43:24 devstack sudo[100244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-97307288-da6a-4f15-85a1-67d5fa704a43 Jun 17 04:43:24 devstack sudo[100244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:43:24 devstack sudo[100242]: pam_unix(sudo:session): session closed for user root Jun 17 04:43:24 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-789c0588-6663-4b15-8647-41ad9e53b7a7 tempest-VolumesCloneTest-982203748 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-8abb92ad-3196-49df-977b-0a2ffc4b7d2c" returned: 0 in 0.812s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:43:24 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-789c0588-6663-4b15-8647-41ad9e53b7a7 tempest-VolumesCloneTest-982203748 None] Lock "cinder-quobyte-8abb92ad-3196-49df-977b-0a2ffc4b7d2c" released by "delete_volume" :: held 2.604s {{(pid=92060) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 04:43:24 devstack cinder-volume[92060]: DEBUG cinder.quota [None req-789c0588-6663-4b15-8647-41ad9e53b7a7 tempest-VolumesCloneTest-982203748 None] Created reservations ['f3cfc388-20c0-4d28-8a57-29cc7ed3fefe', '8497f238-3ddd-451e-9e68-b28acfa9c567', 'deef438a-ff1a-4560-b555-e7c1057d86a1', '7c2ad3a5-80d8-4a17-8b32-8cac3500bd22'] {{(pid=92060) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 17 04:43:25 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-b9c8e054-0baa-4ef2-9295-d518e3b34161 tempest-SnapshotMetadataTestJSON-1672378877 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 04:43:25 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-b9c8e054-0baa-4ef2-9295-d518e3b34161 tempest-SnapshotMetadataTestJSON-1672378877 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 04:43:25 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.remotefs [None req-b9c8e054-0baa-4ef2-9295-d518e3b34161 tempest-SnapshotMetadataTestJSON-1672378877 None] Creating offline snapshot 7a534a19-a304-4b43-9a12-cfd48863a8df of volume c25d447d-4fda-4ad5-9b16-598b1b29dc1c {{(pid=92060) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 17 04:43:25 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-789c0588-6663-4b15-8647-41ad9e53b7a7 tempest-VolumesCloneTest-982203748 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 04:43:25 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-789c0588-6663-4b15-8647-41ad9e53b7a7 tempest-VolumesCloneTest-982203748 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 04:43:25 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-789c0588-6663-4b15-8647-41ad9e53b7a7 tempest-VolumesCloneTest-982203748 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588': None} {{(pid=92060) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 17 04:43:25 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-789c0588-6663-4b15-8647-41ad9e53b7a7 tempest-VolumesCloneTest-982203748 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588'] {{(pid=92060) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 17 04:43:25 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-789c0588-6663-4b15-8647-41ad9e53b7a7 tempest-VolumesCloneTest-982203748 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 04:43:25 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-789c0588-6663-4b15-8647-41ad9e53b7a7 tempest-VolumesCloneTest-982203748 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:43:25 devstack cinder-volume[92060]: DEBUG oslo.privsep.daemon [-] privsep: reply[05a96e27-5270-417d-af48-4576430fd171]: (4, 'qcow2') {{(pid=93130) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 04:43:25 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-b9c8e054-0baa-4ef2-9295-d518e3b34161 tempest-SnapshotMetadataTestJSON-1672378877 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-c25d447d-4fda-4ad5-9b16-598b1b29dc1c {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:43:25 devstack sudo[100249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a Jun 17 04:43:25 devstack sudo[100249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:43:25 devstack sudo[100244]: pam_unix(sudo:session): session closed for user root Jun 17 04:43:25 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-c505fa05-53e4-49cd-be34-4dceb4d63e83 tempest-VolumesTransfersV355Test-1080086179 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-97307288-da6a-4f15-85a1-67d5fa704a43" returned: 0 in 1.044s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:43:25 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-c505fa05-53e4-49cd-be34-4dceb4d63e83 tempest-VolumesTransfersV355Test-1080086179 None] Lock "cinder-quobyte-97307288-da6a-4f15-85a1-67d5fa704a43" released by "delete_volume" :: held 2.388s {{(pid=92060) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 04:43:25 devstack sudo[100250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-c25d447d-4fda-4ad5-9b16-598b1b29dc1c Jun 17 04:43:25 devstack sudo[100250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:43:25 devstack cinder-volume[92060]: DEBUG cinder.quota [None req-c505fa05-53e4-49cd-be34-4dceb4d63e83 tempest-VolumesTransfersV355Test-1080086179 None] Created reservations ['8aa35762-b876-4a9c-83b0-3329751a60a1', '851ca686-77ae-4cd7-a886-93750f49f9ef', '2a1e97e4-b623-4077-bcc0-66b09db226bd', '8f4ad724-4b89-4303-870a-83b3653d074b'] {{(pid=92060) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 17 04:43:25 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-c505fa05-53e4-49cd-be34-4dceb4d63e83 tempest-VolumesTransfersV355Test-1080086179 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 04:43:25 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-c505fa05-53e4-49cd-be34-4dceb4d63e83 tempest-VolumesTransfersV355Test-1080086179 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 04:43:25 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-c505fa05-53e4-49cd-be34-4dceb4d63e83 tempest-VolumesTransfersV355Test-1080086179 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588': None} {{(pid=92060) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 17 04:43:25 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-c505fa05-53e4-49cd-be34-4dceb4d63e83 tempest-VolumesTransfersV355Test-1080086179 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588'] {{(pid=92060) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 17 04:43:25 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-c505fa05-53e4-49cd-be34-4dceb4d63e83 tempest-VolumesTransfersV355Test-1080086179 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 04:43:25 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-c505fa05-53e4-49cd-be34-4dceb4d63e83 tempest-VolumesTransfersV355Test-1080086179 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:43:25 devstack sudo[100254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a Jun 17 04:43:25 devstack sudo[100254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:43:26 devstack sudo[100249]: pam_unix(sudo:session): session closed for user root Jun 17 04:43:26 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-789c0588-6663-4b15-8647-41ad9e53b7a7 tempest-VolumesCloneTest-982203748 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a" returned: 0 in 0.975s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:43:26 devstack cinder-volume[92060]: DEBUG cinder.manager [None req-789c0588-6663-4b15-8647-41ad9e53b7a7 tempest-VolumesCloneTest-982203748 None] Notifying Schedulers of capabilities ... {{(pid=92060) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 17 04:43:26 devstack cinder-volume[92060]: INFO cinder.volume.manager [None req-789c0588-6663-4b15-8647-41ad9e53b7a7 tempest-VolumesCloneTest-982203748 None] Deleted volume successfully. Jun 17 04:43:26 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-789c0588-6663-4b15-8647-41ad9e53b7a7 tempest-VolumesCloneTest-982203748 None] Lock "cinder-8abb92ad-3196-49df-977b-0a2ffc4b7d2c-delete_volume" released by "delete_volume" :: held 4.022s {{(pid=92060) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 04:43:26 devstack sudo[100250]: pam_unix(sudo:session): session closed for user root Jun 17 04:43:26 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-b9c8e054-0baa-4ef2-9295-d518e3b34161 tempest-SnapshotMetadataTestJSON-1672378877 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-c25d447d-4fda-4ad5-9b16-598b1b29dc1c" returned: 0 in 1.153s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:43:26 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-b9c8e054-0baa-4ef2-9295-d518e3b34161 tempest-SnapshotMetadataTestJSON-1672378877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-c25d447d-4fda-4ad5-9b16-598b1b29dc1c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-c25d447d-4fda-4ad5-9b16-598b1b29dc1c.7a534a19-a304-4b43-9a12-cfd48863a8df 1G {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:43:26 devstack sudo[100262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-c25d447d-4fda-4ad5-9b16-598b1b29dc1c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-c25d447d-4fda-4ad5-9b16-598b1b29dc1c.7a534a19-a304-4b43-9a12-cfd48863a8df 1G Jun 17 04:43:26 devstack sudo[100262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:43:26 devstack sudo[100254]: pam_unix(sudo:session): session closed for user root Jun 17 04:43:26 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-c505fa05-53e4-49cd-be34-4dceb4d63e83 tempest-VolumesTransfersV355Test-1080086179 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a" returned: 0 in 0.971s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:43:26 devstack cinder-volume[92060]: DEBUG cinder.manager [None req-c505fa05-53e4-49cd-be34-4dceb4d63e83 tempest-VolumesTransfersV355Test-1080086179 None] Notifying Schedulers of capabilities ... {{(pid=92060) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 17 04:43:26 devstack cinder-volume[92060]: INFO cinder.volume.manager [None req-c505fa05-53e4-49cd-be34-4dceb4d63e83 tempest-VolumesTransfersV355Test-1080086179 None] Deleted volume successfully. Jun 17 04:43:26 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-c505fa05-53e4-49cd-be34-4dceb4d63e83 tempest-VolumesTransfersV355Test-1080086179 None] Lock "cinder-97307288-da6a-4f15-85a1-67d5fa704a43-delete_volume" released by "delete_volume" :: held 3.787s {{(pid=92060) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 04:43:27 devstack sudo[100262]: pam_unix(sudo:session): session closed for user root Jun 17 04:43:27 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-b9c8e054-0baa-4ef2-9295-d518e3b34161 tempest-SnapshotMetadataTestJSON-1672378877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-c25d447d-4fda-4ad5-9b16-598b1b29dc1c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-c25d447d-4fda-4ad5-9b16-598b1b29dc1c.7a534a19-a304-4b43-9a12-cfd48863a8df 1G" returned: 0 in 1.348s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:43:27 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-b9c8e054-0baa-4ef2-9295-d518e3b34161 tempest-SnapshotMetadataTestJSON-1672378877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c25d447d-4fda-4ad5-9b16-598b1b29dc1c -F qcow2 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-c25d447d-4fda-4ad5-9b16-598b1b29dc1c.7a534a19-a304-4b43-9a12-cfd48863a8df {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:43:27 devstack sudo[100269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c25d447d-4fda-4ad5-9b16-598b1b29dc1c -F qcow2 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-c25d447d-4fda-4ad5-9b16-598b1b29dc1c.7a534a19-a304-4b43-9a12-cfd48863a8df Jun 17 04:43:27 devstack sudo[100269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:43:28 devstack sudo[100269]: pam_unix(sudo:session): session closed for user root Jun 17 04:43:28 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-b9c8e054-0baa-4ef2-9295-d518e3b34161 tempest-SnapshotMetadataTestJSON-1672378877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c25d447d-4fda-4ad5-9b16-598b1b29dc1c -F qcow2 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-c25d447d-4fda-4ad5-9b16-598b1b29dc1c.7a534a19-a304-4b43-9a12-cfd48863a8df" returned: 0 in 0.938s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:43:28 devstack cinder-volume[92060]: WARNING cinder.volume.drivers.remotefs [None req-b9c8e054-0baa-4ef2-9295-d518e3b34161 tempest-SnapshotMetadataTestJSON-1672378877 None] /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-c25d447d-4fda-4ad5-9b16-598b1b29dc1c.7a534a19-a304-4b43-9a12-cfd48863a8df is being set with open permissions: ugo+rw Jun 17 04:43:28 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-b9c8e054-0baa-4ef2-9295-d518e3b34161 tempest-SnapshotMetadataTestJSON-1672378877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-c25d447d-4fda-4ad5-9b16-598b1b29dc1c.7a534a19-a304-4b43-9a12-cfd48863a8df {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:43:28 devstack sudo[100280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-c25d447d-4fda-4ad5-9b16-598b1b29dc1c.7a534a19-a304-4b43-9a12-cfd48863a8df Jun 17 04:43:28 devstack sudo[100280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:43:29 devstack sudo[100280]: pam_unix(sudo:session): session closed for user root Jun 17 04:43:29 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-b9c8e054-0baa-4ef2-9295-d518e3b34161 tempest-SnapshotMetadataTestJSON-1672378877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-c25d447d-4fda-4ad5-9b16-598b1b29dc1c.7a534a19-a304-4b43-9a12-cfd48863a8df" returned: 0 in 1.258s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:43:29 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-b9c8e054-0baa-4ef2-9295-d518e3b34161 tempest-SnapshotMetadataTestJSON-1672378877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-c25d447d-4fda-4ad5-9b16-598b1b29dc1c.info {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:43:29 devstack sudo[100287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-c25d447d-4fda-4ad5-9b16-598b1b29dc1c.info Jun 17 04:43:29 devstack sudo[100287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:43:30 devstack cinder-volume[92060]: DEBUG cinder.volume.flows.manager.create_volume [None req-4a155ead-8d3a-49ec-936f-7fb3a9055b4f tempest-VolumesListTestJSON-1799956421 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92060) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 17 04:43:30 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-4a155ead-8d3a-49ec-936f-7fb3a9055b4f tempest-VolumesListTestJSON-1799956421 None] Flow 'volume_create_manager' (1c52fcee-6e58-407b-a2ee-564da7b1b7f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 17 04:43:30 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-4a155ead-8d3a-49ec-936f-7fb3a9055b4f tempest-VolumesListTestJSON-1799956421 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3247b236-61ad-4f63-b1a4-e16d422a9f00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:43:30 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-4a155ead-8d3a-49ec-936f-7fb3a9055b4f tempest-VolumesListTestJSON-1799956421 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3247b236-61ad-4f63-b1a4-e16d422a9f00) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-17T02:43:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1221203793',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7f394082-f346-4460-8798-b2d0528b50e5,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='d954b1e4b5a84738aff62b47b7d42c76',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T02:43:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T02:43:30Z,use_quota=True,user_id='58dfbea3cf494c169d8210b9b7766006',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aad9ce24-93f9-41a6-baa1-5125964f96d1),volume_type_id=aad9ce24-93f9-41a6-baa1-5125964f96d1)' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:43:30 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-4a155ead-8d3a-49ec-936f-7fb3a9055b4f tempest-VolumesListTestJSON-1799956421 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d73d612a-1499-4c15-bd9e-e4e2050d6f15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:43:30 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-4a155ead-8d3a-49ec-936f-7fb3a9055b4f tempest-VolumesListTestJSON-1799956421 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d73d612a-1499-4c15-bd9e-e4e2050d6f15) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:43:30 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-4a155ead-8d3a-49ec-936f-7fb3a9055b4f tempest-VolumesListTestJSON-1799956421 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5591aeca-74e6-442a-bcb6-de3a86127c73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:43:30 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-4a155ead-8d3a-49ec-936f-7fb3a9055b4f tempest-VolumesListTestJSON-1799956421 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5591aeca-74e6-442a-bcb6-de3a86127c73) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7f394082-f346-4460-8798-b2d0528b50e5', 'volume_name': 'volume-7f394082-f346-4460-8798-b2d0528b50e5', 'volume_size': 1}' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:43:30 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-4a155ead-8d3a-49ec-936f-7fb3a9055b4f tempest-VolumesListTestJSON-1799956421 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1b09f5e5-7c89-4aea-9ca0-5ac5076f256c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:43:30 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-4a155ead-8d3a-49ec-936f-7fb3a9055b4f tempest-VolumesListTestJSON-1799956421 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1b09f5e5-7c89-4aea-9ca0-5ac5076f256c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:43:30 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-4a155ead-8d3a-49ec-936f-7fb3a9055b4f tempest-VolumesListTestJSON-1799956421 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dc36eb8a-67a0-47f5-b399-544e4aa19698) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:43:30 devstack cinder-volume[92060]: INFO cinder.volume.flows.manager.create_volume [None req-4a155ead-8d3a-49ec-936f-7fb3a9055b4f tempest-VolumesListTestJSON-1799956421 None] Volume 7f394082-f346-4460-8798-b2d0528b50e5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7f394082-f346-4460-8798-b2d0528b50e5', 'volume_size': 1} Jun 17 04:43:30 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-4a155ead-8d3a-49ec-936f-7fb3a9055b4f tempest-VolumesListTestJSON-1799956421 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 04:43:30 devstack sudo[100287]: pam_unix(sudo:session): session closed for user root Jun 17 04:43:30 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-b9c8e054-0baa-4ef2-9295-d518e3b34161 tempest-SnapshotMetadataTestJSON-1672378877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-c25d447d-4fda-4ad5-9b16-598b1b29dc1c.info" returned: 0 in 0.821s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:43:30 devstack cinder-volume[92060]: WARNING cinder.volume.drivers.remotefs [None req-b9c8e054-0baa-4ef2-9295-d518e3b34161 tempest-SnapshotMetadataTestJSON-1672378877 None] /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-c25d447d-4fda-4ad5-9b16-598b1b29dc1c.info is being set with open permissions: ugo+rw Jun 17 04:43:30 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-b9c8e054-0baa-4ef2-9295-d518e3b34161 tempest-SnapshotMetadataTestJSON-1672378877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-c25d447d-4fda-4ad5-9b16-598b1b29dc1c.info {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:43:30 devstack sudo[100290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-c25d447d-4fda-4ad5-9b16-598b1b29dc1c.info Jun 17 04:43:30 devstack sudo[100290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:43:31 devstack sudo[100290]: pam_unix(sudo:session): session closed for user root Jun 17 04:43:31 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-b9c8e054-0baa-4ef2-9295-d518e3b34161 tempest-SnapshotMetadataTestJSON-1672378877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-c25d447d-4fda-4ad5-9b16-598b1b29dc1c.info" returned: 0 in 0.673s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:43:31 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-b9c8e054-0baa-4ef2-9295-d518e3b34161 tempest-SnapshotMetadataTestJSON-1672378877 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 6.322s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 04:43:31 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-4a155ead-8d3a-49ec-936f-7fb3a9055b4f tempest-VolumesListTestJSON-1799956421 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.796s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 04:43:31 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-4a155ead-8d3a-49ec-936f-7fb3a9055b4f tempest-VolumesListTestJSON-1799956421 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-17T02:43:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1221203793',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7f394082-f346-4460-8798-b2d0528b50e5,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='d954b1e4b5a84738aff62b47b7d42c76',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T02:43:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T02:43:30Z,use_quota=True,user_id='58dfbea3cf494c169d8210b9b7766006',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aad9ce24-93f9-41a6-baa1-5125964f96d1),volume_type_id=aad9ce24-93f9-41a6-baa1-5125964f96d1)}" {{(pid=92060) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 17 04:43:31 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.remotefs [None req-4a155ead-8d3a-49ec-936f-7fb3a9055b4f tempest-VolumesListTestJSON-1799956421 None] Creating volume 7f394082-f346-4460-8798-b2d0528b50e5 {{(pid=92060) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 17 04:43:31 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-4a155ead-8d3a-49ec-936f-7fb3a9055b4f tempest-VolumesListTestJSON-1799956421 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 04:43:31 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-4a155ead-8d3a-49ec-936f-7fb3a9055b4f tempest-VolumesListTestJSON-1799956421 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 04:43:31 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-4a155ead-8d3a-49ec-936f-7fb3a9055b4f tempest-VolumesListTestJSON-1799956421 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588': None} {{(pid=92060) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 17 04:43:31 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-4a155ead-8d3a-49ec-936f-7fb3a9055b4f tempest-VolumesListTestJSON-1799956421 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588'] {{(pid=92060) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 17 04:43:31 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-4a155ead-8d3a-49ec-936f-7fb3a9055b4f tempest-VolumesListTestJSON-1799956421 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 04:43:31 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-4a155ead-8d3a-49ec-936f-7fb3a9055b4f tempest-VolumesListTestJSON-1799956421 None] Selected osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588 as target Quobyte volume. {{(pid=92060) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 17 04:43:31 devstack cinder-volume[92060]: INFO cinder.volume.drivers.remotefs [None req-4a155ead-8d3a-49ec-936f-7fb3a9055b4f tempest-VolumesListTestJSON-1799956421 None] casted to osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588 Jun 17 04:43:31 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-4a155ead-8d3a-49ec-936f-7fb3a9055b4f tempest-VolumesListTestJSON-1799956421 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-7f394082-f346-4460-8798-b2d0528b50e5 1073741824 {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:43:31 devstack sudo[100294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-7f394082-f346-4460-8798-b2d0528b50e5 1073741824 Jun 17 04:43:31 devstack sudo[100294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:43:31 devstack cinder-volume[92060]: INFO cinder.volume.manager [None req-b9c8e054-0baa-4ef2-9295-d518e3b34161 tempest-SnapshotMetadataTestJSON-1672378877 None] Create snapshot completed successfully Jun 17 04:43:32 devstack sudo[100294]: pam_unix(sudo:session): session closed for user root Jun 17 04:43:32 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-4a155ead-8d3a-49ec-936f-7fb3a9055b4f tempest-VolumesListTestJSON-1799956421 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-7f394082-f346-4460-8798-b2d0528b50e5 1073741824" returned: 0 in 0.847s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:43:32 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-4a155ead-8d3a-49ec-936f-7fb3a9055b4f tempest-VolumesListTestJSON-1799956421 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-7f394082-f346-4460-8798-b2d0528b50e5 {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:43:32 devstack sudo[100300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-7f394082-f346-4460-8798-b2d0528b50e5 Jun 17 04:43:32 devstack sudo[100300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:43:33 devstack sudo[100300]: pam_unix(sudo:session): session closed for user root Jun 17 04:43:33 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-4a155ead-8d3a-49ec-936f-7fb3a9055b4f tempest-VolumesListTestJSON-1799956421 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-7f394082-f346-4460-8798-b2d0528b50e5" returned: 0 in 0.746s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:43:33 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-4a155ead-8d3a-49ec-936f-7fb3a9055b4f tempest-VolumesListTestJSON-1799956421 None] <== create_volume: return (1657ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588'} {{(pid=92060) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 17 04:43:33 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-4a155ead-8d3a-49ec-936f-7fb3a9055b4f tempest-VolumesListTestJSON-1799956421 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.664s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 04:43:33 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-4a155ead-8d3a-49ec-936f-7fb3a9055b4f tempest-VolumesListTestJSON-1799956421 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dc36eb8a-67a0-47f5-b399-544e4aa19698) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7f394082-f346-4460-8798-b2d0528b50e5', 'volume_size': 1}' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:43:33 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-4a155ead-8d3a-49ec-936f-7fb3a9055b4f tempest-VolumesListTestJSON-1799956421 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (813868a1-ce74-4473-a046-4dd873697306) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:43:33 devstack cinder-volume[92060]: INFO cinder.volume.flows.manager.create_volume [None req-4a155ead-8d3a-49ec-936f-7fb3a9055b4f tempest-VolumesListTestJSON-1799956421 None] Volume volume-7f394082-f346-4460-8798-b2d0528b50e5 (7f394082-f346-4460-8798-b2d0528b50e5): created successfully Jun 17 04:43:33 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-4a155ead-8d3a-49ec-936f-7fb3a9055b4f tempest-VolumesListTestJSON-1799956421 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (813868a1-ce74-4473-a046-4dd873697306) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:43:33 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-4a155ead-8d3a-49ec-936f-7fb3a9055b4f tempest-VolumesListTestJSON-1799956421 None] Flow 'volume_create_manager' (1c52fcee-6e58-407b-a2ee-564da7b1b7f3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92060) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 17 04:43:33 devstack cinder-volume[92060]: INFO cinder.volume.manager [None req-4a155ead-8d3a-49ec-936f-7fb3a9055b4f tempest-VolumesListTestJSON-1799956421 None] Created volume successfully. Jun 17 04:43:33 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-8a35f66a-b234-48dc-952c-d4d38ac191a5 tempest-SnapshotMetadataTestJSON-1672378877 None] Acquiring lock "cinder-7a534a19-a304-4b43-9a12-cfd48863a8df-delete_snapshot" by "delete_snapshot" {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 04:43:33 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-8a35f66a-b234-48dc-952c-d4d38ac191a5 tempest-SnapshotMetadataTestJSON-1672378877 None] Lock "cinder-7a534a19-a304-4b43-9a12-cfd48863a8df-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 04:43:33 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-8a35f66a-b234-48dc-952c-d4d38ac191a5 tempest-SnapshotMetadataTestJSON-1672378877 None] Acquiring lock "cinder-quobyte-c25d447d-4fda-4ad5-9b16-598b1b29dc1c" by "delete_snapshot" {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 04:43:33 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-8a35f66a-b234-48dc-952c-d4d38ac191a5 tempest-SnapshotMetadataTestJSON-1672378877 None] Lock "cinder-quobyte-c25d447d-4fda-4ad5-9b16-598b1b29dc1c" acquired by "delete_snapshot" :: waited 0.027s {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 04:43:33 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-8a35f66a-b234-48dc-952c-d4d38ac191a5 tempest-SnapshotMetadataTestJSON-1672378877 None] Acquiring lock "cinder-quobyte-7a534a19-a304-4b43-9a12-cfd48863a8df" by "_delete_snapshot" {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 04:43:33 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-8a35f66a-b234-48dc-952c-d4d38ac191a5 tempest-SnapshotMetadataTestJSON-1672378877 None] Lock "cinder-quobyte-7a534a19-a304-4b43-9a12-cfd48863a8df" acquired by "_delete_snapshot" :: waited 0.028s {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 04:43:33 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.remotefs [None req-8a35f66a-b234-48dc-952c-d4d38ac191a5 tempest-SnapshotMetadataTestJSON-1672378877 None] Deleting offline snapshot 7a534a19-a304-4b43-9a12-cfd48863a8df of volume c25d447d-4fda-4ad5-9b16-598b1b29dc1c {{(pid=92060) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 17 04:43:33 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.remotefs [None req-8a35f66a-b234-48dc-952c-d4d38ac191a5 tempest-SnapshotMetadataTestJSON-1672378877 None] snapshot_file for this snap is: volume-c25d447d-4fda-4ad5-9b16-598b1b29dc1c.7a534a19-a304-4b43-9a12-cfd48863a8df {{(pid=92060) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 17 04:43:33 devstack cinder-volume[92060]: DEBUG oslo.privsep.daemon [-] privsep: reply[327f4ab9-a070-4b0c-a12d-8407ae497f33]: (4, 'qcow2') {{(pid=93130) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 04:43:33 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-8a35f66a-b234-48dc-952c-d4d38ac191a5 tempest-SnapshotMetadataTestJSON-1672378877 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-c25d447d-4fda-4ad5-9b16-598b1b29dc1c.7a534a19-a304-4b43-9a12-cfd48863a8df {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:43:33 devstack sudo[100331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-c25d447d-4fda-4ad5-9b16-598b1b29dc1c.7a534a19-a304-4b43-9a12-cfd48863a8df Jun 17 04:43:33 devstack sudo[100331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:43:33 devstack cinder-volume[92060]: DEBUG cinder.volume.flows.manager.create_volume [None req-9ebddf08-a493-457c-9fa1-01a3b6a79ab9 tempest-VolumesCloneNegativeTest-1125786990 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92060) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 17 04:43:33 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-9ebddf08-a493-457c-9fa1-01a3b6a79ab9 tempest-VolumesCloneNegativeTest-1125786990 None] Flow 'volume_create_manager' (a3c098a5-a9e0-42e3-9f53-ed711ab4fa2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 17 04:43:33 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-9ebddf08-a493-457c-9fa1-01a3b6a79ab9 tempest-VolumesCloneNegativeTest-1125786990 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (caa50714-d14b-478c-9986-9ff75a955578) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:43:33 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-9ebddf08-a493-457c-9fa1-01a3b6a79ab9 tempest-VolumesCloneNegativeTest-1125786990 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (caa50714-d14b-478c-9986-9ff75a955578) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-17T02:43:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-53539566',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cb865b6b-fdea-418e-970a-f8d52d363718,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c3c9c7d98e2345d5848fb92032bac08a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T02:43:34Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T02:43:34Z,use_quota=True,user_id='368cc96022694facbe5864de553ac63e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aad9ce24-93f9-41a6-baa1-5125964f96d1),volume_type_id=aad9ce24-93f9-41a6-baa1-5125964f96d1)' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:43:33 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-9ebddf08-a493-457c-9fa1-01a3b6a79ab9 tempest-VolumesCloneNegativeTest-1125786990 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (49413ff6-6032-4b43-8b0c-91f51249dd62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:43:33 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-9ebddf08-a493-457c-9fa1-01a3b6a79ab9 tempest-VolumesCloneNegativeTest-1125786990 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (49413ff6-6032-4b43-8b0c-91f51249dd62) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:43:33 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-9ebddf08-a493-457c-9fa1-01a3b6a79ab9 tempest-VolumesCloneNegativeTest-1125786990 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (74d66860-cb38-4496-99e8-50f7e0d9e6f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:43:33 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-9ebddf08-a493-457c-9fa1-01a3b6a79ab9 tempest-VolumesCloneNegativeTest-1125786990 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (74d66860-cb38-4496-99e8-50f7e0d9e6f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cb865b6b-fdea-418e-970a-f8d52d363718', 'volume_name': 'volume-cb865b6b-fdea-418e-970a-f8d52d363718', 'volume_size': 2}' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:43:33 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-9ebddf08-a493-457c-9fa1-01a3b6a79ab9 tempest-VolumesCloneNegativeTest-1125786990 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (44355ad6-6b45-4f35-9a25-6e410e1a5c7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:43:33 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-9ebddf08-a493-457c-9fa1-01a3b6a79ab9 tempest-VolumesCloneNegativeTest-1125786990 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (44355ad6-6b45-4f35-9a25-6e410e1a5c7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:43:33 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-9ebddf08-a493-457c-9fa1-01a3b6a79ab9 tempest-VolumesCloneNegativeTest-1125786990 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cd3d0c11-4c81-4d85-936a-c64347840864) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:43:33 devstack cinder-volume[92060]: INFO cinder.volume.flows.manager.create_volume [None req-9ebddf08-a493-457c-9fa1-01a3b6a79ab9 tempest-VolumesCloneNegativeTest-1125786990 None] Volume cb865b6b-fdea-418e-970a-f8d52d363718: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cb865b6b-fdea-418e-970a-f8d52d363718', 'volume_size': 2} Jun 17 04:43:33 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-9ebddf08-a493-457c-9fa1-01a3b6a79ab9 tempest-VolumesCloneNegativeTest-1125786990 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 04:43:33 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-9ebddf08-a493-457c-9fa1-01a3b6a79ab9 tempest-VolumesCloneNegativeTest-1125786990 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 04:43:33 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-9ebddf08-a493-457c-9fa1-01a3b6a79ab9 tempest-VolumesCloneNegativeTest-1125786990 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-17T02:43:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-53539566',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cb865b6b-fdea-418e-970a-f8d52d363718,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c3c9c7d98e2345d5848fb92032bac08a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T02:43:34Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T02:43:34Z,use_quota=True,user_id='368cc96022694facbe5864de553ac63e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aad9ce24-93f9-41a6-baa1-5125964f96d1),volume_type_id=aad9ce24-93f9-41a6-baa1-5125964f96d1)}" {{(pid=92060) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 17 04:43:33 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.remotefs [None req-9ebddf08-a493-457c-9fa1-01a3b6a79ab9 tempest-VolumesCloneNegativeTest-1125786990 None] Creating volume cb865b6b-fdea-418e-970a-f8d52d363718 {{(pid=92060) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 17 04:43:33 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-9ebddf08-a493-457c-9fa1-01a3b6a79ab9 tempest-VolumesCloneNegativeTest-1125786990 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 04:43:33 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-9ebddf08-a493-457c-9fa1-01a3b6a79ab9 tempest-VolumesCloneNegativeTest-1125786990 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 04:43:33 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-9ebddf08-a493-457c-9fa1-01a3b6a79ab9 tempest-VolumesCloneNegativeTest-1125786990 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588': None} {{(pid=92060) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 17 04:43:33 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-9ebddf08-a493-457c-9fa1-01a3b6a79ab9 tempest-VolumesCloneNegativeTest-1125786990 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588'] {{(pid=92060) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 17 04:43:33 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-9ebddf08-a493-457c-9fa1-01a3b6a79ab9 tempest-VolumesCloneNegativeTest-1125786990 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 04:43:33 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-9ebddf08-a493-457c-9fa1-01a3b6a79ab9 tempest-VolumesCloneNegativeTest-1125786990 None] Selected osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588 as target Quobyte volume. {{(pid=92060) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 17 04:43:33 devstack cinder-volume[92060]: INFO cinder.volume.drivers.remotefs [None req-9ebddf08-a493-457c-9fa1-01a3b6a79ab9 tempest-VolumesCloneNegativeTest-1125786990 None] casted to osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588 Jun 17 04:43:33 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-9ebddf08-a493-457c-9fa1-01a3b6a79ab9 tempest-VolumesCloneNegativeTest-1125786990 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-cb865b6b-fdea-418e-970a-f8d52d363718 2147483648 {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:43:34 devstack sudo[100333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-cb865b6b-fdea-418e-970a-f8d52d363718 2147483648 Jun 17 04:43:34 devstack sudo[100333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:43:34 devstack cinder-volume[92060]: DEBUG cinder.volume.flows.manager.create_volume [None req-2f994adc-3702-4589-a537-b0cc56cafbe2 tempest-VolumesListTestJSON-1799956421 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92060) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 17 04:43:34 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-2f994adc-3702-4589-a537-b0cc56cafbe2 tempest-VolumesListTestJSON-1799956421 None] Flow 'volume_create_manager' (75a1ce8a-104b-4a13-94d3-baa627a95f2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 17 04:43:34 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-2f994adc-3702-4589-a537-b0cc56cafbe2 tempest-VolumesListTestJSON-1799956421 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a946220e-6cdf-4e54-8273-ed412998d8ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:43:34 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-2f994adc-3702-4589-a537-b0cc56cafbe2 tempest-VolumesListTestJSON-1799956421 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a946220e-6cdf-4e54-8273-ed412998d8ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-17T02:43:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1408834539',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=00bb9570-45f1-4451-8630-b85f37f2726c,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='d954b1e4b5a84738aff62b47b7d42c76',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T02:43:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T02:43:34Z,use_quota=True,user_id='58dfbea3cf494c169d8210b9b7766006',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aad9ce24-93f9-41a6-baa1-5125964f96d1),volume_type_id=aad9ce24-93f9-41a6-baa1-5125964f96d1)' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:43:34 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-2f994adc-3702-4589-a537-b0cc56cafbe2 tempest-VolumesListTestJSON-1799956421 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bbd7d8f3-7448-4d2f-b812-89fb6cf409a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:43:34 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-2f994adc-3702-4589-a537-b0cc56cafbe2 tempest-VolumesListTestJSON-1799956421 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bbd7d8f3-7448-4d2f-b812-89fb6cf409a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:43:34 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-2f994adc-3702-4589-a537-b0cc56cafbe2 tempest-VolumesListTestJSON-1799956421 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2c3088e1-aaf2-40db-be28-cf223fb31f50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:43:34 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-2f994adc-3702-4589-a537-b0cc56cafbe2 tempest-VolumesListTestJSON-1799956421 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2c3088e1-aaf2-40db-be28-cf223fb31f50) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '00bb9570-45f1-4451-8630-b85f37f2726c', 'volume_name': 'volume-00bb9570-45f1-4451-8630-b85f37f2726c', 'volume_size': 1}' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:43:34 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-2f994adc-3702-4589-a537-b0cc56cafbe2 tempest-VolumesListTestJSON-1799956421 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a8fcbbcb-e931-4903-ace7-a967f1d67ea6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:43:34 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-2f994adc-3702-4589-a537-b0cc56cafbe2 tempest-VolumesListTestJSON-1799956421 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a8fcbbcb-e931-4903-ace7-a967f1d67ea6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:43:34 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-2f994adc-3702-4589-a537-b0cc56cafbe2 tempest-VolumesListTestJSON-1799956421 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (82464aa3-5979-4528-8cc7-895563cff066) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:43:34 devstack cinder-volume[92060]: INFO cinder.volume.flows.manager.create_volume [None req-2f994adc-3702-4589-a537-b0cc56cafbe2 tempest-VolumesListTestJSON-1799956421 None] Volume 00bb9570-45f1-4451-8630-b85f37f2726c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-00bb9570-45f1-4451-8630-b85f37f2726c', 'volume_size': 1} Jun 17 04:43:34 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-2f994adc-3702-4589-a537-b0cc56cafbe2 tempest-VolumesListTestJSON-1799956421 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 04:43:34 devstack sudo[100331]: pam_unix(sudo:session): session closed for user root Jun 17 04:43:34 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-8a35f66a-b234-48dc-952c-d4d38ac191a5 tempest-SnapshotMetadataTestJSON-1672378877 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-c25d447d-4fda-4ad5-9b16-598b1b29dc1c.7a534a19-a304-4b43-9a12-cfd48863a8df" returned: 0 in 0.839s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:43:34 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.remotefs [None req-8a35f66a-b234-48dc-952c-d4d38ac191a5 tempest-SnapshotMetadataTestJSON-1672378877 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c25d447d-4fda-4ad5-9b16-598b1b29dc1c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=92060) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 17 04:43:34 devstack cinder-volume[92060]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb942f00-eec4-4c1b-8ef9-689527f90442]: (4, 'qcow2') {{(pid=93130) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 04:43:34 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-8a35f66a-b234-48dc-952c-d4d38ac191a5 tempest-SnapshotMetadataTestJSON-1672378877 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-c25d447d-4fda-4ad5-9b16-598b1b29dc1c {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:43:34 devstack sudo[100339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-c25d447d-4fda-4ad5-9b16-598b1b29dc1c Jun 17 04:43:34 devstack sudo[100339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:43:34 devstack sudo[100333]: pam_unix(sudo:session): session closed for user root Jun 17 04:43:34 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-9ebddf08-a493-457c-9fa1-01a3b6a79ab9 tempest-VolumesCloneNegativeTest-1125786990 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-cb865b6b-fdea-418e-970a-f8d52d363718 2147483648" returned: 0 in 0.902s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:43:34 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-9ebddf08-a493-457c-9fa1-01a3b6a79ab9 tempest-VolumesCloneNegativeTest-1125786990 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-cb865b6b-fdea-418e-970a-f8d52d363718 {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:43:34 devstack sudo[100345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-cb865b6b-fdea-418e-970a-f8d52d363718 Jun 17 04:43:34 devstack sudo[100345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:43:35 devstack sudo[100339]: pam_unix(sudo:session): session closed for user root Jun 17 04:43:35 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-8a35f66a-b234-48dc-952c-d4d38ac191a5 tempest-SnapshotMetadataTestJSON-1672378877 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-c25d447d-4fda-4ad5-9b16-598b1b29dc1c" returned: 0 in 0.733s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:43:35 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-8a35f66a-b234-48dc-952c-d4d38ac191a5 tempest-SnapshotMetadataTestJSON-1672378877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-c25d447d-4fda-4ad5-9b16-598b1b29dc1c.7a534a19-a304-4b43-9a12-cfd48863a8df {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:43:35 devstack sudo[100350]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-c25d447d-4fda-4ad5-9b16-598b1b29dc1c.7a534a19-a304-4b43-9a12-cfd48863a8df Jun 17 04:43:35 devstack sudo[100350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:43:35 devstack sudo[100345]: pam_unix(sudo:session): session closed for user root Jun 17 04:43:35 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-9ebddf08-a493-457c-9fa1-01a3b6a79ab9 tempest-VolumesCloneNegativeTest-1125786990 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-cb865b6b-fdea-418e-970a-f8d52d363718" returned: 0 in 0.608s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:43:35 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-9ebddf08-a493-457c-9fa1-01a3b6a79ab9 tempest-VolumesCloneNegativeTest-1125786990 None] <== create_volume: return (1564ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588'} {{(pid=92060) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 17 04:43:35 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-9ebddf08-a493-457c-9fa1-01a3b6a79ab9 tempest-VolumesCloneNegativeTest-1125786990 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.572s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 04:43:35 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-2f994adc-3702-4589-a537-b0cc56cafbe2 tempest-VolumesListTestJSON-1799956421 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.129s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 04:43:35 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-2f994adc-3702-4589-a537-b0cc56cafbe2 tempest-VolumesListTestJSON-1799956421 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-17T02:43:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1408834539',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=00bb9570-45f1-4451-8630-b85f37f2726c,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='d954b1e4b5a84738aff62b47b7d42c76',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T02:43:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T02:43:34Z,use_quota=True,user_id='58dfbea3cf494c169d8210b9b7766006',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aad9ce24-93f9-41a6-baa1-5125964f96d1),volume_type_id=aad9ce24-93f9-41a6-baa1-5125964f96d1)}" {{(pid=92060) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 17 04:43:35 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.remotefs [None req-2f994adc-3702-4589-a537-b0cc56cafbe2 tempest-VolumesListTestJSON-1799956421 None] Creating volume 00bb9570-45f1-4451-8630-b85f37f2726c {{(pid=92060) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 17 04:43:35 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-2f994adc-3702-4589-a537-b0cc56cafbe2 tempest-VolumesListTestJSON-1799956421 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 04:43:35 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-2f994adc-3702-4589-a537-b0cc56cafbe2 tempest-VolumesListTestJSON-1799956421 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 04:43:35 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-2f994adc-3702-4589-a537-b0cc56cafbe2 tempest-VolumesListTestJSON-1799956421 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588': None} {{(pid=92060) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 17 04:43:35 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-2f994adc-3702-4589-a537-b0cc56cafbe2 tempest-VolumesListTestJSON-1799956421 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588'] {{(pid=92060) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 17 04:43:35 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-2f994adc-3702-4589-a537-b0cc56cafbe2 tempest-VolumesListTestJSON-1799956421 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 04:43:35 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-2f994adc-3702-4589-a537-b0cc56cafbe2 tempest-VolumesListTestJSON-1799956421 None] Selected osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588 as target Quobyte volume. {{(pid=92060) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 17 04:43:35 devstack cinder-volume[92060]: INFO cinder.volume.drivers.remotefs [None req-2f994adc-3702-4589-a537-b0cc56cafbe2 tempest-VolumesListTestJSON-1799956421 None] casted to osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588 Jun 17 04:43:35 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-2f994adc-3702-4589-a537-b0cc56cafbe2 tempest-VolumesListTestJSON-1799956421 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-00bb9570-45f1-4451-8630-b85f37f2726c 1073741824 {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:43:35 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-9ebddf08-a493-457c-9fa1-01a3b6a79ab9 tempest-VolumesCloneNegativeTest-1125786990 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cd3d0c11-4c81-4d85-936a-c64347840864) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cb865b6b-fdea-418e-970a-f8d52d363718', 'volume_size': 2}' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:43:35 devstack sudo[100353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-00bb9570-45f1-4451-8630-b85f37f2726c 1073741824 Jun 17 04:43:35 devstack sudo[100353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:43:35 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-9ebddf08-a493-457c-9fa1-01a3b6a79ab9 tempest-VolumesCloneNegativeTest-1125786990 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3366ef58-68fb-422f-8d57-18e9bd13b1ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:43:35 devstack cinder-volume[92060]: INFO cinder.volume.flows.manager.create_volume [None req-9ebddf08-a493-457c-9fa1-01a3b6a79ab9 tempest-VolumesCloneNegativeTest-1125786990 None] Volume volume-cb865b6b-fdea-418e-970a-f8d52d363718 (cb865b6b-fdea-418e-970a-f8d52d363718): created successfully Jun 17 04:43:35 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-9ebddf08-a493-457c-9fa1-01a3b6a79ab9 tempest-VolumesCloneNegativeTest-1125786990 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3366ef58-68fb-422f-8d57-18e9bd13b1ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:43:35 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-9ebddf08-a493-457c-9fa1-01a3b6a79ab9 tempest-VolumesCloneNegativeTest-1125786990 None] Flow 'volume_create_manager' (a3c098a5-a9e0-42e3-9f53-ed711ab4fa2c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92060) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 17 04:43:35 devstack cinder-volume[92060]: INFO cinder.volume.manager [None req-9ebddf08-a493-457c-9fa1-01a3b6a79ab9 tempest-VolumesCloneNegativeTest-1125786990 None] Created volume successfully. Jun 17 04:43:35 devstack sudo[100350]: pam_unix(sudo:session): session closed for user root Jun 17 04:43:35 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-8a35f66a-b234-48dc-952c-d4d38ac191a5 tempest-SnapshotMetadataTestJSON-1672378877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-c25d447d-4fda-4ad5-9b16-598b1b29dc1c.7a534a19-a304-4b43-9a12-cfd48863a8df" returned: 0 in 0.702s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:43:35 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-8a35f66a-b234-48dc-952c-d4d38ac191a5 tempest-SnapshotMetadataTestJSON-1672378877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-c25d447d-4fda-4ad5-9b16-598b1b29dc1c.7a534a19-a304-4b43-9a12-cfd48863a8df {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:43:35 devstack sudo[100358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-c25d447d-4fda-4ad5-9b16-598b1b29dc1c.7a534a19-a304-4b43-9a12-cfd48863a8df Jun 17 04:43:35 devstack sudo[100358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:43:36 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-18da5c17-1ea9-4762-8013-22dc0c6996fc tempest-VolumesCloneNegativeTest-1125786990 None] Acquiring lock "cinder-cb865b6b-fdea-418e-970a-f8d52d363718-delete_volume" by "delete_volume" {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 04:43:36 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-18da5c17-1ea9-4762-8013-22dc0c6996fc tempest-VolumesCloneNegativeTest-1125786990 None] Lock "cinder-cb865b6b-fdea-418e-970a-f8d52d363718-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 04:43:36 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-18da5c17-1ea9-4762-8013-22dc0c6996fc tempest-VolumesCloneNegativeTest-1125786990 None] Acquiring lock "cinder-quobyte-cb865b6b-fdea-418e-970a-f8d52d363718" by "delete_volume" {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 04:43:36 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-18da5c17-1ea9-4762-8013-22dc0c6996fc tempest-VolumesCloneNegativeTest-1125786990 None] Lock "cinder-quobyte-cb865b6b-fdea-418e-970a-f8d52d363718" acquired by "delete_volume" :: waited 0.023s {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 04:43:36 devstack cinder-volume[92060]: DEBUG oslo.privsep.daemon [-] privsep: reply[33e3be6a-e9c6-4fd6-832e-51743aedae13]: (4, 'qcow2') {{(pid=93130) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 04:43:36 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-18da5c17-1ea9-4762-8013-22dc0c6996fc tempest-VolumesCloneNegativeTest-1125786990 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-cb865b6b-fdea-418e-970a-f8d52d363718 {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:43:36 devstack sudo[100363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-cb865b6b-fdea-418e-970a-f8d52d363718 Jun 17 04:43:36 devstack sudo[100363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:43:36 devstack sudo[100353]: pam_unix(sudo:session): session closed for user root Jun 17 04:43:36 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-2f994adc-3702-4589-a537-b0cc56cafbe2 tempest-VolumesListTestJSON-1799956421 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-00bb9570-45f1-4451-8630-b85f37f2726c 1073741824" returned: 0 in 0.854s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:43:36 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-2f994adc-3702-4589-a537-b0cc56cafbe2 tempest-VolumesListTestJSON-1799956421 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-00bb9570-45f1-4451-8630-b85f37f2726c {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:43:36 devstack sudo[100358]: pam_unix(sudo:session): session closed for user root Jun 17 04:43:36 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-8a35f66a-b234-48dc-952c-d4d38ac191a5 tempest-SnapshotMetadataTestJSON-1672378877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-c25d447d-4fda-4ad5-9b16-598b1b29dc1c.7a534a19-a304-4b43-9a12-cfd48863a8df" returned: 0 in 0.634s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:43:36 devstack sudo[100367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-00bb9570-45f1-4451-8630-b85f37f2726c Jun 17 04:43:36 devstack sudo[100367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:43:36 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-8a35f66a-b234-48dc-952c-d4d38ac191a5 tempest-SnapshotMetadataTestJSON-1672378877 None] Lock "cinder-quobyte-7a534a19-a304-4b43-9a12-cfd48863a8df" released by "_delete_snapshot" :: held 3.038s {{(pid=92060) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 04:43:36 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-8a35f66a-b234-48dc-952c-d4d38ac191a5 tempest-SnapshotMetadataTestJSON-1672378877 None] Lock "cinder-quobyte-c25d447d-4fda-4ad5-9b16-598b1b29dc1c" released by "delete_snapshot" :: held 3.077s {{(pid=92060) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 04:43:36 devstack cinder-volume[92060]: DEBUG cinder.quota [None req-8a35f66a-b234-48dc-952c-d4d38ac191a5 tempest-SnapshotMetadataTestJSON-1672378877 None] Created reservations ['bd10d933-0a29-4f4a-a538-1b90ec9ab504', '7cf8d1e4-af8d-41c6-ac6d-25e37d474f25', 'd3fa3cf6-7881-4e4e-a06b-a740158194d8', '6019cb26-e3ce-4933-9d59-e5721de28fd1'] {{(pid=92060) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 17 04:43:36 devstack cinder-volume[92060]: INFO cinder.volume.manager [None req-8a35f66a-b234-48dc-952c-d4d38ac191a5 tempest-SnapshotMetadataTestJSON-1672378877 None] Delete snapshot completed successfully. Jun 17 04:43:36 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-8a35f66a-b234-48dc-952c-d4d38ac191a5 tempest-SnapshotMetadataTestJSON-1672378877 None] Lock "cinder-7a534a19-a304-4b43-9a12-cfd48863a8df-delete_snapshot" released by "delete_snapshot" :: held 3.247s {{(pid=92060) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 04:43:36 devstack sudo[100363]: pam_unix(sudo:session): session closed for user root Jun 17 04:43:36 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-18da5c17-1ea9-4762-8013-22dc0c6996fc tempest-VolumesCloneNegativeTest-1125786990 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-cb865b6b-fdea-418e-970a-f8d52d363718" returned: 0 in 0.792s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:43:36 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-18da5c17-1ea9-4762-8013-22dc0c6996fc tempest-VolumesCloneNegativeTest-1125786990 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-cb865b6b-fdea-418e-970a-f8d52d363718 {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:43:36 devstack sudo[100373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-cb865b6b-fdea-418e-970a-f8d52d363718 Jun 17 04:43:36 devstack sudo[100373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:43:37 devstack sudo[100367]: pam_unix(sudo:session): session closed for user root Jun 17 04:43:37 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-2f994adc-3702-4589-a537-b0cc56cafbe2 tempest-VolumesListTestJSON-1799956421 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-00bb9570-45f1-4451-8630-b85f37f2726c" returned: 0 in 0.617s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:43:37 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-2f994adc-3702-4589-a537-b0cc56cafbe2 tempest-VolumesListTestJSON-1799956421 None] <== create_volume: return (1543ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588'} {{(pid=92060) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 17 04:43:37 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-2f994adc-3702-4589-a537-b0cc56cafbe2 tempest-VolumesListTestJSON-1799956421 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.546s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 04:43:37 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-2f994adc-3702-4589-a537-b0cc56cafbe2 tempest-VolumesListTestJSON-1799956421 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (82464aa3-5979-4528-8cc7-895563cff066) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-00bb9570-45f1-4451-8630-b85f37f2726c', 'volume_size': 1}' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:43:37 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-2f994adc-3702-4589-a537-b0cc56cafbe2 tempest-VolumesListTestJSON-1799956421 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7eebaf2a-cac0-428d-888d-508ce3604464) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:43:37 devstack cinder-volume[92060]: INFO cinder.volume.flows.manager.create_volume [None req-2f994adc-3702-4589-a537-b0cc56cafbe2 tempest-VolumesListTestJSON-1799956421 None] Volume volume-00bb9570-45f1-4451-8630-b85f37f2726c (00bb9570-45f1-4451-8630-b85f37f2726c): created successfully Jun 17 04:43:37 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-2f994adc-3702-4589-a537-b0cc56cafbe2 tempest-VolumesListTestJSON-1799956421 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7eebaf2a-cac0-428d-888d-508ce3604464) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:43:37 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-2f994adc-3702-4589-a537-b0cc56cafbe2 tempest-VolumesListTestJSON-1799956421 None] Flow 'volume_create_manager' (75a1ce8a-104b-4a13-94d3-baa627a95f2e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92060) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 17 04:43:37 devstack cinder-volume[92060]: INFO cinder.volume.manager [None req-2f994adc-3702-4589-a537-b0cc56cafbe2 tempest-VolumesListTestJSON-1799956421 None] Created volume successfully. Jun 17 04:43:37 devstack sudo[100373]: pam_unix(sudo:session): session closed for user root Jun 17 04:43:37 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-18da5c17-1ea9-4762-8013-22dc0c6996fc tempest-VolumesCloneNegativeTest-1125786990 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-cb865b6b-fdea-418e-970a-f8d52d363718" returned: 0 in 0.615s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:43:37 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-18da5c17-1ea9-4762-8013-22dc0c6996fc tempest-VolumesCloneNegativeTest-1125786990 None] Lock "cinder-quobyte-cb865b6b-fdea-418e-970a-f8d52d363718" released by "delete_volume" :: held 1.455s {{(pid=92060) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 04:43:37 devstack cinder-volume[92060]: DEBUG cinder.quota [None req-18da5c17-1ea9-4762-8013-22dc0c6996fc tempest-VolumesCloneNegativeTest-1125786990 None] Created reservations ['0b8ad8fd-0256-44c5-9536-430ce38fd92a', '287afeb4-aed8-4c6d-b1c7-27ca09de1f7a', 'e537b03e-41ef-4416-b0df-215c7359d42d', '9e88caac-38d0-4d0f-9276-26f8296d419a'] {{(pid=92060) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 17 04:43:37 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-3060742d-d0b1-4e4f-9877-75bbda63c5cb tempest-SnapshotMetadataTestJSON-1672378877 None] Acquiring lock "cinder-c25d447d-4fda-4ad5-9b16-598b1b29dc1c-delete_volume" by "delete_volume" {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 04:43:37 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-18da5c17-1ea9-4762-8013-22dc0c6996fc tempest-VolumesCloneNegativeTest-1125786990 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 04:43:37 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-18da5c17-1ea9-4762-8013-22dc0c6996fc tempest-VolumesCloneNegativeTest-1125786990 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 04:43:37 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-18da5c17-1ea9-4762-8013-22dc0c6996fc tempest-VolumesCloneNegativeTest-1125786990 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588': None} {{(pid=92060) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 17 04:43:37 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-18da5c17-1ea9-4762-8013-22dc0c6996fc tempest-VolumesCloneNegativeTest-1125786990 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588'] {{(pid=92060) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 17 04:43:37 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-18da5c17-1ea9-4762-8013-22dc0c6996fc tempest-VolumesCloneNegativeTest-1125786990 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 04:43:37 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-18da5c17-1ea9-4762-8013-22dc0c6996fc tempest-VolumesCloneNegativeTest-1125786990 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:43:37 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-3060742d-d0b1-4e4f-9877-75bbda63c5cb tempest-SnapshotMetadataTestJSON-1672378877 None] Lock "cinder-c25d447d-4fda-4ad5-9b16-598b1b29dc1c-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 04:43:37 devstack sudo[100376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a Jun 17 04:43:37 devstack sudo[100376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:43:37 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-3060742d-d0b1-4e4f-9877-75bbda63c5cb tempest-SnapshotMetadataTestJSON-1672378877 None] Acquiring lock "cinder-quobyte-c25d447d-4fda-4ad5-9b16-598b1b29dc1c" by "delete_volume" {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 04:43:37 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-3060742d-d0b1-4e4f-9877-75bbda63c5cb tempest-SnapshotMetadataTestJSON-1672378877 None] Lock "cinder-quobyte-c25d447d-4fda-4ad5-9b16-598b1b29dc1c" acquired by "delete_volume" :: waited 0.021s {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 04:43:37 devstack cinder-volume[92060]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e66ee65-7f7c-4d46-a775-f454fbd2922f]: (4, 'qcow2') {{(pid=93130) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 04:43:37 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-3060742d-d0b1-4e4f-9877-75bbda63c5cb tempest-SnapshotMetadataTestJSON-1672378877 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-c25d447d-4fda-4ad5-9b16-598b1b29dc1c {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:43:38 devstack sudo[100378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-c25d447d-4fda-4ad5-9b16-598b1b29dc1c Jun 17 04:43:38 devstack sudo[100378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:43:38 devstack cinder-volume[92060]: DEBUG cinder.volume.flows.manager.create_volume [None req-20dcebc5-ec69-4759-b372-0eb746ac3266 tempest-VolumesListTestJSON-1799956421 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92060) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 17 04:43:38 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-20dcebc5-ec69-4759-b372-0eb746ac3266 tempest-VolumesListTestJSON-1799956421 None] Flow 'volume_create_manager' (0fbf6138-2c0e-4a36-baed-ef7ea5e0c330) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 17 04:43:38 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-20dcebc5-ec69-4759-b372-0eb746ac3266 tempest-VolumesListTestJSON-1799956421 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f0a3b4bc-1b92-4092-8989-f52c7836e3ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:43:38 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-20dcebc5-ec69-4759-b372-0eb746ac3266 tempest-VolumesListTestJSON-1799956421 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f0a3b4bc-1b92-4092-8989-f52c7836e3ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-17T02:43:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-685937746',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e9c64368-1afe-4853-9060-fb671999998d,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='d954b1e4b5a84738aff62b47b7d42c76',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T02:43:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T02:43:38Z,use_quota=True,user_id='58dfbea3cf494c169d8210b9b7766006',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aad9ce24-93f9-41a6-baa1-5125964f96d1),volume_type_id=aad9ce24-93f9-41a6-baa1-5125964f96d1)' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:43:38 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-20dcebc5-ec69-4759-b372-0eb746ac3266 tempest-VolumesListTestJSON-1799956421 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (056570f3-5d95-4636-a66b-bc018ffc7d5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:43:38 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-20dcebc5-ec69-4759-b372-0eb746ac3266 tempest-VolumesListTestJSON-1799956421 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (056570f3-5d95-4636-a66b-bc018ffc7d5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:43:38 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-20dcebc5-ec69-4759-b372-0eb746ac3266 tempest-VolumesListTestJSON-1799956421 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c0acc811-07e7-4942-ada2-e50ae1461127) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:43:38 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-20dcebc5-ec69-4759-b372-0eb746ac3266 tempest-VolumesListTestJSON-1799956421 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c0acc811-07e7-4942-ada2-e50ae1461127) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e9c64368-1afe-4853-9060-fb671999998d', 'volume_name': 'volume-e9c64368-1afe-4853-9060-fb671999998d', 'volume_size': 1}' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:43:38 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-20dcebc5-ec69-4759-b372-0eb746ac3266 tempest-VolumesListTestJSON-1799956421 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (22251405-e834-43f0-ba3d-c7ff300340ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:43:38 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-20dcebc5-ec69-4759-b372-0eb746ac3266 tempest-VolumesListTestJSON-1799956421 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (22251405-e834-43f0-ba3d-c7ff300340ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:43:38 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-20dcebc5-ec69-4759-b372-0eb746ac3266 tempest-VolumesListTestJSON-1799956421 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (83c8596d-2139-4fe3-87e0-a1524251facc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:43:38 devstack cinder-volume[92060]: INFO cinder.volume.flows.manager.create_volume [None req-20dcebc5-ec69-4759-b372-0eb746ac3266 tempest-VolumesListTestJSON-1799956421 None] Volume e9c64368-1afe-4853-9060-fb671999998d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e9c64368-1afe-4853-9060-fb671999998d', 'volume_size': 1} Jun 17 04:43:38 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-20dcebc5-ec69-4759-b372-0eb746ac3266 tempest-VolumesListTestJSON-1799956421 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 04:43:38 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-20dcebc5-ec69-4759-b372-0eb746ac3266 tempest-VolumesListTestJSON-1799956421 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 04:43:38 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-20dcebc5-ec69-4759-b372-0eb746ac3266 tempest-VolumesListTestJSON-1799956421 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-17T02:43:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-685937746',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e9c64368-1afe-4853-9060-fb671999998d,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='d954b1e4b5a84738aff62b47b7d42c76',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T02:43:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T02:43:38Z,use_quota=True,user_id='58dfbea3cf494c169d8210b9b7766006',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aad9ce24-93f9-41a6-baa1-5125964f96d1),volume_type_id=aad9ce24-93f9-41a6-baa1-5125964f96d1)}" {{(pid=92060) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 17 04:43:38 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.remotefs [None req-20dcebc5-ec69-4759-b372-0eb746ac3266 tempest-VolumesListTestJSON-1799956421 None] Creating volume e9c64368-1afe-4853-9060-fb671999998d {{(pid=92060) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 17 04:43:38 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-20dcebc5-ec69-4759-b372-0eb746ac3266 tempest-VolumesListTestJSON-1799956421 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 04:43:38 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-20dcebc5-ec69-4759-b372-0eb746ac3266 tempest-VolumesListTestJSON-1799956421 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 04:43:38 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-20dcebc5-ec69-4759-b372-0eb746ac3266 tempest-VolumesListTestJSON-1799956421 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588': None} {{(pid=92060) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 17 04:43:38 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-20dcebc5-ec69-4759-b372-0eb746ac3266 tempest-VolumesListTestJSON-1799956421 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588'] {{(pid=92060) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 17 04:43:38 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-20dcebc5-ec69-4759-b372-0eb746ac3266 tempest-VolumesListTestJSON-1799956421 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 04:43:38 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-20dcebc5-ec69-4759-b372-0eb746ac3266 tempest-VolumesListTestJSON-1799956421 None] Selected osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588 as target Quobyte volume. {{(pid=92060) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 17 04:43:38 devstack cinder-volume[92060]: INFO cinder.volume.drivers.remotefs [None req-20dcebc5-ec69-4759-b372-0eb746ac3266 tempest-VolumesListTestJSON-1799956421 None] casted to osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588 Jun 17 04:43:38 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-20dcebc5-ec69-4759-b372-0eb746ac3266 tempest-VolumesListTestJSON-1799956421 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-e9c64368-1afe-4853-9060-fb671999998d 1073741824 {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:43:38 devstack sudo[100380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-e9c64368-1afe-4853-9060-fb671999998d 1073741824 Jun 17 04:43:38 devstack sudo[100380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:43:38 devstack sudo[100376]: pam_unix(sudo:session): session closed for user root Jun 17 04:43:38 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-18da5c17-1ea9-4762-8013-22dc0c6996fc tempest-VolumesCloneNegativeTest-1125786990 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a" returned: 0 in 0.661s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:43:38 devstack cinder-volume[92060]: DEBUG cinder.manager [None req-18da5c17-1ea9-4762-8013-22dc0c6996fc tempest-VolumesCloneNegativeTest-1125786990 None] Notifying Schedulers of capabilities ... {{(pid=92060) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 17 04:43:38 devstack cinder-volume[92060]: INFO cinder.volume.manager [None req-18da5c17-1ea9-4762-8013-22dc0c6996fc tempest-VolumesCloneNegativeTest-1125786990 None] Deleted volume successfully. Jun 17 04:43:38 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-18da5c17-1ea9-4762-8013-22dc0c6996fc tempest-VolumesCloneNegativeTest-1125786990 None] Lock "cinder-cb865b6b-fdea-418e-970a-f8d52d363718-delete_volume" released by "delete_volume" :: held 2.384s {{(pid=92060) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 04:43:38 devstack sudo[100378]: pam_unix(sudo:session): session closed for user root Jun 17 04:43:38 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-3060742d-d0b1-4e4f-9877-75bbda63c5cb tempest-SnapshotMetadataTestJSON-1672378877 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-c25d447d-4fda-4ad5-9b16-598b1b29dc1c" returned: 0 in 0.774s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:43:38 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-3060742d-d0b1-4e4f-9877-75bbda63c5cb tempest-SnapshotMetadataTestJSON-1672378877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-c25d447d-4fda-4ad5-9b16-598b1b29dc1c {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:43:38 devstack sudo[100387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-c25d447d-4fda-4ad5-9b16-598b1b29dc1c Jun 17 04:43:38 devstack sudo[100387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:43:39 devstack sudo[100380]: pam_unix(sudo:session): session closed for user root Jun 17 04:43:39 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-20dcebc5-ec69-4759-b372-0eb746ac3266 tempest-VolumesListTestJSON-1799956421 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-e9c64368-1afe-4853-9060-fb671999998d 1073741824" returned: 0 in 0.917s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:43:39 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-20dcebc5-ec69-4759-b372-0eb746ac3266 tempest-VolumesListTestJSON-1799956421 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-e9c64368-1afe-4853-9060-fb671999998d {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:43:39 devstack sudo[100392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-e9c64368-1afe-4853-9060-fb671999998d Jun 17 04:43:39 devstack sudo[100392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:43:39 devstack sudo[100387]: pam_unix(sudo:session): session closed for user root Jun 17 04:43:39 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-3060742d-d0b1-4e4f-9877-75bbda63c5cb tempest-SnapshotMetadataTestJSON-1672378877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-c25d447d-4fda-4ad5-9b16-598b1b29dc1c" returned: 0 in 0.666s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:43:39 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-3060742d-d0b1-4e4f-9877-75bbda63c5cb tempest-SnapshotMetadataTestJSON-1672378877 None] Lock "cinder-quobyte-c25d447d-4fda-4ad5-9b16-598b1b29dc1c" released by "delete_volume" :: held 1.512s {{(pid=92060) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 04:43:39 devstack cinder-volume[92060]: DEBUG cinder.quota [None req-3060742d-d0b1-4e4f-9877-75bbda63c5cb tempest-SnapshotMetadataTestJSON-1672378877 None] Created reservations ['02f4dabd-89df-4340-ae4d-46ee83f80eb1', 'ca9e2713-3a7a-4236-bee6-1b33b6e669ca', '10f58546-ea4c-40f8-a12c-f48d5178dd29', 'c8a59c2a-2ac5-41e4-aa3c-5bbad4f4c04c'] {{(pid=92060) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 17 04:43:39 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-3060742d-d0b1-4e4f-9877-75bbda63c5cb tempest-SnapshotMetadataTestJSON-1672378877 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 04:43:39 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-3060742d-d0b1-4e4f-9877-75bbda63c5cb tempest-SnapshotMetadataTestJSON-1672378877 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 04:43:39 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-3060742d-d0b1-4e4f-9877-75bbda63c5cb tempest-SnapshotMetadataTestJSON-1672378877 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588': None} {{(pid=92060) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 17 04:43:39 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-3060742d-d0b1-4e4f-9877-75bbda63c5cb tempest-SnapshotMetadataTestJSON-1672378877 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588'] {{(pid=92060) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 17 04:43:39 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-3060742d-d0b1-4e4f-9877-75bbda63c5cb tempest-SnapshotMetadataTestJSON-1672378877 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 04:43:39 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-3060742d-d0b1-4e4f-9877-75bbda63c5cb tempest-SnapshotMetadataTestJSON-1672378877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:43:39 devstack sudo[100395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a Jun 17 04:43:39 devstack sudo[100395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:43:39 devstack sudo[100392]: pam_unix(sudo:session): session closed for user root Jun 17 04:43:39 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-20dcebc5-ec69-4759-b372-0eb746ac3266 tempest-VolumesListTestJSON-1799956421 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-e9c64368-1afe-4853-9060-fb671999998d" returned: 0 in 0.619s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:43:39 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-20dcebc5-ec69-4759-b372-0eb746ac3266 tempest-VolumesListTestJSON-1799956421 None] <== create_volume: return (1589ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588'} {{(pid=92060) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 17 04:43:39 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-20dcebc5-ec69-4759-b372-0eb746ac3266 tempest-VolumesListTestJSON-1799956421 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.593s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 04:43:39 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-20dcebc5-ec69-4759-b372-0eb746ac3266 tempest-VolumesListTestJSON-1799956421 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (83c8596d-2139-4fe3-87e0-a1524251facc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e9c64368-1afe-4853-9060-fb671999998d', 'volume_size': 1}' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:43:39 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-20dcebc5-ec69-4759-b372-0eb746ac3266 tempest-VolumesListTestJSON-1799956421 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a399b862-932c-4e79-8c5f-03b1a84f8b57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:43:39 devstack cinder-volume[92060]: INFO cinder.volume.flows.manager.create_volume [None req-20dcebc5-ec69-4759-b372-0eb746ac3266 tempest-VolumesListTestJSON-1799956421 None] Volume volume-e9c64368-1afe-4853-9060-fb671999998d (e9c64368-1afe-4853-9060-fb671999998d): created successfully Jun 17 04:43:39 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-20dcebc5-ec69-4759-b372-0eb746ac3266 tempest-VolumesListTestJSON-1799956421 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a399b862-932c-4e79-8c5f-03b1a84f8b57) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:43:39 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-20dcebc5-ec69-4759-b372-0eb746ac3266 tempest-VolumesListTestJSON-1799956421 None] Flow 'volume_create_manager' (0fbf6138-2c0e-4a36-baed-ef7ea5e0c330) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92060) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 17 04:43:39 devstack cinder-volume[92060]: INFO cinder.volume.manager [None req-20dcebc5-ec69-4759-b372-0eb746ac3266 tempest-VolumesListTestJSON-1799956421 None] Created volume successfully. Jun 17 04:43:40 devstack sudo[100395]: pam_unix(sudo:session): session closed for user root Jun 17 04:43:40 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-3060742d-d0b1-4e4f-9877-75bbda63c5cb tempest-SnapshotMetadataTestJSON-1672378877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a" returned: 0 in 0.696s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:43:40 devstack cinder-volume[92060]: DEBUG cinder.manager [None req-3060742d-d0b1-4e4f-9877-75bbda63c5cb tempest-SnapshotMetadataTestJSON-1672378877 None] Notifying Schedulers of capabilities ... {{(pid=92060) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 17 04:43:40 devstack cinder-volume[92060]: INFO cinder.volume.manager [None req-3060742d-d0b1-4e4f-9877-75bbda63c5cb tempest-SnapshotMetadataTestJSON-1672378877 None] Deleted volume successfully. Jun 17 04:43:40 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-3060742d-d0b1-4e4f-9877-75bbda63c5cb tempest-SnapshotMetadataTestJSON-1672378877 None] Lock "cinder-c25d447d-4fda-4ad5-9b16-598b1b29dc1c-delete_volume" released by "delete_volume" :: held 2.473s {{(pid=92060) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 04:43:43 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-85d5d9a8-69b3-47d7-8df4-c88d4532cc62 tempest-VolumesListTestJSON-1799956421 None] Acquiring lock "cinder-e9c64368-1afe-4853-9060-fb671999998d-delete_volume" by "delete_volume" {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 04:43:43 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-85d5d9a8-69b3-47d7-8df4-c88d4532cc62 tempest-VolumesListTestJSON-1799956421 None] Lock "cinder-e9c64368-1afe-4853-9060-fb671999998d-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 04:43:43 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-85d5d9a8-69b3-47d7-8df4-c88d4532cc62 tempest-VolumesListTestJSON-1799956421 None] Acquiring lock "cinder-quobyte-e9c64368-1afe-4853-9060-fb671999998d" by "delete_volume" {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 04:43:43 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-85d5d9a8-69b3-47d7-8df4-c88d4532cc62 tempest-VolumesListTestJSON-1799956421 None] Lock "cinder-quobyte-e9c64368-1afe-4853-9060-fb671999998d" acquired by "delete_volume" :: waited 0.017s {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 04:43:43 devstack cinder-volume[92060]: DEBUG oslo.privsep.daemon [-] privsep: reply[6087a818-2940-4795-a8bd-ddb4a7ba407c]: (4, 'qcow2') {{(pid=93130) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 04:43:43 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-85d5d9a8-69b3-47d7-8df4-c88d4532cc62 tempest-VolumesListTestJSON-1799956421 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-e9c64368-1afe-4853-9060-fb671999998d {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:43:43 devstack sudo[100400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-e9c64368-1afe-4853-9060-fb671999998d Jun 17 04:43:43 devstack sudo[100400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:43:44 devstack sudo[100400]: pam_unix(sudo:session): session closed for user root Jun 17 04:43:44 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-85d5d9a8-69b3-47d7-8df4-c88d4532cc62 tempest-VolumesListTestJSON-1799956421 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-e9c64368-1afe-4853-9060-fb671999998d" returned: 0 in 0.832s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:43:44 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-85d5d9a8-69b3-47d7-8df4-c88d4532cc62 tempest-VolumesListTestJSON-1799956421 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-e9c64368-1afe-4853-9060-fb671999998d {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:43:44 devstack sudo[100405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-e9c64368-1afe-4853-9060-fb671999998d Jun 17 04:43:44 devstack sudo[100405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:43:44 devstack cinder-volume[92060]: DEBUG oslo_service.periodic_task [None req-60d279ad-ad8c-4d36-a4b8-f593e74fb922 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=92060) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 17 04:43:44 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-60d279ad-ad8c-4d36-a4b8-f593e74fb922 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 04:43:44 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-60d279ad-ad8c-4d36-a4b8-f593e74fb922 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 04:43:44 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-60d279ad-ad8c-4d36-a4b8-f593e74fb922 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588': None} {{(pid=92060) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 17 04:43:44 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-60d279ad-ad8c-4d36-a4b8-f593e74fb922 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588'] {{(pid=92060) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 17 04:43:44 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-60d279ad-ad8c-4d36-a4b8-f593e74fb922 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 04:43:44 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-60d279ad-ad8c-4d36-a4b8-f593e74fb922 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:43:44 devstack sudo[100410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a Jun 17 04:43:44 devstack sudo[100410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:43:45 devstack sudo[100405]: pam_unix(sudo:session): session closed for user root Jun 17 04:43:45 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-85d5d9a8-69b3-47d7-8df4-c88d4532cc62 tempest-VolumesListTestJSON-1799956421 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-e9c64368-1afe-4853-9060-fb671999998d" returned: 0 in 0.864s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:43:45 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-85d5d9a8-69b3-47d7-8df4-c88d4532cc62 tempest-VolumesListTestJSON-1799956421 None] Lock "cinder-quobyte-e9c64368-1afe-4853-9060-fb671999998d" released by "delete_volume" :: held 1.773s {{(pid=92060) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 04:43:45 devstack cinder-volume[92060]: DEBUG cinder.quota [None req-85d5d9a8-69b3-47d7-8df4-c88d4532cc62 tempest-VolumesListTestJSON-1799956421 None] Created reservations ['2c30636c-ccf3-4c8c-a83f-93128d3bd5c0', '0222314e-79ca-4306-bccf-4c9f91c2afa3', '264ac65e-4199-4d8d-9030-44d15a1e4a98', '555f3001-4f84-40a5-b2b7-9e1ee505b303'] {{(pid=92060) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 17 04:43:45 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-85d5d9a8-69b3-47d7-8df4-c88d4532cc62 tempest-VolumesListTestJSON-1799956421 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 04:43:45 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-85d5d9a8-69b3-47d7-8df4-c88d4532cc62 tempest-VolumesListTestJSON-1799956421 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 04:43:45 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-85d5d9a8-69b3-47d7-8df4-c88d4532cc62 tempest-VolumesListTestJSON-1799956421 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588': None} {{(pid=92060) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 17 04:43:45 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-85d5d9a8-69b3-47d7-8df4-c88d4532cc62 tempest-VolumesListTestJSON-1799956421 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588'] {{(pid=92060) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 17 04:43:45 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-85d5d9a8-69b3-47d7-8df4-c88d4532cc62 tempest-VolumesListTestJSON-1799956421 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 04:43:45 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-85d5d9a8-69b3-47d7-8df4-c88d4532cc62 tempest-VolumesListTestJSON-1799956421 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:43:45 devstack sudo[100412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a Jun 17 04:43:45 devstack sudo[100412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:43:45 devstack cinder-volume[92060]: DEBUG cinder.volume.flows.manager.create_volume [None req-77a58807-3795-4fca-b770-f8e060eee87d tempest-AttachVolumeTestJSON-189381823 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92060) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 17 04:43:45 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-77a58807-3795-4fca-b770-f8e060eee87d tempest-AttachVolumeTestJSON-189381823 None] Flow 'volume_create_manager' (3a31a6cb-1d59-495b-aad9-7d2dc5773e9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 17 04:43:45 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-77a58807-3795-4fca-b770-f8e060eee87d tempest-AttachVolumeTestJSON-189381823 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (de66acf6-fbd5-467d-9904-356892d1d590) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:43:45 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-77a58807-3795-4fca-b770-f8e060eee87d tempest-AttachVolumeTestJSON-189381823 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (de66acf6-fbd5-467d-9904-356892d1d590) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-17T02:43:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-775093011',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a85c206e-c58d-4cc4-8d97-614030f30f77,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9cb0f3e8aabc47e582b3e9924538b792',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T02:43:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T02:43:45Z,use_quota=True,user_id='f25a55d2802e4cf4b442a23df3eb34cc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aad9ce24-93f9-41a6-baa1-5125964f96d1),volume_type_id=aad9ce24-93f9-41a6-baa1-5125964f96d1)' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:43:45 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-77a58807-3795-4fca-b770-f8e060eee87d tempest-AttachVolumeTestJSON-189381823 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f88f4957-fa24-42ed-aed6-25ab4b252bc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:43:45 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-77a58807-3795-4fca-b770-f8e060eee87d tempest-AttachVolumeTestJSON-189381823 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f88f4957-fa24-42ed-aed6-25ab4b252bc8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:43:45 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-77a58807-3795-4fca-b770-f8e060eee87d tempest-AttachVolumeTestJSON-189381823 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (143f1b48-8bd7-40ec-8a1c-ef9553eb69dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:43:45 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-77a58807-3795-4fca-b770-f8e060eee87d tempest-AttachVolumeTestJSON-189381823 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (143f1b48-8bd7-40ec-8a1c-ef9553eb69dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a85c206e-c58d-4cc4-8d97-614030f30f77', 'volume_name': 'volume-a85c206e-c58d-4cc4-8d97-614030f30f77', 'volume_size': 1}' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:43:45 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-77a58807-3795-4fca-b770-f8e060eee87d tempest-AttachVolumeTestJSON-189381823 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2225ac37-e246-4bf3-854a-2c896e666640) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:43:45 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-77a58807-3795-4fca-b770-f8e060eee87d tempest-AttachVolumeTestJSON-189381823 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2225ac37-e246-4bf3-854a-2c896e666640) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:43:45 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-77a58807-3795-4fca-b770-f8e060eee87d tempest-AttachVolumeTestJSON-189381823 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f59cdeab-4489-4507-9cbd-b189336c591f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:43:45 devstack cinder-volume[92060]: INFO cinder.volume.flows.manager.create_volume [None req-77a58807-3795-4fca-b770-f8e060eee87d tempest-AttachVolumeTestJSON-189381823 None] Volume a85c206e-c58d-4cc4-8d97-614030f30f77: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a85c206e-c58d-4cc4-8d97-614030f30f77', 'volume_size': 1} Jun 17 04:43:45 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-77a58807-3795-4fca-b770-f8e060eee87d tempest-AttachVolumeTestJSON-189381823 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 04:43:45 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-77a58807-3795-4fca-b770-f8e060eee87d tempest-AttachVolumeTestJSON-189381823 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 04:43:45 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-77a58807-3795-4fca-b770-f8e060eee87d tempest-AttachVolumeTestJSON-189381823 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-17T02:43:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-775093011',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a85c206e-c58d-4cc4-8d97-614030f30f77,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9cb0f3e8aabc47e582b3e9924538b792',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T02:43:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T02:43:45Z,use_quota=True,user_id='f25a55d2802e4cf4b442a23df3eb34cc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aad9ce24-93f9-41a6-baa1-5125964f96d1),volume_type_id=aad9ce24-93f9-41a6-baa1-5125964f96d1)}" {{(pid=92060) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 17 04:43:45 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.remotefs [None req-77a58807-3795-4fca-b770-f8e060eee87d tempest-AttachVolumeTestJSON-189381823 None] Creating volume a85c206e-c58d-4cc4-8d97-614030f30f77 {{(pid=92060) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 17 04:43:45 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-77a58807-3795-4fca-b770-f8e060eee87d tempest-AttachVolumeTestJSON-189381823 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 04:43:45 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-77a58807-3795-4fca-b770-f8e060eee87d tempest-AttachVolumeTestJSON-189381823 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 04:43:45 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-77a58807-3795-4fca-b770-f8e060eee87d tempest-AttachVolumeTestJSON-189381823 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588': None} {{(pid=92060) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 17 04:43:45 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-77a58807-3795-4fca-b770-f8e060eee87d tempest-AttachVolumeTestJSON-189381823 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588'] {{(pid=92060) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 17 04:43:45 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-77a58807-3795-4fca-b770-f8e060eee87d tempest-AttachVolumeTestJSON-189381823 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 04:43:45 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-77a58807-3795-4fca-b770-f8e060eee87d tempest-AttachVolumeTestJSON-189381823 None] Selected osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588 as target Quobyte volume. {{(pid=92060) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 17 04:43:45 devstack cinder-volume[92060]: INFO cinder.volume.drivers.remotefs [None req-77a58807-3795-4fca-b770-f8e060eee87d tempest-AttachVolumeTestJSON-189381823 None] casted to osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588 Jun 17 04:43:45 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-77a58807-3795-4fca-b770-f8e060eee87d tempest-AttachVolumeTestJSON-189381823 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-a85c206e-c58d-4cc4-8d97-614030f30f77 1073741824 {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:43:45 devstack sudo[100414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-a85c206e-c58d-4cc4-8d97-614030f30f77 1073741824 Jun 17 04:43:45 devstack sudo[100414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:43:45 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-53672581-a2b3-4c29-9461-0317b9bd0265 tempest-VolumesListTestJSON-1799956421 None] Acquiring lock "cinder-00bb9570-45f1-4451-8630-b85f37f2726c-delete_volume" by "delete_volume" {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 04:43:45 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-53672581-a2b3-4c29-9461-0317b9bd0265 tempest-VolumesListTestJSON-1799956421 None] Lock "cinder-00bb9570-45f1-4451-8630-b85f37f2726c-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 04:43:45 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-53672581-a2b3-4c29-9461-0317b9bd0265 tempest-VolumesListTestJSON-1799956421 None] Acquiring lock "cinder-quobyte-00bb9570-45f1-4451-8630-b85f37f2726c" by "delete_volume" {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 04:43:45 devstack sudo[100410]: pam_unix(sudo:session): session closed for user root Jun 17 04:43:45 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-60d279ad-ad8c-4d36-a4b8-f593e74fb922 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a" returned: 0 in 0.921s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:43:45 devstack cinder-volume[92060]: DEBUG cinder.manager [None req-60d279ad-ad8c-4d36-a4b8-f593e74fb922 None None] Notifying Schedulers of capabilities ... {{(pid=92060) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 17 04:43:45 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-53672581-a2b3-4c29-9461-0317b9bd0265 tempest-VolumesListTestJSON-1799956421 None] Lock "cinder-quobyte-00bb9570-45f1-4451-8630-b85f37f2726c" acquired by "delete_volume" :: waited 0.039s {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 04:43:45 devstack cinder-volume[92060]: DEBUG oslo_service.periodic_task [None req-60d279ad-ad8c-4d36-a4b8-f593e74fb922 None None] Running periodic task VolumeManager._thread_info {{(pid=92060) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 17 04:43:45 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-60d279ad-ad8c-4d36-a4b8-f593e74fb922 None None] thread count: 28 {{(pid=92060) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 17 04:43:45 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-60d279ad-ad8c-4d36-a4b8-f593e74fb922 None None] thread info: [<_MainThread(MainThread, started 130061806440576)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=92060) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 17 04:43:45 devstack cinder-volume[92060]: DEBUG oslo.privsep.daemon [-] privsep: reply[01793414-da79-418c-9aec-2efbb6ae09a2]: (4, 'qcow2') {{(pid=93130) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 04:43:45 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-53672581-a2b3-4c29-9461-0317b9bd0265 tempest-VolumesListTestJSON-1799956421 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-00bb9570-45f1-4451-8630-b85f37f2726c {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:43:46 devstack sudo[100417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-00bb9570-45f1-4451-8630-b85f37f2726c Jun 17 04:43:46 devstack sudo[100417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:43:46 devstack sudo[100412]: pam_unix(sudo:session): session closed for user root Jun 17 04:43:46 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-85d5d9a8-69b3-47d7-8df4-c88d4532cc62 tempest-VolumesListTestJSON-1799956421 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a" returned: 0 in 1.023s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:43:46 devstack cinder-volume[92060]: DEBUG cinder.manager [None req-85d5d9a8-69b3-47d7-8df4-c88d4532cc62 tempest-VolumesListTestJSON-1799956421 None] Notifying Schedulers of capabilities ... {{(pid=92060) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 17 04:43:46 devstack cinder-volume[92060]: INFO cinder.volume.manager [None req-85d5d9a8-69b3-47d7-8df4-c88d4532cc62 tempest-VolumesListTestJSON-1799956421 None] Deleted volume successfully. Jun 17 04:43:46 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-85d5d9a8-69b3-47d7-8df4-c88d4532cc62 tempest-VolumesListTestJSON-1799956421 None] Lock "cinder-e9c64368-1afe-4853-9060-fb671999998d-delete_volume" released by "delete_volume" :: held 3.201s {{(pid=92060) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 04:43:46 devstack cinder-volume[92060]: DEBUG cinder.volume.flows.manager.create_volume [None req-98c93abe-a45c-4b35-9749-0290d79a3a88 tempest-VolumesDeleteCascade-1909219053 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92060) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 17 04:43:46 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-98c93abe-a45c-4b35-9749-0290d79a3a88 tempest-VolumesDeleteCascade-1909219053 None] Flow 'volume_create_manager' (b3f7ae42-301c-4f9a-85bc-63a49bde2c42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 17 04:43:46 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-98c93abe-a45c-4b35-9749-0290d79a3a88 tempest-VolumesDeleteCascade-1909219053 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (67b9bc1e-2286-43a9-95f4-1d01d5a3113e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:43:46 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-98c93abe-a45c-4b35-9749-0290d79a3a88 tempest-VolumesDeleteCascade-1909219053 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (67b9bc1e-2286-43a9-95f4-1d01d5a3113e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-17T02:43:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-267183480',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6b8ce59e-1cdc-45ab-bde9-3768f0d6705b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='71aa70d8201e463f904712e7de33922a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T02:43:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T02:43:47Z,use_quota=True,user_id='078aaa69dcdb4ab8854c52f9529b905c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aad9ce24-93f9-41a6-baa1-5125964f96d1),volume_type_id=aad9ce24-93f9-41a6-baa1-5125964f96d1)' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:43:46 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-98c93abe-a45c-4b35-9749-0290d79a3a88 tempest-VolumesDeleteCascade-1909219053 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (58ecbb21-e58d-4a52-b96a-59f9220bc770) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:43:46 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-98c93abe-a45c-4b35-9749-0290d79a3a88 tempest-VolumesDeleteCascade-1909219053 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (58ecbb21-e58d-4a52-b96a-59f9220bc770) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:43:46 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-98c93abe-a45c-4b35-9749-0290d79a3a88 tempest-VolumesDeleteCascade-1909219053 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (834b51e4-5a3e-47a7-9b1a-5151dfebe29a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:43:46 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-98c93abe-a45c-4b35-9749-0290d79a3a88 tempest-VolumesDeleteCascade-1909219053 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (834b51e4-5a3e-47a7-9b1a-5151dfebe29a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6b8ce59e-1cdc-45ab-bde9-3768f0d6705b', 'volume_name': 'volume-6b8ce59e-1cdc-45ab-bde9-3768f0d6705b', 'volume_size': 1}' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:43:46 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-98c93abe-a45c-4b35-9749-0290d79a3a88 tempest-VolumesDeleteCascade-1909219053 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4df3d12a-20ed-4be3-89f1-c7594f602fb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:43:46 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-98c93abe-a45c-4b35-9749-0290d79a3a88 tempest-VolumesDeleteCascade-1909219053 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4df3d12a-20ed-4be3-89f1-c7594f602fb6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:43:46 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-98c93abe-a45c-4b35-9749-0290d79a3a88 tempest-VolumesDeleteCascade-1909219053 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5d6c3aba-82ef-451a-89c9-49fcfae9cf86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:43:46 devstack cinder-volume[92060]: INFO cinder.volume.flows.manager.create_volume [None req-98c93abe-a45c-4b35-9749-0290d79a3a88 tempest-VolumesDeleteCascade-1909219053 None] Volume 6b8ce59e-1cdc-45ab-bde9-3768f0d6705b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6b8ce59e-1cdc-45ab-bde9-3768f0d6705b', 'volume_size': 1} Jun 17 04:43:46 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-98c93abe-a45c-4b35-9749-0290d79a3a88 tempest-VolumesDeleteCascade-1909219053 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 04:43:46 devstack sudo[100414]: pam_unix(sudo:session): session closed for user root Jun 17 04:43:46 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-77a58807-3795-4fca-b770-f8e060eee87d tempest-AttachVolumeTestJSON-189381823 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-a85c206e-c58d-4cc4-8d97-614030f30f77 1073741824" returned: 0 in 1.176s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:43:46 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-77a58807-3795-4fca-b770-f8e060eee87d tempest-AttachVolumeTestJSON-189381823 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-a85c206e-c58d-4cc4-8d97-614030f30f77 {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:43:46 devstack sudo[100426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-a85c206e-c58d-4cc4-8d97-614030f30f77 Jun 17 04:43:46 devstack sudo[100426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:43:46 devstack sudo[100417]: pam_unix(sudo:session): session closed for user root Jun 17 04:43:46 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-53672581-a2b3-4c29-9461-0317b9bd0265 tempest-VolumesListTestJSON-1799956421 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-00bb9570-45f1-4451-8630-b85f37f2726c" returned: 0 in 1.061s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:43:46 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-53672581-a2b3-4c29-9461-0317b9bd0265 tempest-VolumesListTestJSON-1799956421 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-00bb9570-45f1-4451-8630-b85f37f2726c {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:43:47 devstack sudo[100430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-00bb9570-45f1-4451-8630-b85f37f2726c Jun 17 04:43:47 devstack sudo[100430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:43:47 devstack sudo[100426]: pam_unix(sudo:session): session closed for user root Jun 17 04:43:47 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-77a58807-3795-4fca-b770-f8e060eee87d tempest-AttachVolumeTestJSON-189381823 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-a85c206e-c58d-4cc4-8d97-614030f30f77" returned: 0 in 0.702s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:43:47 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-77a58807-3795-4fca-b770-f8e060eee87d tempest-AttachVolumeTestJSON-189381823 None] <== create_volume: return (1929ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588'} {{(pid=92060) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 17 04:43:47 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-77a58807-3795-4fca-b770-f8e060eee87d tempest-AttachVolumeTestJSON-189381823 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.932s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 04:43:47 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-98c93abe-a45c-4b35-9749-0290d79a3a88 tempest-VolumesDeleteCascade-1909219053 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.763s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 04:43:47 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-98c93abe-a45c-4b35-9749-0290d79a3a88 tempest-VolumesDeleteCascade-1909219053 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-17T02:43:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-267183480',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6b8ce59e-1cdc-45ab-bde9-3768f0d6705b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='71aa70d8201e463f904712e7de33922a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T02:43:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T02:43:47Z,use_quota=True,user_id='078aaa69dcdb4ab8854c52f9529b905c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aad9ce24-93f9-41a6-baa1-5125964f96d1),volume_type_id=aad9ce24-93f9-41a6-baa1-5125964f96d1)}" {{(pid=92060) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 17 04:43:47 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.remotefs [None req-98c93abe-a45c-4b35-9749-0290d79a3a88 tempest-VolumesDeleteCascade-1909219053 None] Creating volume 6b8ce59e-1cdc-45ab-bde9-3768f0d6705b {{(pid=92060) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 17 04:43:47 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-98c93abe-a45c-4b35-9749-0290d79a3a88 tempest-VolumesDeleteCascade-1909219053 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 04:43:47 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-98c93abe-a45c-4b35-9749-0290d79a3a88 tempest-VolumesDeleteCascade-1909219053 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 04:43:47 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-98c93abe-a45c-4b35-9749-0290d79a3a88 tempest-VolumesDeleteCascade-1909219053 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588': None} {{(pid=92060) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 17 04:43:47 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-98c93abe-a45c-4b35-9749-0290d79a3a88 tempest-VolumesDeleteCascade-1909219053 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588'] {{(pid=92060) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 17 04:43:47 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-98c93abe-a45c-4b35-9749-0290d79a3a88 tempest-VolumesDeleteCascade-1909219053 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 04:43:47 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-98c93abe-a45c-4b35-9749-0290d79a3a88 tempest-VolumesDeleteCascade-1909219053 None] Selected osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588 as target Quobyte volume. {{(pid=92060) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 17 04:43:47 devstack cinder-volume[92060]: INFO cinder.volume.drivers.remotefs [None req-98c93abe-a45c-4b35-9749-0290d79a3a88 tempest-VolumesDeleteCascade-1909219053 None] casted to osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588 Jun 17 04:43:47 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-98c93abe-a45c-4b35-9749-0290d79a3a88 tempest-VolumesDeleteCascade-1909219053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-6b8ce59e-1cdc-45ab-bde9-3768f0d6705b 1073741824 {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:43:47 devstack sudo[100433]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-6b8ce59e-1cdc-45ab-bde9-3768f0d6705b 1073741824 Jun 17 04:43:47 devstack sudo[100433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:43:47 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-77a58807-3795-4fca-b770-f8e060eee87d tempest-AttachVolumeTestJSON-189381823 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f59cdeab-4489-4507-9cbd-b189336c591f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a85c206e-c58d-4cc4-8d97-614030f30f77', 'volume_size': 1}' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:43:47 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-77a58807-3795-4fca-b770-f8e060eee87d tempest-AttachVolumeTestJSON-189381823 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c7815892-4168-4928-b3e2-d0313fa4a677) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:43:47 devstack cinder-volume[92060]: INFO cinder.volume.flows.manager.create_volume [None req-77a58807-3795-4fca-b770-f8e060eee87d tempest-AttachVolumeTestJSON-189381823 None] Volume volume-a85c206e-c58d-4cc4-8d97-614030f30f77 (a85c206e-c58d-4cc4-8d97-614030f30f77): created successfully Jun 17 04:43:47 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-77a58807-3795-4fca-b770-f8e060eee87d tempest-AttachVolumeTestJSON-189381823 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c7815892-4168-4928-b3e2-d0313fa4a677) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:43:47 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-77a58807-3795-4fca-b770-f8e060eee87d tempest-AttachVolumeTestJSON-189381823 None] Flow 'volume_create_manager' (3a31a6cb-1d59-495b-aad9-7d2dc5773e9e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92060) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 17 04:43:47 devstack cinder-volume[92060]: INFO cinder.volume.manager [None req-77a58807-3795-4fca-b770-f8e060eee87d tempest-AttachVolumeTestJSON-189381823 None] Created volume successfully. Jun 17 04:43:47 devstack sudo[100430]: pam_unix(sudo:session): session closed for user root Jun 17 04:43:47 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-53672581-a2b3-4c29-9461-0317b9bd0265 tempest-VolumesListTestJSON-1799956421 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-00bb9570-45f1-4451-8630-b85f37f2726c" returned: 0 in 0.816s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:43:47 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-53672581-a2b3-4c29-9461-0317b9bd0265 tempest-VolumesListTestJSON-1799956421 None] Lock "cinder-quobyte-00bb9570-45f1-4451-8630-b85f37f2726c" released by "delete_volume" :: held 1.960s {{(pid=92060) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 04:43:47 devstack cinder-volume[92060]: DEBUG cinder.quota [None req-53672581-a2b3-4c29-9461-0317b9bd0265 tempest-VolumesListTestJSON-1799956421 None] Created reservations ['58277a77-59f4-4fa5-b424-664c159cd223', '4446630b-0baf-457d-b6b6-ee130ceca322', '9aec720f-ed0c-4835-850c-5a69aacefb64', 'df31bb76-a80b-4c8d-ad1f-99309bfac538'] {{(pid=92060) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 17 04:43:47 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-53672581-a2b3-4c29-9461-0317b9bd0265 tempest-VolumesListTestJSON-1799956421 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 04:43:47 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-53672581-a2b3-4c29-9461-0317b9bd0265 tempest-VolumesListTestJSON-1799956421 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 04:43:47 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-53672581-a2b3-4c29-9461-0317b9bd0265 tempest-VolumesListTestJSON-1799956421 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588': None} {{(pid=92060) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 17 04:43:47 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-53672581-a2b3-4c29-9461-0317b9bd0265 tempest-VolumesListTestJSON-1799956421 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588'] {{(pid=92060) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 17 04:43:47 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-53672581-a2b3-4c29-9461-0317b9bd0265 tempest-VolumesListTestJSON-1799956421 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 04:43:47 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-53672581-a2b3-4c29-9461-0317b9bd0265 tempest-VolumesListTestJSON-1799956421 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:43:48 devstack sudo[100436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a Jun 17 04:43:48 devstack sudo[100436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:43:48 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-f5418a76-0c6d-42c0-b23c-b7734cc011a6 tempest-VolumesListTestJSON-1799956421 None] Acquiring lock "cinder-7f394082-f346-4460-8798-b2d0528b50e5-delete_volume" by "delete_volume" {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 04:43:48 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-f5418a76-0c6d-42c0-b23c-b7734cc011a6 tempest-VolumesListTestJSON-1799956421 None] Lock "cinder-7f394082-f346-4460-8798-b2d0528b50e5-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 04:43:48 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-f5418a76-0c6d-42c0-b23c-b7734cc011a6 tempest-VolumesListTestJSON-1799956421 None] Acquiring lock "cinder-quobyte-7f394082-f346-4460-8798-b2d0528b50e5" by "delete_volume" {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 04:43:48 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-f5418a76-0c6d-42c0-b23c-b7734cc011a6 tempest-VolumesListTestJSON-1799956421 None] Lock "cinder-quobyte-7f394082-f346-4460-8798-b2d0528b50e5" acquired by "delete_volume" :: waited 0.026s {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 04:43:48 devstack cinder-volume[92060]: DEBUG oslo.privsep.daemon [-] privsep: reply[e014d53e-5893-47c0-acda-d6e65415a150]: (4, 'qcow2') {{(pid=93130) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 04:43:48 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-f5418a76-0c6d-42c0-b23c-b7734cc011a6 tempest-VolumesListTestJSON-1799956421 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-7f394082-f346-4460-8798-b2d0528b50e5 {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:43:48 devstack sudo[100441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-7f394082-f346-4460-8798-b2d0528b50e5 Jun 17 04:43:48 devstack sudo[100441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:43:48 devstack sudo[100436]: pam_unix(sudo:session): session closed for user root Jun 17 04:43:48 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-53672581-a2b3-4c29-9461-0317b9bd0265 tempest-VolumesListTestJSON-1799956421 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a" returned: 0 in 0.822s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:43:48 devstack cinder-volume[92060]: DEBUG cinder.manager [None req-53672581-a2b3-4c29-9461-0317b9bd0265 tempest-VolumesListTestJSON-1799956421 None] Notifying Schedulers of capabilities ... {{(pid=92060) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 17 04:43:48 devstack cinder-volume[92060]: INFO cinder.volume.manager [None req-53672581-a2b3-4c29-9461-0317b9bd0265 tempest-VolumesListTestJSON-1799956421 None] Deleted volume successfully. Jun 17 04:43:48 devstack sudo[100433]: pam_unix(sudo:session): session closed for user root Jun 17 04:43:48 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-98c93abe-a45c-4b35-9749-0290d79a3a88 tempest-VolumesDeleteCascade-1909219053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-6b8ce59e-1cdc-45ab-bde9-3768f0d6705b 1073741824" returned: 0 in 1.256s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:43:48 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-53672581-a2b3-4c29-9461-0317b9bd0265 tempest-VolumesListTestJSON-1799956421 None] Lock "cinder-00bb9570-45f1-4451-8630-b85f37f2726c-delete_volume" released by "delete_volume" :: held 3.091s {{(pid=92060) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 04:43:48 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-98c93abe-a45c-4b35-9749-0290d79a3a88 tempest-VolumesDeleteCascade-1909219053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-6b8ce59e-1cdc-45ab-bde9-3768f0d6705b {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:43:48 devstack sudo[100444]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-6b8ce59e-1cdc-45ab-bde9-3768f0d6705b Jun 17 04:43:48 devstack sudo[100444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:43:49 devstack sudo[100441]: pam_unix(sudo:session): session closed for user root Jun 17 04:43:49 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-f5418a76-0c6d-42c0-b23c-b7734cc011a6 tempest-VolumesListTestJSON-1799956421 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-7f394082-f346-4460-8798-b2d0528b50e5" returned: 0 in 1.036s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:43:49 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-f5418a76-0c6d-42c0-b23c-b7734cc011a6 tempest-VolumesListTestJSON-1799956421 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-7f394082-f346-4460-8798-b2d0528b50e5 {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:43:49 devstack sudo[100451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-7f394082-f346-4460-8798-b2d0528b50e5 Jun 17 04:43:49 devstack sudo[100451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:43:49 devstack sudo[100444]: pam_unix(sudo:session): session closed for user root Jun 17 04:43:49 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-98c93abe-a45c-4b35-9749-0290d79a3a88 tempest-VolumesDeleteCascade-1909219053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-6b8ce59e-1cdc-45ab-bde9-3768f0d6705b" returned: 0 in 0.678s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:43:49 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-98c93abe-a45c-4b35-9749-0290d79a3a88 tempest-VolumesDeleteCascade-1909219053 None] <== create_volume: return (2030ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588'} {{(pid=92060) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 17 04:43:49 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-98c93abe-a45c-4b35-9749-0290d79a3a88 tempest-VolumesDeleteCascade-1909219053 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.033s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 04:43:49 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-98c93abe-a45c-4b35-9749-0290d79a3a88 tempest-VolumesDeleteCascade-1909219053 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5d6c3aba-82ef-451a-89c9-49fcfae9cf86) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6b8ce59e-1cdc-45ab-bde9-3768f0d6705b', 'volume_size': 1}' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:43:49 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-98c93abe-a45c-4b35-9749-0290d79a3a88 tempest-VolumesDeleteCascade-1909219053 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ed118601-6367-4d06-8992-c66a4bc40ae2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:43:49 devstack cinder-volume[92060]: INFO cinder.volume.flows.manager.create_volume [None req-98c93abe-a45c-4b35-9749-0290d79a3a88 tempest-VolumesDeleteCascade-1909219053 None] Volume volume-6b8ce59e-1cdc-45ab-bde9-3768f0d6705b (6b8ce59e-1cdc-45ab-bde9-3768f0d6705b): created successfully Jun 17 04:43:49 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-98c93abe-a45c-4b35-9749-0290d79a3a88 tempest-VolumesDeleteCascade-1909219053 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ed118601-6367-4d06-8992-c66a4bc40ae2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:43:49 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-98c93abe-a45c-4b35-9749-0290d79a3a88 tempest-VolumesDeleteCascade-1909219053 None] Flow 'volume_create_manager' (b3f7ae42-301c-4f9a-85bc-63a49bde2c42) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92060) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 17 04:43:49 devstack cinder-volume[92060]: INFO cinder.volume.manager [None req-98c93abe-a45c-4b35-9749-0290d79a3a88 tempest-VolumesDeleteCascade-1909219053 None] Created volume successfully. Jun 17 04:43:50 devstack sudo[100451]: pam_unix(sudo:session): session closed for user root Jun 17 04:43:50 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-f5418a76-0c6d-42c0-b23c-b7734cc011a6 tempest-VolumesListTestJSON-1799956421 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-7f394082-f346-4460-8798-b2d0528b50e5" returned: 0 in 0.741s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:43:50 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-f5418a76-0c6d-42c0-b23c-b7734cc011a6 tempest-VolumesListTestJSON-1799956421 None] Lock "cinder-quobyte-7f394082-f346-4460-8798-b2d0528b50e5" released by "delete_volume" :: held 1.847s {{(pid=92060) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 04:43:50 devstack cinder-volume[92060]: DEBUG cinder.quota [None req-f5418a76-0c6d-42c0-b23c-b7734cc011a6 tempest-VolumesListTestJSON-1799956421 None] Created reservations ['615efb6a-0469-4a67-96b7-29f8df15b666', '3be0e955-611a-4109-b0a6-d00628056447', 'e095f7fc-0c74-44f9-b32c-8825cd28cac2', 'f8c24afc-3cab-4735-991b-6aa2b7c1a76f'] {{(pid=92060) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 17 04:43:50 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-fbeb086a-9a0d-4fed-b8d6-69a007a0773c tempest-VolumesDeleteCascade-1909219053 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 04:43:50 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-fbeb086a-9a0d-4fed-b8d6-69a007a0773c tempest-VolumesDeleteCascade-1909219053 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 04:43:50 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.remotefs [None req-fbeb086a-9a0d-4fed-b8d6-69a007a0773c tempest-VolumesDeleteCascade-1909219053 None] Creating offline snapshot 791a2306-8ed3-40b8-bd0f-b4ac59f13fad of volume 6b8ce59e-1cdc-45ab-bde9-3768f0d6705b {{(pid=92060) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 17 04:43:50 devstack cinder-volume[92060]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdbd7537-4d2e-4f47-8f71-306e1b192ab6]: (4, 'qcow2') {{(pid=93130) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 04:43:50 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-fbeb086a-9a0d-4fed-b8d6-69a007a0773c tempest-VolumesDeleteCascade-1909219053 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-6b8ce59e-1cdc-45ab-bde9-3768f0d6705b {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:43:50 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-f5418a76-0c6d-42c0-b23c-b7734cc011a6 tempest-VolumesListTestJSON-1799956421 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 04:43:50 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-f5418a76-0c6d-42c0-b23c-b7734cc011a6 tempest-VolumesListTestJSON-1799956421 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 04:43:50 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-f5418a76-0c6d-42c0-b23c-b7734cc011a6 tempest-VolumesListTestJSON-1799956421 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588': None} {{(pid=92060) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 17 04:43:50 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-f5418a76-0c6d-42c0-b23c-b7734cc011a6 tempest-VolumesListTestJSON-1799956421 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588'] {{(pid=92060) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 17 04:43:50 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-f5418a76-0c6d-42c0-b23c-b7734cc011a6 tempest-VolumesListTestJSON-1799956421 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 04:43:50 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-f5418a76-0c6d-42c0-b23c-b7734cc011a6 tempest-VolumesListTestJSON-1799956421 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:43:50 devstack sudo[100456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a Jun 17 04:43:50 devstack sudo[100456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:43:50 devstack sudo[100455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-6b8ce59e-1cdc-45ab-bde9-3768f0d6705b Jun 17 04:43:50 devstack sudo[100455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:43:51 devstack sudo[100456]: pam_unix(sudo:session): session closed for user root Jun 17 04:43:51 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-f5418a76-0c6d-42c0-b23c-b7734cc011a6 tempest-VolumesListTestJSON-1799956421 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a" returned: 0 in 0.744s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:43:51 devstack cinder-volume[92060]: DEBUG cinder.manager [None req-f5418a76-0c6d-42c0-b23c-b7734cc011a6 tempest-VolumesListTestJSON-1799956421 None] Notifying Schedulers of capabilities ... {{(pid=92060) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 17 04:43:51 devstack cinder-volume[92060]: INFO cinder.volume.manager [None req-f5418a76-0c6d-42c0-b23c-b7734cc011a6 tempest-VolumesListTestJSON-1799956421 None] Deleted volume successfully. Jun 17 04:43:51 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-f5418a76-0c6d-42c0-b23c-b7734cc011a6 tempest-VolumesListTestJSON-1799956421 None] Lock "cinder-7f394082-f346-4460-8798-b2d0528b50e5-delete_volume" released by "delete_volume" :: held 2.965s {{(pid=92060) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 04:43:51 devstack sudo[100455]: pam_unix(sudo:session): session closed for user root Jun 17 04:43:51 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-fbeb086a-9a0d-4fed-b8d6-69a007a0773c tempest-VolumesDeleteCascade-1909219053 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-6b8ce59e-1cdc-45ab-bde9-3768f0d6705b" returned: 0 in 0.929s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:43:51 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-fbeb086a-9a0d-4fed-b8d6-69a007a0773c tempest-VolumesDeleteCascade-1909219053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-6b8ce59e-1cdc-45ab-bde9-3768f0d6705b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-6b8ce59e-1cdc-45ab-bde9-3768f0d6705b.791a2306-8ed3-40b8-bd0f-b4ac59f13fad 1G {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:43:51 devstack sudo[100464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-6b8ce59e-1cdc-45ab-bde9-3768f0d6705b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-6b8ce59e-1cdc-45ab-bde9-3768f0d6705b.791a2306-8ed3-40b8-bd0f-b4ac59f13fad 1G Jun 17 04:43:51 devstack sudo[100464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:43:52 devstack sudo[100464]: pam_unix(sudo:session): session closed for user root Jun 17 04:43:52 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-fbeb086a-9a0d-4fed-b8d6-69a007a0773c tempest-VolumesDeleteCascade-1909219053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-6b8ce59e-1cdc-45ab-bde9-3768f0d6705b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-6b8ce59e-1cdc-45ab-bde9-3768f0d6705b.791a2306-8ed3-40b8-bd0f-b4ac59f13fad 1G" returned: 0 in 1.118s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:43:52 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-fbeb086a-9a0d-4fed-b8d6-69a007a0773c tempest-VolumesDeleteCascade-1909219053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6b8ce59e-1cdc-45ab-bde9-3768f0d6705b -F qcow2 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-6b8ce59e-1cdc-45ab-bde9-3768f0d6705b.791a2306-8ed3-40b8-bd0f-b4ac59f13fad {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:43:52 devstack sudo[100478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6b8ce59e-1cdc-45ab-bde9-3768f0d6705b -F qcow2 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-6b8ce59e-1cdc-45ab-bde9-3768f0d6705b.791a2306-8ed3-40b8-bd0f-b4ac59f13fad Jun 17 04:43:52 devstack sudo[100478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:43:52 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [req-77815ea6-1527-4c28-b31c-ff0ee4b436a3 req-52d059ea-122f-4d51-a514-db78305f4e90 tempest-AttachVolumeTestJSON-189381823 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 04:43:53 devstack sudo[100478]: pam_unix(sudo:session): session closed for user root Jun 17 04:43:53 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-fbeb086a-9a0d-4fed-b8d6-69a007a0773c tempest-VolumesDeleteCascade-1909219053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6b8ce59e-1cdc-45ab-bde9-3768f0d6705b -F qcow2 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-6b8ce59e-1cdc-45ab-bde9-3768f0d6705b.791a2306-8ed3-40b8-bd0f-b4ac59f13fad" returned: 0 in 0.754s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:43:53 devstack cinder-volume[92060]: WARNING cinder.volume.drivers.remotefs [None req-fbeb086a-9a0d-4fed-b8d6-69a007a0773c tempest-VolumesDeleteCascade-1909219053 None] /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-6b8ce59e-1cdc-45ab-bde9-3768f0d6705b.791a2306-8ed3-40b8-bd0f-b4ac59f13fad is being set with open permissions: ugo+rw Jun 17 04:43:53 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-fbeb086a-9a0d-4fed-b8d6-69a007a0773c tempest-VolumesDeleteCascade-1909219053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-6b8ce59e-1cdc-45ab-bde9-3768f0d6705b.791a2306-8ed3-40b8-bd0f-b4ac59f13fad {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:43:53 devstack sudo[100484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-6b8ce59e-1cdc-45ab-bde9-3768f0d6705b.791a2306-8ed3-40b8-bd0f-b4ac59f13fad Jun 17 04:43:53 devstack sudo[100484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:43:53 devstack cinder-volume[92060]: DEBUG cinder.volume.flows.manager.create_volume [None req-b06bbe2d-ed52-403e-80df-f3a1648daf94 tempest-VolumesSnapshotTestJSON-1039322322 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92060) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 17 04:43:53 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-b06bbe2d-ed52-403e-80df-f3a1648daf94 tempest-VolumesSnapshotTestJSON-1039322322 None] Flow 'volume_create_manager' (c31dabe0-cde1-40d2-83f6-c1fff2de1469) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 17 04:43:53 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-b06bbe2d-ed52-403e-80df-f3a1648daf94 tempest-VolumesSnapshotTestJSON-1039322322 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2600cf09-c840-4922-9163-f6dd371109ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:43:53 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-b06bbe2d-ed52-403e-80df-f3a1648daf94 tempest-VolumesSnapshotTestJSON-1039322322 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2600cf09-c840-4922-9163-f6dd371109ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-17T02:43:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1941573577',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b3e29595-6f25-48ae-806c-92f769e46722,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='411c6111710645bfa3f034c46596cbaf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T02:43:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T02:43:54Z,use_quota=True,user_id='84f516bc01824ccfaaea6fa73a4f20b1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aad9ce24-93f9-41a6-baa1-5125964f96d1),volume_type_id=aad9ce24-93f9-41a6-baa1-5125964f96d1)' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:43:53 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-b06bbe2d-ed52-403e-80df-f3a1648daf94 tempest-VolumesSnapshotTestJSON-1039322322 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5271feb2-f79e-4aa6-bcf4-e3adc50755de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:43:53 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-b06bbe2d-ed52-403e-80df-f3a1648daf94 tempest-VolumesSnapshotTestJSON-1039322322 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5271feb2-f79e-4aa6-bcf4-e3adc50755de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:43:53 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-b06bbe2d-ed52-403e-80df-f3a1648daf94 tempest-VolumesSnapshotTestJSON-1039322322 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eea2608d-825f-4920-ad16-3120c9a60b87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:43:53 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-b06bbe2d-ed52-403e-80df-f3a1648daf94 tempest-VolumesSnapshotTestJSON-1039322322 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eea2608d-825f-4920-ad16-3120c9a60b87) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b3e29595-6f25-48ae-806c-92f769e46722', 'volume_name': 'volume-b3e29595-6f25-48ae-806c-92f769e46722', 'volume_size': 1}' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:43:53 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-b06bbe2d-ed52-403e-80df-f3a1648daf94 tempest-VolumesSnapshotTestJSON-1039322322 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2e3b5fdd-6be2-44b2-bb93-748b4ae1b62c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:43:53 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-b06bbe2d-ed52-403e-80df-f3a1648daf94 tempest-VolumesSnapshotTestJSON-1039322322 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2e3b5fdd-6be2-44b2-bb93-748b4ae1b62c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:43:53 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-b06bbe2d-ed52-403e-80df-f3a1648daf94 tempest-VolumesSnapshotTestJSON-1039322322 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a32ef2cc-54a6-473f-a675-b129ecf81a9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:43:53 devstack cinder-volume[92060]: INFO cinder.volume.flows.manager.create_volume [None req-b06bbe2d-ed52-403e-80df-f3a1648daf94 tempest-VolumesSnapshotTestJSON-1039322322 None] Volume b3e29595-6f25-48ae-806c-92f769e46722: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b3e29595-6f25-48ae-806c-92f769e46722', 'volume_size': 1} Jun 17 04:43:53 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-b06bbe2d-ed52-403e-80df-f3a1648daf94 tempest-VolumesSnapshotTestJSON-1039322322 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 04:43:53 devstack sudo[100484]: pam_unix(sudo:session): session closed for user root Jun 17 04:43:53 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-fbeb086a-9a0d-4fed-b8d6-69a007a0773c tempest-VolumesDeleteCascade-1909219053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-6b8ce59e-1cdc-45ab-bde9-3768f0d6705b.791a2306-8ed3-40b8-bd0f-b4ac59f13fad" returned: 0 in 0.603s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:43:53 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-fbeb086a-9a0d-4fed-b8d6-69a007a0773c tempest-VolumesDeleteCascade-1909219053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-6b8ce59e-1cdc-45ab-bde9-3768f0d6705b.info {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:43:53 devstack sudo[100488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-6b8ce59e-1cdc-45ab-bde9-3768f0d6705b.info Jun 17 04:43:53 devstack sudo[100488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:43:54 devstack cinder-volume[92060]: DEBUG cinder.volume.flows.manager.create_volume [None req-c73eaff3-ff60-4208-b0de-9c8df55018ad tempest-VolumesNegativeTest-1419416898 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92060) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 17 04:43:54 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-c73eaff3-ff60-4208-b0de-9c8df55018ad tempest-VolumesNegativeTest-1419416898 None] Flow 'volume_create_manager' (0fd6a6ca-22bf-47ca-9a58-a016b62e30da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 17 04:43:54 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-c73eaff3-ff60-4208-b0de-9c8df55018ad tempest-VolumesNegativeTest-1419416898 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (92a387e9-6a9e-4d9f-881e-d198a827b3b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:43:54 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-c73eaff3-ff60-4208-b0de-9c8df55018ad tempest-VolumesNegativeTest-1419416898 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (92a387e9-6a9e-4d9f-881e-d198a827b3b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-17T02:43:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-611281320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6144d3a5-4717-43dc-b912-a9aac1276a73,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='43616c7791c84fe68710302d606bcbd2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T02:43:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T02:43:54Z,use_quota=True,user_id='e010cebd39bf4cfcae0450f7510fdeb3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aad9ce24-93f9-41a6-baa1-5125964f96d1),volume_type_id=aad9ce24-93f9-41a6-baa1-5125964f96d1)' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:43:54 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-c73eaff3-ff60-4208-b0de-9c8df55018ad tempest-VolumesNegativeTest-1419416898 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f1900112-0ac0-480f-ac9f-159036771b8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:43:54 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-c73eaff3-ff60-4208-b0de-9c8df55018ad tempest-VolumesNegativeTest-1419416898 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f1900112-0ac0-480f-ac9f-159036771b8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:43:54 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-c73eaff3-ff60-4208-b0de-9c8df55018ad tempest-VolumesNegativeTest-1419416898 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bc53cf23-4622-4bdb-a621-a482412943dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:43:54 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-c73eaff3-ff60-4208-b0de-9c8df55018ad tempest-VolumesNegativeTest-1419416898 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bc53cf23-4622-4bdb-a621-a482412943dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6144d3a5-4717-43dc-b912-a9aac1276a73', 'volume_name': 'volume-6144d3a5-4717-43dc-b912-a9aac1276a73', 'volume_size': 1}' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:43:54 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-c73eaff3-ff60-4208-b0de-9c8df55018ad tempest-VolumesNegativeTest-1419416898 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a94a89b9-4610-412e-80a3-fe2ffc0970d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:43:54 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-c73eaff3-ff60-4208-b0de-9c8df55018ad tempest-VolumesNegativeTest-1419416898 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a94a89b9-4610-412e-80a3-fe2ffc0970d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:43:54 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-c73eaff3-ff60-4208-b0de-9c8df55018ad tempest-VolumesNegativeTest-1419416898 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f9a9232a-6205-4fbc-945d-87d54fc4af26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:43:54 devstack cinder-volume[92060]: INFO cinder.volume.flows.manager.create_volume [None req-c73eaff3-ff60-4208-b0de-9c8df55018ad tempest-VolumesNegativeTest-1419416898 None] Volume 6144d3a5-4717-43dc-b912-a9aac1276a73: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6144d3a5-4717-43dc-b912-a9aac1276a73', 'volume_size': 1} Jun 17 04:43:54 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-c73eaff3-ff60-4208-b0de-9c8df55018ad tempest-VolumesNegativeTest-1419416898 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 04:43:54 devstack sudo[100488]: pam_unix(sudo:session): session closed for user root Jun 17 04:43:54 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-fbeb086a-9a0d-4fed-b8d6-69a007a0773c tempest-VolumesDeleteCascade-1909219053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-6b8ce59e-1cdc-45ab-bde9-3768f0d6705b.info" returned: 0 in 0.581s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:43:54 devstack cinder-volume[92060]: WARNING cinder.volume.drivers.remotefs [None req-fbeb086a-9a0d-4fed-b8d6-69a007a0773c tempest-VolumesDeleteCascade-1909219053 None] /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-6b8ce59e-1cdc-45ab-bde9-3768f0d6705b.info is being set with open permissions: ugo+rw Jun 17 04:43:54 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-fbeb086a-9a0d-4fed-b8d6-69a007a0773c tempest-VolumesDeleteCascade-1909219053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-6b8ce59e-1cdc-45ab-bde9-3768f0d6705b.info {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:43:54 devstack sudo[100491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-6b8ce59e-1cdc-45ab-bde9-3768f0d6705b.info Jun 17 04:43:54 devstack sudo[100491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:43:54 devstack sudo[100491]: pam_unix(sudo:session): session closed for user root Jun 17 04:43:54 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-fbeb086a-9a0d-4fed-b8d6-69a007a0773c tempest-VolumesDeleteCascade-1909219053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-6b8ce59e-1cdc-45ab-bde9-3768f0d6705b.info" returned: 0 in 0.595s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:43:55 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-fbeb086a-9a0d-4fed-b8d6-69a007a0773c tempest-VolumesDeleteCascade-1909219053 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.668s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 04:43:55 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [req-77815ea6-1527-4c28-b31c-ff0ee4b436a3 req-52d059ea-122f-4d51-a514-db78305f4e90 tempest-AttachVolumeTestJSON-189381823 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 2.461s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 04:43:55 devstack cinder-volume[92060]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd5d03f8-ab73-4653-a00f-f0c00b5e84e4]: (4, 'qcow2') {{(pid=93130) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 04:43:55 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [req-77815ea6-1527-4c28-b31c-ff0ee4b436a3 req-52d059ea-122f-4d51-a514-db78305f4e90 tempest-AttachVolumeTestJSON-189381823 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-a85c206e-c58d-4cc4-8d97-614030f30f77 {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:43:55 devstack cinder-volume[92060]: INFO cinder.volume.manager [None req-fbeb086a-9a0d-4fed-b8d6-69a007a0773c tempest-VolumesDeleteCascade-1909219053 None] Create snapshot completed successfully Jun 17 04:43:55 devstack sudo[100494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-a85c206e-c58d-4cc4-8d97-614030f30f77 Jun 17 04:43:55 devstack sudo[100494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:43:55 devstack sudo[100494]: pam_unix(sudo:session): session closed for user root Jun 17 04:43:55 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [req-77815ea6-1527-4c28-b31c-ff0ee4b436a3 req-52d059ea-122f-4d51-a514-db78305f4e90 tempest-AttachVolumeTestJSON-189381823 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-a85c206e-c58d-4cc4-8d97-614030f30f77" returned: 0 in 0.697s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:43:55 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [req-77815ea6-1527-4c28-b31c-ff0ee4b436a3 req-52d059ea-122f-4d51-a514-db78305f4e90 tempest-AttachVolumeTestJSON-189381823 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.722s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 04:43:55 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-b06bbe2d-ed52-403e-80df-f3a1648daf94 tempest-VolumesSnapshotTestJSON-1039322322 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.041s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 04:43:55 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-b06bbe2d-ed52-403e-80df-f3a1648daf94 tempest-VolumesSnapshotTestJSON-1039322322 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-17T02:43:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1941573577',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b3e29595-6f25-48ae-806c-92f769e46722,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='411c6111710645bfa3f034c46596cbaf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T02:43:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T02:43:54Z,use_quota=True,user_id='84f516bc01824ccfaaea6fa73a4f20b1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aad9ce24-93f9-41a6-baa1-5125964f96d1),volume_type_id=aad9ce24-93f9-41a6-baa1-5125964f96d1)}" {{(pid=92060) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 17 04:43:55 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.remotefs [None req-b06bbe2d-ed52-403e-80df-f3a1648daf94 tempest-VolumesSnapshotTestJSON-1039322322 None] Creating volume b3e29595-6f25-48ae-806c-92f769e46722 {{(pid=92060) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 17 04:43:55 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-b06bbe2d-ed52-403e-80df-f3a1648daf94 tempest-VolumesSnapshotTestJSON-1039322322 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 04:43:55 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-b06bbe2d-ed52-403e-80df-f3a1648daf94 tempest-VolumesSnapshotTestJSON-1039322322 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 04:43:55 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-b06bbe2d-ed52-403e-80df-f3a1648daf94 tempest-VolumesSnapshotTestJSON-1039322322 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588': None} {{(pid=92060) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 17 04:43:55 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-b06bbe2d-ed52-403e-80df-f3a1648daf94 tempest-VolumesSnapshotTestJSON-1039322322 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588'] {{(pid=92060) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 17 04:43:55 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-b06bbe2d-ed52-403e-80df-f3a1648daf94 tempest-VolumesSnapshotTestJSON-1039322322 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 04:43:55 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-b06bbe2d-ed52-403e-80df-f3a1648daf94 tempest-VolumesSnapshotTestJSON-1039322322 None] Selected osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588 as target Quobyte volume. {{(pid=92060) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 17 04:43:55 devstack cinder-volume[92060]: INFO cinder.volume.drivers.remotefs [None req-b06bbe2d-ed52-403e-80df-f3a1648daf94 tempest-VolumesSnapshotTestJSON-1039322322 None] casted to osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588 Jun 17 04:43:55 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-b06bbe2d-ed52-403e-80df-f3a1648daf94 tempest-VolumesSnapshotTestJSON-1039322322 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-b3e29595-6f25-48ae-806c-92f769e46722 1073741824 {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:43:55 devstack sudo[100499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-b3e29595-6f25-48ae-806c-92f769e46722 1073741824 Jun 17 04:43:55 devstack sudo[100499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:43:55 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [req-77815ea6-1527-4c28-b31c-ff0ee4b436a3 req-52d059ea-122f-4d51-a514-db78305f4e90 tempest-AttachVolumeTestJSON-189381823 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588', 'name': 'volume-a85c206e-c58d-4cc4-8d97-614030f30f77', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'e2ea77fc-4eeb-4faa-8c16-26e124c71fa7', 'enforce_multipath': True} {{(pid=92060) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 17 04:43:55 devstack cinder-volume[92060]: INFO cinder.volume.manager [req-77815ea6-1527-4c28-b31c-ff0ee4b436a3 req-52d059ea-122f-4d51-a514-db78305f4e90 tempest-AttachVolumeTestJSON-189381823 None] attachment_update completed successfully. Jun 17 04:43:56 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-5909e435-2916-4d8a-901c-d786b2593d25 tempest-VolumesDeleteCascade-1909219053 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 04:43:56 devstack sudo[100499]: pam_unix(sudo:session): session closed for user root Jun 17 04:43:56 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-b06bbe2d-ed52-403e-80df-f3a1648daf94 tempest-VolumesSnapshotTestJSON-1039322322 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-b3e29595-6f25-48ae-806c-92f769e46722 1073741824" returned: 0 in 0.824s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:43:56 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-b06bbe2d-ed52-403e-80df-f3a1648daf94 tempest-VolumesSnapshotTestJSON-1039322322 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-b3e29595-6f25-48ae-806c-92f769e46722 {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:43:56 devstack sudo[100572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-b3e29595-6f25-48ae-806c-92f769e46722 Jun 17 04:43:56 devstack sudo[100572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:43:57 devstack sudo[100572]: pam_unix(sudo:session): session closed for user root Jun 17 04:43:57 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-b06bbe2d-ed52-403e-80df-f3a1648daf94 tempest-VolumesSnapshotTestJSON-1039322322 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-b3e29595-6f25-48ae-806c-92f769e46722" returned: 0 in 0.579s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:43:57 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-b06bbe2d-ed52-403e-80df-f3a1648daf94 tempest-VolumesSnapshotTestJSON-1039322322 None] <== create_volume: return (1436ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588'} {{(pid=92060) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 17 04:43:57 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-b06bbe2d-ed52-403e-80df-f3a1648daf94 tempest-VolumesSnapshotTestJSON-1039322322 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.439s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 04:43:57 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-c73eaff3-ff60-4208-b0de-9c8df55018ad tempest-VolumesNegativeTest-1419416898 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.980s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 04:43:57 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-c73eaff3-ff60-4208-b0de-9c8df55018ad tempest-VolumesNegativeTest-1419416898 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-17T02:43:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-611281320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6144d3a5-4717-43dc-b912-a9aac1276a73,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='43616c7791c84fe68710302d606bcbd2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T02:43:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T02:43:54Z,use_quota=True,user_id='e010cebd39bf4cfcae0450f7510fdeb3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aad9ce24-93f9-41a6-baa1-5125964f96d1),volume_type_id=aad9ce24-93f9-41a6-baa1-5125964f96d1)}" {{(pid=92060) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 17 04:43:57 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.remotefs [None req-c73eaff3-ff60-4208-b0de-9c8df55018ad tempest-VolumesNegativeTest-1419416898 None] Creating volume 6144d3a5-4717-43dc-b912-a9aac1276a73 {{(pid=92060) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 17 04:43:57 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-c73eaff3-ff60-4208-b0de-9c8df55018ad tempest-VolumesNegativeTest-1419416898 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 04:43:57 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-c73eaff3-ff60-4208-b0de-9c8df55018ad tempest-VolumesNegativeTest-1419416898 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 04:43:57 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-c73eaff3-ff60-4208-b0de-9c8df55018ad tempest-VolumesNegativeTest-1419416898 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588': None} {{(pid=92060) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 17 04:43:57 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-c73eaff3-ff60-4208-b0de-9c8df55018ad tempest-VolumesNegativeTest-1419416898 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588'] {{(pid=92060) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 17 04:43:57 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-c73eaff3-ff60-4208-b0de-9c8df55018ad tempest-VolumesNegativeTest-1419416898 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 04:43:57 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-c73eaff3-ff60-4208-b0de-9c8df55018ad tempest-VolumesNegativeTest-1419416898 None] Selected osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588 as target Quobyte volume. {{(pid=92060) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 17 04:43:57 devstack cinder-volume[92060]: INFO cinder.volume.drivers.remotefs [None req-c73eaff3-ff60-4208-b0de-9c8df55018ad tempest-VolumesNegativeTest-1419416898 None] casted to osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588 Jun 17 04:43:57 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-c73eaff3-ff60-4208-b0de-9c8df55018ad tempest-VolumesNegativeTest-1419416898 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-6144d3a5-4717-43dc-b912-a9aac1276a73 1073741824 {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:43:57 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-b06bbe2d-ed52-403e-80df-f3a1648daf94 tempest-VolumesSnapshotTestJSON-1039322322 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a32ef2cc-54a6-473f-a675-b129ecf81a9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b3e29595-6f25-48ae-806c-92f769e46722', 'volume_size': 1}' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:43:57 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-b06bbe2d-ed52-403e-80df-f3a1648daf94 tempest-VolumesSnapshotTestJSON-1039322322 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (81ae04ee-6df2-4693-819f-a2fe25036ab9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:43:57 devstack sudo[100891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-6144d3a5-4717-43dc-b912-a9aac1276a73 1073741824 Jun 17 04:43:57 devstack sudo[100891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:43:57 devstack cinder-volume[92060]: INFO cinder.volume.flows.manager.create_volume [None req-b06bbe2d-ed52-403e-80df-f3a1648daf94 tempest-VolumesSnapshotTestJSON-1039322322 None] Volume volume-b3e29595-6f25-48ae-806c-92f769e46722 (b3e29595-6f25-48ae-806c-92f769e46722): created successfully Jun 17 04:43:57 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-b06bbe2d-ed52-403e-80df-f3a1648daf94 tempest-VolumesSnapshotTestJSON-1039322322 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (81ae04ee-6df2-4693-819f-a2fe25036ab9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:43:57 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-b06bbe2d-ed52-403e-80df-f3a1648daf94 tempest-VolumesSnapshotTestJSON-1039322322 None] Flow 'volume_create_manager' (c31dabe0-cde1-40d2-83f6-c1fff2de1469) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92060) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 17 04:43:57 devstack cinder-volume[92060]: INFO cinder.volume.manager [None req-b06bbe2d-ed52-403e-80df-f3a1648daf94 tempest-VolumesSnapshotTestJSON-1039322322 None] Created volume successfully. Jun 17 04:43:57 devstack sudo[100891]: pam_unix(sudo:session): session closed for user root Jun 17 04:43:57 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-c73eaff3-ff60-4208-b0de-9c8df55018ad tempest-VolumesNegativeTest-1419416898 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-6144d3a5-4717-43dc-b912-a9aac1276a73 1073741824" returned: 0 in 0.795s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:43:58 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-c73eaff3-ff60-4208-b0de-9c8df55018ad tempest-VolumesNegativeTest-1419416898 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-6144d3a5-4717-43dc-b912-a9aac1276a73 {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:43:58 devstack sudo[100896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-6144d3a5-4717-43dc-b912-a9aac1276a73 Jun 17 04:43:58 devstack sudo[100896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:43:58 devstack sudo[100896]: pam_unix(sudo:session): session closed for user root Jun 17 04:43:58 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-c73eaff3-ff60-4208-b0de-9c8df55018ad tempest-VolumesNegativeTest-1419416898 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-6144d3a5-4717-43dc-b912-a9aac1276a73" returned: 0 in 0.599s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:43:58 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-c73eaff3-ff60-4208-b0de-9c8df55018ad tempest-VolumesNegativeTest-1419416898 None] <== create_volume: return (1427ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588'} {{(pid=92060) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 17 04:43:58 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-c73eaff3-ff60-4208-b0de-9c8df55018ad tempest-VolumesNegativeTest-1419416898 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.430s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 04:43:58 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-5909e435-2916-4d8a-901c-d786b2593d25 tempest-VolumesDeleteCascade-1909219053 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.248s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 04:43:58 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-918dbec4-f5e9-40dd-b8bd-29acd3371f20 tempest-VolumesSnapshotTestJSON-1039322322 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 04:43:58 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-c73eaff3-ff60-4208-b0de-9c8df55018ad tempest-VolumesNegativeTest-1419416898 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f9a9232a-6205-4fbc-945d-87d54fc4af26) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6144d3a5-4717-43dc-b912-a9aac1276a73', 'volume_size': 1}' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:43:58 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-c73eaff3-ff60-4208-b0de-9c8df55018ad tempest-VolumesNegativeTest-1419416898 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8399726c-54e3-4b10-9b2a-ec67e91d18dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:43:58 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.remotefs [None req-5909e435-2916-4d8a-901c-d786b2593d25 tempest-VolumesDeleteCascade-1909219053 None] Creating offline snapshot 309004ac-fea5-4f3f-965c-0e6c80906d73 of volume 6b8ce59e-1cdc-45ab-bde9-3768f0d6705b {{(pid=92060) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 17 04:43:58 devstack cinder-volume[92060]: INFO cinder.volume.flows.manager.create_volume [None req-c73eaff3-ff60-4208-b0de-9c8df55018ad tempest-VolumesNegativeTest-1419416898 None] Volume volume-6144d3a5-4717-43dc-b912-a9aac1276a73 (6144d3a5-4717-43dc-b912-a9aac1276a73): created successfully Jun 17 04:43:58 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-c73eaff3-ff60-4208-b0de-9c8df55018ad tempest-VolumesNegativeTest-1419416898 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8399726c-54e3-4b10-9b2a-ec67e91d18dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:43:58 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-c73eaff3-ff60-4208-b0de-9c8df55018ad tempest-VolumesNegativeTest-1419416898 None] Flow 'volume_create_manager' (0fd6a6ca-22bf-47ca-9a58-a016b62e30da) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92060) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 17 04:43:58 devstack cinder-volume[92060]: DEBUG oslo.privsep.daemon [-] privsep: reply[70e607bc-fe48-409b-9265-e7cb86e88f8a]: (4, 'qcow2') {{(pid=93130) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 04:43:58 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-5909e435-2916-4d8a-901c-d786b2593d25 tempest-VolumesDeleteCascade-1909219053 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-6b8ce59e-1cdc-45ab-bde9-3768f0d6705b.791a2306-8ed3-40b8-bd0f-b4ac59f13fad {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:43:58 devstack cinder-volume[92060]: INFO cinder.volume.manager [None req-c73eaff3-ff60-4208-b0de-9c8df55018ad tempest-VolumesNegativeTest-1419416898 None] Created volume successfully. Jun 17 04:43:58 devstack sudo[100899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-6b8ce59e-1cdc-45ab-bde9-3768f0d6705b.791a2306-8ed3-40b8-bd0f-b4ac59f13fad Jun 17 04:43:58 devstack sudo[100899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:43:59 devstack sudo[100899]: pam_unix(sudo:session): session closed for user root Jun 17 04:43:59 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-5909e435-2916-4d8a-901c-d786b2593d25 tempest-VolumesDeleteCascade-1909219053 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-6b8ce59e-1cdc-45ab-bde9-3768f0d6705b.791a2306-8ed3-40b8-bd0f-b4ac59f13fad" returned: 0 in 0.698s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:43:59 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.remotefs [None req-5909e435-2916-4d8a-901c-d786b2593d25 tempest-VolumesDeleteCascade-1909219053 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6b8ce59e-1cdc-45ab-bde9-3768f0d6705b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=92060) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 17 04:43:59 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-5909e435-2916-4d8a-901c-d786b2593d25 tempest-VolumesDeleteCascade-1909219053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-6b8ce59e-1cdc-45ab-bde9-3768f0d6705b.791a2306-8ed3-40b8-bd0f-b4ac59f13fad,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-6b8ce59e-1cdc-45ab-bde9-3768f0d6705b.309004ac-fea5-4f3f-965c-0e6c80906d73 1G {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:43:59 devstack sudo[100904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-6b8ce59e-1cdc-45ab-bde9-3768f0d6705b.791a2306-8ed3-40b8-bd0f-b4ac59f13fad,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-6b8ce59e-1cdc-45ab-bde9-3768f0d6705b.309004ac-fea5-4f3f-965c-0e6c80906d73 1G Jun 17 04:43:59 devstack sudo[100904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:44:00 devstack sudo[100904]: pam_unix(sudo:session): session closed for user root Jun 17 04:44:00 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-5909e435-2916-4d8a-901c-d786b2593d25 tempest-VolumesDeleteCascade-1909219053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-6b8ce59e-1cdc-45ab-bde9-3768f0d6705b.791a2306-8ed3-40b8-bd0f-b4ac59f13fad,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-6b8ce59e-1cdc-45ab-bde9-3768f0d6705b.309004ac-fea5-4f3f-965c-0e6c80906d73 1G" returned: 0 in 0.862s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:44:00 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-5909e435-2916-4d8a-901c-d786b2593d25 tempest-VolumesDeleteCascade-1909219053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6b8ce59e-1cdc-45ab-bde9-3768f0d6705b.791a2306-8ed3-40b8-bd0f-b4ac59f13fad -F qcow2 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-6b8ce59e-1cdc-45ab-bde9-3768f0d6705b.309004ac-fea5-4f3f-965c-0e6c80906d73 {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:44:00 devstack sudo[100912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6b8ce59e-1cdc-45ab-bde9-3768f0d6705b.791a2306-8ed3-40b8-bd0f-b4ac59f13fad -F qcow2 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-6b8ce59e-1cdc-45ab-bde9-3768f0d6705b.309004ac-fea5-4f3f-965c-0e6c80906d73 Jun 17 04:44:00 devstack sudo[100912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:44:00 devstack cinder-volume[92060]: DEBUG cinder.volume.flows.manager.create_volume [None req-67147db8-f9eb-4d15-bbcc-d513ada1294f tempest-AttachVolumeTestJSON-189381823 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92060) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 17 04:44:00 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-67147db8-f9eb-4d15-bbcc-d513ada1294f tempest-AttachVolumeTestJSON-189381823 None] Flow 'volume_create_manager' (9d2a70a6-cf74-458a-a6a6-f7439457a043) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 17 04:44:00 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-67147db8-f9eb-4d15-bbcc-d513ada1294f tempest-AttachVolumeTestJSON-189381823 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a365fabc-2bad-4913-b887-bfaa36ee0dde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:44:00 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-67147db8-f9eb-4d15-bbcc-d513ada1294f tempest-AttachVolumeTestJSON-189381823 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a365fabc-2bad-4913-b887-bfaa36ee0dde) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-17T02:44:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1448797042',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b92c4149-011c-4b5a-82da-0d49240470fc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9cb0f3e8aabc47e582b3e9924538b792',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T02:44:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T02:44:01Z,use_quota=True,user_id='f25a55d2802e4cf4b442a23df3eb34cc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aad9ce24-93f9-41a6-baa1-5125964f96d1),volume_type_id=aad9ce24-93f9-41a6-baa1-5125964f96d1)' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:44:00 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-67147db8-f9eb-4d15-bbcc-d513ada1294f tempest-AttachVolumeTestJSON-189381823 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (57492792-f595-4ec9-9473-3de1b556bedf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:44:00 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-67147db8-f9eb-4d15-bbcc-d513ada1294f tempest-AttachVolumeTestJSON-189381823 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (57492792-f595-4ec9-9473-3de1b556bedf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:44:00 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-67147db8-f9eb-4d15-bbcc-d513ada1294f tempest-AttachVolumeTestJSON-189381823 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7ed2079e-b1a9-4280-a88a-504e1782db54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:44:00 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-67147db8-f9eb-4d15-bbcc-d513ada1294f tempest-AttachVolumeTestJSON-189381823 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7ed2079e-b1a9-4280-a88a-504e1782db54) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b92c4149-011c-4b5a-82da-0d49240470fc', 'volume_name': 'volume-b92c4149-011c-4b5a-82da-0d49240470fc', 'volume_size': 1}' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:44:00 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-67147db8-f9eb-4d15-bbcc-d513ada1294f tempest-AttachVolumeTestJSON-189381823 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (738c4841-42ef-439b-bb45-c64d9c1d2410) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:44:00 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-67147db8-f9eb-4d15-bbcc-d513ada1294f tempest-AttachVolumeTestJSON-189381823 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (738c4841-42ef-439b-bb45-c64d9c1d2410) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:44:00 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-67147db8-f9eb-4d15-bbcc-d513ada1294f tempest-AttachVolumeTestJSON-189381823 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e9b2cb0f-83a9-402f-9623-4646fe2c086a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:44:00 devstack cinder-volume[92060]: INFO cinder.volume.flows.manager.create_volume [None req-67147db8-f9eb-4d15-bbcc-d513ada1294f tempest-AttachVolumeTestJSON-189381823 None] Volume b92c4149-011c-4b5a-82da-0d49240470fc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b92c4149-011c-4b5a-82da-0d49240470fc', 'volume_size': 1} Jun 17 04:44:00 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-67147db8-f9eb-4d15-bbcc-d513ada1294f tempest-AttachVolumeTestJSON-189381823 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 04:44:00 devstack sudo[100912]: pam_unix(sudo:session): session closed for user root Jun 17 04:44:00 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-5909e435-2916-4d8a-901c-d786b2593d25 tempest-VolumesDeleteCascade-1909219053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6b8ce59e-1cdc-45ab-bde9-3768f0d6705b.791a2306-8ed3-40b8-bd0f-b4ac59f13fad -F qcow2 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-6b8ce59e-1cdc-45ab-bde9-3768f0d6705b.309004ac-fea5-4f3f-965c-0e6c80906d73" returned: 0 in 0.712s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:44:00 devstack cinder-volume[92060]: WARNING cinder.volume.drivers.remotefs [None req-5909e435-2916-4d8a-901c-d786b2593d25 tempest-VolumesDeleteCascade-1909219053 None] /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-6b8ce59e-1cdc-45ab-bde9-3768f0d6705b.309004ac-fea5-4f3f-965c-0e6c80906d73 is being set with open permissions: ugo+rw Jun 17 04:44:00 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-5909e435-2916-4d8a-901c-d786b2593d25 tempest-VolumesDeleteCascade-1909219053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-6b8ce59e-1cdc-45ab-bde9-3768f0d6705b.309004ac-fea5-4f3f-965c-0e6c80906d73 {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:44:01 devstack sudo[100918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-6b8ce59e-1cdc-45ab-bde9-3768f0d6705b.309004ac-fea5-4f3f-965c-0e6c80906d73 Jun 17 04:44:01 devstack sudo[100918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:44:01 devstack sudo[100918]: pam_unix(sudo:session): session closed for user root Jun 17 04:44:01 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-5909e435-2916-4d8a-901c-d786b2593d25 tempest-VolumesDeleteCascade-1909219053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-6b8ce59e-1cdc-45ab-bde9-3768f0d6705b.309004ac-fea5-4f3f-965c-0e6c80906d73" returned: 0 in 0.598s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:44:01 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-5909e435-2916-4d8a-901c-d786b2593d25 tempest-VolumesDeleteCascade-1909219053 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.988s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 04:44:01 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-918dbec4-f5e9-40dd-b8bd-29acd3371f20 tempest-VolumesSnapshotTestJSON-1039322322 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.984s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 04:44:01 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.remotefs [None req-918dbec4-f5e9-40dd-b8bd-29acd3371f20 tempest-VolumesSnapshotTestJSON-1039322322 None] Creating offline snapshot aea3c8da-9374-43ef-9070-c96e6e82f7fd of volume b3e29595-6f25-48ae-806c-92f769e46722 {{(pid=92060) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 17 04:44:01 devstack cinder-volume[92060]: INFO cinder.volume.manager [None req-5909e435-2916-4d8a-901c-d786b2593d25 tempest-VolumesDeleteCascade-1909219053 None] Create snapshot completed successfully Jun 17 04:44:01 devstack cinder-volume[92060]: DEBUG oslo.privsep.daemon [-] privsep: reply[40445a55-ea0a-442d-9e0b-54436f62a7f5]: (4, 'qcow2') {{(pid=93130) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 04:44:01 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-918dbec4-f5e9-40dd-b8bd-29acd3371f20 tempest-VolumesSnapshotTestJSON-1039322322 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-b3e29595-6f25-48ae-806c-92f769e46722 {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:44:01 devstack sudo[100921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-b3e29595-6f25-48ae-806c-92f769e46722 Jun 17 04:44:01 devstack sudo[100921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:44:02 devstack sudo[100921]: pam_unix(sudo:session): session closed for user root Jun 17 04:44:02 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-918dbec4-f5e9-40dd-b8bd-29acd3371f20 tempest-VolumesSnapshotTestJSON-1039322322 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-b3e29595-6f25-48ae-806c-92f769e46722" returned: 0 in 0.751s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:44:02 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-918dbec4-f5e9-40dd-b8bd-29acd3371f20 tempest-VolumesSnapshotTestJSON-1039322322 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-b3e29595-6f25-48ae-806c-92f769e46722,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-b3e29595-6f25-48ae-806c-92f769e46722.aea3c8da-9374-43ef-9070-c96e6e82f7fd 1G {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:44:02 devstack sudo[100926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-b3e29595-6f25-48ae-806c-92f769e46722,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-b3e29595-6f25-48ae-806c-92f769e46722.aea3c8da-9374-43ef-9070-c96e6e82f7fd 1G Jun 17 04:44:02 devstack sudo[100926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:44:02 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-e9f755d5-78d4-43bf-823b-985ae0a994c4 tempest-VolumesDeleteCascade-1909219053 None] Acquiring lock "cinder-6b8ce59e-1cdc-45ab-bde9-3768f0d6705b-delete_volume" by "delete_volume" {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 04:44:02 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-e9f755d5-78d4-43bf-823b-985ae0a994c4 tempest-VolumesDeleteCascade-1909219053 None] Lock "cinder-6b8ce59e-1cdc-45ab-bde9-3768f0d6705b-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 04:44:02 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-e9f755d5-78d4-43bf-823b-985ae0a994c4 tempest-VolumesDeleteCascade-1909219053 None] Performing cascade delete. {{(pid=92060) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Jun 17 04:44:02 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-e9f755d5-78d4-43bf-823b-985ae0a994c4 tempest-VolumesDeleteCascade-1909219053 None] Acquiring lock "cinder-309004ac-fea5-4f3f-965c-0e6c80906d73-delete_snapshot" by "delete_snapshot" {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 04:44:02 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-e9f755d5-78d4-43bf-823b-985ae0a994c4 tempest-VolumesDeleteCascade-1909219053 None] Lock "cinder-309004ac-fea5-4f3f-965c-0e6c80906d73-delete_snapshot" acquired by "delete_snapshot" :: waited 0.015s {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 04:44:02 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-e9f755d5-78d4-43bf-823b-985ae0a994c4 tempest-VolumesDeleteCascade-1909219053 None] Acquiring lock "cinder-quobyte-6b8ce59e-1cdc-45ab-bde9-3768f0d6705b" by "delete_snapshot" {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 04:44:02 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-e9f755d5-78d4-43bf-823b-985ae0a994c4 tempest-VolumesDeleteCascade-1909219053 None] Lock "cinder-quobyte-6b8ce59e-1cdc-45ab-bde9-3768f0d6705b" acquired by "delete_snapshot" :: waited 0.013s {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 04:44:02 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-e9f755d5-78d4-43bf-823b-985ae0a994c4 tempest-VolumesDeleteCascade-1909219053 None] Acquiring lock "cinder-quobyte-309004ac-fea5-4f3f-965c-0e6c80906d73" by "_delete_snapshot" {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 04:44:02 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-e9f755d5-78d4-43bf-823b-985ae0a994c4 tempest-VolumesDeleteCascade-1909219053 None] Lock "cinder-quobyte-309004ac-fea5-4f3f-965c-0e6c80906d73" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 04:44:02 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.remotefs [None req-e9f755d5-78d4-43bf-823b-985ae0a994c4 tempest-VolumesDeleteCascade-1909219053 None] Deleting offline snapshot 309004ac-fea5-4f3f-965c-0e6c80906d73 of volume 6b8ce59e-1cdc-45ab-bde9-3768f0d6705b {{(pid=92060) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 17 04:44:02 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.remotefs [None req-e9f755d5-78d4-43bf-823b-985ae0a994c4 tempest-VolumesDeleteCascade-1909219053 None] snapshot_file for this snap is: volume-6b8ce59e-1cdc-45ab-bde9-3768f0d6705b.309004ac-fea5-4f3f-965c-0e6c80906d73 {{(pid=92060) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 17 04:44:02 devstack cinder-volume[92060]: DEBUG oslo.privsep.daemon [-] privsep: reply[eba6c40d-532f-4d05-9fd1-68ed06ad83df]: (4, 'qcow2') {{(pid=93130) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 04:44:02 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-e9f755d5-78d4-43bf-823b-985ae0a994c4 tempest-VolumesDeleteCascade-1909219053 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-6b8ce59e-1cdc-45ab-bde9-3768f0d6705b.309004ac-fea5-4f3f-965c-0e6c80906d73 {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:44:02 devstack sudo[100928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-6b8ce59e-1cdc-45ab-bde9-3768f0d6705b.309004ac-fea5-4f3f-965c-0e6c80906d73 Jun 17 04:44:02 devstack sudo[100928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:44:03 devstack sudo[100926]: pam_unix(sudo:session): session closed for user root Jun 17 04:44:03 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-918dbec4-f5e9-40dd-b8bd-29acd3371f20 tempest-VolumesSnapshotTestJSON-1039322322 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-b3e29595-6f25-48ae-806c-92f769e46722,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-b3e29595-6f25-48ae-806c-92f769e46722.aea3c8da-9374-43ef-9070-c96e6e82f7fd 1G" returned: 0 in 0.778s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:44:03 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-918dbec4-f5e9-40dd-b8bd-29acd3371f20 tempest-VolumesSnapshotTestJSON-1039322322 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b3e29595-6f25-48ae-806c-92f769e46722 -F qcow2 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-b3e29595-6f25-48ae-806c-92f769e46722.aea3c8da-9374-43ef-9070-c96e6e82f7fd {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:44:03 devstack sudo[100933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b3e29595-6f25-48ae-806c-92f769e46722 -F qcow2 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-b3e29595-6f25-48ae-806c-92f769e46722.aea3c8da-9374-43ef-9070-c96e6e82f7fd Jun 17 04:44:03 devstack sudo[100933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:44:03 devstack sudo[100928]: pam_unix(sudo:session): session closed for user root Jun 17 04:44:03 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-e9f755d5-78d4-43bf-823b-985ae0a994c4 tempest-VolumesDeleteCascade-1909219053 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-6b8ce59e-1cdc-45ab-bde9-3768f0d6705b.309004ac-fea5-4f3f-965c-0e6c80906d73" returned: 0 in 0.731s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:44:03 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.remotefs [None req-e9f755d5-78d4-43bf-823b-985ae0a994c4 tempest-VolumesDeleteCascade-1909219053 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6b8ce59e-1cdc-45ab-bde9-3768f0d6705b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=92060) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 17 04:44:03 devstack cinder-volume[92060]: DEBUG oslo.privsep.daemon [-] privsep: reply[3815d998-cf4b-4b2c-8277-92f45db23bde]: (4, 'qcow2') {{(pid=93130) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 04:44:03 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-e9f755d5-78d4-43bf-823b-985ae0a994c4 tempest-VolumesDeleteCascade-1909219053 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-6b8ce59e-1cdc-45ab-bde9-3768f0d6705b.791a2306-8ed3-40b8-bd0f-b4ac59f13fad {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:44:03 devstack sudo[100938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-6b8ce59e-1cdc-45ab-bde9-3768f0d6705b.791a2306-8ed3-40b8-bd0f-b4ac59f13fad Jun 17 04:44:03 devstack sudo[100938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:44:03 devstack sudo[100933]: pam_unix(sudo:session): session closed for user root Jun 17 04:44:03 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-918dbec4-f5e9-40dd-b8bd-29acd3371f20 tempest-VolumesSnapshotTestJSON-1039322322 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b3e29595-6f25-48ae-806c-92f769e46722 -F qcow2 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-b3e29595-6f25-48ae-806c-92f769e46722.aea3c8da-9374-43ef-9070-c96e6e82f7fd" returned: 0 in 0.656s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:44:03 devstack cinder-volume[92060]: WARNING cinder.volume.drivers.remotefs [None req-918dbec4-f5e9-40dd-b8bd-29acd3371f20 tempest-VolumesSnapshotTestJSON-1039322322 None] /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-b3e29595-6f25-48ae-806c-92f769e46722.aea3c8da-9374-43ef-9070-c96e6e82f7fd is being set with open permissions: ugo+rw Jun 17 04:44:03 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-918dbec4-f5e9-40dd-b8bd-29acd3371f20 tempest-VolumesSnapshotTestJSON-1039322322 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-b3e29595-6f25-48ae-806c-92f769e46722.aea3c8da-9374-43ef-9070-c96e6e82f7fd {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:44:03 devstack sudo[100943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-b3e29595-6f25-48ae-806c-92f769e46722.aea3c8da-9374-43ef-9070-c96e6e82f7fd Jun 17 04:44:03 devstack sudo[100943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:44:04 devstack sudo[100938]: pam_unix(sudo:session): session closed for user root Jun 17 04:44:04 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-e9f755d5-78d4-43bf-823b-985ae0a994c4 tempest-VolumesDeleteCascade-1909219053 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-6b8ce59e-1cdc-45ab-bde9-3768f0d6705b.791a2306-8ed3-40b8-bd0f-b4ac59f13fad" returned: 0 in 0.705s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:44:04 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.remotefs [None req-e9f755d5-78d4-43bf-823b-985ae0a994c4 tempest-VolumesDeleteCascade-1909219053 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6b8ce59e-1cdc-45ab-bde9-3768f0d6705b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=92060) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 17 04:44:04 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-e9f755d5-78d4-43bf-823b-985ae0a994c4 tempest-VolumesDeleteCascade-1909219053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-6b8ce59e-1cdc-45ab-bde9-3768f0d6705b.309004ac-fea5-4f3f-965c-0e6c80906d73 {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:44:04 devstack sudo[100948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-6b8ce59e-1cdc-45ab-bde9-3768f0d6705b.309004ac-fea5-4f3f-965c-0e6c80906d73 Jun 17 04:44:04 devstack sudo[100948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:44:04 devstack sudo[100943]: pam_unix(sudo:session): session closed for user root Jun 17 04:44:04 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-918dbec4-f5e9-40dd-b8bd-29acd3371f20 tempest-VolumesSnapshotTestJSON-1039322322 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-b3e29595-6f25-48ae-806c-92f769e46722.aea3c8da-9374-43ef-9070-c96e6e82f7fd" returned: 0 in 0.609s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:44:04 devstack cinder-volume[92060]: DEBUG dbcounter [-] [92060] Writing DB stats cinder:UPDATE=124,cinder:INSERT=25,cinder:SELECT=94,cinder:DELETE=10 {{(pid=92060) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 17 04:44:04 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-918dbec4-f5e9-40dd-b8bd-29acd3371f20 tempest-VolumesSnapshotTestJSON-1039322322 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-b3e29595-6f25-48ae-806c-92f769e46722.info {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:44:04 devstack sudo[100951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-b3e29595-6f25-48ae-806c-92f769e46722.info Jun 17 04:44:04 devstack sudo[100951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:44:05 devstack sudo[100948]: pam_unix(sudo:session): session closed for user root Jun 17 04:44:05 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-e9f755d5-78d4-43bf-823b-985ae0a994c4 tempest-VolumesDeleteCascade-1909219053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-6b8ce59e-1cdc-45ab-bde9-3768f0d6705b.309004ac-fea5-4f3f-965c-0e6c80906d73" returned: 0 in 0.830s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:44:05 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-e9f755d5-78d4-43bf-823b-985ae0a994c4 tempest-VolumesDeleteCascade-1909219053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-6b8ce59e-1cdc-45ab-bde9-3768f0d6705b.309004ac-fea5-4f3f-965c-0e6c80906d73 {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:44:05 devstack sudo[100958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-6b8ce59e-1cdc-45ab-bde9-3768f0d6705b.309004ac-fea5-4f3f-965c-0e6c80906d73 Jun 17 04:44:05 devstack sudo[100958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:44:05 devstack sudo[100951]: pam_unix(sudo:session): session closed for user root Jun 17 04:44:05 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-918dbec4-f5e9-40dd-b8bd-29acd3371f20 tempest-VolumesSnapshotTestJSON-1039322322 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-b3e29595-6f25-48ae-806c-92f769e46722.info" returned: 0 in 0.769s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:44:05 devstack cinder-volume[92060]: WARNING cinder.volume.drivers.remotefs [None req-918dbec4-f5e9-40dd-b8bd-29acd3371f20 tempest-VolumesSnapshotTestJSON-1039322322 None] /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-b3e29595-6f25-48ae-806c-92f769e46722.info is being set with open permissions: ugo+rw Jun 17 04:44:05 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-918dbec4-f5e9-40dd-b8bd-29acd3371f20 tempest-VolumesSnapshotTestJSON-1039322322 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-b3e29595-6f25-48ae-806c-92f769e46722.info {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:44:05 devstack sudo[100960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-b3e29595-6f25-48ae-806c-92f769e46722.info Jun 17 04:44:05 devstack sudo[100960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:44:05 devstack sudo[100958]: pam_unix(sudo:session): session closed for user root Jun 17 04:44:05 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-e9f755d5-78d4-43bf-823b-985ae0a994c4 tempest-VolumesDeleteCascade-1909219053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-6b8ce59e-1cdc-45ab-bde9-3768f0d6705b.309004ac-fea5-4f3f-965c-0e6c80906d73" returned: 0 in 0.659s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:44:05 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-e9f755d5-78d4-43bf-823b-985ae0a994c4 tempest-VolumesDeleteCascade-1909219053 None] Lock "cinder-quobyte-309004ac-fea5-4f3f-965c-0e6c80906d73" released by "_delete_snapshot" :: held 3.066s {{(pid=92060) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 04:44:05 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-e9f755d5-78d4-43bf-823b-985ae0a994c4 tempest-VolumesDeleteCascade-1909219053 None] Lock "cinder-quobyte-6b8ce59e-1cdc-45ab-bde9-3768f0d6705b" released by "delete_snapshot" :: held 3.106s {{(pid=92060) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 04:44:06 devstack cinder-volume[92060]: DEBUG cinder.quota [None req-e9f755d5-78d4-43bf-823b-985ae0a994c4 tempest-VolumesDeleteCascade-1909219053 None] Created reservations ['c00cbde6-3229-4820-8068-4b0b0ef9b996', '69ea3453-d094-420e-a43c-23dda981681c', 'e59b2972-cdbb-439c-a86b-9b2017172388', '74872eca-09d9-41e7-85a3-fa7bbd24899c'] {{(pid=92060) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 17 04:44:06 devstack sudo[100960]: pam_unix(sudo:session): session closed for user root Jun 17 04:44:06 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-918dbec4-f5e9-40dd-b8bd-29acd3371f20 tempest-VolumesSnapshotTestJSON-1039322322 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-b3e29595-6f25-48ae-806c-92f769e46722.info" returned: 0 in 0.826s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:44:06 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-918dbec4-f5e9-40dd-b8bd-29acd3371f20 tempest-VolumesSnapshotTestJSON-1039322322 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.501s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 04:44:06 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-67147db8-f9eb-4d15-bbcc-d513ada1294f tempest-AttachVolumeTestJSON-189381823 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.344s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 04:44:06 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-67147db8-f9eb-4d15-bbcc-d513ada1294f tempest-AttachVolumeTestJSON-189381823 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-17T02:44:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1448797042',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b92c4149-011c-4b5a-82da-0d49240470fc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9cb0f3e8aabc47e582b3e9924538b792',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T02:44:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T02:44:01Z,use_quota=True,user_id='f25a55d2802e4cf4b442a23df3eb34cc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aad9ce24-93f9-41a6-baa1-5125964f96d1),volume_type_id=aad9ce24-93f9-41a6-baa1-5125964f96d1)}" {{(pid=92060) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 17 04:44:06 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.remotefs [None req-67147db8-f9eb-4d15-bbcc-d513ada1294f tempest-AttachVolumeTestJSON-189381823 None] Creating volume b92c4149-011c-4b5a-82da-0d49240470fc {{(pid=92060) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 17 04:44:06 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-67147db8-f9eb-4d15-bbcc-d513ada1294f tempest-AttachVolumeTestJSON-189381823 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 04:44:06 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-67147db8-f9eb-4d15-bbcc-d513ada1294f tempest-AttachVolumeTestJSON-189381823 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 04:44:06 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-67147db8-f9eb-4d15-bbcc-d513ada1294f tempest-AttachVolumeTestJSON-189381823 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588': None} {{(pid=92060) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 17 04:44:06 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-67147db8-f9eb-4d15-bbcc-d513ada1294f tempest-AttachVolumeTestJSON-189381823 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588'] {{(pid=92060) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 17 04:44:06 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-67147db8-f9eb-4d15-bbcc-d513ada1294f tempest-AttachVolumeTestJSON-189381823 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 04:44:06 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-67147db8-f9eb-4d15-bbcc-d513ada1294f tempest-AttachVolumeTestJSON-189381823 None] Selected osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588 as target Quobyte volume. {{(pid=92060) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 17 04:44:06 devstack cinder-volume[92060]: INFO cinder.volume.drivers.remotefs [None req-67147db8-f9eb-4d15-bbcc-d513ada1294f tempest-AttachVolumeTestJSON-189381823 None] casted to osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588 Jun 17 04:44:06 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-67147db8-f9eb-4d15-bbcc-d513ada1294f tempest-AttachVolumeTestJSON-189381823 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-b92c4149-011c-4b5a-82da-0d49240470fc 1073741824 {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:44:06 devstack sudo[100964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-b92c4149-011c-4b5a-82da-0d49240470fc 1073741824 Jun 17 04:44:06 devstack sudo[100964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:44:06 devstack cinder-volume[92060]: INFO cinder.volume.manager [None req-e9f755d5-78d4-43bf-823b-985ae0a994c4 tempest-VolumesDeleteCascade-1909219053 None] Delete snapshot completed successfully. Jun 17 04:44:06 devstack cinder-volume[92060]: INFO cinder.volume.manager [None req-918dbec4-f5e9-40dd-b8bd-29acd3371f20 tempest-VolumesSnapshotTestJSON-1039322322 None] Create snapshot completed successfully Jun 17 04:44:06 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-e9f755d5-78d4-43bf-823b-985ae0a994c4 tempest-VolumesDeleteCascade-1909219053 None] Lock "cinder-309004ac-fea5-4f3f-965c-0e6c80906d73-delete_snapshot" released by "delete_snapshot" :: held 3.482s {{(pid=92060) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 04:44:06 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-e9f755d5-78d4-43bf-823b-985ae0a994c4 tempest-VolumesDeleteCascade-1909219053 None] Acquiring lock "cinder-791a2306-8ed3-40b8-bd0f-b4ac59f13fad-delete_snapshot" by "delete_snapshot" {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 04:44:06 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-e9f755d5-78d4-43bf-823b-985ae0a994c4 tempest-VolumesDeleteCascade-1909219053 None] Lock "cinder-791a2306-8ed3-40b8-bd0f-b4ac59f13fad-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 04:44:06 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-e9f755d5-78d4-43bf-823b-985ae0a994c4 tempest-VolumesDeleteCascade-1909219053 None] Acquiring lock "cinder-quobyte-6b8ce59e-1cdc-45ab-bde9-3768f0d6705b" by "delete_snapshot" {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 04:44:06 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-e9f755d5-78d4-43bf-823b-985ae0a994c4 tempest-VolumesDeleteCascade-1909219053 None] Lock "cinder-quobyte-6b8ce59e-1cdc-45ab-bde9-3768f0d6705b" acquired by "delete_snapshot" :: waited 0.015s {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 04:44:06 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-e9f755d5-78d4-43bf-823b-985ae0a994c4 tempest-VolumesDeleteCascade-1909219053 None] Acquiring lock "cinder-quobyte-791a2306-8ed3-40b8-bd0f-b4ac59f13fad" by "_delete_snapshot" {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 04:44:06 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-e9f755d5-78d4-43bf-823b-985ae0a994c4 tempest-VolumesDeleteCascade-1909219053 None] Lock "cinder-quobyte-791a2306-8ed3-40b8-bd0f-b4ac59f13fad" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 04:44:06 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.remotefs [None req-e9f755d5-78d4-43bf-823b-985ae0a994c4 tempest-VolumesDeleteCascade-1909219053 None] Deleting offline snapshot 791a2306-8ed3-40b8-bd0f-b4ac59f13fad of volume 6b8ce59e-1cdc-45ab-bde9-3768f0d6705b {{(pid=92060) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 17 04:44:06 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.remotefs [None req-e9f755d5-78d4-43bf-823b-985ae0a994c4 tempest-VolumesDeleteCascade-1909219053 None] snapshot_file for this snap is: volume-6b8ce59e-1cdc-45ab-bde9-3768f0d6705b.791a2306-8ed3-40b8-bd0f-b4ac59f13fad {{(pid=92060) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 17 04:44:06 devstack cinder-volume[92060]: DEBUG oslo.privsep.daemon [-] privsep: reply[52e50ace-cfec-4588-ac14-e557e41e354b]: (4, 'qcow2') {{(pid=93130) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 04:44:06 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-e9f755d5-78d4-43bf-823b-985ae0a994c4 tempest-VolumesDeleteCascade-1909219053 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-6b8ce59e-1cdc-45ab-bde9-3768f0d6705b.791a2306-8ed3-40b8-bd0f-b4ac59f13fad {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:44:06 devstack sudo[100966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-6b8ce59e-1cdc-45ab-bde9-3768f0d6705b.791a2306-8ed3-40b8-bd0f-b4ac59f13fad Jun 17 04:44:06 devstack sudo[100966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:44:07 devstack sudo[100964]: pam_unix(sudo:session): session closed for user root Jun 17 04:44:07 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-67147db8-f9eb-4d15-bbcc-d513ada1294f tempest-AttachVolumeTestJSON-189381823 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-b92c4149-011c-4b5a-82da-0d49240470fc 1073741824" returned: 0 in 1.098s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:44:07 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-67147db8-f9eb-4d15-bbcc-d513ada1294f tempest-AttachVolumeTestJSON-189381823 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-b92c4149-011c-4b5a-82da-0d49240470fc {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:44:07 devstack sudo[100992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-b92c4149-011c-4b5a-82da-0d49240470fc Jun 17 04:44:07 devstack sudo[100992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:44:07 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-cc2d7f8c-43b1-40db-ad25-19ff29212401 tempest-VolumesSnapshotTestJSON-1039322322 None] Acquiring lock "cinder-aea3c8da-9374-43ef-9070-c96e6e82f7fd-delete_snapshot" by "delete_snapshot" {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 04:44:07 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-cc2d7f8c-43b1-40db-ad25-19ff29212401 tempest-VolumesSnapshotTestJSON-1039322322 None] Lock "cinder-aea3c8da-9374-43ef-9070-c96e6e82f7fd-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 04:44:07 devstack sudo[100966]: pam_unix(sudo:session): session closed for user root Jun 17 04:44:07 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-e9f755d5-78d4-43bf-823b-985ae0a994c4 tempest-VolumesDeleteCascade-1909219053 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-6b8ce59e-1cdc-45ab-bde9-3768f0d6705b.791a2306-8ed3-40b8-bd0f-b4ac59f13fad" returned: 0 in 1.099s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:44:07 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.remotefs [None req-e9f755d5-78d4-43bf-823b-985ae0a994c4 tempest-VolumesDeleteCascade-1909219053 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6b8ce59e-1cdc-45ab-bde9-3768f0d6705b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=92060) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 17 04:44:07 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-cc2d7f8c-43b1-40db-ad25-19ff29212401 tempest-VolumesSnapshotTestJSON-1039322322 None] Acquiring lock "cinder-quobyte-b3e29595-6f25-48ae-806c-92f769e46722" by "delete_snapshot" {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 04:44:07 devstack cinder-volume[92060]: DEBUG oslo.privsep.daemon [-] privsep: reply[11e80d58-6394-4386-aa5b-0b03e9dd1b54]: (4, 'qcow2') {{(pid=93130) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 04:44:07 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-e9f755d5-78d4-43bf-823b-985ae0a994c4 tempest-VolumesDeleteCascade-1909219053 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-6b8ce59e-1cdc-45ab-bde9-3768f0d6705b {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:44:07 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-cc2d7f8c-43b1-40db-ad25-19ff29212401 tempest-VolumesSnapshotTestJSON-1039322322 None] Lock "cinder-quobyte-b3e29595-6f25-48ae-806c-92f769e46722" acquired by "delete_snapshot" :: waited 0.032s {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 04:44:07 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-cc2d7f8c-43b1-40db-ad25-19ff29212401 tempest-VolumesSnapshotTestJSON-1039322322 None] Acquiring lock "cinder-quobyte-aea3c8da-9374-43ef-9070-c96e6e82f7fd" by "_delete_snapshot" {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 04:44:07 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-cc2d7f8c-43b1-40db-ad25-19ff29212401 tempest-VolumesSnapshotTestJSON-1039322322 None] Lock "cinder-quobyte-aea3c8da-9374-43ef-9070-c96e6e82f7fd" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 04:44:07 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.remotefs [None req-cc2d7f8c-43b1-40db-ad25-19ff29212401 tempest-VolumesSnapshotTestJSON-1039322322 None] Deleting offline snapshot aea3c8da-9374-43ef-9070-c96e6e82f7fd of volume b3e29595-6f25-48ae-806c-92f769e46722 {{(pid=92060) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 17 04:44:07 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.remotefs [None req-cc2d7f8c-43b1-40db-ad25-19ff29212401 tempest-VolumesSnapshotTestJSON-1039322322 None] snapshot_file for this snap is: volume-b3e29595-6f25-48ae-806c-92f769e46722.aea3c8da-9374-43ef-9070-c96e6e82f7fd {{(pid=92060) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 17 04:44:07 devstack cinder-volume[92060]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d800566-1af5-48b0-8a5a-a815b2bba44c]: (4, 'qcow2') {{(pid=93130) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 04:44:07 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-cc2d7f8c-43b1-40db-ad25-19ff29212401 tempest-VolumesSnapshotTestJSON-1039322322 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-b3e29595-6f25-48ae-806c-92f769e46722.aea3c8da-9374-43ef-9070-c96e6e82f7fd {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:44:07 devstack sudo[100994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-6b8ce59e-1cdc-45ab-bde9-3768f0d6705b Jun 17 04:44:07 devstack sudo[100994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:44:07 devstack sudo[100995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-b3e29595-6f25-48ae-806c-92f769e46722.aea3c8da-9374-43ef-9070-c96e6e82f7fd Jun 17 04:44:07 devstack sudo[100995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:44:07 devstack sudo[100992]: pam_unix(sudo:session): session closed for user root Jun 17 04:44:07 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-67147db8-f9eb-4d15-bbcc-d513ada1294f tempest-AttachVolumeTestJSON-189381823 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-b92c4149-011c-4b5a-82da-0d49240470fc" returned: 0 in 0.680s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:44:07 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-67147db8-f9eb-4d15-bbcc-d513ada1294f tempest-AttachVolumeTestJSON-189381823 None] <== create_volume: return (1868ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588'} {{(pid=92060) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 17 04:44:07 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-67147db8-f9eb-4d15-bbcc-d513ada1294f tempest-AttachVolumeTestJSON-189381823 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.871s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 04:44:08 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-67147db8-f9eb-4d15-bbcc-d513ada1294f tempest-AttachVolumeTestJSON-189381823 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e9b2cb0f-83a9-402f-9623-4646fe2c086a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b92c4149-011c-4b5a-82da-0d49240470fc', 'volume_size': 1}' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:44:08 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-67147db8-f9eb-4d15-bbcc-d513ada1294f tempest-AttachVolumeTestJSON-189381823 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cdc7aaa7-7a3a-42e7-9efb-4dd3a984184c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:44:08 devstack cinder-volume[92060]: INFO cinder.volume.flows.manager.create_volume [None req-67147db8-f9eb-4d15-bbcc-d513ada1294f tempest-AttachVolumeTestJSON-189381823 None] Volume volume-b92c4149-011c-4b5a-82da-0d49240470fc (b92c4149-011c-4b5a-82da-0d49240470fc): created successfully Jun 17 04:44:08 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-67147db8-f9eb-4d15-bbcc-d513ada1294f tempest-AttachVolumeTestJSON-189381823 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cdc7aaa7-7a3a-42e7-9efb-4dd3a984184c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:44:08 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-67147db8-f9eb-4d15-bbcc-d513ada1294f tempest-AttachVolumeTestJSON-189381823 None] Flow 'volume_create_manager' (9d2a70a6-cf74-458a-a6a6-f7439457a043) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92060) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 17 04:44:08 devstack cinder-volume[92060]: INFO cinder.volume.manager [None req-67147db8-f9eb-4d15-bbcc-d513ada1294f tempest-AttachVolumeTestJSON-189381823 None] Created volume successfully. Jun 17 04:44:08 devstack sudo[100994]: pam_unix(sudo:session): session closed for user root Jun 17 04:44:08 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-e9f755d5-78d4-43bf-823b-985ae0a994c4 tempest-VolumesDeleteCascade-1909219053 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-6b8ce59e-1cdc-45ab-bde9-3768f0d6705b" returned: 0 in 0.818s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:44:08 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-e9f755d5-78d4-43bf-823b-985ae0a994c4 tempest-VolumesDeleteCascade-1909219053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-6b8ce59e-1cdc-45ab-bde9-3768f0d6705b.791a2306-8ed3-40b8-bd0f-b4ac59f13fad {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:44:08 devstack sudo[101014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-6b8ce59e-1cdc-45ab-bde9-3768f0d6705b.791a2306-8ed3-40b8-bd0f-b4ac59f13fad Jun 17 04:44:08 devstack sudo[101014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:44:08 devstack sudo[100995]: pam_unix(sudo:session): session closed for user root Jun 17 04:44:08 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-cc2d7f8c-43b1-40db-ad25-19ff29212401 tempest-VolumesSnapshotTestJSON-1039322322 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-b3e29595-6f25-48ae-806c-92f769e46722.aea3c8da-9374-43ef-9070-c96e6e82f7fd" returned: 0 in 0.792s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:44:08 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.remotefs [None req-cc2d7f8c-43b1-40db-ad25-19ff29212401 tempest-VolumesSnapshotTestJSON-1039322322 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b3e29595-6f25-48ae-806c-92f769e46722(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=92060) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 17 04:44:08 devstack cinder-volume[92060]: DEBUG oslo.privsep.daemon [-] privsep: reply[14cfa457-6fd7-493f-a14d-5ff75ac8c0c5]: (4, 'qcow2') {{(pid=93130) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 04:44:08 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-cc2d7f8c-43b1-40db-ad25-19ff29212401 tempest-VolumesSnapshotTestJSON-1039322322 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-b3e29595-6f25-48ae-806c-92f769e46722 {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:44:08 devstack sudo[101016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-b3e29595-6f25-48ae-806c-92f769e46722 Jun 17 04:44:08 devstack sudo[101016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:44:09 devstack sudo[101014]: pam_unix(sudo:session): session closed for user root Jun 17 04:44:09 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-e9f755d5-78d4-43bf-823b-985ae0a994c4 tempest-VolumesDeleteCascade-1909219053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-6b8ce59e-1cdc-45ab-bde9-3768f0d6705b.791a2306-8ed3-40b8-bd0f-b4ac59f13fad" returned: 0 in 0.725s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:44:09 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-e9f755d5-78d4-43bf-823b-985ae0a994c4 tempest-VolumesDeleteCascade-1909219053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-6b8ce59e-1cdc-45ab-bde9-3768f0d6705b.791a2306-8ed3-40b8-bd0f-b4ac59f13fad {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:44:09 devstack sudo[101024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-6b8ce59e-1cdc-45ab-bde9-3768f0d6705b.791a2306-8ed3-40b8-bd0f-b4ac59f13fad Jun 17 04:44:09 devstack sudo[101024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:44:09 devstack sudo[101016]: pam_unix(sudo:session): session closed for user root Jun 17 04:44:09 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-cc2d7f8c-43b1-40db-ad25-19ff29212401 tempest-VolumesSnapshotTestJSON-1039322322 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-b3e29595-6f25-48ae-806c-92f769e46722" returned: 0 in 0.721s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:44:09 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-cc2d7f8c-43b1-40db-ad25-19ff29212401 tempest-VolumesSnapshotTestJSON-1039322322 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-b3e29595-6f25-48ae-806c-92f769e46722.aea3c8da-9374-43ef-9070-c96e6e82f7fd {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:44:09 devstack sudo[101026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-b3e29595-6f25-48ae-806c-92f769e46722.aea3c8da-9374-43ef-9070-c96e6e82f7fd Jun 17 04:44:09 devstack sudo[101026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:44:09 devstack sudo[101024]: pam_unix(sudo:session): session closed for user root Jun 17 04:44:09 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-e9f755d5-78d4-43bf-823b-985ae0a994c4 tempest-VolumesDeleteCascade-1909219053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-6b8ce59e-1cdc-45ab-bde9-3768f0d6705b.791a2306-8ed3-40b8-bd0f-b4ac59f13fad" returned: 0 in 0.614s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:44:09 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-e9f755d5-78d4-43bf-823b-985ae0a994c4 tempest-VolumesDeleteCascade-1909219053 None] Lock "cinder-quobyte-791a2306-8ed3-40b8-bd0f-b4ac59f13fad" released by "_delete_snapshot" :: held 3.365s {{(pid=92060) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 04:44:09 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-e9f755d5-78d4-43bf-823b-985ae0a994c4 tempest-VolumesDeleteCascade-1909219053 None] Lock "cinder-quobyte-6b8ce59e-1cdc-45ab-bde9-3768f0d6705b" released by "delete_snapshot" :: held 3.388s {{(pid=92060) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 04:44:09 devstack cinder-volume[92060]: DEBUG cinder.quota [None req-e9f755d5-78d4-43bf-823b-985ae0a994c4 tempest-VolumesDeleteCascade-1909219053 None] Created reservations ['799920a5-2f31-41b7-804d-80a6f8604b25', '35fa2a7b-6116-4032-98b1-b7b9c61726c5', '2bd18c07-a89b-489d-9633-76f8afd2456b', '84a95877-b108-4263-92c4-40fed904d3cb'] {{(pid=92060) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 17 04:44:09 devstack cinder-volume[92060]: INFO cinder.volume.manager [None req-e9f755d5-78d4-43bf-823b-985ae0a994c4 tempest-VolumesDeleteCascade-1909219053 None] Delete snapshot completed successfully. Jun 17 04:44:09 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-e9f755d5-78d4-43bf-823b-985ae0a994c4 tempest-VolumesDeleteCascade-1909219053 None] Lock "cinder-791a2306-8ed3-40b8-bd0f-b4ac59f13fad-delete_snapshot" released by "delete_snapshot" :: held 3.531s {{(pid=92060) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 04:44:09 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-e9f755d5-78d4-43bf-823b-985ae0a994c4 tempest-VolumesDeleteCascade-1909219053 None] Snapshots deleted, issuing volume delete {{(pid=92060) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Jun 17 04:44:09 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-e9f755d5-78d4-43bf-823b-985ae0a994c4 tempest-VolumesDeleteCascade-1909219053 None] Acquiring lock "cinder-quobyte-6b8ce59e-1cdc-45ab-bde9-3768f0d6705b" by "delete_volume" {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 04:44:09 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-e9f755d5-78d4-43bf-823b-985ae0a994c4 tempest-VolumesDeleteCascade-1909219053 None] Lock "cinder-quobyte-6b8ce59e-1cdc-45ab-bde9-3768f0d6705b" acquired by "delete_volume" :: waited 0.023s {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 04:44:09 devstack sudo[101026]: pam_unix(sudo:session): session closed for user root Jun 17 04:44:09 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-cc2d7f8c-43b1-40db-ad25-19ff29212401 tempest-VolumesSnapshotTestJSON-1039322322 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-b3e29595-6f25-48ae-806c-92f769e46722.aea3c8da-9374-43ef-9070-c96e6e82f7fd" returned: 0 in 0.736s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:44:09 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-cc2d7f8c-43b1-40db-ad25-19ff29212401 tempest-VolumesSnapshotTestJSON-1039322322 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-b3e29595-6f25-48ae-806c-92f769e46722.aea3c8da-9374-43ef-9070-c96e6e82f7fd {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:44:09 devstack cinder-volume[92060]: DEBUG oslo.privsep.daemon [-] privsep: reply[a651f604-5a6e-427d-8a7c-b2aee4c72b90]: (4, 'qcow2') {{(pid=93130) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 04:44:09 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-e9f755d5-78d4-43bf-823b-985ae0a994c4 tempest-VolumesDeleteCascade-1909219053 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-6b8ce59e-1cdc-45ab-bde9-3768f0d6705b {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:44:09 devstack sudo[101032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-b3e29595-6f25-48ae-806c-92f769e46722.aea3c8da-9374-43ef-9070-c96e6e82f7fd Jun 17 04:44:09 devstack sudo[101032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:44:10 devstack sudo[101033]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-6b8ce59e-1cdc-45ab-bde9-3768f0d6705b Jun 17 04:44:10 devstack sudo[101033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:44:10 devstack sudo[101032]: pam_unix(sudo:session): session closed for user root Jun 17 04:44:10 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-cc2d7f8c-43b1-40db-ad25-19ff29212401 tempest-VolumesSnapshotTestJSON-1039322322 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-b3e29595-6f25-48ae-806c-92f769e46722.aea3c8da-9374-43ef-9070-c96e6e82f7fd" returned: 0 in 0.615s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:44:10 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-cc2d7f8c-43b1-40db-ad25-19ff29212401 tempest-VolumesSnapshotTestJSON-1039322322 None] Lock "cinder-quobyte-aea3c8da-9374-43ef-9070-c96e6e82f7fd" released by "_delete_snapshot" :: held 3.000s {{(pid=92060) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 04:44:10 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-cc2d7f8c-43b1-40db-ad25-19ff29212401 tempest-VolumesSnapshotTestJSON-1039322322 None] Lock "cinder-quobyte-b3e29595-6f25-48ae-806c-92f769e46722" released by "delete_snapshot" :: held 3.034s {{(pid=92060) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 04:44:10 devstack cinder-volume[92060]: DEBUG cinder.quota [None req-cc2d7f8c-43b1-40db-ad25-19ff29212401 tempest-VolumesSnapshotTestJSON-1039322322 None] Created reservations ['162ae4cc-710c-40e2-8693-24a022318842', '5d3f463c-2a7b-44b4-9339-927f8ea7351b', '38270ef3-0129-45b8-8431-d0d1afa524c6', '16bffc3a-1f02-4cff-b5e9-bb4f455dbdc4'] {{(pid=92060) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 17 04:44:10 devstack sudo[101033]: pam_unix(sudo:session): session closed for user root Jun 17 04:44:10 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-e9f755d5-78d4-43bf-823b-985ae0a994c4 tempest-VolumesDeleteCascade-1909219053 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-6b8ce59e-1cdc-45ab-bde9-3768f0d6705b" returned: 0 in 0.802s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:44:10 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-e9f755d5-78d4-43bf-823b-985ae0a994c4 tempest-VolumesDeleteCascade-1909219053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-6b8ce59e-1cdc-45ab-bde9-3768f0d6705b {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:44:10 devstack cinder-volume[92060]: INFO cinder.volume.manager [None req-cc2d7f8c-43b1-40db-ad25-19ff29212401 tempest-VolumesSnapshotTestJSON-1039322322 None] Delete snapshot completed successfully. Jun 17 04:44:10 devstack sudo[101043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-6b8ce59e-1cdc-45ab-bde9-3768f0d6705b Jun 17 04:44:10 devstack sudo[101043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:44:10 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-cc2d7f8c-43b1-40db-ad25-19ff29212401 tempest-VolumesSnapshotTestJSON-1039322322 None] Lock "cinder-aea3c8da-9374-43ef-9070-c96e6e82f7fd-delete_snapshot" released by "delete_snapshot" :: held 3.305s {{(pid=92060) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 04:44:11 devstack sudo[101043]: pam_unix(sudo:session): session closed for user root Jun 17 04:44:11 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-e9f755d5-78d4-43bf-823b-985ae0a994c4 tempest-VolumesDeleteCascade-1909219053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-6b8ce59e-1cdc-45ab-bde9-3768f0d6705b" returned: 0 in 0.590s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:44:11 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-e9f755d5-78d4-43bf-823b-985ae0a994c4 tempest-VolumesDeleteCascade-1909219053 None] Lock "cinder-quobyte-6b8ce59e-1cdc-45ab-bde9-3768f0d6705b" released by "delete_volume" :: held 1.510s {{(pid=92060) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 04:44:11 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [req-922d3224-bf33-49ab-bcbc-a37045bb716f req-0112e528-da8b-4116-9f67-28cd443e20f1 tempest-AttachVolumeTestJSON-189381823 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 04:44:11 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [req-922d3224-bf33-49ab-bcbc-a37045bb716f req-0112e528-da8b-4116-9f67-28cd443e20f1 tempest-AttachVolumeTestJSON-189381823 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 04:44:11 devstack cinder-volume[92060]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5ebd752-115a-4a9b-aafc-ab9765ea2860]: (4, 'qcow2') {{(pid=93130) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 04:44:11 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [req-922d3224-bf33-49ab-bcbc-a37045bb716f req-0112e528-da8b-4116-9f67-28cd443e20f1 tempest-AttachVolumeTestJSON-189381823 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-b92c4149-011c-4b5a-82da-0d49240470fc {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:44:11 devstack cinder-volume[92060]: DEBUG cinder.quota [None req-e9f755d5-78d4-43bf-823b-985ae0a994c4 tempest-VolumesDeleteCascade-1909219053 None] Created reservations ['4e662044-881a-47aa-8bb3-d29337cf3578', 'ebf36a9d-da1e-45e8-880b-b8476d26a82b', '4ce32d5e-a4eb-4722-9925-b5cbdeea483c', 'ebc07b56-2265-4a1e-b355-a3fad7677373'] {{(pid=92060) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 17 04:44:11 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-e9f755d5-78d4-43bf-823b-985ae0a994c4 tempest-VolumesDeleteCascade-1909219053 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 04:44:11 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-e9f755d5-78d4-43bf-823b-985ae0a994c4 tempest-VolumesDeleteCascade-1909219053 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 04:44:11 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-e9f755d5-78d4-43bf-823b-985ae0a994c4 tempest-VolumesDeleteCascade-1909219053 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588': None} {{(pid=92060) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 17 04:44:11 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-e9f755d5-78d4-43bf-823b-985ae0a994c4 tempest-VolumesDeleteCascade-1909219053 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588'] {{(pid=92060) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 17 04:44:11 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-e9f755d5-78d4-43bf-823b-985ae0a994c4 tempest-VolumesDeleteCascade-1909219053 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 04:44:11 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-e9f755d5-78d4-43bf-823b-985ae0a994c4 tempest-VolumesDeleteCascade-1909219053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:44:11 devstack sudo[101055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-b92c4149-011c-4b5a-82da-0d49240470fc Jun 17 04:44:11 devstack sudo[101055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:44:11 devstack sudo[101057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a Jun 17 04:44:11 devstack sudo[101057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:44:12 devstack sudo[101057]: pam_unix(sudo:session): session closed for user root Jun 17 04:44:12 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-e9f755d5-78d4-43bf-823b-985ae0a994c4 tempest-VolumesDeleteCascade-1909219053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a" returned: 0 in 0.637s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:44:12 devstack cinder-volume[92060]: DEBUG cinder.manager [None req-e9f755d5-78d4-43bf-823b-985ae0a994c4 tempest-VolumesDeleteCascade-1909219053 None] Notifying Schedulers of capabilities ... {{(pid=92060) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 17 04:44:12 devstack cinder-volume[92060]: INFO cinder.volume.manager [None req-e9f755d5-78d4-43bf-823b-985ae0a994c4 tempest-VolumesDeleteCascade-1909219053 None] Deleted volume successfully. Jun 17 04:44:12 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-e9f755d5-78d4-43bf-823b-985ae0a994c4 tempest-VolumesDeleteCascade-1909219053 None] Lock "cinder-6b8ce59e-1cdc-45ab-bde9-3768f0d6705b-delete_volume" released by "delete_volume" :: held 9.475s {{(pid=92060) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 04:44:12 devstack sudo[101055]: pam_unix(sudo:session): session closed for user root Jun 17 04:44:12 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [req-922d3224-bf33-49ab-bcbc-a37045bb716f req-0112e528-da8b-4116-9f67-28cd443e20f1 tempest-AttachVolumeTestJSON-189381823 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-b92c4149-011c-4b5a-82da-0d49240470fc" returned: 0 in 0.797s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:44:12 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [req-922d3224-bf33-49ab-bcbc-a37045bb716f req-0112e528-da8b-4116-9f67-28cd443e20f1 tempest-AttachVolumeTestJSON-189381823 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.821s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 04:44:12 devstack cinder-volume[92060]: DEBUG cinder.volume.flows.manager.create_volume [None req-9a736fd7-3ab0-47ef-ad8e-1ebadae26f97 tempest-VolumesSnapshotTestJSON-1039322322 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92060) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 17 04:44:12 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-9a736fd7-3ab0-47ef-ad8e-1ebadae26f97 tempest-VolumesSnapshotTestJSON-1039322322 None] Flow 'volume_create_manager' (410693be-570a-48b6-890a-3a7926dfa16e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 17 04:44:12 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-9a736fd7-3ab0-47ef-ad8e-1ebadae26f97 tempest-VolumesSnapshotTestJSON-1039322322 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a7edc413-ce95-4394-a39a-356d70211b03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:44:12 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-9a736fd7-3ab0-47ef-ad8e-1ebadae26f97 tempest-VolumesSnapshotTestJSON-1039322322 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a7edc413-ce95-4394-a39a-356d70211b03) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-17T02:44:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1500149081',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cc44cc2e-42ac-4892-8587-446c312ae2a6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='411c6111710645bfa3f034c46596cbaf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T02:44:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T02:44:12Z,use_quota=True,user_id='84f516bc01824ccfaaea6fa73a4f20b1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aad9ce24-93f9-41a6-baa1-5125964f96d1),volume_type_id=aad9ce24-93f9-41a6-baa1-5125964f96d1)' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:44:12 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-9a736fd7-3ab0-47ef-ad8e-1ebadae26f97 tempest-VolumesSnapshotTestJSON-1039322322 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (16ba2e87-18a1-46b7-8ac4-b6a923e1aaa4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:44:12 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-9a736fd7-3ab0-47ef-ad8e-1ebadae26f97 tempest-VolumesSnapshotTestJSON-1039322322 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (16ba2e87-18a1-46b7-8ac4-b6a923e1aaa4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:44:12 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-9a736fd7-3ab0-47ef-ad8e-1ebadae26f97 tempest-VolumesSnapshotTestJSON-1039322322 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b5d6c45e-84ea-4fba-a4f5-4262f5e155bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:44:12 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-9a736fd7-3ab0-47ef-ad8e-1ebadae26f97 tempest-VolumesSnapshotTestJSON-1039322322 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b5d6c45e-84ea-4fba-a4f5-4262f5e155bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cc44cc2e-42ac-4892-8587-446c312ae2a6', 'volume_name': 'volume-cc44cc2e-42ac-4892-8587-446c312ae2a6', 'volume_size': 1}' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:44:12 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-9a736fd7-3ab0-47ef-ad8e-1ebadae26f97 tempest-VolumesSnapshotTestJSON-1039322322 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (72b77f21-dc55-48a4-92d2-378dfcf9cb32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:44:12 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-9a736fd7-3ab0-47ef-ad8e-1ebadae26f97 tempest-VolumesSnapshotTestJSON-1039322322 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (72b77f21-dc55-48a4-92d2-378dfcf9cb32) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:44:12 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-9a736fd7-3ab0-47ef-ad8e-1ebadae26f97 tempest-VolumesSnapshotTestJSON-1039322322 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (23584fe1-804b-414b-bb4d-a4c1bb6ede9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:44:12 devstack cinder-volume[92060]: INFO cinder.volume.flows.manager.create_volume [None req-9a736fd7-3ab0-47ef-ad8e-1ebadae26f97 tempest-VolumesSnapshotTestJSON-1039322322 None] Volume cc44cc2e-42ac-4892-8587-446c312ae2a6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cc44cc2e-42ac-4892-8587-446c312ae2a6', 'volume_size': 1} Jun 17 04:44:12 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-9a736fd7-3ab0-47ef-ad8e-1ebadae26f97 tempest-VolumesSnapshotTestJSON-1039322322 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 04:44:12 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-9a736fd7-3ab0-47ef-ad8e-1ebadae26f97 tempest-VolumesSnapshotTestJSON-1039322322 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 04:44:12 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-9a736fd7-3ab0-47ef-ad8e-1ebadae26f97 tempest-VolumesSnapshotTestJSON-1039322322 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-17T02:44:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1500149081',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cc44cc2e-42ac-4892-8587-446c312ae2a6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='411c6111710645bfa3f034c46596cbaf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T02:44:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T02:44:12Z,use_quota=True,user_id='84f516bc01824ccfaaea6fa73a4f20b1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aad9ce24-93f9-41a6-baa1-5125964f96d1),volume_type_id=aad9ce24-93f9-41a6-baa1-5125964f96d1)}" {{(pid=92060) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 17 04:44:12 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.remotefs [None req-9a736fd7-3ab0-47ef-ad8e-1ebadae26f97 tempest-VolumesSnapshotTestJSON-1039322322 None] Creating volume cc44cc2e-42ac-4892-8587-446c312ae2a6 {{(pid=92060) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 17 04:44:12 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-9a736fd7-3ab0-47ef-ad8e-1ebadae26f97 tempest-VolumesSnapshotTestJSON-1039322322 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 04:44:12 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-9a736fd7-3ab0-47ef-ad8e-1ebadae26f97 tempest-VolumesSnapshotTestJSON-1039322322 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 04:44:12 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-9a736fd7-3ab0-47ef-ad8e-1ebadae26f97 tempest-VolumesSnapshotTestJSON-1039322322 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588': None} {{(pid=92060) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 17 04:44:12 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-9a736fd7-3ab0-47ef-ad8e-1ebadae26f97 tempest-VolumesSnapshotTestJSON-1039322322 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588'] {{(pid=92060) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 17 04:44:12 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-9a736fd7-3ab0-47ef-ad8e-1ebadae26f97 tempest-VolumesSnapshotTestJSON-1039322322 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.035s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 04:44:12 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-9a736fd7-3ab0-47ef-ad8e-1ebadae26f97 tempest-VolumesSnapshotTestJSON-1039322322 None] Selected osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588 as target Quobyte volume. {{(pid=92060) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 17 04:44:12 devstack cinder-volume[92060]: INFO cinder.volume.drivers.remotefs [None req-9a736fd7-3ab0-47ef-ad8e-1ebadae26f97 tempest-VolumesSnapshotTestJSON-1039322322 None] casted to osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588 Jun 17 04:44:12 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-9a736fd7-3ab0-47ef-ad8e-1ebadae26f97 tempest-VolumesSnapshotTestJSON-1039322322 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-cc44cc2e-42ac-4892-8587-446c312ae2a6 1073741824 {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:44:12 devstack sudo[101080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-cc44cc2e-42ac-4892-8587-446c312ae2a6 1073741824 Jun 17 04:44:12 devstack sudo[101080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:44:12 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [req-922d3224-bf33-49ab-bcbc-a37045bb716f req-0112e528-da8b-4116-9f67-28cd443e20f1 tempest-AttachVolumeTestJSON-189381823 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588', 'name': 'volume-b92c4149-011c-4b5a-82da-0d49240470fc', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '3a20436f-7a97-493c-9723-12a7a590f779', 'enforce_multipath': True} {{(pid=92060) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 17 04:44:12 devstack cinder-volume[92060]: INFO cinder.volume.manager [req-922d3224-bf33-49ab-bcbc-a37045bb716f req-0112e528-da8b-4116-9f67-28cd443e20f1 tempest-AttachVolumeTestJSON-189381823 None] attachment_update completed successfully. Jun 17 04:44:13 devstack cinder-volume[92060]: DEBUG cinder.volume.flows.manager.create_volume [None req-937ce671-85d7-4e95-acbd-3280a125d75c tempest-VolumesDeleteCascade-1909219053 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92060) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 17 04:44:13 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-937ce671-85d7-4e95-acbd-3280a125d75c tempest-VolumesDeleteCascade-1909219053 None] Flow 'volume_create_manager' (8a06a293-a1e2-42d7-8e6a-fcdaa9eac42b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 17 04:44:13 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-937ce671-85d7-4e95-acbd-3280a125d75c tempest-VolumesDeleteCascade-1909219053 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (795b5234-e7b5-4a73-91aa-db3a932ce628) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:44:13 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-937ce671-85d7-4e95-acbd-3280a125d75c tempest-VolumesDeleteCascade-1909219053 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (795b5234-e7b5-4a73-91aa-db3a932ce628) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-17T02:44:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-859605445',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=787aa2b2-1905-4b49-9a7b-76228def377e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='71aa70d8201e463f904712e7de33922a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T02:44:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T02:44:14Z,use_quota=True,user_id='078aaa69dcdb4ab8854c52f9529b905c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aad9ce24-93f9-41a6-baa1-5125964f96d1),volume_type_id=aad9ce24-93f9-41a6-baa1-5125964f96d1)' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:44:13 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-937ce671-85d7-4e95-acbd-3280a125d75c tempest-VolumesDeleteCascade-1909219053 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7224863a-f891-4b33-9d72-b08de6ae7ce7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:44:13 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-937ce671-85d7-4e95-acbd-3280a125d75c tempest-VolumesDeleteCascade-1909219053 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7224863a-f891-4b33-9d72-b08de6ae7ce7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:44:13 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-937ce671-85d7-4e95-acbd-3280a125d75c tempest-VolumesDeleteCascade-1909219053 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (767c98cc-6b18-44a9-9e51-d9d1356aead1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:44:13 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-937ce671-85d7-4e95-acbd-3280a125d75c tempest-VolumesDeleteCascade-1909219053 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (767c98cc-6b18-44a9-9e51-d9d1356aead1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '787aa2b2-1905-4b49-9a7b-76228def377e', 'volume_name': 'volume-787aa2b2-1905-4b49-9a7b-76228def377e', 'volume_size': 1}' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:44:13 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-937ce671-85d7-4e95-acbd-3280a125d75c tempest-VolumesDeleteCascade-1909219053 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eaf21a93-c482-4d31-b34e-9a96848716c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:44:13 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-937ce671-85d7-4e95-acbd-3280a125d75c tempest-VolumesDeleteCascade-1909219053 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eaf21a93-c482-4d31-b34e-9a96848716c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:44:13 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-937ce671-85d7-4e95-acbd-3280a125d75c tempest-VolumesDeleteCascade-1909219053 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (10f803db-26b3-4501-9f14-fd6db8add7de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:44:13 devstack cinder-volume[92060]: INFO cinder.volume.flows.manager.create_volume [None req-937ce671-85d7-4e95-acbd-3280a125d75c tempest-VolumesDeleteCascade-1909219053 None] Volume 787aa2b2-1905-4b49-9a7b-76228def377e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-787aa2b2-1905-4b49-9a7b-76228def377e', 'volume_size': 1} Jun 17 04:44:13 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-937ce671-85d7-4e95-acbd-3280a125d75c tempest-VolumesDeleteCascade-1909219053 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 04:44:13 devstack sudo[101080]: pam_unix(sudo:session): session closed for user root Jun 17 04:44:13 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-9a736fd7-3ab0-47ef-ad8e-1ebadae26f97 tempest-VolumesSnapshotTestJSON-1039322322 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-cc44cc2e-42ac-4892-8587-446c312ae2a6 1073741824" returned: 0 in 1.583s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:44:13 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-9a736fd7-3ab0-47ef-ad8e-1ebadae26f97 tempest-VolumesSnapshotTestJSON-1039322322 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-cc44cc2e-42ac-4892-8587-446c312ae2a6 {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:44:13 devstack sudo[101135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-cc44cc2e-42ac-4892-8587-446c312ae2a6 Jun 17 04:44:13 devstack sudo[101135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:44:14 devstack sudo[101135]: pam_unix(sudo:session): session closed for user root Jun 17 04:44:14 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-9a736fd7-3ab0-47ef-ad8e-1ebadae26f97 tempest-VolumesSnapshotTestJSON-1039322322 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-cc44cc2e-42ac-4892-8587-446c312ae2a6" returned: 0 in 0.674s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:44:14 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-9a736fd7-3ab0-47ef-ad8e-1ebadae26f97 tempest-VolumesSnapshotTestJSON-1039322322 None] <== create_volume: return (2335ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588'} {{(pid=92060) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 17 04:44:14 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-9a736fd7-3ab0-47ef-ad8e-1ebadae26f97 tempest-VolumesSnapshotTestJSON-1039322322 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.337s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 04:44:14 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-937ce671-85d7-4e95-acbd-3280a125d75c tempest-VolumesDeleteCascade-1909219053 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.893s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 04:44:14 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-937ce671-85d7-4e95-acbd-3280a125d75c tempest-VolumesDeleteCascade-1909219053 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-17T02:44:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-859605445',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=787aa2b2-1905-4b49-9a7b-76228def377e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='71aa70d8201e463f904712e7de33922a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T02:44:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T02:44:14Z,use_quota=True,user_id='078aaa69dcdb4ab8854c52f9529b905c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aad9ce24-93f9-41a6-baa1-5125964f96d1),volume_type_id=aad9ce24-93f9-41a6-baa1-5125964f96d1)}" {{(pid=92060) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 17 04:44:14 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.remotefs [None req-937ce671-85d7-4e95-acbd-3280a125d75c tempest-VolumesDeleteCascade-1909219053 None] Creating volume 787aa2b2-1905-4b49-9a7b-76228def377e {{(pid=92060) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 17 04:44:14 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-937ce671-85d7-4e95-acbd-3280a125d75c tempest-VolumesDeleteCascade-1909219053 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 04:44:14 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-937ce671-85d7-4e95-acbd-3280a125d75c tempest-VolumesDeleteCascade-1909219053 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 04:44:14 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-937ce671-85d7-4e95-acbd-3280a125d75c tempest-VolumesDeleteCascade-1909219053 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588': None} {{(pid=92060) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 17 04:44:14 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-937ce671-85d7-4e95-acbd-3280a125d75c tempest-VolumesDeleteCascade-1909219053 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588'] {{(pid=92060) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 17 04:44:14 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-937ce671-85d7-4e95-acbd-3280a125d75c tempest-VolumesDeleteCascade-1909219053 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 04:44:14 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-937ce671-85d7-4e95-acbd-3280a125d75c tempest-VolumesDeleteCascade-1909219053 None] Selected osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588 as target Quobyte volume. {{(pid=92060) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 17 04:44:14 devstack cinder-volume[92060]: INFO cinder.volume.drivers.remotefs [None req-937ce671-85d7-4e95-acbd-3280a125d75c tempest-VolumesDeleteCascade-1909219053 None] casted to osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588 Jun 17 04:44:14 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-937ce671-85d7-4e95-acbd-3280a125d75c tempest-VolumesDeleteCascade-1909219053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-787aa2b2-1905-4b49-9a7b-76228def377e 1073741824 {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:44:14 devstack sudo[101138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-787aa2b2-1905-4b49-9a7b-76228def377e 1073741824 Jun 17 04:44:14 devstack sudo[101138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:44:14 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-9a736fd7-3ab0-47ef-ad8e-1ebadae26f97 tempest-VolumesSnapshotTestJSON-1039322322 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (23584fe1-804b-414b-bb4d-a4c1bb6ede9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cc44cc2e-42ac-4892-8587-446c312ae2a6', 'volume_size': 1}' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:44:14 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-9a736fd7-3ab0-47ef-ad8e-1ebadae26f97 tempest-VolumesSnapshotTestJSON-1039322322 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (54db91d4-5962-491b-8b8f-a6399e7e01bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:44:14 devstack cinder-volume[92060]: INFO cinder.volume.flows.manager.create_volume [None req-9a736fd7-3ab0-47ef-ad8e-1ebadae26f97 tempest-VolumesSnapshotTestJSON-1039322322 None] Volume volume-cc44cc2e-42ac-4892-8587-446c312ae2a6 (cc44cc2e-42ac-4892-8587-446c312ae2a6): created successfully Jun 17 04:44:14 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-9a736fd7-3ab0-47ef-ad8e-1ebadae26f97 tempest-VolumesSnapshotTestJSON-1039322322 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (54db91d4-5962-491b-8b8f-a6399e7e01bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:44:14 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-9a736fd7-3ab0-47ef-ad8e-1ebadae26f97 tempest-VolumesSnapshotTestJSON-1039322322 None] Flow 'volume_create_manager' (410693be-570a-48b6-890a-3a7926dfa16e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92060) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 17 04:44:14 devstack cinder-volume[92060]: INFO cinder.volume.manager [None req-9a736fd7-3ab0-47ef-ad8e-1ebadae26f97 tempest-VolumesSnapshotTestJSON-1039322322 None] Created volume successfully. Jun 17 04:44:15 devstack sudo[101138]: pam_unix(sudo:session): session closed for user root Jun 17 04:44:15 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-937ce671-85d7-4e95-acbd-3280a125d75c tempest-VolumesDeleteCascade-1909219053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-787aa2b2-1905-4b49-9a7b-76228def377e 1073741824" returned: 0 in 1.062s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:44:15 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-937ce671-85d7-4e95-acbd-3280a125d75c tempest-VolumesDeleteCascade-1909219053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-787aa2b2-1905-4b49-9a7b-76228def377e {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:44:15 devstack sudo[101144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-787aa2b2-1905-4b49-9a7b-76228def377e Jun 17 04:44:15 devstack sudo[101144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:44:15 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-d66155eb-f19f-45a7-a48c-cb04fad9abf7 tempest-VolumesSnapshotTestJSON-1039322322 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 04:44:16 devstack sudo[101144]: pam_unix(sudo:session): session closed for user root Jun 17 04:44:16 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-937ce671-85d7-4e95-acbd-3280a125d75c tempest-VolumesDeleteCascade-1909219053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-787aa2b2-1905-4b49-9a7b-76228def377e" returned: 0 in 0.757s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:44:16 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-937ce671-85d7-4e95-acbd-3280a125d75c tempest-VolumesDeleteCascade-1909219053 None] <== create_volume: return (1880ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588'} {{(pid=92060) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 17 04:44:16 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-937ce671-85d7-4e95-acbd-3280a125d75c tempest-VolumesDeleteCascade-1909219053 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.883s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 04:44:16 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-d66155eb-f19f-45a7-a48c-cb04fad9abf7 tempest-VolumesSnapshotTestJSON-1039322322 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.569s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 04:44:16 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.remotefs [None req-d66155eb-f19f-45a7-a48c-cb04fad9abf7 tempest-VolumesSnapshotTestJSON-1039322322 None] Creating offline snapshot 0c726350-18a4-48e9-a3a6-638bf1216835 of volume cc44cc2e-42ac-4892-8587-446c312ae2a6 {{(pid=92060) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 17 04:44:16 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-937ce671-85d7-4e95-acbd-3280a125d75c tempest-VolumesDeleteCascade-1909219053 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (10f803db-26b3-4501-9f14-fd6db8add7de) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-787aa2b2-1905-4b49-9a7b-76228def377e', 'volume_size': 1}' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:44:16 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-937ce671-85d7-4e95-acbd-3280a125d75c tempest-VolumesDeleteCascade-1909219053 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c6d76684-e621-4307-a70a-d9675581f7fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:44:16 devstack cinder-volume[92060]: DEBUG oslo.privsep.daemon [-] privsep: reply[76fc9db8-fba5-417e-a40a-825e3d5dfdbe]: (4, 'qcow2') {{(pid=93130) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 04:44:16 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-d66155eb-f19f-45a7-a48c-cb04fad9abf7 tempest-VolumesSnapshotTestJSON-1039322322 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-cc44cc2e-42ac-4892-8587-446c312ae2a6 {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:44:16 devstack cinder-volume[92060]: INFO cinder.volume.flows.manager.create_volume [None req-937ce671-85d7-4e95-acbd-3280a125d75c tempest-VolumesDeleteCascade-1909219053 None] Volume volume-787aa2b2-1905-4b49-9a7b-76228def377e (787aa2b2-1905-4b49-9a7b-76228def377e): created successfully Jun 17 04:44:16 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-937ce671-85d7-4e95-acbd-3280a125d75c tempest-VolumesDeleteCascade-1909219053 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c6d76684-e621-4307-a70a-d9675581f7fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:44:16 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-937ce671-85d7-4e95-acbd-3280a125d75c tempest-VolumesDeleteCascade-1909219053 None] Flow 'volume_create_manager' (8a06a293-a1e2-42d7-8e6a-fcdaa9eac42b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92060) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 17 04:44:16 devstack cinder-volume[92060]: INFO cinder.volume.manager [None req-937ce671-85d7-4e95-acbd-3280a125d75c tempest-VolumesDeleteCascade-1909219053 None] Created volume successfully. Jun 17 04:44:16 devstack sudo[101171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-cc44cc2e-42ac-4892-8587-446c312ae2a6 Jun 17 04:44:16 devstack sudo[101171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:44:17 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-58df5318-d6b2-4ba1-9889-5688da2ffcf2 tempest-VolumesDeleteCascade-1909219053 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 04:44:17 devstack sudo[101171]: pam_unix(sudo:session): session closed for user root Jun 17 04:44:17 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-d66155eb-f19f-45a7-a48c-cb04fad9abf7 tempest-VolumesSnapshotTestJSON-1039322322 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-cc44cc2e-42ac-4892-8587-446c312ae2a6" returned: 0 in 1.041s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:44:17 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-d66155eb-f19f-45a7-a48c-cb04fad9abf7 tempest-VolumesSnapshotTestJSON-1039322322 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-cc44cc2e-42ac-4892-8587-446c312ae2a6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-cc44cc2e-42ac-4892-8587-446c312ae2a6.0c726350-18a4-48e9-a3a6-638bf1216835 1G {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:44:17 devstack sudo[101214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-cc44cc2e-42ac-4892-8587-446c312ae2a6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-cc44cc2e-42ac-4892-8587-446c312ae2a6.0c726350-18a4-48e9-a3a6-638bf1216835 1G Jun 17 04:44:17 devstack sudo[101214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:44:18 devstack sudo[101214]: pam_unix(sudo:session): session closed for user root Jun 17 04:44:18 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-d66155eb-f19f-45a7-a48c-cb04fad9abf7 tempest-VolumesSnapshotTestJSON-1039322322 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-cc44cc2e-42ac-4892-8587-446c312ae2a6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-cc44cc2e-42ac-4892-8587-446c312ae2a6.0c726350-18a4-48e9-a3a6-638bf1216835 1G" returned: 0 in 0.832s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:44:18 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-d66155eb-f19f-45a7-a48c-cb04fad9abf7 tempest-VolumesSnapshotTestJSON-1039322322 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cc44cc2e-42ac-4892-8587-446c312ae2a6 -F qcow2 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-cc44cc2e-42ac-4892-8587-446c312ae2a6.0c726350-18a4-48e9-a3a6-638bf1216835 {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:44:18 devstack sudo[101257]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cc44cc2e-42ac-4892-8587-446c312ae2a6 -F qcow2 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-cc44cc2e-42ac-4892-8587-446c312ae2a6.0c726350-18a4-48e9-a3a6-638bf1216835 Jun 17 04:44:18 devstack sudo[101257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:44:18 devstack cinder-volume[92060]: INFO cinder.volume.manager [req-83077fd9-28b4-4ad2-975c-5f4853a038eb req-09e242d2-d297-453a-a204-923c0a148f06 tempest-AttachVolumeTestJSON-189381823 None] Terminate volume connection completed successfully. Jun 17 04:44:18 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [req-83077fd9-28b4-4ad2-975c-5f4853a038eb req-09e242d2-d297-453a-a204-923c0a148f06 tempest-AttachVolumeTestJSON-189381823 None] Deleting attachment e2ea77fc-4eeb-4faa-8c16-26e124c71fa7. {{(pid=92060) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 17 04:44:19 devstack sudo[101257]: pam_unix(sudo:session): session closed for user root Jun 17 04:44:19 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-d66155eb-f19f-45a7-a48c-cb04fad9abf7 tempest-VolumesSnapshotTestJSON-1039322322 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cc44cc2e-42ac-4892-8587-446c312ae2a6 -F qcow2 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-cc44cc2e-42ac-4892-8587-446c312ae2a6.0c726350-18a4-48e9-a3a6-638bf1216835" returned: 0 in 0.758s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:44:19 devstack cinder-volume[92060]: WARNING cinder.volume.drivers.remotefs [None req-d66155eb-f19f-45a7-a48c-cb04fad9abf7 tempest-VolumesSnapshotTestJSON-1039322322 None] /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-cc44cc2e-42ac-4892-8587-446c312ae2a6.0c726350-18a4-48e9-a3a6-638bf1216835 is being set with open permissions: ugo+rw Jun 17 04:44:19 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-d66155eb-f19f-45a7-a48c-cb04fad9abf7 tempest-VolumesSnapshotTestJSON-1039322322 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-cc44cc2e-42ac-4892-8587-446c312ae2a6.0c726350-18a4-48e9-a3a6-638bf1216835 {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:44:19 devstack sudo[101266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-cc44cc2e-42ac-4892-8587-446c312ae2a6.0c726350-18a4-48e9-a3a6-638bf1216835 Jun 17 04:44:19 devstack sudo[101266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:44:19 devstack sudo[101266]: pam_unix(sudo:session): session closed for user root Jun 17 04:44:19 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-d66155eb-f19f-45a7-a48c-cb04fad9abf7 tempest-VolumesSnapshotTestJSON-1039322322 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-cc44cc2e-42ac-4892-8587-446c312ae2a6.0c726350-18a4-48e9-a3a6-638bf1216835" returned: 0 in 0.602s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:44:19 devstack cinder-volume[92060]: DEBUG dbcounter [-] [92060] Writing DB stats cinder:DELETE=15,cinder:SELECT=121,cinder:UPDATE=142,cinder:INSERT=33 {{(pid=92060) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 17 04:44:19 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-d66155eb-f19f-45a7-a48c-cb04fad9abf7 tempest-VolumesSnapshotTestJSON-1039322322 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-cc44cc2e-42ac-4892-8587-446c312ae2a6.info {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:44:19 devstack sudo[101269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-cc44cc2e-42ac-4892-8587-446c312ae2a6.info Jun 17 04:44:19 devstack sudo[101269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:44:20 devstack sudo[101269]: pam_unix(sudo:session): session closed for user root Jun 17 04:44:20 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-d66155eb-f19f-45a7-a48c-cb04fad9abf7 tempest-VolumesSnapshotTestJSON-1039322322 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-cc44cc2e-42ac-4892-8587-446c312ae2a6.info" returned: 0 in 0.649s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:44:20 devstack cinder-volume[92060]: WARNING cinder.volume.drivers.remotefs [None req-d66155eb-f19f-45a7-a48c-cb04fad9abf7 tempest-VolumesSnapshotTestJSON-1039322322 None] /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-cc44cc2e-42ac-4892-8587-446c312ae2a6.info is being set with open permissions: ugo+rw Jun 17 04:44:20 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-d66155eb-f19f-45a7-a48c-cb04fad9abf7 tempest-VolumesSnapshotTestJSON-1039322322 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-cc44cc2e-42ac-4892-8587-446c312ae2a6.info {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:44:20 devstack sudo[101272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-cc44cc2e-42ac-4892-8587-446c312ae2a6.info Jun 17 04:44:20 devstack sudo[101272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:44:21 devstack sudo[101272]: pam_unix(sudo:session): session closed for user root Jun 17 04:44:21 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-d66155eb-f19f-45a7-a48c-cb04fad9abf7 tempest-VolumesSnapshotTestJSON-1039322322 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-cc44cc2e-42ac-4892-8587-446c312ae2a6.info" returned: 0 in 0.615s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:44:21 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-d66155eb-f19f-45a7-a48c-cb04fad9abf7 tempest-VolumesSnapshotTestJSON-1039322322 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.637s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 04:44:21 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-58df5318-d6b2-4ba1-9889-5688da2ffcf2 tempest-VolumesDeleteCascade-1909219053 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 3.970s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 04:44:21 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.remotefs [None req-58df5318-d6b2-4ba1-9889-5688da2ffcf2 tempest-VolumesDeleteCascade-1909219053 None] Creating offline snapshot ad883e4c-5402-4ef5-8a7e-eef7191d6637 of volume 787aa2b2-1905-4b49-9a7b-76228def377e {{(pid=92060) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 17 04:44:21 devstack cinder-volume[92060]: INFO cinder.volume.manager [None req-d66155eb-f19f-45a7-a48c-cb04fad9abf7 tempest-VolumesSnapshotTestJSON-1039322322 None] Create snapshot completed successfully Jun 17 04:44:21 devstack cinder-volume[92060]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0e4c194-10a4-4e0d-ae91-0af5e289a45a]: (4, 'qcow2') {{(pid=93130) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 04:44:21 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-58df5318-d6b2-4ba1-9889-5688da2ffcf2 tempest-VolumesDeleteCascade-1909219053 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-787aa2b2-1905-4b49-9a7b-76228def377e {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:44:21 devstack cinder-volume[92060]: INFO cinder.volume.manager [req-7ff5cdc6-ff5c-49e5-9355-d8de0571b205 req-bccbb335-5cfd-4d94-8b5c-1b0401c4d523 tempest-AttachVolumeTestJSON-189381823 None] Terminate volume connection completed successfully. Jun 17 04:44:21 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [req-7ff5cdc6-ff5c-49e5-9355-d8de0571b205 req-bccbb335-5cfd-4d94-8b5c-1b0401c4d523 tempest-AttachVolumeTestJSON-189381823 None] Deleting attachment 3a20436f-7a97-493c-9723-12a7a590f779. {{(pid=92060) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 17 04:44:21 devstack sudo[101279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-787aa2b2-1905-4b49-9a7b-76228def377e Jun 17 04:44:21 devstack sudo[101279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:44:21 devstack sudo[101279]: pam_unix(sudo:session): session closed for user root Jun 17 04:44:21 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-58df5318-d6b2-4ba1-9889-5688da2ffcf2 tempest-VolumesDeleteCascade-1909219053 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-787aa2b2-1905-4b49-9a7b-76228def377e" returned: 0 in 0.765s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:44:21 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-58df5318-d6b2-4ba1-9889-5688da2ffcf2 tempest-VolumesDeleteCascade-1909219053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-787aa2b2-1905-4b49-9a7b-76228def377e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-787aa2b2-1905-4b49-9a7b-76228def377e.ad883e4c-5402-4ef5-8a7e-eef7191d6637 1G {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:44:21 devstack sudo[101286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-787aa2b2-1905-4b49-9a7b-76228def377e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-787aa2b2-1905-4b49-9a7b-76228def377e.ad883e4c-5402-4ef5-8a7e-eef7191d6637 1G Jun 17 04:44:21 devstack sudo[101286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:44:22 devstack cinder-volume[92060]: DEBUG cinder.volume.flows.manager.create_volume [None req-89abde00-e3fe-42d0-9cb5-148e326b56f6 tempest-VolumesSnapshotTestJSON-1039322322 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92060) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 17 04:44:22 devstack sudo[101286]: pam_unix(sudo:session): session closed for user root Jun 17 04:44:22 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-89abde00-e3fe-42d0-9cb5-148e326b56f6 tempest-VolumesSnapshotTestJSON-1039322322 None] Flow 'volume_create_manager' (7a07708f-d645-40a4-ada6-d3523243a29f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 17 04:44:22 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-89abde00-e3fe-42d0-9cb5-148e326b56f6 tempest-VolumesSnapshotTestJSON-1039322322 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6382868d-5bbd-42d0-835e-149e1d9d6247) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:44:22 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-58df5318-d6b2-4ba1-9889-5688da2ffcf2 tempest-VolumesDeleteCascade-1909219053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-787aa2b2-1905-4b49-9a7b-76228def377e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-787aa2b2-1905-4b49-9a7b-76228def377e.ad883e4c-5402-4ef5-8a7e-eef7191d6637 1G" returned: 0 in 0.887s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:44:22 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-58df5318-d6b2-4ba1-9889-5688da2ffcf2 tempest-VolumesDeleteCascade-1909219053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-787aa2b2-1905-4b49-9a7b-76228def377e -F qcow2 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-787aa2b2-1905-4b49-9a7b-76228def377e.ad883e4c-5402-4ef5-8a7e-eef7191d6637 {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:44:22 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-89abde00-e3fe-42d0-9cb5-148e326b56f6 tempest-VolumesSnapshotTestJSON-1039322322 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6382868d-5bbd-42d0-835e-149e1d9d6247) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-17T02:44:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-335099806',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=03e84962-0a15-4b8c-bfd3-659ed0261dfe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='411c6111710645bfa3f034c46596cbaf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T02:44:23Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=0c726350-18a4-48e9-a3a6-638bf1216835,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T02:44:23Z,use_quota=True,user_id='84f516bc01824ccfaaea6fa73a4f20b1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aad9ce24-93f9-41a6-baa1-5125964f96d1),volume_type_id=aad9ce24-93f9-41a6-baa1-5125964f96d1)' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:44:22 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-89abde00-e3fe-42d0-9cb5-148e326b56f6 tempest-VolumesSnapshotTestJSON-1039322322 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3eb6a690-f536-4070-8e0d-134763a3451d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:44:22 devstack sudo[101292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-787aa2b2-1905-4b49-9a7b-76228def377e -F qcow2 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-787aa2b2-1905-4b49-9a7b-76228def377e.ad883e4c-5402-4ef5-8a7e-eef7191d6637 Jun 17 04:44:22 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-89abde00-e3fe-42d0-9cb5-148e326b56f6 tempest-VolumesSnapshotTestJSON-1039322322 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3eb6a690-f536-4070-8e0d-134763a3451d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:44:22 devstack sudo[101292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:44:22 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-89abde00-e3fe-42d0-9cb5-148e326b56f6 tempest-VolumesSnapshotTestJSON-1039322322 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c9b2c6f9-9622-4142-8cf4-0343a85fdcdb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:44:22 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-89abde00-e3fe-42d0-9cb5-148e326b56f6 tempest-VolumesSnapshotTestJSON-1039322322 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c9b2c6f9-9622-4142-8cf4-0343a85fdcdb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '03e84962-0a15-4b8c-bfd3-659ed0261dfe', 'volume_name': 'volume-03e84962-0a15-4b8c-bfd3-659ed0261dfe', 'volume_size': 2, 'snapshot_id': '0c726350-18a4-48e9-a3a6-638bf1216835'}' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:44:22 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-89abde00-e3fe-42d0-9cb5-148e326b56f6 tempest-VolumesSnapshotTestJSON-1039322322 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c54e9175-d2ea-42eb-9625-97790ee3d77d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:44:22 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-89abde00-e3fe-42d0-9cb5-148e326b56f6 tempest-VolumesSnapshotTestJSON-1039322322 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c54e9175-d2ea-42eb-9625-97790ee3d77d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:44:22 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-89abde00-e3fe-42d0-9cb5-148e326b56f6 tempest-VolumesSnapshotTestJSON-1039322322 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (677be42a-62ce-4159-a71c-c054c0675367) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:44:22 devstack cinder-volume[92060]: INFO cinder.volume.flows.manager.create_volume [None req-89abde00-e3fe-42d0-9cb5-148e326b56f6 tempest-VolumesSnapshotTestJSON-1039322322 None] Volume 03e84962-0a15-4b8c-bfd3-659ed0261dfe: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-03e84962-0a15-4b8c-bfd3-659ed0261dfe', 'volume_size': 2, 'snapshot_id': '0c726350-18a4-48e9-a3a6-638bf1216835'} Jun 17 04:44:22 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-89abde00-e3fe-42d0-9cb5-148e326b56f6 tempest-VolumesSnapshotTestJSON-1039322322 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 04:44:23 devstack sudo[101292]: pam_unix(sudo:session): session closed for user root Jun 17 04:44:23 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-58df5318-d6b2-4ba1-9889-5688da2ffcf2 tempest-VolumesDeleteCascade-1909219053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-787aa2b2-1905-4b49-9a7b-76228def377e -F qcow2 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-787aa2b2-1905-4b49-9a7b-76228def377e.ad883e4c-5402-4ef5-8a7e-eef7191d6637" returned: 0 in 0.717s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:44:23 devstack cinder-volume[92060]: WARNING cinder.volume.drivers.remotefs [None req-58df5318-d6b2-4ba1-9889-5688da2ffcf2 tempest-VolumesDeleteCascade-1909219053 None] /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-787aa2b2-1905-4b49-9a7b-76228def377e.ad883e4c-5402-4ef5-8a7e-eef7191d6637 is being set with open permissions: ugo+rw Jun 17 04:44:23 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-58df5318-d6b2-4ba1-9889-5688da2ffcf2 tempest-VolumesDeleteCascade-1909219053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-787aa2b2-1905-4b49-9a7b-76228def377e.ad883e4c-5402-4ef5-8a7e-eef7191d6637 {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:44:23 devstack sudo[101298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-787aa2b2-1905-4b49-9a7b-76228def377e.ad883e4c-5402-4ef5-8a7e-eef7191d6637 Jun 17 04:44:23 devstack sudo[101298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:44:24 devstack sudo[101298]: pam_unix(sudo:session): session closed for user root Jun 17 04:44:24 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-58df5318-d6b2-4ba1-9889-5688da2ffcf2 tempest-VolumesDeleteCascade-1909219053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-787aa2b2-1905-4b49-9a7b-76228def377e.ad883e4c-5402-4ef5-8a7e-eef7191d6637" returned: 0 in 0.617s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:44:24 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-58df5318-d6b2-4ba1-9889-5688da2ffcf2 tempest-VolumesDeleteCascade-1909219053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-787aa2b2-1905-4b49-9a7b-76228def377e.info {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:44:24 devstack sudo[101301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-787aa2b2-1905-4b49-9a7b-76228def377e.info Jun 17 04:44:24 devstack sudo[101301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:44:24 devstack sudo[101301]: pam_unix(sudo:session): session closed for user root Jun 17 04:44:24 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-58df5318-d6b2-4ba1-9889-5688da2ffcf2 tempest-VolumesDeleteCascade-1909219053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-787aa2b2-1905-4b49-9a7b-76228def377e.info" returned: 0 in 0.717s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:44:24 devstack cinder-volume[92060]: WARNING cinder.volume.drivers.remotefs [None req-58df5318-d6b2-4ba1-9889-5688da2ffcf2 tempest-VolumesDeleteCascade-1909219053 None] /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-787aa2b2-1905-4b49-9a7b-76228def377e.info is being set with open permissions: ugo+rw Jun 17 04:44:24 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-58df5318-d6b2-4ba1-9889-5688da2ffcf2 tempest-VolumesDeleteCascade-1909219053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-787aa2b2-1905-4b49-9a7b-76228def377e.info {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:44:24 devstack sudo[101332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-787aa2b2-1905-4b49-9a7b-76228def377e.info Jun 17 04:44:24 devstack sudo[101332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:44:25 devstack sudo[101332]: pam_unix(sudo:session): session closed for user root Jun 17 04:44:25 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-58df5318-d6b2-4ba1-9889-5688da2ffcf2 tempest-VolumesDeleteCascade-1909219053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-787aa2b2-1905-4b49-9a7b-76228def377e.info" returned: 0 in 0.740s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:44:25 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-58df5318-d6b2-4ba1-9889-5688da2ffcf2 tempest-VolumesDeleteCascade-1909219053 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.549s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 04:44:25 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-89abde00-e3fe-42d0-9cb5-148e326b56f6 tempest-VolumesSnapshotTestJSON-1039322322 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 2.767s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 04:44:25 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-89abde00-e3fe-42d0-9cb5-148e326b56f6 tempest-VolumesSnapshotTestJSON-1039322322 None] Acquiring lock "cinder-quobyte-0c726350-18a4-48e9-a3a6-638bf1216835-03e84962-0a15-4b8c-bfd3-659ed0261dfe" by "_create_volume_from_snapshot" {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 04:44:25 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-89abde00-e3fe-42d0-9cb5-148e326b56f6 tempest-VolumesSnapshotTestJSON-1039322322 None] Lock "cinder-quobyte-0c726350-18a4-48e9-a3a6-638bf1216835-03e84962-0a15-4b8c-bfd3-659ed0261dfe" acquired by "_create_volume_from_snapshot" :: waited 0.026s {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 04:44:25 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-89abde00-e3fe-42d0-9cb5-148e326b56f6 tempest-VolumesSnapshotTestJSON-1039322322 None] Creating volume 03e84962-0a15-4b8c-bfd3-659ed0261dfe from snapshot 0c726350-18a4-48e9-a3a6-638bf1216835 {{(pid=92060) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jun 17 04:44:25 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-89abde00-e3fe-42d0-9cb5-148e326b56f6 tempest-VolumesSnapshotTestJSON-1039322322 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 04:44:25 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-89abde00-e3fe-42d0-9cb5-148e326b56f6 tempest-VolumesSnapshotTestJSON-1039322322 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 04:44:25 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-89abde00-e3fe-42d0-9cb5-148e326b56f6 tempest-VolumesSnapshotTestJSON-1039322322 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588': None} {{(pid=92060) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 17 04:44:25 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-89abde00-e3fe-42d0-9cb5-148e326b56f6 tempest-VolumesSnapshotTestJSON-1039322322 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588'] {{(pid=92060) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 17 04:44:25 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-89abde00-e3fe-42d0-9cb5-148e326b56f6 tempest-VolumesSnapshotTestJSON-1039322322 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 04:44:25 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-89abde00-e3fe-42d0-9cb5-148e326b56f6 tempest-VolumesSnapshotTestJSON-1039322322 None] Selected osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588 as target Quobyte volume. {{(pid=92060) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 17 04:44:25 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-89abde00-e3fe-42d0-9cb5-148e326b56f6 tempest-VolumesSnapshotTestJSON-1039322322 None] Acquiring lock "cinder-quobyte-03e84962-0a15-4b8c-bfd3-659ed0261dfe" by "_copy_volume_from_snapshot" {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 04:44:25 devstack cinder-volume[92060]: INFO cinder.volume.manager [None req-58df5318-d6b2-4ba1-9889-5688da2ffcf2 tempest-VolumesDeleteCascade-1909219053 None] Create snapshot completed successfully Jun 17 04:44:25 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-89abde00-e3fe-42d0-9cb5-148e326b56f6 tempest-VolumesSnapshotTestJSON-1039322322 None] Lock "cinder-quobyte-03e84962-0a15-4b8c-bfd3-659ed0261dfe" acquired by "_copy_volume_from_snapshot" :: waited 0.022s {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 04:44:25 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-89abde00-e3fe-42d0-9cb5-148e326b56f6 tempest-VolumesSnapshotTestJSON-1039322322 None] snapshot: 0c726350-18a4-48e9-a3a6-638bf1216835, volume: 03e84962-0a15-4b8c-bfd3-659ed0261dfe, {{(pid=92060) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jun 17 04:44:25 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-89abde00-e3fe-42d0-9cb5-148e326b56f6 tempest-VolumesSnapshotTestJSON-1039322322 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 04:44:25 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-89abde00-e3fe-42d0-9cb5-148e326b56f6 tempest-VolumesSnapshotTestJSON-1039322322 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 04:44:25 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-89abde00-e3fe-42d0-9cb5-148e326b56f6 tempest-VolumesSnapshotTestJSON-1039322322 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588': None} {{(pid=92060) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 17 04:44:25 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-89abde00-e3fe-42d0-9cb5-148e326b56f6 tempest-VolumesSnapshotTestJSON-1039322322 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588'] {{(pid=92060) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 17 04:44:25 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-89abde00-e3fe-42d0-9cb5-148e326b56f6 tempest-VolumesSnapshotTestJSON-1039322322 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 04:44:25 devstack cinder-volume[92060]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ecfd454-c98f-4f11-a684-e484a8d9aecd]: (4, 'qcow2') {{(pid=93130) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 04:44:25 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-89abde00-e3fe-42d0-9cb5-148e326b56f6 tempest-VolumesSnapshotTestJSON-1039322322 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-cc44cc2e-42ac-4892-8587-446c312ae2a6.0c726350-18a4-48e9-a3a6-638bf1216835 {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:44:25 devstack sudo[101351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-cc44cc2e-42ac-4892-8587-446c312ae2a6.0c726350-18a4-48e9-a3a6-638bf1216835 Jun 17 04:44:25 devstack sudo[101351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:44:26 devstack sudo[101351]: pam_unix(sudo:session): session closed for user root Jun 17 04:44:26 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-89abde00-e3fe-42d0-9cb5-148e326b56f6 tempest-VolumesSnapshotTestJSON-1039322322 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-cc44cc2e-42ac-4892-8587-446c312ae2a6.0c726350-18a4-48e9-a3a6-638bf1216835" returned: 0 in 0.779s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:44:26 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.remotefs [None req-89abde00-e3fe-42d0-9cb5-148e326b56f6 tempest-VolumesSnapshotTestJSON-1039322322 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cc44cc2e-42ac-4892-8587-446c312ae2a6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=92060) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 17 04:44:26 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-89abde00-e3fe-42d0-9cb5-148e326b56f6 tempest-VolumesSnapshotTestJSON-1039322322 None] will copy from snapshot at /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-cc44cc2e-42ac-4892-8587-446c312ae2a6 {{(pid=92060) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jun 17 04:44:26 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-89abde00-e3fe-42d0-9cb5-148e326b56f6 tempest-VolumesSnapshotTestJSON-1039322322 None] Creating direct copy from snapshot {{(pid=92060) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jun 17 04:44:26 devstack cinder-volume[92060]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d31c188-665b-46a8-9c2d-669978bd0b41]: (4, 'qcow2') {{(pid=93130) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 04:44:26 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-89abde00-e3fe-42d0-9cb5-148e326b56f6 tempest-VolumesSnapshotTestJSON-1039322322 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-cc44cc2e-42ac-4892-8587-446c312ae2a6 {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:44:26 devstack sudo[101358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-cc44cc2e-42ac-4892-8587-446c312ae2a6 Jun 17 04:44:26 devstack sudo[101358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:44:27 devstack cinder-volume[92060]: DEBUG cinder.volume.flows.manager.create_volume [None req-3fba6b68-54be-4844-abba-91c1bc88b5c4 tempest-VolumesDeleteCascade-1909219053 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92060) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 17 04:44:27 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-3fba6b68-54be-4844-abba-91c1bc88b5c4 tempest-VolumesDeleteCascade-1909219053 None] Flow 'volume_create_manager' (dceb00fb-19a9-4674-9690-d00c56e7b2ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 17 04:44:27 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-3fba6b68-54be-4844-abba-91c1bc88b5c4 tempest-VolumesDeleteCascade-1909219053 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (15873cb9-a1aa-45f5-b92a-b60f7f2882f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:44:27 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-3fba6b68-54be-4844-abba-91c1bc88b5c4 tempest-VolumesDeleteCascade-1909219053 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (15873cb9-a1aa-45f5-b92a-b60f7f2882f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-17T02:44:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1345175799',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=887cb018-0ecb-4d35-8b33-b5e4e9276daa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='71aa70d8201e463f904712e7de33922a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T02:44:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=ad883e4c-5402-4ef5-8a7e-eef7191d6637,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T02:44:27Z,use_quota=True,user_id='078aaa69dcdb4ab8854c52f9529b905c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aad9ce24-93f9-41a6-baa1-5125964f96d1),volume_type_id=aad9ce24-93f9-41a6-baa1-5125964f96d1)' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:44:27 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-3fba6b68-54be-4844-abba-91c1bc88b5c4 tempest-VolumesDeleteCascade-1909219053 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1cec811e-1529-4215-b7d0-9976cd0bb842) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:44:27 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-3fba6b68-54be-4844-abba-91c1bc88b5c4 tempest-VolumesDeleteCascade-1909219053 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1cec811e-1529-4215-b7d0-9976cd0bb842) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:44:27 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-3fba6b68-54be-4844-abba-91c1bc88b5c4 tempest-VolumesDeleteCascade-1909219053 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1e9169e7-1abd-4a23-922e-1c035acb72a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:44:27 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-3fba6b68-54be-4844-abba-91c1bc88b5c4 tempest-VolumesDeleteCascade-1909219053 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1e9169e7-1abd-4a23-922e-1c035acb72a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '887cb018-0ecb-4d35-8b33-b5e4e9276daa', 'volume_name': 'volume-887cb018-0ecb-4d35-8b33-b5e4e9276daa', 'volume_size': 1, 'snapshot_id': 'ad883e4c-5402-4ef5-8a7e-eef7191d6637'}' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:44:27 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-3fba6b68-54be-4844-abba-91c1bc88b5c4 tempest-VolumesDeleteCascade-1909219053 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7d8a8933-6c06-4b01-94ff-8c619689ab5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:44:27 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-3fba6b68-54be-4844-abba-91c1bc88b5c4 tempest-VolumesDeleteCascade-1909219053 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7d8a8933-6c06-4b01-94ff-8c619689ab5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:44:27 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-3fba6b68-54be-4844-abba-91c1bc88b5c4 tempest-VolumesDeleteCascade-1909219053 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9cbecab7-8ea5-4d23-ad61-bdcc8254d1bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:44:27 devstack cinder-volume[92060]: INFO cinder.volume.flows.manager.create_volume [None req-3fba6b68-54be-4844-abba-91c1bc88b5c4 tempest-VolumesDeleteCascade-1909219053 None] Volume 887cb018-0ecb-4d35-8b33-b5e4e9276daa: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-887cb018-0ecb-4d35-8b33-b5e4e9276daa', 'volume_size': 1, 'snapshot_id': 'ad883e4c-5402-4ef5-8a7e-eef7191d6637'} Jun 17 04:44:27 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-3fba6b68-54be-4844-abba-91c1bc88b5c4 tempest-VolumesDeleteCascade-1909219053 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 04:44:27 devstack sudo[101358]: pam_unix(sudo:session): session closed for user root Jun 17 04:44:27 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-89abde00-e3fe-42d0-9cb5-148e326b56f6 tempest-VolumesSnapshotTestJSON-1039322322 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-cc44cc2e-42ac-4892-8587-446c312ae2a6" returned: 0 in 0.996s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:44:27 devstack cinder-volume[92060]: DEBUG cinder.utils [None req-89abde00-e3fe-42d0-9cb5-148e326b56f6 tempest-VolumesSnapshotTestJSON-1039322322 None] Path /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-03e84962-0a15-4b8c-bfd3-659ed0261dfe not found in is_blk_device check {{(pid=92060) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jun 17 04:44:27 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-89abde00-e3fe-42d0-9cb5-148e326b56f6 tempest-VolumesSnapshotTestJSON-1039322322 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-cc44cc2e-42ac-4892-8587-446c312ae2a6 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-03e84962-0a15-4b8c-bfd3-659ed0261dfe {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:44:27 devstack sudo[101365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-cc44cc2e-42ac-4892-8587-446c312ae2a6 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-03e84962-0a15-4b8c-bfd3-659ed0261dfe Jun 17 04:44:27 devstack sudo[101365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:44:29 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-7307979b-d08d-49a2-9d3b-c78223046374 tempest-VolumesNegativeTest-1419416898 None] Acquiring lock "cinder-6144d3a5-4717-43dc-b912-a9aac1276a73-delete_volume" by "delete_volume" {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 04:44:29 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-7307979b-d08d-49a2-9d3b-c78223046374 tempest-VolumesNegativeTest-1419416898 None] Lock "cinder-6144d3a5-4717-43dc-b912-a9aac1276a73-delete_volume" acquired by "delete_volume" :: waited 0.051s {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 04:44:29 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-7307979b-d08d-49a2-9d3b-c78223046374 tempest-VolumesNegativeTest-1419416898 None] Acquiring lock "cinder-quobyte-6144d3a5-4717-43dc-b912-a9aac1276a73" by "delete_volume" {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 04:44:29 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-7307979b-d08d-49a2-9d3b-c78223046374 tempest-VolumesNegativeTest-1419416898 None] Lock "cinder-quobyte-6144d3a5-4717-43dc-b912-a9aac1276a73" acquired by "delete_volume" :: waited 0.038s {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 04:44:29 devstack cinder-volume[92060]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecef4d00-d92c-4d6d-8bb0-73488335eabf]: (4, 'qcow2') {{(pid=93130) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 04:44:29 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-7307979b-d08d-49a2-9d3b-c78223046374 tempest-VolumesNegativeTest-1419416898 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-6144d3a5-4717-43dc-b912-a9aac1276a73 {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:44:30 devstack sudo[101378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-6144d3a5-4717-43dc-b912-a9aac1276a73 Jun 17 04:44:30 devstack sudo[101378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:44:31 devstack sudo[101378]: pam_unix(sudo:session): session closed for user root Jun 17 04:44:31 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-7307979b-d08d-49a2-9d3b-c78223046374 tempest-VolumesNegativeTest-1419416898 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-6144d3a5-4717-43dc-b912-a9aac1276a73" returned: 0 in 1.279s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:44:31 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-7307979b-d08d-49a2-9d3b-c78223046374 tempest-VolumesNegativeTest-1419416898 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-6144d3a5-4717-43dc-b912-a9aac1276a73 {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:44:31 devstack sudo[101385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-6144d3a5-4717-43dc-b912-a9aac1276a73 Jun 17 04:44:31 devstack sudo[101385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:44:32 devstack sudo[101385]: pam_unix(sudo:session): session closed for user root Jun 17 04:44:32 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-7307979b-d08d-49a2-9d3b-c78223046374 tempest-VolumesNegativeTest-1419416898 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-6144d3a5-4717-43dc-b912-a9aac1276a73" returned: 0 in 1.489s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:44:32 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-7307979b-d08d-49a2-9d3b-c78223046374 tempest-VolumesNegativeTest-1419416898 None] Lock "cinder-quobyte-6144d3a5-4717-43dc-b912-a9aac1276a73" released by "delete_volume" :: held 2.866s {{(pid=92060) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 04:44:32 devstack cinder-volume[92060]: DEBUG cinder.quota [None req-7307979b-d08d-49a2-9d3b-c78223046374 tempest-VolumesNegativeTest-1419416898 None] Created reservations ['68d0e248-aef2-4e6c-b22f-812733c4945a', 'f9098768-f4a5-4b20-9558-c40cac90f87f', 'e415bd06-e4d7-4d8f-8c99-7f03b85c2f41', '9516d645-bdd1-44c2-8514-07f521cba412'] {{(pid=92060) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 17 04:44:33 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-7307979b-d08d-49a2-9d3b-c78223046374 tempest-VolumesNegativeTest-1419416898 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 04:44:33 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-7307979b-d08d-49a2-9d3b-c78223046374 tempest-VolumesNegativeTest-1419416898 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 04:44:33 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-7307979b-d08d-49a2-9d3b-c78223046374 tempest-VolumesNegativeTest-1419416898 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588': None} {{(pid=92060) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 17 04:44:33 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-7307979b-d08d-49a2-9d3b-c78223046374 tempest-VolumesNegativeTest-1419416898 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588'] {{(pid=92060) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 17 04:44:33 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-7307979b-d08d-49a2-9d3b-c78223046374 tempest-VolumesNegativeTest-1419416898 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 04:44:33 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-7307979b-d08d-49a2-9d3b-c78223046374 tempest-VolumesNegativeTest-1419416898 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:44:33 devstack sudo[101388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a Jun 17 04:44:33 devstack sudo[101388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:44:33 devstack sudo[101365]: pam_unix(sudo:session): session closed for user root Jun 17 04:44:33 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-89abde00-e3fe-42d0-9cb5-148e326b56f6 tempest-VolumesSnapshotTestJSON-1039322322 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-cc44cc2e-42ac-4892-8587-446c312ae2a6 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-03e84962-0a15-4b8c-bfd3-659ed0261dfe" returned: 0 in 6.002s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:44:33 devstack cinder-volume[92060]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcb22910-30ed-4706-9b74-3a19247ad7b6]: (4, 'qcow2') {{(pid=93130) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 04:44:33 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-89abde00-e3fe-42d0-9cb5-148e326b56f6 tempest-VolumesSnapshotTestJSON-1039322322 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-cc44cc2e-42ac-4892-8587-446c312ae2a6 {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:44:33 devstack sudo[101391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-cc44cc2e-42ac-4892-8587-446c312ae2a6 Jun 17 04:44:33 devstack sudo[101391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:44:33 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-63033189-646c-4d46-b707-3141e5d4c020 tempest-AttachVolumeTestJSON-189381823 None] Acquiring lock "cinder-b92c4149-011c-4b5a-82da-0d49240470fc-delete_volume" by "delete_volume" {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 04:44:33 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-63033189-646c-4d46-b707-3141e5d4c020 tempest-AttachVolumeTestJSON-189381823 None] Lock "cinder-b92c4149-011c-4b5a-82da-0d49240470fc-delete_volume" acquired by "delete_volume" :: waited 0.052s {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 04:44:34 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-63033189-646c-4d46-b707-3141e5d4c020 tempest-AttachVolumeTestJSON-189381823 None] Acquiring lock "cinder-quobyte-b92c4149-011c-4b5a-82da-0d49240470fc" by "delete_volume" {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 04:44:34 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-63033189-646c-4d46-b707-3141e5d4c020 tempest-AttachVolumeTestJSON-189381823 None] Lock "cinder-quobyte-b92c4149-011c-4b5a-82da-0d49240470fc" acquired by "delete_volume" :: waited 0.013s {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 04:44:34 devstack cinder-volume[92060]: DEBUG oslo.privsep.daemon [-] privsep: reply[9194926a-743f-4448-be4f-30fb122c2702]: (4, 'qcow2') {{(pid=93130) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 04:44:34 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-63033189-646c-4d46-b707-3141e5d4c020 tempest-AttachVolumeTestJSON-189381823 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-b92c4149-011c-4b5a-82da-0d49240470fc {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:44:34 devstack sudo[101388]: pam_unix(sudo:session): session closed for user root Jun 17 04:44:34 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-7307979b-d08d-49a2-9d3b-c78223046374 tempest-VolumesNegativeTest-1419416898 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a" returned: 0 in 1.040s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:44:34 devstack cinder-volume[92060]: DEBUG cinder.manager [None req-7307979b-d08d-49a2-9d3b-c78223046374 tempest-VolumesNegativeTest-1419416898 None] Notifying Schedulers of capabilities ... {{(pid=92060) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 17 04:44:34 devstack cinder-volume[92060]: INFO cinder.volume.manager [None req-7307979b-d08d-49a2-9d3b-c78223046374 tempest-VolumesNegativeTest-1419416898 None] Deleted volume successfully. Jun 17 04:44:34 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-7307979b-d08d-49a2-9d3b-c78223046374 tempest-VolumesNegativeTest-1419416898 None] Lock "cinder-6144d3a5-4717-43dc-b912-a9aac1276a73-delete_volume" released by "delete_volume" :: held 4.374s {{(pid=92060) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 04:44:34 devstack sudo[101394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-b92c4149-011c-4b5a-82da-0d49240470fc Jun 17 04:44:34 devstack sudo[101394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:44:34 devstack sudo[101391]: pam_unix(sudo:session): session closed for user root Jun 17 04:44:34 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-89abde00-e3fe-42d0-9cb5-148e326b56f6 tempest-VolumesSnapshotTestJSON-1039322322 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-cc44cc2e-42ac-4892-8587-446c312ae2a6" returned: 0 in 1.085s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:44:34 devstack cinder-volume[92060]: DEBUG cinder.image.image_utils [None req-89abde00-e3fe-42d0-9cb5-148e326b56f6 tempest-VolumesSnapshotTestJSON-1039322322 None] Image conversion details: src /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-cc44cc2e-42ac-4892-8587-446c312ae2a6, size 1024.00 MB, duration 6.00 sec, destination /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-03e84962-0a15-4b8c-bfd3-659ed0261dfe {{(pid=92060) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 17 04:44:34 devstack cinder-volume[92060]: INFO cinder.image.image_utils [None req-89abde00-e3fe-42d0-9cb5-148e326b56f6 tempest-VolumesSnapshotTestJSON-1039322322 None] Converted 1024.00 MB image at 170.58 MB/s Jun 17 04:44:34 devstack cinder-volume[92060]: WARNING cinder.volume.drivers.remotefs [None req-89abde00-e3fe-42d0-9cb5-148e326b56f6 tempest-VolumesSnapshotTestJSON-1039322322 None] /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-03e84962-0a15-4b8c-bfd3-659ed0261dfe is being set with open permissions: ugo+rw Jun 17 04:44:34 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-89abde00-e3fe-42d0-9cb5-148e326b56f6 tempest-VolumesSnapshotTestJSON-1039322322 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-03e84962-0a15-4b8c-bfd3-659ed0261dfe {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:44:34 devstack sudo[101401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-03e84962-0a15-4b8c-bfd3-659ed0261dfe Jun 17 04:44:34 devstack sudo[101401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:44:34 devstack sudo[101394]: pam_unix(sudo:session): session closed for user root Jun 17 04:44:34 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-63033189-646c-4d46-b707-3141e5d4c020 tempest-AttachVolumeTestJSON-189381823 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-b92c4149-011c-4b5a-82da-0d49240470fc" returned: 0 in 0.775s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:44:34 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-63033189-646c-4d46-b707-3141e5d4c020 tempest-AttachVolumeTestJSON-189381823 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-b92c4149-011c-4b5a-82da-0d49240470fc {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:44:34 devstack sudo[101404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-b92c4149-011c-4b5a-82da-0d49240470fc Jun 17 04:44:34 devstack sudo[101404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:44:35 devstack sudo[101401]: pam_unix(sudo:session): session closed for user root Jun 17 04:44:35 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-89abde00-e3fe-42d0-9cb5-148e326b56f6 tempest-VolumesSnapshotTestJSON-1039322322 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-03e84962-0a15-4b8c-bfd3-659ed0261dfe" returned: 0 in 0.703s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:44:35 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-89abde00-e3fe-42d0-9cb5-148e326b56f6 tempest-VolumesSnapshotTestJSON-1039322322 None] Lock "cinder-quobyte-03e84962-0a15-4b8c-bfd3-659ed0261dfe" released by "_copy_volume_from_snapshot" :: held 9.686s {{(pid=92060) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 04:44:35 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-89abde00-e3fe-42d0-9cb5-148e326b56f6 tempest-VolumesSnapshotTestJSON-1039322322 None] Lock "cinder-quobyte-0c726350-18a4-48e9-a3a6-638bf1216835-03e84962-0a15-4b8c-bfd3-659ed0261dfe" released by "_create_volume_from_snapshot" :: held 9.726s {{(pid=92060) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 04:44:35 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-89abde00-e3fe-42d0-9cb5-148e326b56f6 tempest-VolumesSnapshotTestJSON-1039322322 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.753s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 04:44:35 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-3fba6b68-54be-4844-abba-91c1bc88b5c4 tempest-VolumesDeleteCascade-1909219053 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 8.082s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 04:44:35 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-3fba6b68-54be-4844-abba-91c1bc88b5c4 tempest-VolumesDeleteCascade-1909219053 None] Acquiring lock "cinder-quobyte-ad883e4c-5402-4ef5-8a7e-eef7191d6637-887cb018-0ecb-4d35-8b33-b5e4e9276daa" by "_create_volume_from_snapshot" {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 04:44:35 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-3fba6b68-54be-4844-abba-91c1bc88b5c4 tempest-VolumesDeleteCascade-1909219053 None] Lock "cinder-quobyte-ad883e4c-5402-4ef5-8a7e-eef7191d6637-887cb018-0ecb-4d35-8b33-b5e4e9276daa" acquired by "_create_volume_from_snapshot" :: waited 0.032s {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 04:44:35 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-3fba6b68-54be-4844-abba-91c1bc88b5c4 tempest-VolumesDeleteCascade-1909219053 None] Creating volume 887cb018-0ecb-4d35-8b33-b5e4e9276daa from snapshot ad883e4c-5402-4ef5-8a7e-eef7191d6637 {{(pid=92060) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jun 17 04:44:35 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-3fba6b68-54be-4844-abba-91c1bc88b5c4 tempest-VolumesDeleteCascade-1909219053 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 04:44:35 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-3fba6b68-54be-4844-abba-91c1bc88b5c4 tempest-VolumesDeleteCascade-1909219053 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 04:44:35 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-3fba6b68-54be-4844-abba-91c1bc88b5c4 tempest-VolumesDeleteCascade-1909219053 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588': None} {{(pid=92060) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 17 04:44:35 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-3fba6b68-54be-4844-abba-91c1bc88b5c4 tempest-VolumesDeleteCascade-1909219053 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588'] {{(pid=92060) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 17 04:44:35 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-3fba6b68-54be-4844-abba-91c1bc88b5c4 tempest-VolumesDeleteCascade-1909219053 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 04:44:35 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-3fba6b68-54be-4844-abba-91c1bc88b5c4 tempest-VolumesDeleteCascade-1909219053 None] Selected osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588 as target Quobyte volume. {{(pid=92060) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 17 04:44:35 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-3fba6b68-54be-4844-abba-91c1bc88b5c4 tempest-VolumesDeleteCascade-1909219053 None] Acquiring lock "cinder-quobyte-887cb018-0ecb-4d35-8b33-b5e4e9276daa" by "_copy_volume_from_snapshot" {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 04:44:35 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-89abde00-e3fe-42d0-9cb5-148e326b56f6 tempest-VolumesSnapshotTestJSON-1039322322 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (677be42a-62ce-4159-a71c-c054c0675367) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-03e84962-0a15-4b8c-bfd3-659ed0261dfe', 'volume_size': 2, 'snapshot_id': '0c726350-18a4-48e9-a3a6-638bf1216835'}' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:44:35 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-89abde00-e3fe-42d0-9cb5-148e326b56f6 tempest-VolumesSnapshotTestJSON-1039322322 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cbfb6800-fe4d-458b-b562-277b58ca262f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:44:35 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-3fba6b68-54be-4844-abba-91c1bc88b5c4 tempest-VolumesDeleteCascade-1909219053 None] Lock "cinder-quobyte-887cb018-0ecb-4d35-8b33-b5e4e9276daa" acquired by "_copy_volume_from_snapshot" :: waited 0.035s {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 04:44:35 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-3fba6b68-54be-4844-abba-91c1bc88b5c4 tempest-VolumesDeleteCascade-1909219053 None] snapshot: ad883e4c-5402-4ef5-8a7e-eef7191d6637, volume: 887cb018-0ecb-4d35-8b33-b5e4e9276daa, {{(pid=92060) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jun 17 04:44:35 devstack cinder-volume[92060]: INFO cinder.volume.flows.manager.create_volume [None req-89abde00-e3fe-42d0-9cb5-148e326b56f6 tempest-VolumesSnapshotTestJSON-1039322322 None] Volume volume-03e84962-0a15-4b8c-bfd3-659ed0261dfe (03e84962-0a15-4b8c-bfd3-659ed0261dfe): created successfully Jun 17 04:44:35 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-89abde00-e3fe-42d0-9cb5-148e326b56f6 tempest-VolumesSnapshotTestJSON-1039322322 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cbfb6800-fe4d-458b-b562-277b58ca262f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:44:35 devstack sudo[101404]: pam_unix(sudo:session): session closed for user root Jun 17 04:44:35 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-89abde00-e3fe-42d0-9cb5-148e326b56f6 tempest-VolumesSnapshotTestJSON-1039322322 None] Flow 'volume_create_manager' (7a07708f-d645-40a4-ada6-d3523243a29f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92060) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 17 04:44:35 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-63033189-646c-4d46-b707-3141e5d4c020 tempest-AttachVolumeTestJSON-189381823 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-b92c4149-011c-4b5a-82da-0d49240470fc" returned: 0 in 0.689s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:44:35 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-3fba6b68-54be-4844-abba-91c1bc88b5c4 tempest-VolumesDeleteCascade-1909219053 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 04:44:35 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-3fba6b68-54be-4844-abba-91c1bc88b5c4 tempest-VolumesDeleteCascade-1909219053 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 04:44:35 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-3fba6b68-54be-4844-abba-91c1bc88b5c4 tempest-VolumesDeleteCascade-1909219053 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588': None} {{(pid=92060) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 17 04:44:35 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-3fba6b68-54be-4844-abba-91c1bc88b5c4 tempest-VolumesDeleteCascade-1909219053 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588'] {{(pid=92060) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 17 04:44:35 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-3fba6b68-54be-4844-abba-91c1bc88b5c4 tempest-VolumesDeleteCascade-1909219053 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 04:44:35 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-63033189-646c-4d46-b707-3141e5d4c020 tempest-AttachVolumeTestJSON-189381823 None] Lock "cinder-quobyte-b92c4149-011c-4b5a-82da-0d49240470fc" released by "delete_volume" :: held 1.541s {{(pid=92060) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 04:44:35 devstack cinder-volume[92060]: INFO cinder.volume.manager [None req-89abde00-e3fe-42d0-9cb5-148e326b56f6 tempest-VolumesSnapshotTestJSON-1039322322 None] Created volume successfully. Jun 17 04:44:35 devstack cinder-volume[92060]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcfb0d94-66a4-4dcd-8d47-571e0f8e0560]: (4, 'qcow2') {{(pid=93130) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 04:44:35 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-3fba6b68-54be-4844-abba-91c1bc88b5c4 tempest-VolumesDeleteCascade-1909219053 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-787aa2b2-1905-4b49-9a7b-76228def377e.ad883e4c-5402-4ef5-8a7e-eef7191d6637 {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:44:35 devstack cinder-volume[92060]: DEBUG cinder.quota [None req-63033189-646c-4d46-b707-3141e5d4c020 tempest-AttachVolumeTestJSON-189381823 None] Created reservations ['4ab650ee-1b71-420e-a1e4-27cb7c325f26', '21fd3351-fc5c-4f65-9083-95e3b8fc167e', '9709ea9a-a706-412d-bdba-9dcd86685fb8', '4ed1c33f-658d-4b3d-aa70-3e5030abbd7a'] {{(pid=92060) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 17 04:44:35 devstack sudo[101408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-787aa2b2-1905-4b49-9a7b-76228def377e.ad883e4c-5402-4ef5-8a7e-eef7191d6637 Jun 17 04:44:35 devstack sudo[101408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:44:35 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-63033189-646c-4d46-b707-3141e5d4c020 tempest-AttachVolumeTestJSON-189381823 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 04:44:35 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-63033189-646c-4d46-b707-3141e5d4c020 tempest-AttachVolumeTestJSON-189381823 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 04:44:35 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-63033189-646c-4d46-b707-3141e5d4c020 tempest-AttachVolumeTestJSON-189381823 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588': None} {{(pid=92060) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 17 04:44:35 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-63033189-646c-4d46-b707-3141e5d4c020 tempest-AttachVolumeTestJSON-189381823 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588'] {{(pid=92060) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 17 04:44:35 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-63033189-646c-4d46-b707-3141e5d4c020 tempest-AttachVolumeTestJSON-189381823 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 04:44:35 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-63033189-646c-4d46-b707-3141e5d4c020 tempest-AttachVolumeTestJSON-189381823 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:44:35 devstack sudo[101410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a Jun 17 04:44:35 devstack sudo[101410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:44:36 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-a2519d01-52d3-438f-a49a-38c998be8146 tempest-AttachVolumeTestJSON-189381823 None] Acquiring lock "cinder-a85c206e-c58d-4cc4-8d97-614030f30f77-delete_volume" by "delete_volume" {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 04:44:36 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-a2519d01-52d3-438f-a49a-38c998be8146 tempest-AttachVolumeTestJSON-189381823 None] Lock "cinder-a85c206e-c58d-4cc4-8d97-614030f30f77-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 04:44:36 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-a2519d01-52d3-438f-a49a-38c998be8146 tempest-AttachVolumeTestJSON-189381823 None] Acquiring lock "cinder-quobyte-a85c206e-c58d-4cc4-8d97-614030f30f77" by "delete_volume" {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 04:44:36 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-a2519d01-52d3-438f-a49a-38c998be8146 tempest-AttachVolumeTestJSON-189381823 None] Lock "cinder-quobyte-a85c206e-c58d-4cc4-8d97-614030f30f77" acquired by "delete_volume" :: waited 0.029s {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 04:44:36 devstack sudo[101408]: pam_unix(sudo:session): session closed for user root Jun 17 04:44:36 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-b861a92a-26fa-4f08-9b32-1cbb22098970 tempest-VolumesSnapshotTestJSON-1039322322 None] Acquiring lock "cinder-03e84962-0a15-4b8c-bfd3-659ed0261dfe-delete_volume" by "delete_volume" {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 04:44:36 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-3fba6b68-54be-4844-abba-91c1bc88b5c4 tempest-VolumesDeleteCascade-1909219053 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-787aa2b2-1905-4b49-9a7b-76228def377e.ad883e4c-5402-4ef5-8a7e-eef7191d6637" returned: 0 in 0.832s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:44:36 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.remotefs [None req-3fba6b68-54be-4844-abba-91c1bc88b5c4 tempest-VolumesDeleteCascade-1909219053 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-787aa2b2-1905-4b49-9a7b-76228def377e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=92060) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 17 04:44:36 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-3fba6b68-54be-4844-abba-91c1bc88b5c4 tempest-VolumesDeleteCascade-1909219053 None] will copy from snapshot at /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-787aa2b2-1905-4b49-9a7b-76228def377e {{(pid=92060) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jun 17 04:44:36 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-3fba6b68-54be-4844-abba-91c1bc88b5c4 tempest-VolumesDeleteCascade-1909219053 None] Creating direct copy from snapshot {{(pid=92060) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jun 17 04:44:36 devstack cinder-volume[92060]: DEBUG oslo.privsep.daemon [-] privsep: reply[747210cf-a32a-41da-a8e7-5fed899cf5e6]: (4, 'qcow2') {{(pid=93130) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 04:44:36 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-a2519d01-52d3-438f-a49a-38c998be8146 tempest-AttachVolumeTestJSON-189381823 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-a85c206e-c58d-4cc4-8d97-614030f30f77 {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:44:36 devstack cinder-volume[92060]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ae4355e-5c53-4ee2-ab69-a4da1af26dde]: (4, 'qcow2') {{(pid=93130) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 04:44:36 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-3fba6b68-54be-4844-abba-91c1bc88b5c4 tempest-VolumesDeleteCascade-1909219053 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-787aa2b2-1905-4b49-9a7b-76228def377e {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:44:36 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-b861a92a-26fa-4f08-9b32-1cbb22098970 tempest-VolumesSnapshotTestJSON-1039322322 None] Lock "cinder-03e84962-0a15-4b8c-bfd3-659ed0261dfe-delete_volume" acquired by "delete_volume" :: waited 0.056s {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 04:44:36 devstack sudo[101410]: pam_unix(sudo:session): session closed for user root Jun 17 04:44:36 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-63033189-646c-4d46-b707-3141e5d4c020 tempest-AttachVolumeTestJSON-189381823 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a" returned: 0 in 0.779s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:44:36 devstack cinder-volume[92060]: DEBUG cinder.manager [None req-63033189-646c-4d46-b707-3141e5d4c020 tempest-AttachVolumeTestJSON-189381823 None] Notifying Schedulers of capabilities ... {{(pid=92060) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 17 04:44:36 devstack cinder-volume[92060]: INFO cinder.volume.manager [None req-63033189-646c-4d46-b707-3141e5d4c020 tempest-AttachVolumeTestJSON-189381823 None] Deleted volume successfully. Jun 17 04:44:36 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-b861a92a-26fa-4f08-9b32-1cbb22098970 tempest-VolumesSnapshotTestJSON-1039322322 None] Acquiring lock "cinder-quobyte-03e84962-0a15-4b8c-bfd3-659ed0261dfe" by "delete_volume" {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 04:44:36 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-63033189-646c-4d46-b707-3141e5d4c020 tempest-AttachVolumeTestJSON-189381823 None] Lock "cinder-b92c4149-011c-4b5a-82da-0d49240470fc-delete_volume" released by "delete_volume" :: held 2.609s {{(pid=92060) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 04:44:36 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-b861a92a-26fa-4f08-9b32-1cbb22098970 tempest-VolumesSnapshotTestJSON-1039322322 None] Lock "cinder-quobyte-03e84962-0a15-4b8c-bfd3-659ed0261dfe" acquired by "delete_volume" :: waited 0.029s {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 04:44:36 devstack sudo[101417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-a85c206e-c58d-4cc4-8d97-614030f30f77 Jun 17 04:44:36 devstack sudo[101417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:44:36 devstack cinder-volume[92060]: DEBUG oslo.privsep.daemon [-] privsep: reply[32ea9ab3-6420-4140-81e6-2d8c670f4ed3]: (4, 'qcow2') {{(pid=93130) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 04:44:36 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-b861a92a-26fa-4f08-9b32-1cbb22098970 tempest-VolumesSnapshotTestJSON-1039322322 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-03e84962-0a15-4b8c-bfd3-659ed0261dfe {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:44:36 devstack sudo[101418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-787aa2b2-1905-4b49-9a7b-76228def377e Jun 17 04:44:36 devstack sudo[101418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:44:36 devstack sudo[101420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-03e84962-0a15-4b8c-bfd3-659ed0261dfe Jun 17 04:44:36 devstack sudo[101420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:44:37 devstack sudo[101417]: pam_unix(sudo:session): session closed for user root Jun 17 04:44:37 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-a2519d01-52d3-438f-a49a-38c998be8146 tempest-AttachVolumeTestJSON-189381823 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-a85c206e-c58d-4cc4-8d97-614030f30f77" returned: 0 in 0.914s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:44:37 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-a2519d01-52d3-438f-a49a-38c998be8146 tempest-AttachVolumeTestJSON-189381823 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-a85c206e-c58d-4cc4-8d97-614030f30f77 {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:44:37 devstack sudo[101429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-a85c206e-c58d-4cc4-8d97-614030f30f77 Jun 17 04:44:37 devstack sudo[101418]: pam_unix(sudo:session): session closed for user root Jun 17 04:44:37 devstack sudo[101429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:44:37 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-3fba6b68-54be-4844-abba-91c1bc88b5c4 tempest-VolumesDeleteCascade-1909219053 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-787aa2b2-1905-4b49-9a7b-76228def377e" returned: 0 in 0.950s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:44:37 devstack cinder-volume[92060]: DEBUG cinder.utils [None req-3fba6b68-54be-4844-abba-91c1bc88b5c4 tempest-VolumesDeleteCascade-1909219053 None] Path /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-887cb018-0ecb-4d35-8b33-b5e4e9276daa not found in is_blk_device check {{(pid=92060) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jun 17 04:44:37 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-3fba6b68-54be-4844-abba-91c1bc88b5c4 tempest-VolumesDeleteCascade-1909219053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-787aa2b2-1905-4b49-9a7b-76228def377e /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-887cb018-0ecb-4d35-8b33-b5e4e9276daa {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:44:37 devstack sudo[101433]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-787aa2b2-1905-4b49-9a7b-76228def377e /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-887cb018-0ecb-4d35-8b33-b5e4e9276daa Jun 17 04:44:37 devstack sudo[101433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:44:37 devstack sudo[101420]: pam_unix(sudo:session): session closed for user root Jun 17 04:44:37 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-b861a92a-26fa-4f08-9b32-1cbb22098970 tempest-VolumesSnapshotTestJSON-1039322322 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-03e84962-0a15-4b8c-bfd3-659ed0261dfe" returned: 0 in 1.016s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:44:37 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-b861a92a-26fa-4f08-9b32-1cbb22098970 tempest-VolumesSnapshotTestJSON-1039322322 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-03e84962-0a15-4b8c-bfd3-659ed0261dfe {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:44:37 devstack sudo[101436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-03e84962-0a15-4b8c-bfd3-659ed0261dfe Jun 17 04:44:37 devstack sudo[101436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:44:38 devstack sudo[101429]: pam_unix(sudo:session): session closed for user root Jun 17 04:44:38 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-a2519d01-52d3-438f-a49a-38c998be8146 tempest-AttachVolumeTestJSON-189381823 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-a85c206e-c58d-4cc4-8d97-614030f30f77" returned: 0 in 0.855s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:44:38 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-a2519d01-52d3-438f-a49a-38c998be8146 tempest-AttachVolumeTestJSON-189381823 None] Lock "cinder-quobyte-a85c206e-c58d-4cc4-8d97-614030f30f77" released by "delete_volume" :: held 1.836s {{(pid=92060) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 04:44:38 devstack cinder-volume[92060]: DEBUG cinder.quota [None req-a2519d01-52d3-438f-a49a-38c998be8146 tempest-AttachVolumeTestJSON-189381823 None] Created reservations ['1f6d1585-c5c7-4cbc-8532-ee6fe7d60242', '30b3f227-d7fc-47a7-abac-cd4814c411ca', '9324338f-5920-4126-8891-e23446dd0798', '21a0e67b-fb92-4538-a477-c70961f877bd'] {{(pid=92060) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 17 04:44:38 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-a2519d01-52d3-438f-a49a-38c998be8146 tempest-AttachVolumeTestJSON-189381823 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 04:44:38 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-a2519d01-52d3-438f-a49a-38c998be8146 tempest-AttachVolumeTestJSON-189381823 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 04:44:38 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-a2519d01-52d3-438f-a49a-38c998be8146 tempest-AttachVolumeTestJSON-189381823 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588': None} {{(pid=92060) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 17 04:44:38 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-a2519d01-52d3-438f-a49a-38c998be8146 tempest-AttachVolumeTestJSON-189381823 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588'] {{(pid=92060) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 17 04:44:38 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-a2519d01-52d3-438f-a49a-38c998be8146 tempest-AttachVolumeTestJSON-189381823 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 04:44:38 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-a2519d01-52d3-438f-a49a-38c998be8146 tempest-AttachVolumeTestJSON-189381823 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:44:38 devstack sudo[101450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a Jun 17 04:44:38 devstack sudo[101450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:44:38 devstack sudo[101436]: pam_unix(sudo:session): session closed for user root Jun 17 04:44:38 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-b861a92a-26fa-4f08-9b32-1cbb22098970 tempest-VolumesSnapshotTestJSON-1039322322 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-03e84962-0a15-4b8c-bfd3-659ed0261dfe" returned: 0 in 0.933s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:44:38 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-b861a92a-26fa-4f08-9b32-1cbb22098970 tempest-VolumesSnapshotTestJSON-1039322322 None] Lock "cinder-quobyte-03e84962-0a15-4b8c-bfd3-659ed0261dfe" released by "delete_volume" :: held 2.041s {{(pid=92060) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 04:44:38 devstack cinder-volume[92060]: DEBUG cinder.quota [None req-b861a92a-26fa-4f08-9b32-1cbb22098970 tempest-VolumesSnapshotTestJSON-1039322322 None] Created reservations ['9a8024ed-f67d-4512-ba7b-fac9e2b2a131', 'd3cb5946-ff11-4a70-bea1-47f0e9b06c92', '1dd582aa-f47d-4dd1-b63b-d4aff1b41d7c', '687e75c9-4003-42ca-b2ac-c63cc769cdc9'] {{(pid=92060) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 17 04:44:39 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-b861a92a-26fa-4f08-9b32-1cbb22098970 tempest-VolumesSnapshotTestJSON-1039322322 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 04:44:39 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-b861a92a-26fa-4f08-9b32-1cbb22098970 tempest-VolumesSnapshotTestJSON-1039322322 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 04:44:39 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-b861a92a-26fa-4f08-9b32-1cbb22098970 tempest-VolumesSnapshotTestJSON-1039322322 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588': None} {{(pid=92060) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 17 04:44:39 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-b861a92a-26fa-4f08-9b32-1cbb22098970 tempest-VolumesSnapshotTestJSON-1039322322 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588'] {{(pid=92060) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 17 04:44:39 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-b861a92a-26fa-4f08-9b32-1cbb22098970 tempest-VolumesSnapshotTestJSON-1039322322 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 04:44:39 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-b861a92a-26fa-4f08-9b32-1cbb22098970 tempest-VolumesSnapshotTestJSON-1039322322 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:44:39 devstack sudo[101452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a Jun 17 04:44:39 devstack sudo[101452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:44:39 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-691ab2d3-3ba7-409e-bda7-1d0508bee1f7 tempest-AttachVolumeTestJSON-189381823 None] Acquiring lock "cinder-1409e9c5-943a-4086-b281-042471eeb293-delete_volume" by "delete_volume" {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 04:44:39 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-691ab2d3-3ba7-409e-bda7-1d0508bee1f7 tempest-AttachVolumeTestJSON-189381823 None] Lock "cinder-1409e9c5-943a-4086-b281-042471eeb293-delete_volume" acquired by "delete_volume" :: waited 0.050s {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 04:44:39 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-691ab2d3-3ba7-409e-bda7-1d0508bee1f7 tempest-AttachVolumeTestJSON-189381823 None] Acquiring lock "cinder-quobyte-1409e9c5-943a-4086-b281-042471eeb293" by "delete_volume" {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 04:44:39 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-691ab2d3-3ba7-409e-bda7-1d0508bee1f7 tempest-AttachVolumeTestJSON-189381823 None] Lock "cinder-quobyte-1409e9c5-943a-4086-b281-042471eeb293" acquired by "delete_volume" :: waited 0.037s {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 04:44:39 devstack cinder-volume[92060]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa7f8a04-24fa-4792-a14c-cd088b01e9ab]: (4, 'qcow2') {{(pid=93130) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 04:44:39 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-691ab2d3-3ba7-409e-bda7-1d0508bee1f7 tempest-AttachVolumeTestJSON-189381823 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-1409e9c5-943a-4086-b281-042471eeb293 {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:44:39 devstack sudo[101450]: pam_unix(sudo:session): session closed for user root Jun 17 04:44:39 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-a2519d01-52d3-438f-a49a-38c998be8146 tempest-AttachVolumeTestJSON-189381823 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a" returned: 0 in 1.338s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:44:39 devstack cinder-volume[92060]: DEBUG cinder.manager [None req-a2519d01-52d3-438f-a49a-38c998be8146 tempest-AttachVolumeTestJSON-189381823 None] Notifying Schedulers of capabilities ... {{(pid=92060) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 17 04:44:39 devstack cinder-volume[92060]: INFO cinder.volume.manager [None req-a2519d01-52d3-438f-a49a-38c998be8146 tempest-AttachVolumeTestJSON-189381823 None] Deleted volume successfully. Jun 17 04:44:39 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-a2519d01-52d3-438f-a49a-38c998be8146 tempest-AttachVolumeTestJSON-189381823 None] Lock "cinder-a85c206e-c58d-4cc4-8d97-614030f30f77-delete_volume" released by "delete_volume" :: held 3.694s {{(pid=92060) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 04:44:40 devstack sudo[101455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-1409e9c5-943a-4086-b281-042471eeb293 Jun 17 04:44:40 devstack sudo[101455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:44:40 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-6d6fa245-8d62-4923-b533-a8b5111471a8 tempest-VolumesSnapshotTestJSON-1039322322 None] Acquiring lock "cinder-0c726350-18a4-48e9-a3a6-638bf1216835-delete_snapshot" by "delete_snapshot" {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 04:44:40 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-6d6fa245-8d62-4923-b533-a8b5111471a8 tempest-VolumesSnapshotTestJSON-1039322322 None] Lock "cinder-0c726350-18a4-48e9-a3a6-638bf1216835-delete_snapshot" acquired by "delete_snapshot" :: waited 0.061s {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 04:44:40 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-6d6fa245-8d62-4923-b533-a8b5111471a8 tempest-VolumesSnapshotTestJSON-1039322322 None] Acquiring lock "cinder-quobyte-cc44cc2e-42ac-4892-8587-446c312ae2a6" by "delete_snapshot" {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 04:44:40 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-6d6fa245-8d62-4923-b533-a8b5111471a8 tempest-VolumesSnapshotTestJSON-1039322322 None] Lock "cinder-quobyte-cc44cc2e-42ac-4892-8587-446c312ae2a6" acquired by "delete_snapshot" :: waited 0.035s {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 04:44:40 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-6d6fa245-8d62-4923-b533-a8b5111471a8 tempest-VolumesSnapshotTestJSON-1039322322 None] Acquiring lock "cinder-quobyte-0c726350-18a4-48e9-a3a6-638bf1216835" by "_delete_snapshot" {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 04:44:40 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-6d6fa245-8d62-4923-b533-a8b5111471a8 tempest-VolumesSnapshotTestJSON-1039322322 None] Lock "cinder-quobyte-0c726350-18a4-48e9-a3a6-638bf1216835" acquired by "_delete_snapshot" :: waited 0.031s {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 04:44:40 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.remotefs [None req-6d6fa245-8d62-4923-b533-a8b5111471a8 tempest-VolumesSnapshotTestJSON-1039322322 None] Deleting offline snapshot 0c726350-18a4-48e9-a3a6-638bf1216835 of volume cc44cc2e-42ac-4892-8587-446c312ae2a6 {{(pid=92060) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 17 04:44:41 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.remotefs [None req-6d6fa245-8d62-4923-b533-a8b5111471a8 tempest-VolumesSnapshotTestJSON-1039322322 None] snapshot_file for this snap is: volume-cc44cc2e-42ac-4892-8587-446c312ae2a6.0c726350-18a4-48e9-a3a6-638bf1216835 {{(pid=92060) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 17 04:44:41 devstack cinder-volume[92060]: DEBUG oslo.privsep.daemon [-] privsep: reply[7336e1ee-a8d3-44ac-917f-c1fe63344f05]: (4, 'qcow2') {{(pid=93130) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 04:44:41 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-6d6fa245-8d62-4923-b533-a8b5111471a8 tempest-VolumesSnapshotTestJSON-1039322322 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-cc44cc2e-42ac-4892-8587-446c312ae2a6.0c726350-18a4-48e9-a3a6-638bf1216835 {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:44:41 devstack sudo[101452]: pam_unix(sudo:session): session closed for user root Jun 17 04:44:41 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-b861a92a-26fa-4f08-9b32-1cbb22098970 tempest-VolumesSnapshotTestJSON-1039322322 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a" returned: 0 in 2.208s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:44:41 devstack cinder-volume[92060]: DEBUG cinder.manager [None req-b861a92a-26fa-4f08-9b32-1cbb22098970 tempest-VolumesSnapshotTestJSON-1039322322 None] Notifying Schedulers of capabilities ... {{(pid=92060) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 17 04:44:41 devstack cinder-volume[92060]: INFO cinder.volume.manager [None req-b861a92a-26fa-4f08-9b32-1cbb22098970 tempest-VolumesSnapshotTestJSON-1039322322 None] Deleted volume successfully. Jun 17 04:44:41 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-b861a92a-26fa-4f08-9b32-1cbb22098970 tempest-VolumesSnapshotTestJSON-1039322322 None] Lock "cinder-03e84962-0a15-4b8c-bfd3-659ed0261dfe-delete_volume" released by "delete_volume" :: held 4.895s {{(pid=92060) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 04:44:41 devstack sudo[101462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-cc44cc2e-42ac-4892-8587-446c312ae2a6.0c726350-18a4-48e9-a3a6-638bf1216835 Jun 17 04:44:41 devstack sudo[101462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:44:41 devstack sudo[101455]: pam_unix(sudo:session): session closed for user root Jun 17 04:44:41 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-691ab2d3-3ba7-409e-bda7-1d0508bee1f7 tempest-AttachVolumeTestJSON-189381823 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-1409e9c5-943a-4086-b281-042471eeb293" returned: 0 in 1.994s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:44:41 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-691ab2d3-3ba7-409e-bda7-1d0508bee1f7 tempest-AttachVolumeTestJSON-189381823 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-1409e9c5-943a-4086-b281-042471eeb293 {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:44:41 devstack sudo[101465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-1409e9c5-943a-4086-b281-042471eeb293 Jun 17 04:44:41 devstack sudo[101465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:44:42 devstack sudo[101462]: pam_unix(sudo:session): session closed for user root Jun 17 04:44:42 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-6d6fa245-8d62-4923-b533-a8b5111471a8 tempest-VolumesSnapshotTestJSON-1039322322 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-cc44cc2e-42ac-4892-8587-446c312ae2a6.0c726350-18a4-48e9-a3a6-638bf1216835" returned: 0 in 1.629s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:44:42 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.remotefs [None req-6d6fa245-8d62-4923-b533-a8b5111471a8 tempest-VolumesSnapshotTestJSON-1039322322 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cc44cc2e-42ac-4892-8587-446c312ae2a6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=92060) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 17 04:44:42 devstack cinder-volume[92060]: DEBUG oslo.privsep.daemon [-] privsep: reply[0946d68d-999a-4711-b2e6-3e72a28cc4b5]: (4, 'qcow2') {{(pid=93130) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 04:44:42 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-6d6fa245-8d62-4923-b533-a8b5111471a8 tempest-VolumesSnapshotTestJSON-1039322322 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-cc44cc2e-42ac-4892-8587-446c312ae2a6 {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:44:42 devstack sudo[101465]: pam_unix(sudo:session): session closed for user root Jun 17 04:44:42 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-691ab2d3-3ba7-409e-bda7-1d0508bee1f7 tempest-AttachVolumeTestJSON-189381823 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-1409e9c5-943a-4086-b281-042471eeb293" returned: 0 in 1.251s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:44:42 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-691ab2d3-3ba7-409e-bda7-1d0508bee1f7 tempest-AttachVolumeTestJSON-189381823 None] Lock "cinder-quobyte-1409e9c5-943a-4086-b281-042471eeb293" released by "delete_volume" :: held 3.395s {{(pid=92060) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 04:44:43 devstack cinder-volume[92060]: DEBUG cinder.quota [None req-691ab2d3-3ba7-409e-bda7-1d0508bee1f7 tempest-AttachVolumeTestJSON-189381823 None] Created reservations ['59ecbb66-f27e-4ee6-8f00-c0a7f96ed09c', '0e60c149-4978-422a-9ce7-4d96412e9382', '67dede5b-b656-48e3-a943-a89cdff86c18', '6fab40e6-6252-4104-a975-c3d9b15e6399'] {{(pid=92060) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 17 04:44:43 devstack sudo[101471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-cc44cc2e-42ac-4892-8587-446c312ae2a6 Jun 17 04:44:43 devstack sudo[101471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:44:43 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-691ab2d3-3ba7-409e-bda7-1d0508bee1f7 tempest-AttachVolumeTestJSON-189381823 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 04:44:43 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-691ab2d3-3ba7-409e-bda7-1d0508bee1f7 tempest-AttachVolumeTestJSON-189381823 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 04:44:43 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-691ab2d3-3ba7-409e-bda7-1d0508bee1f7 tempest-AttachVolumeTestJSON-189381823 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588': None} {{(pid=92060) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 17 04:44:43 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-691ab2d3-3ba7-409e-bda7-1d0508bee1f7 tempest-AttachVolumeTestJSON-189381823 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588'] {{(pid=92060) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 17 04:44:43 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-691ab2d3-3ba7-409e-bda7-1d0508bee1f7 tempest-AttachVolumeTestJSON-189381823 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 04:44:43 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-691ab2d3-3ba7-409e-bda7-1d0508bee1f7 tempest-AttachVolumeTestJSON-189381823 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:44:43 devstack sudo[101473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a Jun 17 04:44:43 devstack sudo[101473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:44:44 devstack sudo[101433]: pam_unix(sudo:session): session closed for user root Jun 17 04:44:44 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-3fba6b68-54be-4844-abba-91c1bc88b5c4 tempest-VolumesDeleteCascade-1909219053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-787aa2b2-1905-4b49-9a7b-76228def377e /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-887cb018-0ecb-4d35-8b33-b5e4e9276daa" returned: 0 in 6.797s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:44:44 devstack cinder-volume[92060]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ae0f7ba-b333-46df-84a6-b828922b0ad3]: (4, 'qcow2') {{(pid=93130) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 04:44:44 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-3fba6b68-54be-4844-abba-91c1bc88b5c4 tempest-VolumesDeleteCascade-1909219053 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-787aa2b2-1905-4b49-9a7b-76228def377e {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:44:44 devstack sudo[101477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-787aa2b2-1905-4b49-9a7b-76228def377e Jun 17 04:44:44 devstack sudo[101477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:44:44 devstack sudo[101473]: pam_unix(sudo:session): session closed for user root Jun 17 04:44:44 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-691ab2d3-3ba7-409e-bda7-1d0508bee1f7 tempest-AttachVolumeTestJSON-189381823 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a" returned: 0 in 1.179s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:44:44 devstack cinder-volume[92060]: DEBUG cinder.manager [None req-691ab2d3-3ba7-409e-bda7-1d0508bee1f7 tempest-AttachVolumeTestJSON-189381823 None] Notifying Schedulers of capabilities ... {{(pid=92060) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 17 04:44:44 devstack cinder-volume[92060]: INFO cinder.volume.manager [None req-691ab2d3-3ba7-409e-bda7-1d0508bee1f7 tempest-AttachVolumeTestJSON-189381823 None] Deleted volume successfully. Jun 17 04:44:44 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-691ab2d3-3ba7-409e-bda7-1d0508bee1f7 tempest-AttachVolumeTestJSON-189381823 None] Lock "cinder-1409e9c5-943a-4086-b281-042471eeb293-delete_volume" released by "delete_volume" :: held 5.222s {{(pid=92060) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 04:44:44 devstack sudo[101471]: pam_unix(sudo:session): session closed for user root Jun 17 04:44:44 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-6d6fa245-8d62-4923-b533-a8b5111471a8 tempest-VolumesSnapshotTestJSON-1039322322 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-cc44cc2e-42ac-4892-8587-446c312ae2a6" returned: 0 in 1.741s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:44:44 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-6d6fa245-8d62-4923-b533-a8b5111471a8 tempest-VolumesSnapshotTestJSON-1039322322 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-cc44cc2e-42ac-4892-8587-446c312ae2a6.0c726350-18a4-48e9-a3a6-638bf1216835 {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:44:44 devstack sudo[101481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-cc44cc2e-42ac-4892-8587-446c312ae2a6.0c726350-18a4-48e9-a3a6-638bf1216835 Jun 17 04:44:44 devstack sudo[101481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:44:44 devstack cinder-volume[92060]: DEBUG oslo_service.periodic_task [None req-60d279ad-ad8c-4d36-a4b8-f593e74fb922 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=92060) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 17 04:44:44 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-60d279ad-ad8c-4d36-a4b8-f593e74fb922 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 04:44:44 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-60d279ad-ad8c-4d36-a4b8-f593e74fb922 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 04:44:44 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-60d279ad-ad8c-4d36-a4b8-f593e74fb922 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588': None} {{(pid=92060) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 17 04:44:44 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-60d279ad-ad8c-4d36-a4b8-f593e74fb922 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588'] {{(pid=92060) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 17 04:44:44 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-60d279ad-ad8c-4d36-a4b8-f593e74fb922 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 04:44:44 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-60d279ad-ad8c-4d36-a4b8-f593e74fb922 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:44:45 devstack sudo[101483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a Jun 17 04:44:45 devstack sudo[101483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:44:45 devstack sudo[101477]: pam_unix(sudo:session): session closed for user root Jun 17 04:44:45 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-3fba6b68-54be-4844-abba-91c1bc88b5c4 tempest-VolumesDeleteCascade-1909219053 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-787aa2b2-1905-4b49-9a7b-76228def377e" returned: 0 in 1.137s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:44:45 devstack cinder-volume[92060]: DEBUG cinder.image.image_utils [None req-3fba6b68-54be-4844-abba-91c1bc88b5c4 tempest-VolumesDeleteCascade-1909219053 None] Image conversion details: src /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-787aa2b2-1905-4b49-9a7b-76228def377e, size 1024.00 MB, duration 6.80 sec, destination /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-887cb018-0ecb-4d35-8b33-b5e4e9276daa {{(pid=92060) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 17 04:44:45 devstack cinder-volume[92060]: INFO cinder.image.image_utils [None req-3fba6b68-54be-4844-abba-91c1bc88b5c4 tempest-VolumesDeleteCascade-1909219053 None] Converted 1024.00 MB image at 150.63 MB/s Jun 17 04:44:45 devstack cinder-volume[92060]: WARNING cinder.volume.drivers.remotefs [None req-3fba6b68-54be-4844-abba-91c1bc88b5c4 tempest-VolumesDeleteCascade-1909219053 None] /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-887cb018-0ecb-4d35-8b33-b5e4e9276daa is being set with open permissions: ugo+rw Jun 17 04:44:45 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-3fba6b68-54be-4844-abba-91c1bc88b5c4 tempest-VolumesDeleteCascade-1909219053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-887cb018-0ecb-4d35-8b33-b5e4e9276daa {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:44:45 devstack sudo[101491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-887cb018-0ecb-4d35-8b33-b5e4e9276daa Jun 17 04:44:45 devstack sudo[101491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:44:45 devstack sudo[101481]: pam_unix(sudo:session): session closed for user root Jun 17 04:44:45 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-6d6fa245-8d62-4923-b533-a8b5111471a8 tempest-VolumesSnapshotTestJSON-1039322322 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-cc44cc2e-42ac-4892-8587-446c312ae2a6.0c726350-18a4-48e9-a3a6-638bf1216835" returned: 0 in 0.954s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:44:45 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-6d6fa245-8d62-4923-b533-a8b5111471a8 tempest-VolumesSnapshotTestJSON-1039322322 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-cc44cc2e-42ac-4892-8587-446c312ae2a6.0c726350-18a4-48e9-a3a6-638bf1216835 {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:44:45 devstack sudo[101493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-cc44cc2e-42ac-4892-8587-446c312ae2a6.0c726350-18a4-48e9-a3a6-638bf1216835 Jun 17 04:44:45 devstack sudo[101493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:44:45 devstack sudo[101483]: pam_unix(sudo:session): session closed for user root Jun 17 04:44:46 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-60d279ad-ad8c-4d36-a4b8-f593e74fb922 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a" returned: 0 in 1.038s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:44:46 devstack cinder-volume[92060]: DEBUG cinder.manager [None req-60d279ad-ad8c-4d36-a4b8-f593e74fb922 None None] Notifying Schedulers of capabilities ... {{(pid=92060) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 17 04:44:46 devstack cinder-volume[92060]: DEBUG oslo_service.periodic_task [None req-60d279ad-ad8c-4d36-a4b8-f593e74fb922 None None] Running periodic task VolumeManager._thread_info {{(pid=92060) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 17 04:44:46 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-60d279ad-ad8c-4d36-a4b8-f593e74fb922 None None] thread count: 28 {{(pid=92060) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 17 04:44:46 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-60d279ad-ad8c-4d36-a4b8-f593e74fb922 None None] thread info: [<_MainThread(MainThread, started 130061806440576)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=92060) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 17 04:44:46 devstack sudo[101491]: pam_unix(sudo:session): session closed for user root Jun 17 04:44:46 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-3fba6b68-54be-4844-abba-91c1bc88b5c4 tempest-VolumesDeleteCascade-1909219053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-887cb018-0ecb-4d35-8b33-b5e4e9276daa" returned: 0 in 0.844s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:44:46 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-3fba6b68-54be-4844-abba-91c1bc88b5c4 tempest-VolumesDeleteCascade-1909219053 None] Lock "cinder-quobyte-887cb018-0ecb-4d35-8b33-b5e4e9276daa" released by "_copy_volume_from_snapshot" :: held 10.720s {{(pid=92060) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 04:44:46 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-3fba6b68-54be-4844-abba-91c1bc88b5c4 tempest-VolumesDeleteCascade-1909219053 None] Lock "cinder-quobyte-ad883e4c-5402-4ef5-8a7e-eef7191d6637-887cb018-0ecb-4d35-8b33-b5e4e9276daa" released by "_create_volume_from_snapshot" :: held 10.782s {{(pid=92060) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 04:44:46 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-3fba6b68-54be-4844-abba-91c1bc88b5c4 tempest-VolumesDeleteCascade-1909219053 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 10.816s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 04:44:46 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-3fba6b68-54be-4844-abba-91c1bc88b5c4 tempest-VolumesDeleteCascade-1909219053 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9cbecab7-8ea5-4d23-ad61-bdcc8254d1bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-887cb018-0ecb-4d35-8b33-b5e4e9276daa', 'volume_size': 1, 'snapshot_id': 'ad883e4c-5402-4ef5-8a7e-eef7191d6637'}' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:44:46 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-3fba6b68-54be-4844-abba-91c1bc88b5c4 tempest-VolumesDeleteCascade-1909219053 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (042be7fa-eddd-42df-8771-1a9b804426a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:44:46 devstack cinder-volume[92060]: INFO cinder.volume.flows.manager.create_volume [None req-3fba6b68-54be-4844-abba-91c1bc88b5c4 tempest-VolumesDeleteCascade-1909219053 None] Volume volume-887cb018-0ecb-4d35-8b33-b5e4e9276daa (887cb018-0ecb-4d35-8b33-b5e4e9276daa): created successfully Jun 17 04:44:46 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-3fba6b68-54be-4844-abba-91c1bc88b5c4 tempest-VolumesDeleteCascade-1909219053 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (042be7fa-eddd-42df-8771-1a9b804426a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:44:46 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-3fba6b68-54be-4844-abba-91c1bc88b5c4 tempest-VolumesDeleteCascade-1909219053 None] Flow 'volume_create_manager' (dceb00fb-19a9-4674-9690-d00c56e7b2ab) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92060) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 17 04:44:46 devstack cinder-volume[92060]: INFO cinder.volume.manager [None req-3fba6b68-54be-4844-abba-91c1bc88b5c4 tempest-VolumesDeleteCascade-1909219053 None] Created volume successfully. Jun 17 04:44:46 devstack sudo[101493]: pam_unix(sudo:session): session closed for user root Jun 17 04:44:46 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-6d6fa245-8d62-4923-b533-a8b5111471a8 tempest-VolumesSnapshotTestJSON-1039322322 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-cc44cc2e-42ac-4892-8587-446c312ae2a6.0c726350-18a4-48e9-a3a6-638bf1216835" returned: 0 in 0.946s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:44:46 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-6d6fa245-8d62-4923-b533-a8b5111471a8 tempest-VolumesSnapshotTestJSON-1039322322 None] Lock "cinder-quobyte-0c726350-18a4-48e9-a3a6-638bf1216835" released by "_delete_snapshot" :: held 5.519s {{(pid=92060) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 04:44:46 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-6d6fa245-8d62-4923-b533-a8b5111471a8 tempest-VolumesSnapshotTestJSON-1039322322 None] Lock "cinder-quobyte-cc44cc2e-42ac-4892-8587-446c312ae2a6" released by "delete_snapshot" :: held 5.557s {{(pid=92060) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 04:44:46 devstack cinder-volume[92060]: DEBUG cinder.quota [None req-6d6fa245-8d62-4923-b533-a8b5111471a8 tempest-VolumesSnapshotTestJSON-1039322322 None] Created reservations ['f9469158-68f7-4570-b315-9f2e0c93ff04', '5f9e042a-181d-41ea-b07e-a7d4888091fb', '5277e6df-2d9b-481b-a1d0-c134dba9a27d', 'fbdf68f7-5711-4d30-9497-13890d69e5ad'] {{(pid=92060) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 17 04:44:46 devstack cinder-volume[92060]: INFO cinder.volume.manager [None req-6d6fa245-8d62-4923-b533-a8b5111471a8 tempest-VolumesSnapshotTestJSON-1039322322 None] Delete snapshot completed successfully. Jun 17 04:44:46 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-6d6fa245-8d62-4923-b533-a8b5111471a8 tempest-VolumesSnapshotTestJSON-1039322322 None] Lock "cinder-0c726350-18a4-48e9-a3a6-638bf1216835-delete_snapshot" released by "delete_snapshot" :: held 5.728s {{(pid=92060) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 04:44:46 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-c2203ed9-b806-43ab-ad9b-c5ca552a0f9d tempest-VolumesDeleteCascade-1909219053 None] Acquiring lock "cinder-787aa2b2-1905-4b49-9a7b-76228def377e-delete_volume" by "delete_volume" {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 04:44:46 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-c2203ed9-b806-43ab-ad9b-c5ca552a0f9d tempest-VolumesDeleteCascade-1909219053 None] Lock "cinder-787aa2b2-1905-4b49-9a7b-76228def377e-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 04:44:46 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-c2203ed9-b806-43ab-ad9b-c5ca552a0f9d tempest-VolumesDeleteCascade-1909219053 None] Performing cascade delete. {{(pid=92060) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Jun 17 04:44:46 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-c2203ed9-b806-43ab-ad9b-c5ca552a0f9d tempest-VolumesDeleteCascade-1909219053 None] Acquiring lock "cinder-ad883e4c-5402-4ef5-8a7e-eef7191d6637-delete_snapshot" by "delete_snapshot" {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 04:44:46 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-c2203ed9-b806-43ab-ad9b-c5ca552a0f9d tempest-VolumesDeleteCascade-1909219053 None] Lock "cinder-ad883e4c-5402-4ef5-8a7e-eef7191d6637-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 04:44:46 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-c2203ed9-b806-43ab-ad9b-c5ca552a0f9d tempest-VolumesDeleteCascade-1909219053 None] Acquiring lock "cinder-quobyte-787aa2b2-1905-4b49-9a7b-76228def377e" by "delete_snapshot" {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 04:44:46 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-c2203ed9-b806-43ab-ad9b-c5ca552a0f9d tempest-VolumesDeleteCascade-1909219053 None] Lock "cinder-quobyte-787aa2b2-1905-4b49-9a7b-76228def377e" acquired by "delete_snapshot" :: waited 0.015s {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 04:44:46 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-c2203ed9-b806-43ab-ad9b-c5ca552a0f9d tempest-VolumesDeleteCascade-1909219053 None] Acquiring lock "cinder-quobyte-ad883e4c-5402-4ef5-8a7e-eef7191d6637" by "_delete_snapshot" {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 04:44:46 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-c2203ed9-b806-43ab-ad9b-c5ca552a0f9d tempest-VolumesDeleteCascade-1909219053 None] Lock "cinder-quobyte-ad883e4c-5402-4ef5-8a7e-eef7191d6637" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 04:44:46 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.remotefs [None req-c2203ed9-b806-43ab-ad9b-c5ca552a0f9d tempest-VolumesDeleteCascade-1909219053 None] Deleting offline snapshot ad883e4c-5402-4ef5-8a7e-eef7191d6637 of volume 787aa2b2-1905-4b49-9a7b-76228def377e {{(pid=92060) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 17 04:44:47 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.remotefs [None req-c2203ed9-b806-43ab-ad9b-c5ca552a0f9d tempest-VolumesDeleteCascade-1909219053 None] snapshot_file for this snap is: volume-787aa2b2-1905-4b49-9a7b-76228def377e.ad883e4c-5402-4ef5-8a7e-eef7191d6637 {{(pid=92060) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 17 04:44:47 devstack cinder-volume[92060]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecc78a46-eb27-42c3-a4da-5e168fc99203]: (4, 'qcow2') {{(pid=93130) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 04:44:47 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-c2203ed9-b806-43ab-ad9b-c5ca552a0f9d tempest-VolumesDeleteCascade-1909219053 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-787aa2b2-1905-4b49-9a7b-76228def377e.ad883e4c-5402-4ef5-8a7e-eef7191d6637 {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:44:47 devstack sudo[101499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-787aa2b2-1905-4b49-9a7b-76228def377e.ad883e4c-5402-4ef5-8a7e-eef7191d6637 Jun 17 04:44:47 devstack sudo[101499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:44:47 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-186d0ebc-9ae6-4e1f-8226-9c13bbdd09b1 tempest-VolumesSnapshotTestJSON-1039322322 None] Acquiring lock "cinder-cc44cc2e-42ac-4892-8587-446c312ae2a6-delete_volume" by "delete_volume" {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 04:44:47 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-186d0ebc-9ae6-4e1f-8226-9c13bbdd09b1 tempest-VolumesSnapshotTestJSON-1039322322 None] Lock "cinder-cc44cc2e-42ac-4892-8587-446c312ae2a6-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 04:44:47 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-186d0ebc-9ae6-4e1f-8226-9c13bbdd09b1 tempest-VolumesSnapshotTestJSON-1039322322 None] Acquiring lock "cinder-quobyte-cc44cc2e-42ac-4892-8587-446c312ae2a6" by "delete_volume" {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 04:44:47 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-186d0ebc-9ae6-4e1f-8226-9c13bbdd09b1 tempest-VolumesSnapshotTestJSON-1039322322 None] Lock "cinder-quobyte-cc44cc2e-42ac-4892-8587-446c312ae2a6" acquired by "delete_volume" :: waited 0.026s {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 04:44:47 devstack cinder-volume[92060]: DEBUG oslo.privsep.daemon [-] privsep: reply[d524cee1-80ea-4d54-8ec3-460140b98adc]: (4, 'qcow2') {{(pid=93130) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 04:44:47 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-186d0ebc-9ae6-4e1f-8226-9c13bbdd09b1 tempest-VolumesSnapshotTestJSON-1039322322 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-cc44cc2e-42ac-4892-8587-446c312ae2a6 {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:44:47 devstack sudo[101501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-cc44cc2e-42ac-4892-8587-446c312ae2a6 Jun 17 04:44:47 devstack sudo[101501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:44:47 devstack sudo[101499]: pam_unix(sudo:session): session closed for user root Jun 17 04:44:47 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-c2203ed9-b806-43ab-ad9b-c5ca552a0f9d tempest-VolumesDeleteCascade-1909219053 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-787aa2b2-1905-4b49-9a7b-76228def377e.ad883e4c-5402-4ef5-8a7e-eef7191d6637" returned: 0 in 0.870s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:44:47 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.remotefs [None req-c2203ed9-b806-43ab-ad9b-c5ca552a0f9d tempest-VolumesDeleteCascade-1909219053 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-787aa2b2-1905-4b49-9a7b-76228def377e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=92060) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 17 04:44:47 devstack cinder-volume[92060]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6d80cb9-5881-4b2c-a1e2-8209821b3ebb]: (4, 'qcow2') {{(pid=93130) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 04:44:47 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-c2203ed9-b806-43ab-ad9b-c5ca552a0f9d tempest-VolumesDeleteCascade-1909219053 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-787aa2b2-1905-4b49-9a7b-76228def377e {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:44:48 devstack sudo[101506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-787aa2b2-1905-4b49-9a7b-76228def377e Jun 17 04:44:48 devstack sudo[101506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:44:48 devstack sudo[101501]: pam_unix(sudo:session): session closed for user root Jun 17 04:44:48 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-186d0ebc-9ae6-4e1f-8226-9c13bbdd09b1 tempest-VolumesSnapshotTestJSON-1039322322 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-cc44cc2e-42ac-4892-8587-446c312ae2a6" returned: 0 in 1.073s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:44:48 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-186d0ebc-9ae6-4e1f-8226-9c13bbdd09b1 tempest-VolumesSnapshotTestJSON-1039322322 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-cc44cc2e-42ac-4892-8587-446c312ae2a6 {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:44:48 devstack sudo[101511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-cc44cc2e-42ac-4892-8587-446c312ae2a6 Jun 17 04:44:48 devstack sudo[101511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:44:49 devstack sudo[101506]: pam_unix(sudo:session): session closed for user root Jun 17 04:44:49 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-c2203ed9-b806-43ab-ad9b-c5ca552a0f9d tempest-VolumesDeleteCascade-1909219053 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-787aa2b2-1905-4b49-9a7b-76228def377e" returned: 0 in 1.082s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:44:49 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-c2203ed9-b806-43ab-ad9b-c5ca552a0f9d tempest-VolumesDeleteCascade-1909219053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-787aa2b2-1905-4b49-9a7b-76228def377e.ad883e4c-5402-4ef5-8a7e-eef7191d6637 {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:44:49 devstack sudo[101517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-787aa2b2-1905-4b49-9a7b-76228def377e.ad883e4c-5402-4ef5-8a7e-eef7191d6637 Jun 17 04:44:49 devstack sudo[101517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:44:49 devstack sudo[101511]: pam_unix(sudo:session): session closed for user root Jun 17 04:44:49 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-186d0ebc-9ae6-4e1f-8226-9c13bbdd09b1 tempest-VolumesSnapshotTestJSON-1039322322 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-cc44cc2e-42ac-4892-8587-446c312ae2a6" returned: 0 in 0.811s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:44:49 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-186d0ebc-9ae6-4e1f-8226-9c13bbdd09b1 tempest-VolumesSnapshotTestJSON-1039322322 None] Lock "cinder-quobyte-cc44cc2e-42ac-4892-8587-446c312ae2a6" released by "delete_volume" :: held 1.968s {{(pid=92060) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 04:44:49 devstack cinder-volume[92060]: DEBUG cinder.quota [None req-186d0ebc-9ae6-4e1f-8226-9c13bbdd09b1 tempest-VolumesSnapshotTestJSON-1039322322 None] Created reservations ['29e4ee4e-ab42-47fb-b088-1287b4c19433', '47ab4852-f63d-4d87-8d4c-e743e9769c28', '6531d3a6-acef-46b4-94c8-d6cd76ad13d8', 'b25af8e1-dc61-46ca-8eb8-2af68a80d8aa'] {{(pid=92060) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 17 04:44:49 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-186d0ebc-9ae6-4e1f-8226-9c13bbdd09b1 tempest-VolumesSnapshotTestJSON-1039322322 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 04:44:49 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-186d0ebc-9ae6-4e1f-8226-9c13bbdd09b1 tempest-VolumesSnapshotTestJSON-1039322322 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 04:44:49 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-186d0ebc-9ae6-4e1f-8226-9c13bbdd09b1 tempest-VolumesSnapshotTestJSON-1039322322 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588': None} {{(pid=92060) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 17 04:44:49 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-186d0ebc-9ae6-4e1f-8226-9c13bbdd09b1 tempest-VolumesSnapshotTestJSON-1039322322 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588'] {{(pid=92060) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 17 04:44:49 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-186d0ebc-9ae6-4e1f-8226-9c13bbdd09b1 tempest-VolumesSnapshotTestJSON-1039322322 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 04:44:49 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-186d0ebc-9ae6-4e1f-8226-9c13bbdd09b1 tempest-VolumesSnapshotTestJSON-1039322322 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:44:49 devstack sudo[101525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a Jun 17 04:44:49 devstack sudo[101525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:44:50 devstack sudo[101517]: pam_unix(sudo:session): session closed for user root Jun 17 04:44:50 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-c2203ed9-b806-43ab-ad9b-c5ca552a0f9d tempest-VolumesDeleteCascade-1909219053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-787aa2b2-1905-4b49-9a7b-76228def377e.ad883e4c-5402-4ef5-8a7e-eef7191d6637" returned: 0 in 1.012s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:44:50 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-c2203ed9-b806-43ab-ad9b-c5ca552a0f9d tempest-VolumesDeleteCascade-1909219053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-787aa2b2-1905-4b49-9a7b-76228def377e.ad883e4c-5402-4ef5-8a7e-eef7191d6637 {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:44:50 devstack sudo[101528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-787aa2b2-1905-4b49-9a7b-76228def377e.ad883e4c-5402-4ef5-8a7e-eef7191d6637 Jun 17 04:44:50 devstack sudo[101528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:44:50 devstack cinder-volume[92060]: DEBUG cinder.volume.flows.manager.create_volume [None req-9bea4d84-103a-4d6c-a321-fcb7cf14c991 tempest-VolumesSnapshotTestJSON-1039322322 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92060) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 17 04:44:50 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-9bea4d84-103a-4d6c-a321-fcb7cf14c991 tempest-VolumesSnapshotTestJSON-1039322322 None] Flow 'volume_create_manager' (0db88e70-45c6-4006-af04-d6f432f6f87c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 17 04:44:50 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-9bea4d84-103a-4d6c-a321-fcb7cf14c991 tempest-VolumesSnapshotTestJSON-1039322322 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (857a49ed-905b-489f-8bc5-668ca4fa399f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:44:50 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-9bea4d84-103a-4d6c-a321-fcb7cf14c991 tempest-VolumesSnapshotTestJSON-1039322322 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (857a49ed-905b-489f-8bc5-668ca4fa399f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-17T02:44:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-206200990',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=671b8a5b-e060-484b-a83c-ea822663f67c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='411c6111710645bfa3f034c46596cbaf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T02:44:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T02:44:51Z,use_quota=True,user_id='84f516bc01824ccfaaea6fa73a4f20b1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aad9ce24-93f9-41a6-baa1-5125964f96d1),volume_type_id=aad9ce24-93f9-41a6-baa1-5125964f96d1)' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:44:50 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-9bea4d84-103a-4d6c-a321-fcb7cf14c991 tempest-VolumesSnapshotTestJSON-1039322322 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d409b0e5-f0b7-4cfd-8616-089ca73559ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:44:50 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-9bea4d84-103a-4d6c-a321-fcb7cf14c991 tempest-VolumesSnapshotTestJSON-1039322322 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d409b0e5-f0b7-4cfd-8616-089ca73559ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:44:50 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-9bea4d84-103a-4d6c-a321-fcb7cf14c991 tempest-VolumesSnapshotTestJSON-1039322322 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2b6451ff-a743-4850-9257-4dc1aecd8b70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:44:50 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-9bea4d84-103a-4d6c-a321-fcb7cf14c991 tempest-VolumesSnapshotTestJSON-1039322322 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2b6451ff-a743-4850-9257-4dc1aecd8b70) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '671b8a5b-e060-484b-a83c-ea822663f67c', 'volume_name': 'volume-671b8a5b-e060-484b-a83c-ea822663f67c', 'volume_size': 1}' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:44:50 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-9bea4d84-103a-4d6c-a321-fcb7cf14c991 tempest-VolumesSnapshotTestJSON-1039322322 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3ad23d3d-a1b4-4b70-b572-4f51b0ae13c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:44:50 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-9bea4d84-103a-4d6c-a321-fcb7cf14c991 tempest-VolumesSnapshotTestJSON-1039322322 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3ad23d3d-a1b4-4b70-b572-4f51b0ae13c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:44:50 devstack sudo[101525]: pam_unix(sudo:session): session closed for user root Jun 17 04:44:50 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-9bea4d84-103a-4d6c-a321-fcb7cf14c991 tempest-VolumesSnapshotTestJSON-1039322322 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (786e2335-3745-4ff3-9335-010e79c807f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:44:50 devstack cinder-volume[92060]: INFO cinder.volume.flows.manager.create_volume [None req-9bea4d84-103a-4d6c-a321-fcb7cf14c991 tempest-VolumesSnapshotTestJSON-1039322322 None] Volume 671b8a5b-e060-484b-a83c-ea822663f67c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-671b8a5b-e060-484b-a83c-ea822663f67c', 'volume_size': 1} Jun 17 04:44:50 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-9bea4d84-103a-4d6c-a321-fcb7cf14c991 tempest-VolumesSnapshotTestJSON-1039322322 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 04:44:50 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-9bea4d84-103a-4d6c-a321-fcb7cf14c991 tempest-VolumesSnapshotTestJSON-1039322322 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 04:44:50 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-9bea4d84-103a-4d6c-a321-fcb7cf14c991 tempest-VolumesSnapshotTestJSON-1039322322 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-17T02:44:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-206200990',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=671b8a5b-e060-484b-a83c-ea822663f67c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='411c6111710645bfa3f034c46596cbaf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T02:44:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T02:44:51Z,use_quota=True,user_id='84f516bc01824ccfaaea6fa73a4f20b1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aad9ce24-93f9-41a6-baa1-5125964f96d1),volume_type_id=aad9ce24-93f9-41a6-baa1-5125964f96d1)}" {{(pid=92060) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 17 04:44:50 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.remotefs [None req-9bea4d84-103a-4d6c-a321-fcb7cf14c991 tempest-VolumesSnapshotTestJSON-1039322322 None] Creating volume 671b8a5b-e060-484b-a83c-ea822663f67c {{(pid=92060) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 17 04:44:50 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-9bea4d84-103a-4d6c-a321-fcb7cf14c991 tempest-VolumesSnapshotTestJSON-1039322322 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 04:44:50 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-9bea4d84-103a-4d6c-a321-fcb7cf14c991 tempest-VolumesSnapshotTestJSON-1039322322 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 04:44:50 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-9bea4d84-103a-4d6c-a321-fcb7cf14c991 tempest-VolumesSnapshotTestJSON-1039322322 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588': None} {{(pid=92060) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 17 04:44:50 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-9bea4d84-103a-4d6c-a321-fcb7cf14c991 tempest-VolumesSnapshotTestJSON-1039322322 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588'] {{(pid=92060) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 17 04:44:50 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-9bea4d84-103a-4d6c-a321-fcb7cf14c991 tempest-VolumesSnapshotTestJSON-1039322322 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 04:44:50 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-9bea4d84-103a-4d6c-a321-fcb7cf14c991 tempest-VolumesSnapshotTestJSON-1039322322 None] Selected osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588 as target Quobyte volume. {{(pid=92060) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 17 04:44:50 devstack cinder-volume[92060]: INFO cinder.volume.drivers.remotefs [None req-9bea4d84-103a-4d6c-a321-fcb7cf14c991 tempest-VolumesSnapshotTestJSON-1039322322 None] casted to osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588 Jun 17 04:44:50 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-9bea4d84-103a-4d6c-a321-fcb7cf14c991 tempest-VolumesSnapshotTestJSON-1039322322 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-671b8a5b-e060-484b-a83c-ea822663f67c 1073741824 {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:44:50 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-186d0ebc-9ae6-4e1f-8226-9c13bbdd09b1 tempest-VolumesSnapshotTestJSON-1039322322 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a" returned: 0 in 0.973s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:44:50 devstack cinder-volume[92060]: DEBUG cinder.manager [None req-186d0ebc-9ae6-4e1f-8226-9c13bbdd09b1 tempest-VolumesSnapshotTestJSON-1039322322 None] Notifying Schedulers of capabilities ... {{(pid=92060) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 17 04:44:50 devstack cinder-volume[92060]: INFO cinder.volume.manager [None req-186d0ebc-9ae6-4e1f-8226-9c13bbdd09b1 tempest-VolumesSnapshotTestJSON-1039322322 None] Deleted volume successfully. Jun 17 04:44:50 devstack sudo[101532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-671b8a5b-e060-484b-a83c-ea822663f67c 1073741824 Jun 17 04:44:50 devstack sudo[101532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:44:50 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-186d0ebc-9ae6-4e1f-8226-9c13bbdd09b1 tempest-VolumesSnapshotTestJSON-1039322322 None] Lock "cinder-cc44cc2e-42ac-4892-8587-446c312ae2a6-delete_volume" released by "delete_volume" :: held 3.264s {{(pid=92060) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 04:44:50 devstack sudo[101528]: pam_unix(sudo:session): session closed for user root Jun 17 04:44:50 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-c2203ed9-b806-43ab-ad9b-c5ca552a0f9d tempest-VolumesDeleteCascade-1909219053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-787aa2b2-1905-4b49-9a7b-76228def377e.ad883e4c-5402-4ef5-8a7e-eef7191d6637" returned: 0 in 0.923s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:44:51 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-c2203ed9-b806-43ab-ad9b-c5ca552a0f9d tempest-VolumesDeleteCascade-1909219053 None] Lock "cinder-quobyte-ad883e4c-5402-4ef5-8a7e-eef7191d6637" released by "_delete_snapshot" :: held 4.024s {{(pid=92060) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 04:44:51 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-c2203ed9-b806-43ab-ad9b-c5ca552a0f9d tempest-VolumesDeleteCascade-1909219053 None] Lock "cinder-quobyte-787aa2b2-1905-4b49-9a7b-76228def377e" released by "delete_snapshot" :: held 4.052s {{(pid=92060) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 04:44:51 devstack cinder-volume[92060]: DEBUG cinder.quota [None req-c2203ed9-b806-43ab-ad9b-c5ca552a0f9d tempest-VolumesDeleteCascade-1909219053 None] Created reservations ['98797088-429d-4ddc-bbc2-e2b14f746ae1', 'fa3b7d0b-e43a-4e48-ae03-00d48f7c811e', '1000b51f-f4c1-463c-8385-0a26eb79be8a', '39b10aee-2021-4e93-bb15-e6ef510d0146'] {{(pid=92060) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 17 04:44:51 devstack cinder-volume[92060]: INFO cinder.volume.manager [None req-c2203ed9-b806-43ab-ad9b-c5ca552a0f9d tempest-VolumesDeleteCascade-1909219053 None] Delete snapshot completed successfully. Jun 17 04:44:51 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-c2203ed9-b806-43ab-ad9b-c5ca552a0f9d tempest-VolumesDeleteCascade-1909219053 None] Lock "cinder-ad883e4c-5402-4ef5-8a7e-eef7191d6637-delete_snapshot" released by "delete_snapshot" :: held 4.314s {{(pid=92060) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 04:44:51 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-c2203ed9-b806-43ab-ad9b-c5ca552a0f9d tempest-VolumesDeleteCascade-1909219053 None] Snapshots deleted, issuing volume delete {{(pid=92060) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Jun 17 04:44:51 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-c2203ed9-b806-43ab-ad9b-c5ca552a0f9d tempest-VolumesDeleteCascade-1909219053 None] Acquiring lock "cinder-quobyte-787aa2b2-1905-4b49-9a7b-76228def377e" by "delete_volume" {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 04:44:51 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-c2203ed9-b806-43ab-ad9b-c5ca552a0f9d tempest-VolumesDeleteCascade-1909219053 None] Lock "cinder-quobyte-787aa2b2-1905-4b49-9a7b-76228def377e" acquired by "delete_volume" :: waited 0.025s {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 04:44:51 devstack cinder-volume[92060]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab37c81b-a804-4739-8131-4f8cd1442abf]: (4, 'qcow2') {{(pid=93130) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 04:44:51 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-c2203ed9-b806-43ab-ad9b-c5ca552a0f9d tempest-VolumesDeleteCascade-1909219053 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-787aa2b2-1905-4b49-9a7b-76228def377e {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:44:51 devstack sudo[101536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-787aa2b2-1905-4b49-9a7b-76228def377e Jun 17 04:44:51 devstack sudo[101536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:44:51 devstack sudo[101532]: pam_unix(sudo:session): session closed for user root Jun 17 04:44:51 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-9bea4d84-103a-4d6c-a321-fcb7cf14c991 tempest-VolumesSnapshotTestJSON-1039322322 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-671b8a5b-e060-484b-a83c-ea822663f67c 1073741824" returned: 0 in 1.106s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:44:51 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-9bea4d84-103a-4d6c-a321-fcb7cf14c991 tempest-VolumesSnapshotTestJSON-1039322322 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-671b8a5b-e060-484b-a83c-ea822663f67c {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:44:51 devstack sudo[101541]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-671b8a5b-e060-484b-a83c-ea822663f67c Jun 17 04:44:51 devstack sudo[101541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:44:52 devstack sudo[101536]: pam_unix(sudo:session): session closed for user root Jun 17 04:44:52 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-c2203ed9-b806-43ab-ad9b-c5ca552a0f9d tempest-VolumesDeleteCascade-1909219053 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-787aa2b2-1905-4b49-9a7b-76228def377e" returned: 0 in 1.317s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:44:52 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-c2203ed9-b806-43ab-ad9b-c5ca552a0f9d tempest-VolumesDeleteCascade-1909219053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-787aa2b2-1905-4b49-9a7b-76228def377e {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:44:52 devstack sudo[101546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-787aa2b2-1905-4b49-9a7b-76228def377e Jun 17 04:44:52 devstack sudo[101546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:44:52 devstack sudo[101541]: pam_unix(sudo:session): session closed for user root Jun 17 04:44:52 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-9bea4d84-103a-4d6c-a321-fcb7cf14c991 tempest-VolumesSnapshotTestJSON-1039322322 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-671b8a5b-e060-484b-a83c-ea822663f67c" returned: 0 in 0.989s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:44:52 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-9bea4d84-103a-4d6c-a321-fcb7cf14c991 tempest-VolumesSnapshotTestJSON-1039322322 None] <== create_volume: return (2173ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588'} {{(pid=92060) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 17 04:44:52 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-9bea4d84-103a-4d6c-a321-fcb7cf14c991 tempest-VolumesSnapshotTestJSON-1039322322 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.177s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 04:44:52 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-9bea4d84-103a-4d6c-a321-fcb7cf14c991 tempest-VolumesSnapshotTestJSON-1039322322 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (786e2335-3745-4ff3-9335-010e79c807f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-671b8a5b-e060-484b-a83c-ea822663f67c', 'volume_size': 1}' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:44:52 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-9bea4d84-103a-4d6c-a321-fcb7cf14c991 tempest-VolumesSnapshotTestJSON-1039322322 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c9ae01ae-58d2-4ada-98b4-2b0a0020326b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:44:52 devstack cinder-volume[92060]: INFO cinder.volume.flows.manager.create_volume [None req-9bea4d84-103a-4d6c-a321-fcb7cf14c991 tempest-VolumesSnapshotTestJSON-1039322322 None] Volume volume-671b8a5b-e060-484b-a83c-ea822663f67c (671b8a5b-e060-484b-a83c-ea822663f67c): created successfully Jun 17 04:44:52 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-9bea4d84-103a-4d6c-a321-fcb7cf14c991 tempest-VolumesSnapshotTestJSON-1039322322 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c9ae01ae-58d2-4ada-98b4-2b0a0020326b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:44:52 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-9bea4d84-103a-4d6c-a321-fcb7cf14c991 tempest-VolumesSnapshotTestJSON-1039322322 None] Flow 'volume_create_manager' (0db88e70-45c6-4006-af04-d6f432f6f87c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92060) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 17 04:44:52 devstack cinder-volume[92060]: INFO cinder.volume.manager [None req-9bea4d84-103a-4d6c-a321-fcb7cf14c991 tempest-VolumesSnapshotTestJSON-1039322322 None] Created volume successfully. Jun 17 04:44:53 devstack sudo[101546]: pam_unix(sudo:session): session closed for user root Jun 17 04:44:53 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-c2203ed9-b806-43ab-ad9b-c5ca552a0f9d tempest-VolumesDeleteCascade-1909219053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-787aa2b2-1905-4b49-9a7b-76228def377e" returned: 0 in 0.701s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:44:53 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-c2203ed9-b806-43ab-ad9b-c5ca552a0f9d tempest-VolumesDeleteCascade-1909219053 None] Lock "cinder-quobyte-787aa2b2-1905-4b49-9a7b-76228def377e" released by "delete_volume" :: held 2.101s {{(pid=92060) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 04:44:53 devstack cinder-volume[92060]: DEBUG cinder.quota [None req-c2203ed9-b806-43ab-ad9b-c5ca552a0f9d tempest-VolumesDeleteCascade-1909219053 None] Created reservations ['b4114a76-2022-452a-9eff-6c828e039ff3', 'ee9eb58b-9296-4e47-8c8a-cd8c618eb4ff', 'dca487b5-7221-4fca-81bb-02f8ef1749ce', 'a2d31b16-7304-4978-87f7-b1a4046e5dce'] {{(pid=92060) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 17 04:44:53 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-c2203ed9-b806-43ab-ad9b-c5ca552a0f9d tempest-VolumesDeleteCascade-1909219053 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 04:44:53 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-c2203ed9-b806-43ab-ad9b-c5ca552a0f9d tempest-VolumesDeleteCascade-1909219053 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 04:44:53 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-c2203ed9-b806-43ab-ad9b-c5ca552a0f9d tempest-VolumesDeleteCascade-1909219053 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588': None} {{(pid=92060) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 17 04:44:53 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-c2203ed9-b806-43ab-ad9b-c5ca552a0f9d tempest-VolumesDeleteCascade-1909219053 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588'] {{(pid=92060) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 17 04:44:53 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-c2203ed9-b806-43ab-ad9b-c5ca552a0f9d tempest-VolumesDeleteCascade-1909219053 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 04:44:53 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-c2203ed9-b806-43ab-ad9b-c5ca552a0f9d tempest-VolumesDeleteCascade-1909219053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:44:53 devstack sudo[101550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a Jun 17 04:44:53 devstack sudo[101550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:44:53 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-bd938a19-4052-4686-a340-8e790d7bd9ea tempest-VolumesDeleteCascade-1909219053 None] Acquiring lock "cinder-887cb018-0ecb-4d35-8b33-b5e4e9276daa-delete_volume" by "delete_volume" {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 04:44:53 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-bd938a19-4052-4686-a340-8e790d7bd9ea tempest-VolumesDeleteCascade-1909219053 None] Lock "cinder-887cb018-0ecb-4d35-8b33-b5e4e9276daa-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 04:44:53 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-bd938a19-4052-4686-a340-8e790d7bd9ea tempest-VolumesDeleteCascade-1909219053 None] Acquiring lock "cinder-quobyte-887cb018-0ecb-4d35-8b33-b5e4e9276daa" by "delete_volume" {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 04:44:53 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-bd938a19-4052-4686-a340-8e790d7bd9ea tempest-VolumesDeleteCascade-1909219053 None] Lock "cinder-quobyte-887cb018-0ecb-4d35-8b33-b5e4e9276daa" acquired by "delete_volume" :: waited 0.018s {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 04:44:53 devstack cinder-volume[92060]: DEBUG oslo.privsep.daemon [-] privsep: reply[642cd527-8fbd-4e0c-b98d-a242d22327d0]: (4, 'qcow2') {{(pid=93130) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 04:44:53 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-bd938a19-4052-4686-a340-8e790d7bd9ea tempest-VolumesDeleteCascade-1909219053 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-887cb018-0ecb-4d35-8b33-b5e4e9276daa {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:44:54 devstack sudo[101552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-887cb018-0ecb-4d35-8b33-b5e4e9276daa Jun 17 04:44:54 devstack sudo[101552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:44:54 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-b1604b30-6d71-4743-adab-e5704c277845 tempest-VolumesSnapshotTestJSON-1039322322 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 04:44:54 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-b1604b30-6d71-4743-adab-e5704c277845 tempest-VolumesSnapshotTestJSON-1039322322 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 04:44:54 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.remotefs [None req-b1604b30-6d71-4743-adab-e5704c277845 tempest-VolumesSnapshotTestJSON-1039322322 None] Creating offline snapshot 1ddb3764-7dec-4805-8332-a15d4248cad2 of volume 671b8a5b-e060-484b-a83c-ea822663f67c {{(pid=92060) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 17 04:44:54 devstack sudo[101550]: pam_unix(sudo:session): session closed for user root Jun 17 04:44:54 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-c2203ed9-b806-43ab-ad9b-c5ca552a0f9d tempest-VolumesDeleteCascade-1909219053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a" returned: 0 in 0.893s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:44:54 devstack cinder-volume[92060]: DEBUG cinder.manager [None req-c2203ed9-b806-43ab-ad9b-c5ca552a0f9d tempest-VolumesDeleteCascade-1909219053 None] Notifying Schedulers of capabilities ... {{(pid=92060) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 17 04:44:54 devstack cinder-volume[92060]: INFO cinder.volume.manager [None req-c2203ed9-b806-43ab-ad9b-c5ca552a0f9d tempest-VolumesDeleteCascade-1909219053 None] Deleted volume successfully. Jun 17 04:44:54 devstack cinder-volume[92060]: DEBUG oslo.privsep.daemon [-] privsep: reply[50327d05-974f-4837-9612-d4b9f32516b3]: (4, 'qcow2') {{(pid=93130) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 04:44:54 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-b1604b30-6d71-4743-adab-e5704c277845 tempest-VolumesSnapshotTestJSON-1039322322 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-671b8a5b-e060-484b-a83c-ea822663f67c {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:44:54 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-c2203ed9-b806-43ab-ad9b-c5ca552a0f9d tempest-VolumesDeleteCascade-1909219053 None] Lock "cinder-787aa2b2-1905-4b49-9a7b-76228def377e-delete_volume" released by "delete_volume" :: held 7.611s {{(pid=92060) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 04:44:54 devstack sudo[101555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-671b8a5b-e060-484b-a83c-ea822663f67c Jun 17 04:44:54 devstack sudo[101555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:44:54 devstack sudo[101552]: pam_unix(sudo:session): session closed for user root Jun 17 04:44:54 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-bd938a19-4052-4686-a340-8e790d7bd9ea tempest-VolumesDeleteCascade-1909219053 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-887cb018-0ecb-4d35-8b33-b5e4e9276daa" returned: 0 in 1.029s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:44:54 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-bd938a19-4052-4686-a340-8e790d7bd9ea tempest-VolumesDeleteCascade-1909219053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-887cb018-0ecb-4d35-8b33-b5e4e9276daa {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:44:54 devstack sudo[101560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-887cb018-0ecb-4d35-8b33-b5e4e9276daa Jun 17 04:44:54 devstack sudo[101560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:44:55 devstack sudo[101555]: pam_unix(sudo:session): session closed for user root Jun 17 04:44:55 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-b1604b30-6d71-4743-adab-e5704c277845 tempest-VolumesSnapshotTestJSON-1039322322 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-671b8a5b-e060-484b-a83c-ea822663f67c" returned: 0 in 0.902s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:44:55 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-b1604b30-6d71-4743-adab-e5704c277845 tempest-VolumesSnapshotTestJSON-1039322322 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-671b8a5b-e060-484b-a83c-ea822663f67c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-671b8a5b-e060-484b-a83c-ea822663f67c.1ddb3764-7dec-4805-8332-a15d4248cad2 1G {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:44:55 devstack sudo[101566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-671b8a5b-e060-484b-a83c-ea822663f67c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-671b8a5b-e060-484b-a83c-ea822663f67c.1ddb3764-7dec-4805-8332-a15d4248cad2 1G Jun 17 04:44:55 devstack sudo[101566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:44:55 devstack sudo[101560]: pam_unix(sudo:session): session closed for user root Jun 17 04:44:55 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-bd938a19-4052-4686-a340-8e790d7bd9ea tempest-VolumesDeleteCascade-1909219053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-887cb018-0ecb-4d35-8b33-b5e4e9276daa" returned: 0 in 0.720s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:44:55 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-bd938a19-4052-4686-a340-8e790d7bd9ea tempest-VolumesDeleteCascade-1909219053 None] Lock "cinder-quobyte-887cb018-0ecb-4d35-8b33-b5e4e9276daa" released by "delete_volume" :: held 1.818s {{(pid=92060) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 04:44:55 devstack cinder-volume[92060]: DEBUG cinder.quota [None req-bd938a19-4052-4686-a340-8e790d7bd9ea tempest-VolumesDeleteCascade-1909219053 None] Created reservations ['f6c0ce18-e3a3-4209-ba20-a9fdcc34a356', 'f6836592-cc76-4b23-af32-99656a0161f3', '61161796-d413-4741-a01c-0dff08a21717', '7581a2cf-ee7b-443f-b05a-c5dac5688336'] {{(pid=92060) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 17 04:44:55 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-bd938a19-4052-4686-a340-8e790d7bd9ea tempest-VolumesDeleteCascade-1909219053 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 04:44:55 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-bd938a19-4052-4686-a340-8e790d7bd9ea tempest-VolumesDeleteCascade-1909219053 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 04:44:55 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-bd938a19-4052-4686-a340-8e790d7bd9ea tempest-VolumesDeleteCascade-1909219053 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588': None} {{(pid=92060) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 17 04:44:55 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-bd938a19-4052-4686-a340-8e790d7bd9ea tempest-VolumesDeleteCascade-1909219053 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588'] {{(pid=92060) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 17 04:44:55 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-bd938a19-4052-4686-a340-8e790d7bd9ea tempest-VolumesDeleteCascade-1909219053 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 04:44:55 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-bd938a19-4052-4686-a340-8e790d7bd9ea tempest-VolumesDeleteCascade-1909219053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:44:55 devstack sudo[101569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a Jun 17 04:44:55 devstack sudo[101569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:44:56 devstack sudo[101566]: pam_unix(sudo:session): session closed for user root Jun 17 04:44:56 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-b1604b30-6d71-4743-adab-e5704c277845 tempest-VolumesSnapshotTestJSON-1039322322 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-671b8a5b-e060-484b-a83c-ea822663f67c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-671b8a5b-e060-484b-a83c-ea822663f67c.1ddb3764-7dec-4805-8332-a15d4248cad2 1G" returned: 0 in 1.053s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:44:56 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-b1604b30-6d71-4743-adab-e5704c277845 tempest-VolumesSnapshotTestJSON-1039322322 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-671b8a5b-e060-484b-a83c-ea822663f67c -F qcow2 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-671b8a5b-e060-484b-a83c-ea822663f67c.1ddb3764-7dec-4805-8332-a15d4248cad2 {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:44:56 devstack sudo[101574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-671b8a5b-e060-484b-a83c-ea822663f67c -F qcow2 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-671b8a5b-e060-484b-a83c-ea822663f67c.1ddb3764-7dec-4805-8332-a15d4248cad2 Jun 17 04:44:56 devstack sudo[101574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:44:56 devstack sudo[101569]: pam_unix(sudo:session): session closed for user root Jun 17 04:44:56 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-bd938a19-4052-4686-a340-8e790d7bd9ea tempest-VolumesDeleteCascade-1909219053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a" returned: 0 in 0.762s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:44:56 devstack cinder-volume[92060]: DEBUG cinder.manager [None req-bd938a19-4052-4686-a340-8e790d7bd9ea tempest-VolumesDeleteCascade-1909219053 None] Notifying Schedulers of capabilities ... {{(pid=92060) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 17 04:44:56 devstack cinder-volume[92060]: INFO cinder.volume.manager [None req-bd938a19-4052-4686-a340-8e790d7bd9ea tempest-VolumesDeleteCascade-1909219053 None] Deleted volume successfully. Jun 17 04:44:56 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-bd938a19-4052-4686-a340-8e790d7bd9ea tempest-VolumesDeleteCascade-1909219053 None] Lock "cinder-887cb018-0ecb-4d35-8b33-b5e4e9276daa-delete_volume" released by "delete_volume" :: held 2.841s {{(pid=92060) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 04:44:57 devstack sudo[101574]: pam_unix(sudo:session): session closed for user root Jun 17 04:44:57 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-b1604b30-6d71-4743-adab-e5704c277845 tempest-VolumesSnapshotTestJSON-1039322322 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-671b8a5b-e060-484b-a83c-ea822663f67c -F qcow2 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-671b8a5b-e060-484b-a83c-ea822663f67c.1ddb3764-7dec-4805-8332-a15d4248cad2" returned: 0 in 0.808s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:44:57 devstack cinder-volume[92060]: WARNING cinder.volume.drivers.remotefs [None req-b1604b30-6d71-4743-adab-e5704c277845 tempest-VolumesSnapshotTestJSON-1039322322 None] /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-671b8a5b-e060-484b-a83c-ea822663f67c.1ddb3764-7dec-4805-8332-a15d4248cad2 is being set with open permissions: ugo+rw Jun 17 04:44:57 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-b1604b30-6d71-4743-adab-e5704c277845 tempest-VolumesSnapshotTestJSON-1039322322 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-671b8a5b-e060-484b-a83c-ea822663f67c.1ddb3764-7dec-4805-8332-a15d4248cad2 {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:44:57 devstack sudo[101581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-671b8a5b-e060-484b-a83c-ea822663f67c.1ddb3764-7dec-4805-8332-a15d4248cad2 Jun 17 04:44:57 devstack sudo[101581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:44:57 devstack sudo[101581]: pam_unix(sudo:session): session closed for user root Jun 17 04:44:57 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-b1604b30-6d71-4743-adab-e5704c277845 tempest-VolumesSnapshotTestJSON-1039322322 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-671b8a5b-e060-484b-a83c-ea822663f67c.1ddb3764-7dec-4805-8332-a15d4248cad2" returned: 0 in 0.670s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:44:57 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-b1604b30-6d71-4743-adab-e5704c277845 tempest-VolumesSnapshotTestJSON-1039322322 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-671b8a5b-e060-484b-a83c-ea822663f67c.info {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:44:57 devstack sudo[101584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-671b8a5b-e060-484b-a83c-ea822663f67c.info Jun 17 04:44:57 devstack sudo[101584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:44:58 devstack sudo[101584]: pam_unix(sudo:session): session closed for user root Jun 17 04:44:58 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-b1604b30-6d71-4743-adab-e5704c277845 tempest-VolumesSnapshotTestJSON-1039322322 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-671b8a5b-e060-484b-a83c-ea822663f67c.info" returned: 0 in 0.605s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:44:58 devstack cinder-volume[92060]: WARNING cinder.volume.drivers.remotefs [None req-b1604b30-6d71-4743-adab-e5704c277845 tempest-VolumesSnapshotTestJSON-1039322322 None] /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-671b8a5b-e060-484b-a83c-ea822663f67c.info is being set with open permissions: ugo+rw Jun 17 04:44:58 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-b1604b30-6d71-4743-adab-e5704c277845 tempest-VolumesSnapshotTestJSON-1039322322 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-671b8a5b-e060-484b-a83c-ea822663f67c.info {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:44:58 devstack sudo[101587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-671b8a5b-e060-484b-a83c-ea822663f67c.info Jun 17 04:44:58 devstack sudo[101587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:44:59 devstack sudo[101587]: pam_unix(sudo:session): session closed for user root Jun 17 04:44:59 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-b1604b30-6d71-4743-adab-e5704c277845 tempest-VolumesSnapshotTestJSON-1039322322 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-671b8a5b-e060-484b-a83c-ea822663f67c.info" returned: 0 in 0.844s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:44:59 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-b1604b30-6d71-4743-adab-e5704c277845 tempest-VolumesSnapshotTestJSON-1039322322 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.024s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 04:44:59 devstack cinder-volume[92060]: INFO cinder.volume.manager [None req-b1604b30-6d71-4743-adab-e5704c277845 tempest-VolumesSnapshotTestJSON-1039322322 None] Create snapshot completed successfully Jun 17 04:45:00 devstack cinder-volume[92060]: DEBUG cinder.volume.flows.manager.create_volume [None req-182a9dc0-c03f-4465-820e-44558e00705f tempest-VolumesSnapshotTestJSON-1039322322 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92060) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 17 04:45:00 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-182a9dc0-c03f-4465-820e-44558e00705f tempest-VolumesSnapshotTestJSON-1039322322 None] Flow 'volume_create_manager' (8f0b48ee-1687-4bac-91d8-7219c7fc6bca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 17 04:45:00 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-182a9dc0-c03f-4465-820e-44558e00705f tempest-VolumesSnapshotTestJSON-1039322322 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b7940f06-e016-4b98-9e1d-6c9d6808ff5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:45:00 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-182a9dc0-c03f-4465-820e-44558e00705f tempest-VolumesSnapshotTestJSON-1039322322 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b7940f06-e016-4b98-9e1d-6c9d6808ff5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-17T02:45:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1440909637',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=da651d05-84f6-4f85-91ec-a2218d400ce3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='411c6111710645bfa3f034c46596cbaf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T02:45:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=1ddb3764-7dec-4805-8332-a15d4248cad2,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T02:45:00Z,use_quota=True,user_id='84f516bc01824ccfaaea6fa73a4f20b1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aad9ce24-93f9-41a6-baa1-5125964f96d1),volume_type_id=aad9ce24-93f9-41a6-baa1-5125964f96d1)' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:45:00 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-182a9dc0-c03f-4465-820e-44558e00705f tempest-VolumesSnapshotTestJSON-1039322322 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1cc4c6e3-2b8f-44da-9fb7-42c4c89ae69c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:45:00 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-182a9dc0-c03f-4465-820e-44558e00705f tempest-VolumesSnapshotTestJSON-1039322322 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1cc4c6e3-2b8f-44da-9fb7-42c4c89ae69c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:45:00 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-182a9dc0-c03f-4465-820e-44558e00705f tempest-VolumesSnapshotTestJSON-1039322322 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fe385f67-ac4e-450c-80e1-25334b8941ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:45:00 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-182a9dc0-c03f-4465-820e-44558e00705f tempest-VolumesSnapshotTestJSON-1039322322 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fe385f67-ac4e-450c-80e1-25334b8941ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'da651d05-84f6-4f85-91ec-a2218d400ce3', 'volume_name': 'volume-da651d05-84f6-4f85-91ec-a2218d400ce3', 'volume_size': 1, 'snapshot_id': '1ddb3764-7dec-4805-8332-a15d4248cad2'}' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:45:00 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-182a9dc0-c03f-4465-820e-44558e00705f tempest-VolumesSnapshotTestJSON-1039322322 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (31f54c0c-a5c0-4b52-9105-6ab60ba43ec0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:45:00 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-182a9dc0-c03f-4465-820e-44558e00705f tempest-VolumesSnapshotTestJSON-1039322322 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (31f54c0c-a5c0-4b52-9105-6ab60ba43ec0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:45:00 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-182a9dc0-c03f-4465-820e-44558e00705f tempest-VolumesSnapshotTestJSON-1039322322 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (edcaba79-8127-47bd-b776-2c5bd95a948b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:45:00 devstack cinder-volume[92060]: INFO cinder.volume.flows.manager.create_volume [None req-182a9dc0-c03f-4465-820e-44558e00705f tempest-VolumesSnapshotTestJSON-1039322322 None] Volume da651d05-84f6-4f85-91ec-a2218d400ce3: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-da651d05-84f6-4f85-91ec-a2218d400ce3', 'volume_size': 1, 'snapshot_id': '1ddb3764-7dec-4805-8332-a15d4248cad2'} Jun 17 04:45:00 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-182a9dc0-c03f-4465-820e-44558e00705f tempest-VolumesSnapshotTestJSON-1039322322 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 04:45:00 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-182a9dc0-c03f-4465-820e-44558e00705f tempest-VolumesSnapshotTestJSON-1039322322 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 04:45:00 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-182a9dc0-c03f-4465-820e-44558e00705f tempest-VolumesSnapshotTestJSON-1039322322 None] Acquiring lock "cinder-quobyte-1ddb3764-7dec-4805-8332-a15d4248cad2-da651d05-84f6-4f85-91ec-a2218d400ce3" by "_create_volume_from_snapshot" {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 04:45:00 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-182a9dc0-c03f-4465-820e-44558e00705f tempest-VolumesSnapshotTestJSON-1039322322 None] Lock "cinder-quobyte-1ddb3764-7dec-4805-8332-a15d4248cad2-da651d05-84f6-4f85-91ec-a2218d400ce3" acquired by "_create_volume_from_snapshot" :: waited 0.026s {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 04:45:00 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-182a9dc0-c03f-4465-820e-44558e00705f tempest-VolumesSnapshotTestJSON-1039322322 None] Creating volume da651d05-84f6-4f85-91ec-a2218d400ce3 from snapshot 1ddb3764-7dec-4805-8332-a15d4248cad2 {{(pid=92060) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jun 17 04:45:00 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-182a9dc0-c03f-4465-820e-44558e00705f tempest-VolumesSnapshotTestJSON-1039322322 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 04:45:00 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-182a9dc0-c03f-4465-820e-44558e00705f tempest-VolumesSnapshotTestJSON-1039322322 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 04:45:00 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-182a9dc0-c03f-4465-820e-44558e00705f tempest-VolumesSnapshotTestJSON-1039322322 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588': None} {{(pid=92060) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 17 04:45:00 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-182a9dc0-c03f-4465-820e-44558e00705f tempest-VolumesSnapshotTestJSON-1039322322 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588'] {{(pid=92060) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 17 04:45:00 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-182a9dc0-c03f-4465-820e-44558e00705f tempest-VolumesSnapshotTestJSON-1039322322 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 04:45:00 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-182a9dc0-c03f-4465-820e-44558e00705f tempest-VolumesSnapshotTestJSON-1039322322 None] Selected osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588 as target Quobyte volume. {{(pid=92060) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 17 04:45:00 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-182a9dc0-c03f-4465-820e-44558e00705f tempest-VolumesSnapshotTestJSON-1039322322 None] Acquiring lock "cinder-quobyte-da651d05-84f6-4f85-91ec-a2218d400ce3" by "_copy_volume_from_snapshot" {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 04:45:00 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-182a9dc0-c03f-4465-820e-44558e00705f tempest-VolumesSnapshotTestJSON-1039322322 None] Lock "cinder-quobyte-da651d05-84f6-4f85-91ec-a2218d400ce3" acquired by "_copy_volume_from_snapshot" :: waited 0.021s {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 04:45:00 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-182a9dc0-c03f-4465-820e-44558e00705f tempest-VolumesSnapshotTestJSON-1039322322 None] snapshot: 1ddb3764-7dec-4805-8332-a15d4248cad2, volume: da651d05-84f6-4f85-91ec-a2218d400ce3, {{(pid=92060) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jun 17 04:45:00 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-182a9dc0-c03f-4465-820e-44558e00705f tempest-VolumesSnapshotTestJSON-1039322322 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 04:45:00 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-182a9dc0-c03f-4465-820e-44558e00705f tempest-VolumesSnapshotTestJSON-1039322322 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 04:45:00 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-182a9dc0-c03f-4465-820e-44558e00705f tempest-VolumesSnapshotTestJSON-1039322322 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588': None} {{(pid=92060) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 17 04:45:00 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-182a9dc0-c03f-4465-820e-44558e00705f tempest-VolumesSnapshotTestJSON-1039322322 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588'] {{(pid=92060) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 17 04:45:00 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-182a9dc0-c03f-4465-820e-44558e00705f tempest-VolumesSnapshotTestJSON-1039322322 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 04:45:00 devstack cinder-volume[92060]: DEBUG oslo.privsep.daemon [-] privsep: reply[f45afe2e-c770-4795-9c9b-f95f194f47ca]: (4, 'qcow2') {{(pid=93130) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 04:45:00 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-182a9dc0-c03f-4465-820e-44558e00705f tempest-VolumesSnapshotTestJSON-1039322322 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-671b8a5b-e060-484b-a83c-ea822663f67c.1ddb3764-7dec-4805-8332-a15d4248cad2 {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:45:00 devstack sudo[101590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-671b8a5b-e060-484b-a83c-ea822663f67c.1ddb3764-7dec-4805-8332-a15d4248cad2 Jun 17 04:45:00 devstack sudo[101590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:45:01 devstack sudo[101590]: pam_unix(sudo:session): session closed for user root Jun 17 04:45:01 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-182a9dc0-c03f-4465-820e-44558e00705f tempest-VolumesSnapshotTestJSON-1039322322 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-671b8a5b-e060-484b-a83c-ea822663f67c.1ddb3764-7dec-4805-8332-a15d4248cad2" returned: 0 in 0.883s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:45:01 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.remotefs [None req-182a9dc0-c03f-4465-820e-44558e00705f tempest-VolumesSnapshotTestJSON-1039322322 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-671b8a5b-e060-484b-a83c-ea822663f67c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=92060) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 17 04:45:01 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-182a9dc0-c03f-4465-820e-44558e00705f tempest-VolumesSnapshotTestJSON-1039322322 None] will copy from snapshot at /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-671b8a5b-e060-484b-a83c-ea822663f67c {{(pid=92060) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jun 17 04:45:01 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-182a9dc0-c03f-4465-820e-44558e00705f tempest-VolumesSnapshotTestJSON-1039322322 None] Creating direct copy from snapshot {{(pid=92060) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jun 17 04:45:01 devstack cinder-volume[92060]: DEBUG oslo.privsep.daemon [-] privsep: reply[63d2baff-0d46-442d-892b-70ce02b090e7]: (4, 'qcow2') {{(pid=93130) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 04:45:01 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-182a9dc0-c03f-4465-820e-44558e00705f tempest-VolumesSnapshotTestJSON-1039322322 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-671b8a5b-e060-484b-a83c-ea822663f67c {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:45:01 devstack sudo[101596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-671b8a5b-e060-484b-a83c-ea822663f67c Jun 17 04:45:01 devstack sudo[101596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:45:02 devstack sudo[101596]: pam_unix(sudo:session): session closed for user root Jun 17 04:45:02 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-182a9dc0-c03f-4465-820e-44558e00705f tempest-VolumesSnapshotTestJSON-1039322322 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-671b8a5b-e060-484b-a83c-ea822663f67c" returned: 0 in 0.988s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:45:02 devstack cinder-volume[92060]: DEBUG cinder.utils [None req-182a9dc0-c03f-4465-820e-44558e00705f tempest-VolumesSnapshotTestJSON-1039322322 None] Path /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-da651d05-84f6-4f85-91ec-a2218d400ce3 not found in is_blk_device check {{(pid=92060) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jun 17 04:45:02 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-182a9dc0-c03f-4465-820e-44558e00705f tempest-VolumesSnapshotTestJSON-1039322322 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-671b8a5b-e060-484b-a83c-ea822663f67c /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-da651d05-84f6-4f85-91ec-a2218d400ce3 {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:45:02 devstack sudo[101604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-671b8a5b-e060-484b-a83c-ea822663f67c /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-da651d05-84f6-4f85-91ec-a2218d400ce3 Jun 17 04:45:02 devstack sudo[101604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:45:08 devstack sudo[101604]: pam_unix(sudo:session): session closed for user root Jun 17 04:45:08 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-182a9dc0-c03f-4465-820e-44558e00705f tempest-VolumesSnapshotTestJSON-1039322322 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-671b8a5b-e060-484b-a83c-ea822663f67c /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-da651d05-84f6-4f85-91ec-a2218d400ce3" returned: 0 in 6.085s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:45:08 devstack cinder-volume[92060]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c64a51c-5048-43f8-a312-d7589ce7d8b2]: (4, 'qcow2') {{(pid=93130) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 04:45:08 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-182a9dc0-c03f-4465-820e-44558e00705f tempest-VolumesSnapshotTestJSON-1039322322 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-671b8a5b-e060-484b-a83c-ea822663f67c {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:45:08 devstack sudo[101623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-671b8a5b-e060-484b-a83c-ea822663f67c Jun 17 04:45:08 devstack sudo[101623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:45:09 devstack sudo[101623]: pam_unix(sudo:session): session closed for user root Jun 17 04:45:09 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-182a9dc0-c03f-4465-820e-44558e00705f tempest-VolumesSnapshotTestJSON-1039322322 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-671b8a5b-e060-484b-a83c-ea822663f67c" returned: 0 in 1.129s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:45:09 devstack cinder-volume[92060]: DEBUG cinder.image.image_utils [None req-182a9dc0-c03f-4465-820e-44558e00705f tempest-VolumesSnapshotTestJSON-1039322322 None] Image conversion details: src /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-671b8a5b-e060-484b-a83c-ea822663f67c, size 1024.00 MB, duration 6.09 sec, destination /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-da651d05-84f6-4f85-91ec-a2218d400ce3 {{(pid=92060) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 17 04:45:09 devstack cinder-volume[92060]: INFO cinder.image.image_utils [None req-182a9dc0-c03f-4465-820e-44558e00705f tempest-VolumesSnapshotTestJSON-1039322322 None] Converted 1024.00 MB image at 168.19 MB/s Jun 17 04:45:09 devstack cinder-volume[92060]: WARNING cinder.volume.drivers.remotefs [None req-182a9dc0-c03f-4465-820e-44558e00705f tempest-VolumesSnapshotTestJSON-1039322322 None] /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-da651d05-84f6-4f85-91ec-a2218d400ce3 is being set with open permissions: ugo+rw Jun 17 04:45:09 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-182a9dc0-c03f-4465-820e-44558e00705f tempest-VolumesSnapshotTestJSON-1039322322 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-da651d05-84f6-4f85-91ec-a2218d400ce3 {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:45:09 devstack sudo[101628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-da651d05-84f6-4f85-91ec-a2218d400ce3 Jun 17 04:45:09 devstack sudo[101628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:45:10 devstack sudo[101628]: pam_unix(sudo:session): session closed for user root Jun 17 04:45:10 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-182a9dc0-c03f-4465-820e-44558e00705f tempest-VolumesSnapshotTestJSON-1039322322 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-da651d05-84f6-4f85-91ec-a2218d400ce3" returned: 0 in 0.668s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:45:10 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-182a9dc0-c03f-4465-820e-44558e00705f tempest-VolumesSnapshotTestJSON-1039322322 None] Lock "cinder-quobyte-da651d05-84f6-4f85-91ec-a2218d400ce3" released by "_copy_volume_from_snapshot" :: held 9.870s {{(pid=92060) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 04:45:10 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-182a9dc0-c03f-4465-820e-44558e00705f tempest-VolumesSnapshotTestJSON-1039322322 None] Lock "cinder-quobyte-1ddb3764-7dec-4805-8332-a15d4248cad2-da651d05-84f6-4f85-91ec-a2218d400ce3" released by "_create_volume_from_snapshot" :: held 9.916s {{(pid=92060) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 04:45:10 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-182a9dc0-c03f-4465-820e-44558e00705f tempest-VolumesSnapshotTestJSON-1039322322 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.944s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 04:45:10 devstack cinder-volume[92060]: DEBUG dbcounter [-] [92060] Writing DB stats cinder:SELECT=115,cinder:INSERT=32,cinder:UPDATE=125,cinder:DELETE=8 {{(pid=92060) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 17 04:45:10 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-182a9dc0-c03f-4465-820e-44558e00705f tempest-VolumesSnapshotTestJSON-1039322322 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (edcaba79-8127-47bd-b776-2c5bd95a948b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-da651d05-84f6-4f85-91ec-a2218d400ce3', 'volume_size': 1, 'snapshot_id': '1ddb3764-7dec-4805-8332-a15d4248cad2'}' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:45:10 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-182a9dc0-c03f-4465-820e-44558e00705f tempest-VolumesSnapshotTestJSON-1039322322 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a829de63-3dd7-4cad-9e9b-42af6c617261) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:45:10 devstack cinder-volume[92060]: INFO cinder.volume.flows.manager.create_volume [None req-182a9dc0-c03f-4465-820e-44558e00705f tempest-VolumesSnapshotTestJSON-1039322322 None] Volume volume-da651d05-84f6-4f85-91ec-a2218d400ce3 (da651d05-84f6-4f85-91ec-a2218d400ce3): created successfully Jun 17 04:45:10 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-182a9dc0-c03f-4465-820e-44558e00705f tempest-VolumesSnapshotTestJSON-1039322322 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a829de63-3dd7-4cad-9e9b-42af6c617261) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:45:10 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-182a9dc0-c03f-4465-820e-44558e00705f tempest-VolumesSnapshotTestJSON-1039322322 None] Flow 'volume_create_manager' (8f0b48ee-1687-4bac-91d8-7219c7fc6bca) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92060) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 17 04:45:10 devstack cinder-volume[92060]: INFO cinder.volume.manager [None req-182a9dc0-c03f-4465-820e-44558e00705f tempest-VolumesSnapshotTestJSON-1039322322 None] Created volume successfully. Jun 17 04:45:10 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-4cbbb8cd-73f6-4ea9-b7db-74c1d19a01c5 tempest-VolumesSnapshotTestJSON-1039322322 None] Acquiring lock "cinder-da651d05-84f6-4f85-91ec-a2218d400ce3-delete_volume" by "delete_volume" {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 04:45:10 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-4cbbb8cd-73f6-4ea9-b7db-74c1d19a01c5 tempest-VolumesSnapshotTestJSON-1039322322 None] Lock "cinder-da651d05-84f6-4f85-91ec-a2218d400ce3-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 04:45:10 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-4cbbb8cd-73f6-4ea9-b7db-74c1d19a01c5 tempest-VolumesSnapshotTestJSON-1039322322 None] Acquiring lock "cinder-quobyte-da651d05-84f6-4f85-91ec-a2218d400ce3" by "delete_volume" {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 04:45:10 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-4cbbb8cd-73f6-4ea9-b7db-74c1d19a01c5 tempest-VolumesSnapshotTestJSON-1039322322 None] Lock "cinder-quobyte-da651d05-84f6-4f85-91ec-a2218d400ce3" acquired by "delete_volume" :: waited 0.021s {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 04:45:10 devstack cinder-volume[92060]: DEBUG oslo.privsep.daemon [-] privsep: reply[629979b4-632e-4667-a83a-cf646766c73e]: (4, 'qcow2') {{(pid=93130) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 04:45:10 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-4cbbb8cd-73f6-4ea9-b7db-74c1d19a01c5 tempest-VolumesSnapshotTestJSON-1039322322 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-da651d05-84f6-4f85-91ec-a2218d400ce3 {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:45:10 devstack sudo[101631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-da651d05-84f6-4f85-91ec-a2218d400ce3 Jun 17 04:45:10 devstack sudo[101631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:45:11 devstack cinder-volume[92060]: DEBUG cinder.volume.flows.manager.create_volume [None req-f5eb124f-2fd6-4521-b9a8-a791b110ecbd tempest-VolumesGetTest-1816202824 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92060) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 17 04:45:11 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-f5eb124f-2fd6-4521-b9a8-a791b110ecbd tempest-VolumesGetTest-1816202824 None] Flow 'volume_create_manager' (97d48221-a630-4166-b1bd-2e609dbf3eb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 17 04:45:11 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-f5eb124f-2fd6-4521-b9a8-a791b110ecbd tempest-VolumesGetTest-1816202824 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fe6622dc-4e5d-4a24-928d-bdad4dc3249f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:45:11 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-f5eb124f-2fd6-4521-b9a8-a791b110ecbd tempest-VolumesGetTest-1816202824 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fe6622dc-4e5d-4a24-928d-bdad4dc3249f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-17T02:45:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-395099104',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f6f950f1-5cab-4797-b8a1-351470e16739,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='c94fdcfcea4840c2a1e58688ac864031',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T02:45:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T02:45:11Z,use_quota=True,user_id='f5c2a6062921435dac6f9e70bb79370a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aad9ce24-93f9-41a6-baa1-5125964f96d1),volume_type_id=aad9ce24-93f9-41a6-baa1-5125964f96d1)' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:45:11 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-f5eb124f-2fd6-4521-b9a8-a791b110ecbd tempest-VolumesGetTest-1816202824 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (61958085-273c-4041-8806-f0f52cc9adad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:45:11 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-f5eb124f-2fd6-4521-b9a8-a791b110ecbd tempest-VolumesGetTest-1816202824 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (61958085-273c-4041-8806-f0f52cc9adad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:45:11 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-f5eb124f-2fd6-4521-b9a8-a791b110ecbd tempest-VolumesGetTest-1816202824 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ba2e76ae-8d97-451c-8c3b-2412bd2bef57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:45:11 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-f5eb124f-2fd6-4521-b9a8-a791b110ecbd tempest-VolumesGetTest-1816202824 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ba2e76ae-8d97-451c-8c3b-2412bd2bef57) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f6f950f1-5cab-4797-b8a1-351470e16739', 'volume_name': 'volume-f6f950f1-5cab-4797-b8a1-351470e16739', 'volume_size': 1}' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:45:11 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-f5eb124f-2fd6-4521-b9a8-a791b110ecbd tempest-VolumesGetTest-1816202824 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e8833ce8-32bd-4d7b-8df6-deee231b6e1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:45:11 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-f5eb124f-2fd6-4521-b9a8-a791b110ecbd tempest-VolumesGetTest-1816202824 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e8833ce8-32bd-4d7b-8df6-deee231b6e1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:45:11 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-f5eb124f-2fd6-4521-b9a8-a791b110ecbd tempest-VolumesGetTest-1816202824 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4a1fca3e-844d-46ce-ba10-b89d24022e1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:45:11 devstack cinder-volume[92060]: INFO cinder.volume.flows.manager.create_volume [None req-f5eb124f-2fd6-4521-b9a8-a791b110ecbd tempest-VolumesGetTest-1816202824 None] Volume f6f950f1-5cab-4797-b8a1-351470e16739: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f6f950f1-5cab-4797-b8a1-351470e16739', 'volume_size': 1} Jun 17 04:45:11 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-f5eb124f-2fd6-4521-b9a8-a791b110ecbd tempest-VolumesGetTest-1816202824 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 04:45:11 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-f5eb124f-2fd6-4521-b9a8-a791b110ecbd tempest-VolumesGetTest-1816202824 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 04:45:11 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-f5eb124f-2fd6-4521-b9a8-a791b110ecbd tempest-VolumesGetTest-1816202824 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-17T02:45:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-395099104',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f6f950f1-5cab-4797-b8a1-351470e16739,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='c94fdcfcea4840c2a1e58688ac864031',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T02:45:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T02:45:11Z,use_quota=True,user_id='f5c2a6062921435dac6f9e70bb79370a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aad9ce24-93f9-41a6-baa1-5125964f96d1),volume_type_id=aad9ce24-93f9-41a6-baa1-5125964f96d1)}" {{(pid=92060) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 17 04:45:11 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.remotefs [None req-f5eb124f-2fd6-4521-b9a8-a791b110ecbd tempest-VolumesGetTest-1816202824 None] Creating volume f6f950f1-5cab-4797-b8a1-351470e16739 {{(pid=92060) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 17 04:45:11 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-f5eb124f-2fd6-4521-b9a8-a791b110ecbd tempest-VolumesGetTest-1816202824 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 04:45:11 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-f5eb124f-2fd6-4521-b9a8-a791b110ecbd tempest-VolumesGetTest-1816202824 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 04:45:11 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-f5eb124f-2fd6-4521-b9a8-a791b110ecbd tempest-VolumesGetTest-1816202824 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588': None} {{(pid=92060) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 17 04:45:11 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-f5eb124f-2fd6-4521-b9a8-a791b110ecbd tempest-VolumesGetTest-1816202824 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588'] {{(pid=92060) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 17 04:45:11 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-f5eb124f-2fd6-4521-b9a8-a791b110ecbd tempest-VolumesGetTest-1816202824 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 04:45:11 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-f5eb124f-2fd6-4521-b9a8-a791b110ecbd tempest-VolumesGetTest-1816202824 None] Selected osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588 as target Quobyte volume. {{(pid=92060) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 17 04:45:11 devstack cinder-volume[92060]: INFO cinder.volume.drivers.remotefs [None req-f5eb124f-2fd6-4521-b9a8-a791b110ecbd tempest-VolumesGetTest-1816202824 None] casted to osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588 Jun 17 04:45:11 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-f5eb124f-2fd6-4521-b9a8-a791b110ecbd tempest-VolumesGetTest-1816202824 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-f6f950f1-5cab-4797-b8a1-351470e16739 1073741824 {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:45:11 devstack sudo[101631]: pam_unix(sudo:session): session closed for user root Jun 17 04:45:11 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-4cbbb8cd-73f6-4ea9-b7db-74c1d19a01c5 tempest-VolumesSnapshotTestJSON-1039322322 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-da651d05-84f6-4f85-91ec-a2218d400ce3" returned: 0 in 0.948s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:45:11 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-4cbbb8cd-73f6-4ea9-b7db-74c1d19a01c5 tempest-VolumesSnapshotTestJSON-1039322322 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-da651d05-84f6-4f85-91ec-a2218d400ce3 {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:45:11 devstack sudo[101638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-f6f950f1-5cab-4797-b8a1-351470e16739 1073741824 Jun 17 04:45:11 devstack sudo[101638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:45:11 devstack sudo[101639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-da651d05-84f6-4f85-91ec-a2218d400ce3 Jun 17 04:45:11 devstack sudo[101639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:45:12 devstack sudo[101639]: pam_unix(sudo:session): session closed for user root Jun 17 04:45:12 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-4cbbb8cd-73f6-4ea9-b7db-74c1d19a01c5 tempest-VolumesSnapshotTestJSON-1039322322 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-da651d05-84f6-4f85-91ec-a2218d400ce3" returned: 0 in 0.890s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:45:12 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-4cbbb8cd-73f6-4ea9-b7db-74c1d19a01c5 tempest-VolumesSnapshotTestJSON-1039322322 None] Lock "cinder-quobyte-da651d05-84f6-4f85-91ec-a2218d400ce3" released by "delete_volume" :: held 1.895s {{(pid=92060) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 04:45:12 devstack sudo[101638]: pam_unix(sudo:session): session closed for user root Jun 17 04:45:12 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-f5eb124f-2fd6-4521-b9a8-a791b110ecbd tempest-VolumesGetTest-1816202824 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-f6f950f1-5cab-4797-b8a1-351470e16739 1073741824" returned: 0 in 0.978s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:45:12 devstack cinder-volume[92060]: DEBUG cinder.quota [None req-4cbbb8cd-73f6-4ea9-b7db-74c1d19a01c5 tempest-VolumesSnapshotTestJSON-1039322322 None] Created reservations ['b46220ba-c099-495a-9bc6-e75e889ff01d', '3f36bf4d-6b46-42b1-aebd-d65cf28497a0', 'a14c93ba-9d1b-4789-9a0f-b8747ff99546', 'b4e2660b-374e-46c0-ab83-50dc520c3aa6'] {{(pid=92060) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 17 04:45:12 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-f5eb124f-2fd6-4521-b9a8-a791b110ecbd tempest-VolumesGetTest-1816202824 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-f6f950f1-5cab-4797-b8a1-351470e16739 {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:45:12 devstack sudo[101647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-f6f950f1-5cab-4797-b8a1-351470e16739 Jun 17 04:45:12 devstack sudo[101647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:45:12 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-4cbbb8cd-73f6-4ea9-b7db-74c1d19a01c5 tempest-VolumesSnapshotTestJSON-1039322322 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 04:45:12 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-4cbbb8cd-73f6-4ea9-b7db-74c1d19a01c5 tempest-VolumesSnapshotTestJSON-1039322322 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 04:45:12 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-4cbbb8cd-73f6-4ea9-b7db-74c1d19a01c5 tempest-VolumesSnapshotTestJSON-1039322322 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588': None} {{(pid=92060) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 17 04:45:12 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-4cbbb8cd-73f6-4ea9-b7db-74c1d19a01c5 tempest-VolumesSnapshotTestJSON-1039322322 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588'] {{(pid=92060) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 17 04:45:12 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-4cbbb8cd-73f6-4ea9-b7db-74c1d19a01c5 tempest-VolumesSnapshotTestJSON-1039322322 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 04:45:12 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-4cbbb8cd-73f6-4ea9-b7db-74c1d19a01c5 tempest-VolumesSnapshotTestJSON-1039322322 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:45:12 devstack sudo[101649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a Jun 17 04:45:12 devstack sudo[101649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:45:13 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-85089991-0c81-4b7d-86d9-62de2ae49668 tempest-VolumesSnapshotTestJSON-1039322322 None] Acquiring lock "cinder-1ddb3764-7dec-4805-8332-a15d4248cad2-delete_snapshot" by "delete_snapshot" {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 04:45:13 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-85089991-0c81-4b7d-86d9-62de2ae49668 tempest-VolumesSnapshotTestJSON-1039322322 None] Lock "cinder-1ddb3764-7dec-4805-8332-a15d4248cad2-delete_snapshot" acquired by "delete_snapshot" :: waited 0.037s {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 04:45:13 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-85089991-0c81-4b7d-86d9-62de2ae49668 tempest-VolumesSnapshotTestJSON-1039322322 None] Acquiring lock "cinder-quobyte-671b8a5b-e060-484b-a83c-ea822663f67c" by "delete_snapshot" {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 04:45:13 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-85089991-0c81-4b7d-86d9-62de2ae49668 tempest-VolumesSnapshotTestJSON-1039322322 None] Lock "cinder-quobyte-671b8a5b-e060-484b-a83c-ea822663f67c" acquired by "delete_snapshot" :: waited 0.027s {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 04:45:13 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-85089991-0c81-4b7d-86d9-62de2ae49668 tempest-VolumesSnapshotTestJSON-1039322322 None] Acquiring lock "cinder-quobyte-1ddb3764-7dec-4805-8332-a15d4248cad2" by "_delete_snapshot" {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 04:45:13 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-85089991-0c81-4b7d-86d9-62de2ae49668 tempest-VolumesSnapshotTestJSON-1039322322 None] Lock "cinder-quobyte-1ddb3764-7dec-4805-8332-a15d4248cad2" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 04:45:13 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.remotefs [None req-85089991-0c81-4b7d-86d9-62de2ae49668 tempest-VolumesSnapshotTestJSON-1039322322 None] Deleting offline snapshot 1ddb3764-7dec-4805-8332-a15d4248cad2 of volume 671b8a5b-e060-484b-a83c-ea822663f67c {{(pid=92060) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 17 04:45:13 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.remotefs [None req-85089991-0c81-4b7d-86d9-62de2ae49668 tempest-VolumesSnapshotTestJSON-1039322322 None] snapshot_file for this snap is: volume-671b8a5b-e060-484b-a83c-ea822663f67c.1ddb3764-7dec-4805-8332-a15d4248cad2 {{(pid=92060) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 17 04:45:13 devstack cinder-volume[92060]: DEBUG oslo.privsep.daemon [-] privsep: reply[07b0c4e8-312a-488d-83b2-93e43f6a199d]: (4, 'qcow2') {{(pid=93130) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 04:45:13 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-85089991-0c81-4b7d-86d9-62de2ae49668 tempest-VolumesSnapshotTestJSON-1039322322 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-671b8a5b-e060-484b-a83c-ea822663f67c.1ddb3764-7dec-4805-8332-a15d4248cad2 {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:45:13 devstack sudo[101651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-671b8a5b-e060-484b-a83c-ea822663f67c.1ddb3764-7dec-4805-8332-a15d4248cad2 Jun 17 04:45:13 devstack sudo[101651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:45:13 devstack sudo[101647]: pam_unix(sudo:session): session closed for user root Jun 17 04:45:13 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-f5eb124f-2fd6-4521-b9a8-a791b110ecbd tempest-VolumesGetTest-1816202824 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-f6f950f1-5cab-4797-b8a1-351470e16739" returned: 0 in 0.858s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:45:13 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-f5eb124f-2fd6-4521-b9a8-a791b110ecbd tempest-VolumesGetTest-1816202824 None] <== create_volume: return (1902ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588'} {{(pid=92060) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 17 04:45:13 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-f5eb124f-2fd6-4521-b9a8-a791b110ecbd tempest-VolumesGetTest-1816202824 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.905s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 04:45:13 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-f5eb124f-2fd6-4521-b9a8-a791b110ecbd tempest-VolumesGetTest-1816202824 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4a1fca3e-844d-46ce-ba10-b89d24022e1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f6f950f1-5cab-4797-b8a1-351470e16739', 'volume_size': 1}' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:45:13 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-f5eb124f-2fd6-4521-b9a8-a791b110ecbd tempest-VolumesGetTest-1816202824 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2c46722c-a0b8-4e66-aeef-68a1224d68e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:45:13 devstack cinder-volume[92060]: INFO cinder.volume.flows.manager.create_volume [None req-f5eb124f-2fd6-4521-b9a8-a791b110ecbd tempest-VolumesGetTest-1816202824 None] Volume volume-f6f950f1-5cab-4797-b8a1-351470e16739 (f6f950f1-5cab-4797-b8a1-351470e16739): created successfully Jun 17 04:45:13 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-f5eb124f-2fd6-4521-b9a8-a791b110ecbd tempest-VolumesGetTest-1816202824 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2c46722c-a0b8-4e66-aeef-68a1224d68e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:45:13 devstack sudo[101649]: pam_unix(sudo:session): session closed for user root Jun 17 04:45:13 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-f5eb124f-2fd6-4521-b9a8-a791b110ecbd tempest-VolumesGetTest-1816202824 None] Flow 'volume_create_manager' (97d48221-a630-4166-b1bd-2e609dbf3eb0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92060) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 17 04:45:13 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-4cbbb8cd-73f6-4ea9-b7db-74c1d19a01c5 tempest-VolumesSnapshotTestJSON-1039322322 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a" returned: 0 in 0.876s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:45:13 devstack cinder-volume[92060]: DEBUG cinder.manager [None req-4cbbb8cd-73f6-4ea9-b7db-74c1d19a01c5 tempest-VolumesSnapshotTestJSON-1039322322 None] Notifying Schedulers of capabilities ... {{(pid=92060) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 17 04:45:13 devstack cinder-volume[92060]: INFO cinder.volume.manager [None req-4cbbb8cd-73f6-4ea9-b7db-74c1d19a01c5 tempest-VolumesSnapshotTestJSON-1039322322 None] Deleted volume successfully. Jun 17 04:45:13 devstack cinder-volume[92060]: INFO cinder.volume.manager [None req-f5eb124f-2fd6-4521-b9a8-a791b110ecbd tempest-VolumesGetTest-1816202824 None] Created volume successfully. Jun 17 04:45:13 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-4cbbb8cd-73f6-4ea9-b7db-74c1d19a01c5 tempest-VolumesSnapshotTestJSON-1039322322 None] Lock "cinder-da651d05-84f6-4f85-91ec-a2218d400ce3-delete_volume" released by "delete_volume" :: held 3.067s {{(pid=92060) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 04:45:14 devstack sudo[101651]: pam_unix(sudo:session): session closed for user root Jun 17 04:45:14 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-85089991-0c81-4b7d-86d9-62de2ae49668 tempest-VolumesSnapshotTestJSON-1039322322 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-671b8a5b-e060-484b-a83c-ea822663f67c.1ddb3764-7dec-4805-8332-a15d4248cad2" returned: 0 in 1.016s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:45:14 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.remotefs [None req-85089991-0c81-4b7d-86d9-62de2ae49668 tempest-VolumesSnapshotTestJSON-1039322322 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-671b8a5b-e060-484b-a83c-ea822663f67c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=92060) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 17 04:45:14 devstack cinder-volume[92060]: DEBUG oslo.privsep.daemon [-] privsep: reply[e51bcbb4-3218-4f48-b509-7ed5c6a29258]: (4, 'qcow2') {{(pid=93130) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 04:45:14 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-85089991-0c81-4b7d-86d9-62de2ae49668 tempest-VolumesSnapshotTestJSON-1039322322 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-671b8a5b-e060-484b-a83c-ea822663f67c {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:45:14 devstack sudo[101660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-671b8a5b-e060-484b-a83c-ea822663f67c Jun 17 04:45:14 devstack sudo[101660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:45:15 devstack sudo[101660]: pam_unix(sudo:session): session closed for user root Jun 17 04:45:15 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-85089991-0c81-4b7d-86d9-62de2ae49668 tempest-VolumesSnapshotTestJSON-1039322322 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-671b8a5b-e060-484b-a83c-ea822663f67c" returned: 0 in 0.885s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:45:15 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-85089991-0c81-4b7d-86d9-62de2ae49668 tempest-VolumesSnapshotTestJSON-1039322322 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-671b8a5b-e060-484b-a83c-ea822663f67c.1ddb3764-7dec-4805-8332-a15d4248cad2 {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:45:15 devstack sudo[101667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-671b8a5b-e060-484b-a83c-ea822663f67c.1ddb3764-7dec-4805-8332-a15d4248cad2 Jun 17 04:45:15 devstack sudo[101667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:45:15 devstack cinder-volume[92060]: DEBUG cinder.volume.flows.manager.create_volume [None req-b23dce75-486c-4392-8d1c-9736a359909e tempest-VolumesGetTest-1816202824 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92060) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 17 04:45:15 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-b23dce75-486c-4392-8d1c-9736a359909e tempest-VolumesGetTest-1816202824 None] Flow 'volume_create_manager' (d2e63f8d-d3cf-44dd-824e-62b2e63da379) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 17 04:45:15 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-b23dce75-486c-4392-8d1c-9736a359909e tempest-VolumesGetTest-1816202824 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3c77bcc2-ecdc-4a7c-b007-9dbc755b63d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:45:15 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-b23dce75-486c-4392-8d1c-9736a359909e tempest-VolumesGetTest-1816202824 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3c77bcc2-ecdc-4a7c-b007-9dbc755b63d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-17T02:45:15Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-338113753',display_name='tempest-VolumesGetTest-Volume-96017093',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=398a7f0d-326e-495a-9caf-8ed8e7d68409,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c94fdcfcea4840c2a1e58688ac864031',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T02:45:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T02:45:16Z,use_quota=True,user_id='f5c2a6062921435dac6f9e70bb79370a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aad9ce24-93f9-41a6-baa1-5125964f96d1),volume_type_id=aad9ce24-93f9-41a6-baa1-5125964f96d1)' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:45:15 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-b23dce75-486c-4392-8d1c-9736a359909e tempest-VolumesGetTest-1816202824 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5e96d908-a399-4e2d-9eae-0d920fe2ab61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:45:15 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-b23dce75-486c-4392-8d1c-9736a359909e tempest-VolumesGetTest-1816202824 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5e96d908-a399-4e2d-9eae-0d920fe2ab61) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:45:15 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-b23dce75-486c-4392-8d1c-9736a359909e tempest-VolumesGetTest-1816202824 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (89a4a24c-8468-45a8-a8e4-be1c5ee9ea58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:45:15 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-b23dce75-486c-4392-8d1c-9736a359909e tempest-VolumesGetTest-1816202824 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (89a4a24c-8468-45a8-a8e4-be1c5ee9ea58) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '398a7f0d-326e-495a-9caf-8ed8e7d68409', 'volume_name': 'volume-398a7f0d-326e-495a-9caf-8ed8e7d68409', 'volume_size': 1}' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:45:15 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-b23dce75-486c-4392-8d1c-9736a359909e tempest-VolumesGetTest-1816202824 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4b0c43f4-9189-4322-9315-7f0f305abcfa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:45:15 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-b23dce75-486c-4392-8d1c-9736a359909e tempest-VolumesGetTest-1816202824 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4b0c43f4-9189-4322-9315-7f0f305abcfa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:45:15 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-b23dce75-486c-4392-8d1c-9736a359909e tempest-VolumesGetTest-1816202824 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (04f09890-ae5d-4e04-bfd0-b4ddd4c29bdd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:45:15 devstack cinder-volume[92060]: INFO cinder.volume.flows.manager.create_volume [None req-b23dce75-486c-4392-8d1c-9736a359909e tempest-VolumesGetTest-1816202824 None] Volume 398a7f0d-326e-495a-9caf-8ed8e7d68409: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-398a7f0d-326e-495a-9caf-8ed8e7d68409', 'volume_size': 1} Jun 17 04:45:15 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-b23dce75-486c-4392-8d1c-9736a359909e tempest-VolumesGetTest-1816202824 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 04:45:15 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-b23dce75-486c-4392-8d1c-9736a359909e tempest-VolumesGetTest-1816202824 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 04:45:15 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-b23dce75-486c-4392-8d1c-9736a359909e tempest-VolumesGetTest-1816202824 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-17T02:45:15Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-338113753',display_name='tempest-VolumesGetTest-Volume-96017093',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=398a7f0d-326e-495a-9caf-8ed8e7d68409,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c94fdcfcea4840c2a1e58688ac864031',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T02:45:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T02:45:16Z,use_quota=True,user_id='f5c2a6062921435dac6f9e70bb79370a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aad9ce24-93f9-41a6-baa1-5125964f96d1),volume_type_id=aad9ce24-93f9-41a6-baa1-5125964f96d1)}" {{(pid=92060) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 17 04:45:15 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.remotefs [None req-b23dce75-486c-4392-8d1c-9736a359909e tempest-VolumesGetTest-1816202824 None] Creating volume 398a7f0d-326e-495a-9caf-8ed8e7d68409 {{(pid=92060) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 17 04:45:15 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-b23dce75-486c-4392-8d1c-9736a359909e tempest-VolumesGetTest-1816202824 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 04:45:15 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-b23dce75-486c-4392-8d1c-9736a359909e tempest-VolumesGetTest-1816202824 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 04:45:15 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-b23dce75-486c-4392-8d1c-9736a359909e tempest-VolumesGetTest-1816202824 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588': None} {{(pid=92060) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 17 04:45:15 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-b23dce75-486c-4392-8d1c-9736a359909e tempest-VolumesGetTest-1816202824 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588'] {{(pid=92060) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 17 04:45:15 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-b23dce75-486c-4392-8d1c-9736a359909e tempest-VolumesGetTest-1816202824 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 04:45:15 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-b23dce75-486c-4392-8d1c-9736a359909e tempest-VolumesGetTest-1816202824 None] Selected osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588 as target Quobyte volume. {{(pid=92060) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 17 04:45:15 devstack cinder-volume[92060]: INFO cinder.volume.drivers.remotefs [None req-b23dce75-486c-4392-8d1c-9736a359909e tempest-VolumesGetTest-1816202824 None] casted to osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588 Jun 17 04:45:15 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-b23dce75-486c-4392-8d1c-9736a359909e tempest-VolumesGetTest-1816202824 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-398a7f0d-326e-495a-9caf-8ed8e7d68409 1073741824 {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:45:15 devstack sudo[101672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-398a7f0d-326e-495a-9caf-8ed8e7d68409 1073741824 Jun 17 04:45:15 devstack sudo[101672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:45:15 devstack sudo[101667]: pam_unix(sudo:session): session closed for user root Jun 17 04:45:15 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-85089991-0c81-4b7d-86d9-62de2ae49668 tempest-VolumesSnapshotTestJSON-1039322322 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-671b8a5b-e060-484b-a83c-ea822663f67c.1ddb3764-7dec-4805-8332-a15d4248cad2" returned: 0 in 0.862s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:45:15 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-85089991-0c81-4b7d-86d9-62de2ae49668 tempest-VolumesSnapshotTestJSON-1039322322 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-671b8a5b-e060-484b-a83c-ea822663f67c.1ddb3764-7dec-4805-8332-a15d4248cad2 {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:45:16 devstack sudo[101675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-671b8a5b-e060-484b-a83c-ea822663f67c.1ddb3764-7dec-4805-8332-a15d4248cad2 Jun 17 04:45:16 devstack sudo[101675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:45:16 devstack sudo[101675]: pam_unix(sudo:session): session closed for user root Jun 17 04:45:16 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-85089991-0c81-4b7d-86d9-62de2ae49668 tempest-VolumesSnapshotTestJSON-1039322322 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-671b8a5b-e060-484b-a83c-ea822663f67c.1ddb3764-7dec-4805-8332-a15d4248cad2" returned: 0 in 0.657s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:45:16 devstack sudo[101672]: pam_unix(sudo:session): session closed for user root Jun 17 04:45:16 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-b23dce75-486c-4392-8d1c-9736a359909e tempest-VolumesGetTest-1816202824 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-398a7f0d-326e-495a-9caf-8ed8e7d68409 1073741824" returned: 0 in 0.863s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:45:16 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-85089991-0c81-4b7d-86d9-62de2ae49668 tempest-VolumesSnapshotTestJSON-1039322322 None] Lock "cinder-quobyte-1ddb3764-7dec-4805-8332-a15d4248cad2" released by "_delete_snapshot" :: held 3.580s {{(pid=92060) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 04:45:16 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-85089991-0c81-4b7d-86d9-62de2ae49668 tempest-VolumesSnapshotTestJSON-1039322322 None] Lock "cinder-quobyte-671b8a5b-e060-484b-a83c-ea822663f67c" released by "delete_snapshot" :: held 3.607s {{(pid=92060) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 04:45:16 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-b23dce75-486c-4392-8d1c-9736a359909e tempest-VolumesGetTest-1816202824 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-398a7f0d-326e-495a-9caf-8ed8e7d68409 {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:45:16 devstack sudo[101682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-398a7f0d-326e-495a-9caf-8ed8e7d68409 Jun 17 04:45:16 devstack sudo[101682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:45:16 devstack cinder-volume[92060]: DEBUG cinder.quota [None req-85089991-0c81-4b7d-86d9-62de2ae49668 tempest-VolumesSnapshotTestJSON-1039322322 None] Created reservations ['4c31162f-5044-4fd8-815d-4ef5d53ef2c2', '6710a958-166e-4603-a426-8c25da335c01', '08dd56ba-604c-4413-a502-05777b09827e', 'f7e2b33e-c71f-4be7-861e-e095c0730fb8'] {{(pid=92060) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 17 04:45:16 devstack cinder-volume[92060]: INFO cinder.volume.manager [None req-85089991-0c81-4b7d-86d9-62de2ae49668 tempest-VolumesSnapshotTestJSON-1039322322 None] Delete snapshot completed successfully. Jun 17 04:45:16 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-85089991-0c81-4b7d-86d9-62de2ae49668 tempest-VolumesSnapshotTestJSON-1039322322 None] Lock "cinder-1ddb3764-7dec-4805-8332-a15d4248cad2-delete_snapshot" released by "delete_snapshot" :: held 3.821s {{(pid=92060) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 04:45:17 devstack sudo[101682]: pam_unix(sudo:session): session closed for user root Jun 17 04:45:17 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-c3413f51-2ebd-4514-a34d-8d820ec58e9d tempest-VolumesSnapshotTestJSON-1039322322 None] Acquiring lock "cinder-671b8a5b-e060-484b-a83c-ea822663f67c-delete_volume" by "delete_volume" {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 04:45:17 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-b23dce75-486c-4392-8d1c-9736a359909e tempest-VolumesGetTest-1816202824 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-398a7f0d-326e-495a-9caf-8ed8e7d68409" returned: 0 in 0.656s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:45:17 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-b23dce75-486c-4392-8d1c-9736a359909e tempest-VolumesGetTest-1816202824 None] <== create_volume: return (1609ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588'} {{(pid=92060) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 17 04:45:17 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-b23dce75-486c-4392-8d1c-9736a359909e tempest-VolumesGetTest-1816202824 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.615s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 04:45:17 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-c3413f51-2ebd-4514-a34d-8d820ec58e9d tempest-VolumesSnapshotTestJSON-1039322322 None] Lock "cinder-671b8a5b-e060-484b-a83c-ea822663f67c-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 04:45:17 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-b23dce75-486c-4392-8d1c-9736a359909e tempest-VolumesGetTest-1816202824 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (04f09890-ae5d-4e04-bfd0-b4ddd4c29bdd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-398a7f0d-326e-495a-9caf-8ed8e7d68409', 'volume_size': 1}' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:45:17 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-b23dce75-486c-4392-8d1c-9736a359909e tempest-VolumesGetTest-1816202824 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (46e51f86-d7e4-46f8-b6da-84ae3cf111c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:45:17 devstack cinder-volume[92060]: INFO cinder.volume.flows.manager.create_volume [None req-b23dce75-486c-4392-8d1c-9736a359909e tempest-VolumesGetTest-1816202824 None] Volume volume-398a7f0d-326e-495a-9caf-8ed8e7d68409 (398a7f0d-326e-495a-9caf-8ed8e7d68409): created successfully Jun 17 04:45:17 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-b23dce75-486c-4392-8d1c-9736a359909e tempest-VolumesGetTest-1816202824 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (46e51f86-d7e4-46f8-b6da-84ae3cf111c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:45:17 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-b23dce75-486c-4392-8d1c-9736a359909e tempest-VolumesGetTest-1816202824 None] Flow 'volume_create_manager' (d2e63f8d-d3cf-44dd-824e-62b2e63da379) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92060) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 17 04:45:17 devstack cinder-volume[92060]: INFO cinder.volume.manager [None req-b23dce75-486c-4392-8d1c-9736a359909e tempest-VolumesGetTest-1816202824 None] Created volume successfully. Jun 17 04:45:17 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-c3413f51-2ebd-4514-a34d-8d820ec58e9d tempest-VolumesSnapshotTestJSON-1039322322 None] Acquiring lock "cinder-quobyte-671b8a5b-e060-484b-a83c-ea822663f67c" by "delete_volume" {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 04:45:17 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-c3413f51-2ebd-4514-a34d-8d820ec58e9d tempest-VolumesSnapshotTestJSON-1039322322 None] Lock "cinder-quobyte-671b8a5b-e060-484b-a83c-ea822663f67c" acquired by "delete_volume" :: waited 0.020s {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 04:45:17 devstack cinder-volume[92060]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8ce02a4-e864-4042-b2bc-817ac0d44a69]: (4, 'qcow2') {{(pid=93130) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 04:45:17 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-c3413f51-2ebd-4514-a34d-8d820ec58e9d tempest-VolumesSnapshotTestJSON-1039322322 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-671b8a5b-e060-484b-a83c-ea822663f67c {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:45:17 devstack sudo[101685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-671b8a5b-e060-484b-a83c-ea822663f67c Jun 17 04:45:17 devstack sudo[101685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:45:17 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-130d4b6c-00ef-48e7-a04e-b455601b36aa tempest-VolumesGetTest-1816202824 None] Acquiring lock "cinder-398a7f0d-326e-495a-9caf-8ed8e7d68409-delete_volume" by "delete_volume" {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 04:45:18 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-130d4b6c-00ef-48e7-a04e-b455601b36aa tempest-VolumesGetTest-1816202824 None] Lock "cinder-398a7f0d-326e-495a-9caf-8ed8e7d68409-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 04:45:18 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-130d4b6c-00ef-48e7-a04e-b455601b36aa tempest-VolumesGetTest-1816202824 None] Acquiring lock "cinder-quobyte-398a7f0d-326e-495a-9caf-8ed8e7d68409" by "delete_volume" {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 04:45:18 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-130d4b6c-00ef-48e7-a04e-b455601b36aa tempest-VolumesGetTest-1816202824 None] Lock "cinder-quobyte-398a7f0d-326e-495a-9caf-8ed8e7d68409" acquired by "delete_volume" :: waited 0.021s {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 04:45:18 devstack cinder-volume[92060]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c8ce2dd-482c-492e-81bf-87aed16619e3]: (4, 'qcow2') {{(pid=93130) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 04:45:18 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-130d4b6c-00ef-48e7-a04e-b455601b36aa tempest-VolumesGetTest-1816202824 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-398a7f0d-326e-495a-9caf-8ed8e7d68409 {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:45:18 devstack sudo[101701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-398a7f0d-326e-495a-9caf-8ed8e7d68409 Jun 17 04:45:18 devstack sudo[101701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:45:18 devstack sudo[101685]: pam_unix(sudo:session): session closed for user root Jun 17 04:45:18 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-c3413f51-2ebd-4514-a34d-8d820ec58e9d tempest-VolumesSnapshotTestJSON-1039322322 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-671b8a5b-e060-484b-a83c-ea822663f67c" returned: 0 in 0.740s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:45:18 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-c3413f51-2ebd-4514-a34d-8d820ec58e9d tempest-VolumesSnapshotTestJSON-1039322322 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-671b8a5b-e060-484b-a83c-ea822663f67c {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:45:18 devstack sudo[101726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-671b8a5b-e060-484b-a83c-ea822663f67c Jun 17 04:45:18 devstack sudo[101726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:45:18 devstack sudo[101701]: pam_unix(sudo:session): session closed for user root Jun 17 04:45:18 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-130d4b6c-00ef-48e7-a04e-b455601b36aa tempest-VolumesGetTest-1816202824 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-398a7f0d-326e-495a-9caf-8ed8e7d68409" returned: 0 in 0.818s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:45:18 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-130d4b6c-00ef-48e7-a04e-b455601b36aa tempest-VolumesGetTest-1816202824 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-398a7f0d-326e-495a-9caf-8ed8e7d68409 {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:45:18 devstack sudo[101726]: pam_unix(sudo:session): session closed for user root Jun 17 04:45:18 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-c3413f51-2ebd-4514-a34d-8d820ec58e9d tempest-VolumesSnapshotTestJSON-1039322322 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-671b8a5b-e060-484b-a83c-ea822663f67c" returned: 0 in 0.612s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:45:18 devstack sudo[101735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-398a7f0d-326e-495a-9caf-8ed8e7d68409 Jun 17 04:45:18 devstack sudo[101735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:45:18 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-c3413f51-2ebd-4514-a34d-8d820ec58e9d tempest-VolumesSnapshotTestJSON-1039322322 None] Lock "cinder-quobyte-671b8a5b-e060-484b-a83c-ea822663f67c" released by "delete_volume" :: held 1.411s {{(pid=92060) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 04:45:19 devstack cinder-volume[92060]: DEBUG cinder.quota [None req-c3413f51-2ebd-4514-a34d-8d820ec58e9d tempest-VolumesSnapshotTestJSON-1039322322 None] Created reservations ['740a9afa-5891-420f-b8b2-c4ff7047e088', '7e6d8e24-8bf1-4101-949a-4987d01a60fb', '5e92137b-7a7e-43bc-aff3-c86133d49e3f', '5f05dbd5-0167-45ed-acd7-779cce6c3f18'] {{(pid=92060) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 17 04:45:19 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-c3413f51-2ebd-4514-a34d-8d820ec58e9d tempest-VolumesSnapshotTestJSON-1039322322 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 04:45:19 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-c3413f51-2ebd-4514-a34d-8d820ec58e9d tempest-VolumesSnapshotTestJSON-1039322322 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 04:45:19 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-c3413f51-2ebd-4514-a34d-8d820ec58e9d tempest-VolumesSnapshotTestJSON-1039322322 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588': None} {{(pid=92060) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 17 04:45:19 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-c3413f51-2ebd-4514-a34d-8d820ec58e9d tempest-VolumesSnapshotTestJSON-1039322322 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588'] {{(pid=92060) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 17 04:45:19 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-c3413f51-2ebd-4514-a34d-8d820ec58e9d tempest-VolumesSnapshotTestJSON-1039322322 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 04:45:19 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-c3413f51-2ebd-4514-a34d-8d820ec58e9d tempest-VolumesSnapshotTestJSON-1039322322 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:45:19 devstack sudo[101737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a Jun 17 04:45:19 devstack sudo[101737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:45:19 devstack sudo[101735]: pam_unix(sudo:session): session closed for user root Jun 17 04:45:19 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-130d4b6c-00ef-48e7-a04e-b455601b36aa tempest-VolumesGetTest-1816202824 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-398a7f0d-326e-495a-9caf-8ed8e7d68409" returned: 0 in 0.674s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:45:19 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-130d4b6c-00ef-48e7-a04e-b455601b36aa tempest-VolumesGetTest-1816202824 None] Lock "cinder-quobyte-398a7f0d-326e-495a-9caf-8ed8e7d68409" released by "delete_volume" :: held 1.544s {{(pid=92060) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 04:45:19 devstack cinder-volume[92060]: DEBUG cinder.quota [None req-130d4b6c-00ef-48e7-a04e-b455601b36aa tempest-VolumesGetTest-1816202824 None] Created reservations ['dde488e1-6841-4a80-9215-ee225a0912c4', '4a7e8f08-f14f-48c5-b018-76e83b31bbe5', 'ead2c052-e2dc-4d7b-bac3-395b860a6a6a', 'ec2b29cf-96fb-4e72-b910-3fb397819046'] {{(pid=92060) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 17 04:45:19 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-130d4b6c-00ef-48e7-a04e-b455601b36aa tempest-VolumesGetTest-1816202824 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 04:45:19 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-130d4b6c-00ef-48e7-a04e-b455601b36aa tempest-VolumesGetTest-1816202824 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 04:45:19 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-130d4b6c-00ef-48e7-a04e-b455601b36aa tempest-VolumesGetTest-1816202824 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588': None} {{(pid=92060) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 17 04:45:19 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-130d4b6c-00ef-48e7-a04e-b455601b36aa tempest-VolumesGetTest-1816202824 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588'] {{(pid=92060) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 17 04:45:19 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-130d4b6c-00ef-48e7-a04e-b455601b36aa tempest-VolumesGetTest-1816202824 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 04:45:19 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-130d4b6c-00ef-48e7-a04e-b455601b36aa tempest-VolumesGetTest-1816202824 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:45:19 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-abb89f1e-9797-41d4-8b9c-acde7542b500 tempest-VolumesSnapshotTestJSON-1039322322 None] Acquiring lock "cinder-b3e29595-6f25-48ae-806c-92f769e46722-delete_volume" by "delete_volume" {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 04:45:19 devstack sudo[101741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a Jun 17 04:45:19 devstack sudo[101741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:45:19 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-abb89f1e-9797-41d4-8b9c-acde7542b500 tempest-VolumesSnapshotTestJSON-1039322322 None] Lock "cinder-b3e29595-6f25-48ae-806c-92f769e46722-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 04:45:19 devstack cinder-volume[92060]: DEBUG dbcounter [-] [92060] Writing DB stats cinder:SELECT=87,cinder:UPDATE=124,cinder:INSERT=35,cinder:DELETE=10 {{(pid=92060) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 17 04:45:19 devstack sudo[101737]: pam_unix(sudo:session): session closed for user root Jun 17 04:45:19 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-c3413f51-2ebd-4514-a34d-8d820ec58e9d tempest-VolumesSnapshotTestJSON-1039322322 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a" returned: 0 in 0.844s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:45:19 devstack cinder-volume[92060]: DEBUG cinder.manager [None req-c3413f51-2ebd-4514-a34d-8d820ec58e9d tempest-VolumesSnapshotTestJSON-1039322322 None] Notifying Schedulers of capabilities ... {{(pid=92060) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 17 04:45:19 devstack cinder-volume[92060]: INFO cinder.volume.manager [None req-c3413f51-2ebd-4514-a34d-8d820ec58e9d tempest-VolumesSnapshotTestJSON-1039322322 None] Deleted volume successfully. Jun 17 04:45:20 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-abb89f1e-9797-41d4-8b9c-acde7542b500 tempest-VolumesSnapshotTestJSON-1039322322 None] Acquiring lock "cinder-quobyte-b3e29595-6f25-48ae-806c-92f769e46722" by "delete_volume" {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 04:45:20 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-c3413f51-2ebd-4514-a34d-8d820ec58e9d tempest-VolumesSnapshotTestJSON-1039322322 None] Lock "cinder-671b8a5b-e060-484b-a83c-ea822663f67c-delete_volume" released by "delete_volume" :: held 2.561s {{(pid=92060) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 04:45:20 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-abb89f1e-9797-41d4-8b9c-acde7542b500 tempest-VolumesSnapshotTestJSON-1039322322 None] Lock "cinder-quobyte-b3e29595-6f25-48ae-806c-92f769e46722" acquired by "delete_volume" :: waited 0.031s {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 04:45:20 devstack cinder-volume[92060]: DEBUG oslo.privsep.daemon [-] privsep: reply[eef7cad1-6878-402d-81cc-25c5aebfe197]: (4, 'qcow2') {{(pid=93130) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 04:45:20 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-abb89f1e-9797-41d4-8b9c-acde7542b500 tempest-VolumesSnapshotTestJSON-1039322322 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-b3e29595-6f25-48ae-806c-92f769e46722 {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:45:20 devstack sudo[101743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-b3e29595-6f25-48ae-806c-92f769e46722 Jun 17 04:45:20 devstack sudo[101743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:45:20 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-25827269-a672-4d51-8d7f-261292e98f5e tempest-VolumesGetTest-1816202824 None] Acquiring lock "cinder-f6f950f1-5cab-4797-b8a1-351470e16739-delete_volume" by "delete_volume" {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 04:45:20 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-25827269-a672-4d51-8d7f-261292e98f5e tempest-VolumesGetTest-1816202824 None] Lock "cinder-f6f950f1-5cab-4797-b8a1-351470e16739-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 04:45:20 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-25827269-a672-4d51-8d7f-261292e98f5e tempest-VolumesGetTest-1816202824 None] Acquiring lock "cinder-quobyte-f6f950f1-5cab-4797-b8a1-351470e16739" by "delete_volume" {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 04:45:20 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-25827269-a672-4d51-8d7f-261292e98f5e tempest-VolumesGetTest-1816202824 None] Lock "cinder-quobyte-f6f950f1-5cab-4797-b8a1-351470e16739" acquired by "delete_volume" :: waited 0.017s {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 04:45:20 devstack cinder-volume[92060]: DEBUG oslo.privsep.daemon [-] privsep: reply[6afdeb9c-7ada-4bb4-b445-cc9935c07d62]: (4, 'qcow2') {{(pid=93130) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 04:45:20 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-25827269-a672-4d51-8d7f-261292e98f5e tempest-VolumesGetTest-1816202824 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-f6f950f1-5cab-4797-b8a1-351470e16739 {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:45:20 devstack sudo[101745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-f6f950f1-5cab-4797-b8a1-351470e16739 Jun 17 04:45:20 devstack sudo[101745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:45:20 devstack sudo[101741]: pam_unix(sudo:session): session closed for user root Jun 17 04:45:20 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-130d4b6c-00ef-48e7-a04e-b455601b36aa tempest-VolumesGetTest-1816202824 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a" returned: 0 in 0.950s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:45:20 devstack cinder-volume[92060]: DEBUG cinder.manager [None req-130d4b6c-00ef-48e7-a04e-b455601b36aa tempest-VolumesGetTest-1816202824 None] Notifying Schedulers of capabilities ... {{(pid=92060) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 17 04:45:20 devstack cinder-volume[92060]: INFO cinder.volume.manager [None req-130d4b6c-00ef-48e7-a04e-b455601b36aa tempest-VolumesGetTest-1816202824 None] Deleted volume successfully. Jun 17 04:45:20 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-130d4b6c-00ef-48e7-a04e-b455601b36aa tempest-VolumesGetTest-1816202824 None] Lock "cinder-398a7f0d-326e-495a-9caf-8ed8e7d68409-delete_volume" released by "delete_volume" :: held 2.816s {{(pid=92060) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 04:45:21 devstack sudo[101743]: pam_unix(sudo:session): session closed for user root Jun 17 04:45:21 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-abb89f1e-9797-41d4-8b9c-acde7542b500 tempest-VolumesSnapshotTestJSON-1039322322 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-b3e29595-6f25-48ae-806c-92f769e46722" returned: 0 in 1.202s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:45:21 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-abb89f1e-9797-41d4-8b9c-acde7542b500 tempest-VolumesSnapshotTestJSON-1039322322 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-b3e29595-6f25-48ae-806c-92f769e46722 {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:45:21 devstack sudo[101752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-b3e29595-6f25-48ae-806c-92f769e46722 Jun 17 04:45:21 devstack sudo[101752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:45:21 devstack sudo[101745]: pam_unix(sudo:session): session closed for user root Jun 17 04:45:21 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-25827269-a672-4d51-8d7f-261292e98f5e tempest-VolumesGetTest-1816202824 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-f6f950f1-5cab-4797-b8a1-351470e16739" returned: 0 in 1.083s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:45:21 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-25827269-a672-4d51-8d7f-261292e98f5e tempest-VolumesGetTest-1816202824 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-f6f950f1-5cab-4797-b8a1-351470e16739 {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:45:21 devstack sudo[101759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-f6f950f1-5cab-4797-b8a1-351470e16739 Jun 17 04:45:21 devstack sudo[101759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:45:22 devstack sudo[101752]: pam_unix(sudo:session): session closed for user root Jun 17 04:45:22 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-abb89f1e-9797-41d4-8b9c-acde7542b500 tempest-VolumesSnapshotTestJSON-1039322322 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-b3e29595-6f25-48ae-806c-92f769e46722" returned: 0 in 1.054s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:45:22 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-abb89f1e-9797-41d4-8b9c-acde7542b500 tempest-VolumesSnapshotTestJSON-1039322322 None] Lock "cinder-quobyte-b3e29595-6f25-48ae-806c-92f769e46722" released by "delete_volume" :: held 2.386s {{(pid=92060) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 04:45:22 devstack cinder-volume[92060]: DEBUG cinder.quota [None req-abb89f1e-9797-41d4-8b9c-acde7542b500 tempest-VolumesSnapshotTestJSON-1039322322 None] Created reservations ['8eba4df0-d1fa-4358-adfa-a52747d1753c', '5547a3e1-a32d-4af5-836b-b855e973ce62', 'd3cc9492-de82-4bd5-970c-5b15437a2371', '35d7d389-26f9-4b1a-bd82-fafc1ea6e7d4'] {{(pid=92060) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 17 04:45:22 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-abb89f1e-9797-41d4-8b9c-acde7542b500 tempest-VolumesSnapshotTestJSON-1039322322 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 04:45:22 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-abb89f1e-9797-41d4-8b9c-acde7542b500 tempest-VolumesSnapshotTestJSON-1039322322 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 04:45:22 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-abb89f1e-9797-41d4-8b9c-acde7542b500 tempest-VolumesSnapshotTestJSON-1039322322 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588': None} {{(pid=92060) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 17 04:45:22 devstack sudo[101759]: pam_unix(sudo:session): session closed for user root Jun 17 04:45:22 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-abb89f1e-9797-41d4-8b9c-acde7542b500 tempest-VolumesSnapshotTestJSON-1039322322 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588'] {{(pid=92060) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 17 04:45:22 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-abb89f1e-9797-41d4-8b9c-acde7542b500 tempest-VolumesSnapshotTestJSON-1039322322 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 04:45:22 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-abb89f1e-9797-41d4-8b9c-acde7542b500 tempest-VolumesSnapshotTestJSON-1039322322 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:45:22 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-25827269-a672-4d51-8d7f-261292e98f5e tempest-VolumesGetTest-1816202824 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-f6f950f1-5cab-4797-b8a1-351470e16739" returned: 0 in 1.036s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:45:22 devstack sudo[101780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a Jun 17 04:45:22 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-25827269-a672-4d51-8d7f-261292e98f5e tempest-VolumesGetTest-1816202824 None] Lock "cinder-quobyte-f6f950f1-5cab-4797-b8a1-351470e16739" released by "delete_volume" :: held 2.196s {{(pid=92060) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 04:45:22 devstack sudo[101780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:45:22 devstack cinder-volume[92060]: DEBUG cinder.quota [None req-25827269-a672-4d51-8d7f-261292e98f5e tempest-VolumesGetTest-1816202824 None] Created reservations ['5686183e-ce7b-44e1-8d66-9a79fd8b1a35', '2f3a4a63-c5cc-48ea-8351-0686bbc2dc6d', '92e30144-4674-49e9-aff8-adc3b582dfc9', '06713878-c490-43ea-8947-587cb36257dd'] {{(pid=92060) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 17 04:45:22 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-25827269-a672-4d51-8d7f-261292e98f5e tempest-VolumesGetTest-1816202824 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 04:45:22 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-25827269-a672-4d51-8d7f-261292e98f5e tempest-VolumesGetTest-1816202824 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.008s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 04:45:23 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-25827269-a672-4d51-8d7f-261292e98f5e tempest-VolumesGetTest-1816202824 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588': None} {{(pid=92060) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 17 04:45:23 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-25827269-a672-4d51-8d7f-261292e98f5e tempest-VolumesGetTest-1816202824 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588'] {{(pid=92060) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 17 04:45:23 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-25827269-a672-4d51-8d7f-261292e98f5e tempest-VolumesGetTest-1816202824 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.041s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 04:45:23 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-25827269-a672-4d51-8d7f-261292e98f5e tempest-VolumesGetTest-1816202824 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:45:23 devstack sudo[101786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a Jun 17 04:45:23 devstack sudo[101786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:45:23 devstack sudo[101780]: pam_unix(sudo:session): session closed for user root Jun 17 04:45:23 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-abb89f1e-9797-41d4-8b9c-acde7542b500 tempest-VolumesSnapshotTestJSON-1039322322 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a" returned: 0 in 0.949s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:45:23 devstack cinder-volume[92060]: DEBUG cinder.manager [None req-abb89f1e-9797-41d4-8b9c-acde7542b500 tempest-VolumesSnapshotTestJSON-1039322322 None] Notifying Schedulers of capabilities ... {{(pid=92060) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 17 04:45:23 devstack cinder-volume[92060]: INFO cinder.volume.manager [None req-abb89f1e-9797-41d4-8b9c-acde7542b500 tempest-VolumesSnapshotTestJSON-1039322322 None] Deleted volume successfully. Jun 17 04:45:23 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-abb89f1e-9797-41d4-8b9c-acde7542b500 tempest-VolumesSnapshotTestJSON-1039322322 None] Lock "cinder-b3e29595-6f25-48ae-806c-92f769e46722-delete_volume" released by "delete_volume" :: held 3.830s {{(pid=92060) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 04:45:23 devstack sudo[101786]: pam_unix(sudo:session): session closed for user root Jun 17 04:45:23 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-25827269-a672-4d51-8d7f-261292e98f5e tempest-VolumesGetTest-1816202824 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a" returned: 0 in 0.896s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:45:23 devstack cinder-volume[92060]: DEBUG cinder.manager [None req-25827269-a672-4d51-8d7f-261292e98f5e tempest-VolumesGetTest-1816202824 None] Notifying Schedulers of capabilities ... {{(pid=92060) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 17 04:45:23 devstack cinder-volume[92060]: INFO cinder.volume.manager [None req-25827269-a672-4d51-8d7f-261292e98f5e tempest-VolumesGetTest-1816202824 None] Deleted volume successfully. Jun 17 04:45:23 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-25827269-a672-4d51-8d7f-261292e98f5e tempest-VolumesGetTest-1816202824 None] Lock "cinder-f6f950f1-5cab-4797-b8a1-351470e16739-delete_volume" released by "delete_volume" :: held 3.509s {{(pid=92060) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 04:45:24 devstack cinder-volume[92060]: DEBUG cinder.volume.flows.manager.create_volume [None req-f78220ab-4133-4e04-b876-1d84577766bf tempest-VolumesGetTest-1816202824 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92060) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 17 04:45:24 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-f78220ab-4133-4e04-b876-1d84577766bf tempest-VolumesGetTest-1816202824 None] Flow 'volume_create_manager' (d5a73d0b-58ee-43ac-b1a9-5cf227533a9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 17 04:45:24 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-f78220ab-4133-4e04-b876-1d84577766bf tempest-VolumesGetTest-1816202824 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1069e862-f70e-4d52-b183-9c8b9a9705c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:45:24 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-f78220ab-4133-4e04-b876-1d84577766bf tempest-VolumesGetTest-1816202824 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1069e862-f70e-4d52-b183-9c8b9a9705c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-17T02:45:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-2053927178',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7051f8fe-8c9f-4c83-b7e5-8a19a898cfcf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c94fdcfcea4840c2a1e58688ac864031',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T02:45:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T02:45:24Z,use_quota=True,user_id='f5c2a6062921435dac6f9e70bb79370a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aad9ce24-93f9-41a6-baa1-5125964f96d1),volume_type_id=aad9ce24-93f9-41a6-baa1-5125964f96d1)' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:45:24 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-f78220ab-4133-4e04-b876-1d84577766bf tempest-VolumesGetTest-1816202824 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d25365d7-83f4-4ddf-abb7-825ec422106a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:45:24 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-f78220ab-4133-4e04-b876-1d84577766bf tempest-VolumesGetTest-1816202824 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d25365d7-83f4-4ddf-abb7-825ec422106a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:45:24 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-f78220ab-4133-4e04-b876-1d84577766bf tempest-VolumesGetTest-1816202824 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f9c1173a-0dc2-4d94-bf99-3d3f22cd1796) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:45:24 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-f78220ab-4133-4e04-b876-1d84577766bf tempest-VolumesGetTest-1816202824 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f9c1173a-0dc2-4d94-bf99-3d3f22cd1796) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7051f8fe-8c9f-4c83-b7e5-8a19a898cfcf', 'volume_name': 'volume-7051f8fe-8c9f-4c83-b7e5-8a19a898cfcf', 'volume_size': 1}' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:45:24 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-f78220ab-4133-4e04-b876-1d84577766bf tempest-VolumesGetTest-1816202824 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (94235108-fc22-4035-a128-3fd68132eef2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:45:24 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-f78220ab-4133-4e04-b876-1d84577766bf tempest-VolumesGetTest-1816202824 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (94235108-fc22-4035-a128-3fd68132eef2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:45:24 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-f78220ab-4133-4e04-b876-1d84577766bf tempest-VolumesGetTest-1816202824 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (946fa1bc-6ad5-4209-9cf4-1067c4e9f0da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:45:24 devstack cinder-volume[92060]: INFO cinder.volume.flows.manager.create_volume [None req-f78220ab-4133-4e04-b876-1d84577766bf tempest-VolumesGetTest-1816202824 None] Volume 7051f8fe-8c9f-4c83-b7e5-8a19a898cfcf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7051f8fe-8c9f-4c83-b7e5-8a19a898cfcf', 'volume_size': 1} Jun 17 04:45:24 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-f78220ab-4133-4e04-b876-1d84577766bf tempest-VolumesGetTest-1816202824 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 04:45:24 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-f78220ab-4133-4e04-b876-1d84577766bf tempest-VolumesGetTest-1816202824 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 04:45:24 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-f78220ab-4133-4e04-b876-1d84577766bf tempest-VolumesGetTest-1816202824 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-17T02:45:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-2053927178',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7051f8fe-8c9f-4c83-b7e5-8a19a898cfcf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c94fdcfcea4840c2a1e58688ac864031',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T02:45:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T02:45:24Z,use_quota=True,user_id='f5c2a6062921435dac6f9e70bb79370a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aad9ce24-93f9-41a6-baa1-5125964f96d1),volume_type_id=aad9ce24-93f9-41a6-baa1-5125964f96d1)}" {{(pid=92060) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 17 04:45:24 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.remotefs [None req-f78220ab-4133-4e04-b876-1d84577766bf tempest-VolumesGetTest-1816202824 None] Creating volume 7051f8fe-8c9f-4c83-b7e5-8a19a898cfcf {{(pid=92060) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 17 04:45:24 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-f78220ab-4133-4e04-b876-1d84577766bf tempest-VolumesGetTest-1816202824 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 04:45:24 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-f78220ab-4133-4e04-b876-1d84577766bf tempest-VolumesGetTest-1816202824 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 04:45:24 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-f78220ab-4133-4e04-b876-1d84577766bf tempest-VolumesGetTest-1816202824 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588': None} {{(pid=92060) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 17 04:45:24 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-f78220ab-4133-4e04-b876-1d84577766bf tempest-VolumesGetTest-1816202824 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588'] {{(pid=92060) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 17 04:45:24 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-f78220ab-4133-4e04-b876-1d84577766bf tempest-VolumesGetTest-1816202824 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 04:45:24 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-f78220ab-4133-4e04-b876-1d84577766bf tempest-VolumesGetTest-1816202824 None] Selected osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588 as target Quobyte volume. {{(pid=92060) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 17 04:45:24 devstack cinder-volume[92060]: INFO cinder.volume.drivers.remotefs [None req-f78220ab-4133-4e04-b876-1d84577766bf tempest-VolumesGetTest-1816202824 None] casted to osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588 Jun 17 04:45:24 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-f78220ab-4133-4e04-b876-1d84577766bf tempest-VolumesGetTest-1816202824 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-7051f8fe-8c9f-4c83-b7e5-8a19a898cfcf 1073741824 {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:45:24 devstack sudo[101820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-7051f8fe-8c9f-4c83-b7e5-8a19a898cfcf 1073741824 Jun 17 04:45:24 devstack sudo[101820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:45:25 devstack sudo[101820]: pam_unix(sudo:session): session closed for user root Jun 17 04:45:25 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-f78220ab-4133-4e04-b876-1d84577766bf tempest-VolumesGetTest-1816202824 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-7051f8fe-8c9f-4c83-b7e5-8a19a898cfcf 1073741824" returned: 0 in 0.953s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:45:25 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-f78220ab-4133-4e04-b876-1d84577766bf tempest-VolumesGetTest-1816202824 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-7051f8fe-8c9f-4c83-b7e5-8a19a898cfcf {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:45:25 devstack sudo[101828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-7051f8fe-8c9f-4c83-b7e5-8a19a898cfcf Jun 17 04:45:25 devstack sudo[101828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:45:26 devstack sudo[101828]: pam_unix(sudo:session): session closed for user root Jun 17 04:45:26 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-f78220ab-4133-4e04-b876-1d84577766bf tempest-VolumesGetTest-1816202824 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-7051f8fe-8c9f-4c83-b7e5-8a19a898cfcf" returned: 0 in 0.602s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:45:26 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-f78220ab-4133-4e04-b876-1d84577766bf tempest-VolumesGetTest-1816202824 None] <== create_volume: return (1600ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588'} {{(pid=92060) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 17 04:45:26 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-f78220ab-4133-4e04-b876-1d84577766bf tempest-VolumesGetTest-1816202824 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.603s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 04:45:26 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-f78220ab-4133-4e04-b876-1d84577766bf tempest-VolumesGetTest-1816202824 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (946fa1bc-6ad5-4209-9cf4-1067c4e9f0da) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7051f8fe-8c9f-4c83-b7e5-8a19a898cfcf', 'volume_size': 1}' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:45:26 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-f78220ab-4133-4e04-b876-1d84577766bf tempest-VolumesGetTest-1816202824 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f019e0f1-8a65-4922-9528-4a101f72cae7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:45:26 devstack cinder-volume[92060]: INFO cinder.volume.flows.manager.create_volume [None req-f78220ab-4133-4e04-b876-1d84577766bf tempest-VolumesGetTest-1816202824 None] Volume volume-7051f8fe-8c9f-4c83-b7e5-8a19a898cfcf (7051f8fe-8c9f-4c83-b7e5-8a19a898cfcf): created successfully Jun 17 04:45:26 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-f78220ab-4133-4e04-b876-1d84577766bf tempest-VolumesGetTest-1816202824 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f019e0f1-8a65-4922-9528-4a101f72cae7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:45:26 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-f78220ab-4133-4e04-b876-1d84577766bf tempest-VolumesGetTest-1816202824 None] Flow 'volume_create_manager' (d5a73d0b-58ee-43ac-b1a9-5cf227533a9c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92060) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 17 04:45:26 devstack cinder-volume[92060]: INFO cinder.volume.manager [None req-f78220ab-4133-4e04-b876-1d84577766bf tempest-VolumesGetTest-1816202824 None] Created volume successfully. Jun 17 04:45:27 devstack cinder-volume[92060]: DEBUG cinder.volume.flows.manager.create_volume [None req-c3d763ed-0313-44e9-9297-999e36dc18c7 tempest-VolumesGetTest-1816202824 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92060) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 17 04:45:27 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-c3d763ed-0313-44e9-9297-999e36dc18c7 tempest-VolumesGetTest-1816202824 None] Flow 'volume_create_manager' (ddf01989-598d-4884-a91f-d759e6783983) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 17 04:45:27 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-c3d763ed-0313-44e9-9297-999e36dc18c7 tempest-VolumesGetTest-1816202824 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8d3941f9-ba83-45d1-a339-a286c2d3350b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:45:27 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-c3d763ed-0313-44e9-9297-999e36dc18c7 tempest-VolumesGetTest-1816202824 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8d3941f9-ba83-45d1-a339-a286c2d3350b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-17T02:45:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1086973557',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=62250f3f-837c-4fa5-9a78-bce1fb63fe53,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='c94fdcfcea4840c2a1e58688ac864031',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T02:45:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=7051f8fe-8c9f-4c83-b7e5-8a19a898cfcf,status='creating',terminated_at=None,updated_at=2026-06-17T02:45:27Z,use_quota=True,user_id='f5c2a6062921435dac6f9e70bb79370a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aad9ce24-93f9-41a6-baa1-5125964f96d1),volume_type_id=aad9ce24-93f9-41a6-baa1-5125964f96d1)' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:45:27 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-c3d763ed-0313-44e9-9297-999e36dc18c7 tempest-VolumesGetTest-1816202824 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7a53812f-a659-4d3e-9c84-59d538995aca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:45:27 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-c3d763ed-0313-44e9-9297-999e36dc18c7 tempest-VolumesGetTest-1816202824 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7a53812f-a659-4d3e-9c84-59d538995aca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:45:27 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-c3d763ed-0313-44e9-9297-999e36dc18c7 tempest-VolumesGetTest-1816202824 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b47a0e1a-0cff-441a-a829-9d56495d0ee7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:45:27 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-c3d763ed-0313-44e9-9297-999e36dc18c7 tempest-VolumesGetTest-1816202824 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b47a0e1a-0cff-441a-a829-9d56495d0ee7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '62250f3f-837c-4fa5-9a78-bce1fb63fe53', 'volume_name': 'volume-62250f3f-837c-4fa5-9a78-bce1fb63fe53', 'volume_size': 1, 'source_volid': '7051f8fe-8c9f-4c83-b7e5-8a19a898cfcf', 'source_volstatus': 'available'}' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:45:27 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-c3d763ed-0313-44e9-9297-999e36dc18c7 tempest-VolumesGetTest-1816202824 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (14358be3-e9b5-41ef-bfc4-964b8a0310e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:45:27 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-c3d763ed-0313-44e9-9297-999e36dc18c7 tempest-VolumesGetTest-1816202824 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (14358be3-e9b5-41ef-bfc4-964b8a0310e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:45:27 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-c3d763ed-0313-44e9-9297-999e36dc18c7 tempest-VolumesGetTest-1816202824 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7bb3436a-b020-40b2-8fea-311f6275ecdc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:45:27 devstack cinder-volume[92060]: INFO cinder.volume.flows.manager.create_volume [None req-c3d763ed-0313-44e9-9297-999e36dc18c7 tempest-VolumesGetTest-1816202824 None] Volume 62250f3f-837c-4fa5-9a78-bce1fb63fe53: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-62250f3f-837c-4fa5-9a78-bce1fb63fe53', 'volume_size': 1, 'source_volid': '7051f8fe-8c9f-4c83-b7e5-8a19a898cfcf', 'source_volstatus': 'available'} Jun 17 04:45:27 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-c3d763ed-0313-44e9-9297-999e36dc18c7 tempest-VolumesGetTest-1816202824 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 04:45:27 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-c3d763ed-0313-44e9-9297-999e36dc18c7 tempest-VolumesGetTest-1816202824 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 04:45:27 devstack cinder-volume[92060]: INFO cinder.volume.drivers.remotefs [None req-c3d763ed-0313-44e9-9297-999e36dc18c7 tempest-VolumesGetTest-1816202824 None] Cloning volume 7051f8fe-8c9f-4c83-b7e5-8a19a898cfcf to volume 62250f3f-837c-4fa5-9a78-bce1fb63fe53 Jun 17 04:45:27 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.remotefs [None req-c3d763ed-0313-44e9-9297-999e36dc18c7 tempest-VolumesGetTest-1816202824 None] Creating offline snapshot 15c898f6-bd1b-42f1-8fac-4f3f8deec62e of volume 7051f8fe-8c9f-4c83-b7e5-8a19a898cfcf {{(pid=92060) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 17 04:45:27 devstack cinder-volume[92060]: DEBUG oslo.privsep.daemon [-] privsep: reply[2aae06b8-e17b-4bc6-8cea-910dc7b7c423]: (4, 'qcow2') {{(pid=93130) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 04:45:27 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-c3d763ed-0313-44e9-9297-999e36dc18c7 tempest-VolumesGetTest-1816202824 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-7051f8fe-8c9f-4c83-b7e5-8a19a898cfcf {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:45:27 devstack sudo[101831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-7051f8fe-8c9f-4c83-b7e5-8a19a898cfcf Jun 17 04:45:27 devstack sudo[101831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:45:28 devstack sudo[101831]: pam_unix(sudo:session): session closed for user root Jun 17 04:45:28 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-c3d763ed-0313-44e9-9297-999e36dc18c7 tempest-VolumesGetTest-1816202824 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-7051f8fe-8c9f-4c83-b7e5-8a19a898cfcf" returned: 0 in 0.960s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:45:28 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-c3d763ed-0313-44e9-9297-999e36dc18c7 tempest-VolumesGetTest-1816202824 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-7051f8fe-8c9f-4c83-b7e5-8a19a898cfcf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-7051f8fe-8c9f-4c83-b7e5-8a19a898cfcf.15c898f6-bd1b-42f1-8fac-4f3f8deec62e 1G {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:45:28 devstack sudo[101846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-7051f8fe-8c9f-4c83-b7e5-8a19a898cfcf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-7051f8fe-8c9f-4c83-b7e5-8a19a898cfcf.15c898f6-bd1b-42f1-8fac-4f3f8deec62e 1G Jun 17 04:45:28 devstack sudo[101846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:45:29 devstack sudo[101846]: pam_unix(sudo:session): session closed for user root Jun 17 04:45:29 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-c3d763ed-0313-44e9-9297-999e36dc18c7 tempest-VolumesGetTest-1816202824 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-7051f8fe-8c9f-4c83-b7e5-8a19a898cfcf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-7051f8fe-8c9f-4c83-b7e5-8a19a898cfcf.15c898f6-bd1b-42f1-8fac-4f3f8deec62e 1G" returned: 0 in 0.807s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:45:29 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-c3d763ed-0313-44e9-9297-999e36dc18c7 tempest-VolumesGetTest-1816202824 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7051f8fe-8c9f-4c83-b7e5-8a19a898cfcf -F qcow2 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-7051f8fe-8c9f-4c83-b7e5-8a19a898cfcf.15c898f6-bd1b-42f1-8fac-4f3f8deec62e {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:45:29 devstack sudo[101851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7051f8fe-8c9f-4c83-b7e5-8a19a898cfcf -F qcow2 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-7051f8fe-8c9f-4c83-b7e5-8a19a898cfcf.15c898f6-bd1b-42f1-8fac-4f3f8deec62e Jun 17 04:45:29 devstack sudo[101851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:45:30 devstack sudo[101851]: pam_unix(sudo:session): session closed for user root Jun 17 04:45:30 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-c3d763ed-0313-44e9-9297-999e36dc18c7 tempest-VolumesGetTest-1816202824 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7051f8fe-8c9f-4c83-b7e5-8a19a898cfcf -F qcow2 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-7051f8fe-8c9f-4c83-b7e5-8a19a898cfcf.15c898f6-bd1b-42f1-8fac-4f3f8deec62e" returned: 0 in 1.410s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:45:30 devstack cinder-volume[92060]: WARNING cinder.volume.drivers.remotefs [None req-c3d763ed-0313-44e9-9297-999e36dc18c7 tempest-VolumesGetTest-1816202824 None] /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-7051f8fe-8c9f-4c83-b7e5-8a19a898cfcf.15c898f6-bd1b-42f1-8fac-4f3f8deec62e is being set with open permissions: ugo+rw Jun 17 04:45:30 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-c3d763ed-0313-44e9-9297-999e36dc18c7 tempest-VolumesGetTest-1816202824 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-7051f8fe-8c9f-4c83-b7e5-8a19a898cfcf.15c898f6-bd1b-42f1-8fac-4f3f8deec62e {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:45:30 devstack sudo[101960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-7051f8fe-8c9f-4c83-b7e5-8a19a898cfcf.15c898f6-bd1b-42f1-8fac-4f3f8deec62e Jun 17 04:45:30 devstack sudo[101960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:45:31 devstack sudo[101960]: pam_unix(sudo:session): session closed for user root Jun 17 04:45:31 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-c3d763ed-0313-44e9-9297-999e36dc18c7 tempest-VolumesGetTest-1816202824 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-7051f8fe-8c9f-4c83-b7e5-8a19a898cfcf.15c898f6-bd1b-42f1-8fac-4f3f8deec62e" returned: 0 in 1.295s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:45:31 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-c3d763ed-0313-44e9-9297-999e36dc18c7 tempest-VolumesGetTest-1816202824 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-7051f8fe-8c9f-4c83-b7e5-8a19a898cfcf.info {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:45:31 devstack sudo[101994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-7051f8fe-8c9f-4c83-b7e5-8a19a898cfcf.info Jun 17 04:45:31 devstack sudo[101994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:45:33 devstack sudo[101994]: pam_unix(sudo:session): session closed for user root Jun 17 04:45:33 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-c3d763ed-0313-44e9-9297-999e36dc18c7 tempest-VolumesGetTest-1816202824 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-7051f8fe-8c9f-4c83-b7e5-8a19a898cfcf.info" returned: 0 in 2.006s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:45:33 devstack cinder-volume[92060]: WARNING cinder.volume.drivers.remotefs [None req-c3d763ed-0313-44e9-9297-999e36dc18c7 tempest-VolumesGetTest-1816202824 None] /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-7051f8fe-8c9f-4c83-b7e5-8a19a898cfcf.info is being set with open permissions: ugo+rw Jun 17 04:45:33 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-c3d763ed-0313-44e9-9297-999e36dc18c7 tempest-VolumesGetTest-1816202824 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-7051f8fe-8c9f-4c83-b7e5-8a19a898cfcf.info {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:45:33 devstack sudo[102017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-7051f8fe-8c9f-4c83-b7e5-8a19a898cfcf.info Jun 17 04:45:33 devstack sudo[102017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:45:35 devstack sudo[102017]: pam_unix(sudo:session): session closed for user root Jun 17 04:45:35 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-c3d763ed-0313-44e9-9297-999e36dc18c7 tempest-VolumesGetTest-1816202824 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-7051f8fe-8c9f-4c83-b7e5-8a19a898cfcf.info" returned: 0 in 1.692s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:45:35 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-c3d763ed-0313-44e9-9297-999e36dc18c7 tempest-VolumesGetTest-1816202824 None] Acquiring lock "cinder-quobyte-62250f3f-837c-4fa5-9a78-bce1fb63fe53" by "_copy_volume_from_snapshot" {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 04:45:35 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-c3d763ed-0313-44e9-9297-999e36dc18c7 tempest-VolumesGetTest-1816202824 None] Lock "cinder-quobyte-62250f3f-837c-4fa5-9a78-bce1fb63fe53" acquired by "_copy_volume_from_snapshot" :: waited 0.032s {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 04:45:35 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-c3d763ed-0313-44e9-9297-999e36dc18c7 tempest-VolumesGetTest-1816202824 None] snapshot: 15c898f6-bd1b-42f1-8fac-4f3f8deec62e, volume: 62250f3f-837c-4fa5-9a78-bce1fb63fe53, {{(pid=92060) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jun 17 04:45:35 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-c3d763ed-0313-44e9-9297-999e36dc18c7 tempest-VolumesGetTest-1816202824 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 04:45:35 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-c3d763ed-0313-44e9-9297-999e36dc18c7 tempest-VolumesGetTest-1816202824 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 04:45:35 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-c3d763ed-0313-44e9-9297-999e36dc18c7 tempest-VolumesGetTest-1816202824 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588': None} {{(pid=92060) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 17 04:45:35 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-c3d763ed-0313-44e9-9297-999e36dc18c7 tempest-VolumesGetTest-1816202824 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588'] {{(pid=92060) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 17 04:45:35 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-c3d763ed-0313-44e9-9297-999e36dc18c7 tempest-VolumesGetTest-1816202824 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 04:45:35 devstack cinder-volume[92060]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c4cac21-0bc8-49cc-bf99-82c4db11e6ce]: (4, 'qcow2') {{(pid=93130) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 04:45:35 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-c3d763ed-0313-44e9-9297-999e36dc18c7 tempest-VolumesGetTest-1816202824 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-7051f8fe-8c9f-4c83-b7e5-8a19a898cfcf.15c898f6-bd1b-42f1-8fac-4f3f8deec62e {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:45:36 devstack sudo[102021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-7051f8fe-8c9f-4c83-b7e5-8a19a898cfcf.15c898f6-bd1b-42f1-8fac-4f3f8deec62e Jun 17 04:45:36 devstack sudo[102021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:45:37 devstack sudo[102021]: pam_unix(sudo:session): session closed for user root Jun 17 04:45:37 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-c3d763ed-0313-44e9-9297-999e36dc18c7 tempest-VolumesGetTest-1816202824 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-7051f8fe-8c9f-4c83-b7e5-8a19a898cfcf.15c898f6-bd1b-42f1-8fac-4f3f8deec62e" returned: 0 in 1.723s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:45:37 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.remotefs [None req-c3d763ed-0313-44e9-9297-999e36dc18c7 tempest-VolumesGetTest-1816202824 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7051f8fe-8c9f-4c83-b7e5-8a19a898cfcf(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=92060) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 17 04:45:37 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-c3d763ed-0313-44e9-9297-999e36dc18c7 tempest-VolumesGetTest-1816202824 None] will copy from snapshot at /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-7051f8fe-8c9f-4c83-b7e5-8a19a898cfcf {{(pid=92060) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jun 17 04:45:37 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-c3d763ed-0313-44e9-9297-999e36dc18c7 tempest-VolumesGetTest-1816202824 None] Creating direct copy from snapshot {{(pid=92060) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jun 17 04:45:37 devstack cinder-volume[92060]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ef2793b-83ba-4c8c-aee9-fa9f1de4b4b7]: (4, 'qcow2') {{(pid=93130) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 04:45:37 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-c3d763ed-0313-44e9-9297-999e36dc18c7 tempest-VolumesGetTest-1816202824 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-7051f8fe-8c9f-4c83-b7e5-8a19a898cfcf {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:45:37 devstack sudo[102028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-7051f8fe-8c9f-4c83-b7e5-8a19a898cfcf Jun 17 04:45:37 devstack sudo[102028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:45:38 devstack sudo[102028]: pam_unix(sudo:session): session closed for user root Jun 17 04:45:38 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-c3d763ed-0313-44e9-9297-999e36dc18c7 tempest-VolumesGetTest-1816202824 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-7051f8fe-8c9f-4c83-b7e5-8a19a898cfcf" returned: 0 in 1.166s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:45:38 devstack cinder-volume[92060]: DEBUG cinder.utils [None req-c3d763ed-0313-44e9-9297-999e36dc18c7 tempest-VolumesGetTest-1816202824 None] Path /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-62250f3f-837c-4fa5-9a78-bce1fb63fe53 not found in is_blk_device check {{(pid=92060) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jun 17 04:45:38 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-c3d763ed-0313-44e9-9297-999e36dc18c7 tempest-VolumesGetTest-1816202824 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-7051f8fe-8c9f-4c83-b7e5-8a19a898cfcf /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-62250f3f-837c-4fa5-9a78-bce1fb63fe53 {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:45:38 devstack sudo[102033]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-7051f8fe-8c9f-4c83-b7e5-8a19a898cfcf /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-62250f3f-837c-4fa5-9a78-bce1fb63fe53 Jun 17 04:45:38 devstack sudo[102033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:45:40 devstack cinder-volume[92060]: DEBUG cinder.volume.flows.manager.create_volume [None req-0009aca0-d4e1-47fa-a1c0-17c53ed1eaba tempest-TestMinimumBasicScenario-1576050866 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92060) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 17 04:45:40 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-0009aca0-d4e1-47fa-a1c0-17c53ed1eaba tempest-TestMinimumBasicScenario-1576050866 None] Flow 'volume_create_manager' (89311933-f175-4c60-988c-228451afc946) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 17 04:45:40 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-0009aca0-d4e1-47fa-a1c0-17c53ed1eaba tempest-TestMinimumBasicScenario-1576050866 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c3779b6c-9d72-454f-80c4-d6f4d9b543fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:45:40 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-0009aca0-d4e1-47fa-a1c0-17c53ed1eaba tempest-TestMinimumBasicScenario-1576050866 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c3779b6c-9d72-454f-80c4-d6f4d9b543fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-17T02:45:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-945905414',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fabf3901-486d-462f-a5b1-b697035c8625,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='39e9095f61264537af934d8642eb7dbd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T02:45:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T02:45:40Z,use_quota=True,user_id='ce447da5ff074199963db30b4b763ae5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aad9ce24-93f9-41a6-baa1-5125964f96d1),volume_type_id=aad9ce24-93f9-41a6-baa1-5125964f96d1)' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:45:40 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-0009aca0-d4e1-47fa-a1c0-17c53ed1eaba tempest-TestMinimumBasicScenario-1576050866 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2bd6a605-1e94-45b3-9ed8-89ad99beb269) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:45:40 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-0009aca0-d4e1-47fa-a1c0-17c53ed1eaba tempest-TestMinimumBasicScenario-1576050866 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2bd6a605-1e94-45b3-9ed8-89ad99beb269) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:45:40 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-0009aca0-d4e1-47fa-a1c0-17c53ed1eaba tempest-TestMinimumBasicScenario-1576050866 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1b6a8645-dc0f-4fe1-b628-34bce05dd708) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:45:40 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-0009aca0-d4e1-47fa-a1c0-17c53ed1eaba tempest-TestMinimumBasicScenario-1576050866 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1b6a8645-dc0f-4fe1-b628-34bce05dd708) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fabf3901-486d-462f-a5b1-b697035c8625', 'volume_name': 'volume-fabf3901-486d-462f-a5b1-b697035c8625', 'volume_size': 1}' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:45:40 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-0009aca0-d4e1-47fa-a1c0-17c53ed1eaba tempest-TestMinimumBasicScenario-1576050866 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c1a263e2-50ca-41b4-9c14-f29c16a95430) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:45:40 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-0009aca0-d4e1-47fa-a1c0-17c53ed1eaba tempest-TestMinimumBasicScenario-1576050866 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c1a263e2-50ca-41b4-9c14-f29c16a95430) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:45:40 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-0009aca0-d4e1-47fa-a1c0-17c53ed1eaba tempest-TestMinimumBasicScenario-1576050866 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f3843b89-2ab0-4a6a-8710-d40f59dd041c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:45:40 devstack cinder-volume[92060]: INFO cinder.volume.flows.manager.create_volume [None req-0009aca0-d4e1-47fa-a1c0-17c53ed1eaba tempest-TestMinimumBasicScenario-1576050866 None] Volume fabf3901-486d-462f-a5b1-b697035c8625: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fabf3901-486d-462f-a5b1-b697035c8625', 'volume_size': 1} Jun 17 04:45:40 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-0009aca0-d4e1-47fa-a1c0-17c53ed1eaba tempest-TestMinimumBasicScenario-1576050866 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 04:45:44 devstack cinder-volume[92060]: DEBUG oslo_service.periodic_task [None req-60d279ad-ad8c-4d36-a4b8-f593e74fb922 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=92060) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 17 04:45:44 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-60d279ad-ad8c-4d36-a4b8-f593e74fb922 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 04:45:44 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-60d279ad-ad8c-4d36-a4b8-f593e74fb922 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 04:45:44 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-60d279ad-ad8c-4d36-a4b8-f593e74fb922 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588': None} {{(pid=92060) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 17 04:45:44 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-60d279ad-ad8c-4d36-a4b8-f593e74fb922 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588'] {{(pid=92060) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 17 04:45:44 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-60d279ad-ad8c-4d36-a4b8-f593e74fb922 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.045s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 04:45:44 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-60d279ad-ad8c-4d36-a4b8-f593e74fb922 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:45:45 devstack sudo[102046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a Jun 17 04:45:45 devstack sudo[102046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:45:47 devstack sudo[102046]: pam_unix(sudo:session): session closed for user root Jun 17 04:45:47 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-60d279ad-ad8c-4d36-a4b8-f593e74fb922 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a" returned: 0 in 2.832s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:45:47 devstack cinder-volume[92060]: DEBUG cinder.manager [None req-60d279ad-ad8c-4d36-a4b8-f593e74fb922 None None] Notifying Schedulers of capabilities ... {{(pid=92060) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 17 04:45:47 devstack cinder-volume[92060]: DEBUG oslo_service.periodic_task [None req-60d279ad-ad8c-4d36-a4b8-f593e74fb922 None None] Running periodic task VolumeManager._thread_info {{(pid=92060) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 17 04:45:47 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-60d279ad-ad8c-4d36-a4b8-f593e74fb922 None None] thread count: 28 {{(pid=92060) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 17 04:45:47 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-60d279ad-ad8c-4d36-a4b8-f593e74fb922 None None] thread info: [<_MainThread(MainThread, started 130061806440576)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=92060) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 17 04:45:47 devstack sudo[102033]: pam_unix(sudo:session): session closed for user root Jun 17 04:45:47 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-c3d763ed-0313-44e9-9297-999e36dc18c7 tempest-VolumesGetTest-1816202824 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-7051f8fe-8c9f-4c83-b7e5-8a19a898cfcf /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-62250f3f-837c-4fa5-9a78-bce1fb63fe53" returned: 0 in 9.175s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:45:47 devstack cinder-volume[92060]: DEBUG oslo.privsep.daemon [-] privsep: reply[875be064-c58a-47cc-bb13-b29fd79e11ad]: (4, 'qcow2') {{(pid=93130) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 04:45:47 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-c3d763ed-0313-44e9-9297-999e36dc18c7 tempest-VolumesGetTest-1816202824 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-7051f8fe-8c9f-4c83-b7e5-8a19a898cfcf {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:45:48 devstack sudo[102078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-7051f8fe-8c9f-4c83-b7e5-8a19a898cfcf Jun 17 04:45:48 devstack sudo[102078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:45:48 devstack sudo[102078]: pam_unix(sudo:session): session closed for user root Jun 17 04:45:48 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-c3d763ed-0313-44e9-9297-999e36dc18c7 tempest-VolumesGetTest-1816202824 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-7051f8fe-8c9f-4c83-b7e5-8a19a898cfcf" returned: 0 in 1.051s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:45:48 devstack cinder-volume[92060]: DEBUG cinder.image.image_utils [None req-c3d763ed-0313-44e9-9297-999e36dc18c7 tempest-VolumesGetTest-1816202824 None] Image conversion details: src /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-7051f8fe-8c9f-4c83-b7e5-8a19a898cfcf, size 1024.00 MB, duration 9.18 sec, destination /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-62250f3f-837c-4fa5-9a78-bce1fb63fe53 {{(pid=92060) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 17 04:45:48 devstack cinder-volume[92060]: INFO cinder.image.image_utils [None req-c3d763ed-0313-44e9-9297-999e36dc18c7 tempest-VolumesGetTest-1816202824 None] Converted 1024.00 MB image at 111.59 MB/s Jun 17 04:45:48 devstack cinder-volume[92060]: WARNING cinder.volume.drivers.remotefs [None req-c3d763ed-0313-44e9-9297-999e36dc18c7 tempest-VolumesGetTest-1816202824 None] /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-62250f3f-837c-4fa5-9a78-bce1fb63fe53 is being set with open permissions: ugo+rw Jun 17 04:45:48 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-c3d763ed-0313-44e9-9297-999e36dc18c7 tempest-VolumesGetTest-1816202824 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-62250f3f-837c-4fa5-9a78-bce1fb63fe53 {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:45:48 devstack sudo[102106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-62250f3f-837c-4fa5-9a78-bce1fb63fe53 Jun 17 04:45:48 devstack sudo[102106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:45:49 devstack sudo[102106]: pam_unix(sudo:session): session closed for user root Jun 17 04:45:49 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-c3d763ed-0313-44e9-9297-999e36dc18c7 tempest-VolumesGetTest-1816202824 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-62250f3f-837c-4fa5-9a78-bce1fb63fe53" returned: 0 in 0.575s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:45:49 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-c3d763ed-0313-44e9-9297-999e36dc18c7 tempest-VolumesGetTest-1816202824 None] Lock "cinder-quobyte-62250f3f-837c-4fa5-9a78-bce1fb63fe53" released by "_copy_volume_from_snapshot" :: held 13.839s {{(pid=92060) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 04:45:49 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-c3d763ed-0313-44e9-9297-999e36dc18c7 tempest-VolumesGetTest-1816202824 None] Acquiring lock "cinder-quobyte-15c898f6-bd1b-42f1-8fac-4f3f8deec62e" by "_delete_snapshot" {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 04:45:49 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-c3d763ed-0313-44e9-9297-999e36dc18c7 tempest-VolumesGetTest-1816202824 None] Lock "cinder-quobyte-15c898f6-bd1b-42f1-8fac-4f3f8deec62e" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 04:45:49 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.remotefs [None req-c3d763ed-0313-44e9-9297-999e36dc18c7 tempest-VolumesGetTest-1816202824 None] Deleting offline snapshot 15c898f6-bd1b-42f1-8fac-4f3f8deec62e of volume 7051f8fe-8c9f-4c83-b7e5-8a19a898cfcf {{(pid=92060) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 17 04:45:49 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.remotefs [None req-c3d763ed-0313-44e9-9297-999e36dc18c7 tempest-VolumesGetTest-1816202824 None] snapshot_file for this snap is: volume-7051f8fe-8c9f-4c83-b7e5-8a19a898cfcf.15c898f6-bd1b-42f1-8fac-4f3f8deec62e {{(pid=92060) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 17 04:45:49 devstack cinder-volume[92060]: DEBUG oslo.privsep.daemon [-] privsep: reply[596159b7-7519-4576-b736-fc250b5b705d]: (4, 'qcow2') {{(pid=93130) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 04:45:49 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-c3d763ed-0313-44e9-9297-999e36dc18c7 tempest-VolumesGetTest-1816202824 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-7051f8fe-8c9f-4c83-b7e5-8a19a898cfcf.15c898f6-bd1b-42f1-8fac-4f3f8deec62e {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:45:49 devstack sudo[102110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-7051f8fe-8c9f-4c83-b7e5-8a19a898cfcf.15c898f6-bd1b-42f1-8fac-4f3f8deec62e Jun 17 04:45:49 devstack sudo[102110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:45:50 devstack cinder-volume[92060]: DEBUG dbcounter [-] [92060] Writing DB stats cinder:SELECT=44,cinder:INSERT=14,cinder:UPDATE=53,cinder:DELETE=7 {{(pid=92060) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 17 04:45:50 devstack sudo[102110]: pam_unix(sudo:session): session closed for user root Jun 17 04:45:50 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-c3d763ed-0313-44e9-9297-999e36dc18c7 tempest-VolumesGetTest-1816202824 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-7051f8fe-8c9f-4c83-b7e5-8a19a898cfcf.15c898f6-bd1b-42f1-8fac-4f3f8deec62e" returned: 0 in 0.737s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:45:50 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.remotefs [None req-c3d763ed-0313-44e9-9297-999e36dc18c7 tempest-VolumesGetTest-1816202824 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7051f8fe-8c9f-4c83-b7e5-8a19a898cfcf(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=92060) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 17 04:45:50 devstack cinder-volume[92060]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b805a3f-72ef-4f82-9a60-ec7636ac3b38]: (4, 'qcow2') {{(pid=93130) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 04:45:50 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-c3d763ed-0313-44e9-9297-999e36dc18c7 tempest-VolumesGetTest-1816202824 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-7051f8fe-8c9f-4c83-b7e5-8a19a898cfcf {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:45:50 devstack sudo[102115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-7051f8fe-8c9f-4c83-b7e5-8a19a898cfcf Jun 17 04:45:50 devstack sudo[102115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:45:51 devstack sudo[102115]: pam_unix(sudo:session): session closed for user root Jun 17 04:45:51 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-c3d763ed-0313-44e9-9297-999e36dc18c7 tempest-VolumesGetTest-1816202824 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-7051f8fe-8c9f-4c83-b7e5-8a19a898cfcf" returned: 0 in 0.766s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:45:51 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-c3d763ed-0313-44e9-9297-999e36dc18c7 tempest-VolumesGetTest-1816202824 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-7051f8fe-8c9f-4c83-b7e5-8a19a898cfcf.15c898f6-bd1b-42f1-8fac-4f3f8deec62e {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:45:51 devstack sudo[102121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-7051f8fe-8c9f-4c83-b7e5-8a19a898cfcf.15c898f6-bd1b-42f1-8fac-4f3f8deec62e Jun 17 04:45:51 devstack sudo[102121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:45:51 devstack sudo[102121]: pam_unix(sudo:session): session closed for user root Jun 17 04:45:51 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-c3d763ed-0313-44e9-9297-999e36dc18c7 tempest-VolumesGetTest-1816202824 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-7051f8fe-8c9f-4c83-b7e5-8a19a898cfcf.15c898f6-bd1b-42f1-8fac-4f3f8deec62e" returned: 0 in 0.706s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:45:51 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-c3d763ed-0313-44e9-9297-999e36dc18c7 tempest-VolumesGetTest-1816202824 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-7051f8fe-8c9f-4c83-b7e5-8a19a898cfcf.15c898f6-bd1b-42f1-8fac-4f3f8deec62e {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:45:51 devstack sudo[102126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-7051f8fe-8c9f-4c83-b7e5-8a19a898cfcf.15c898f6-bd1b-42f1-8fac-4f3f8deec62e Jun 17 04:45:51 devstack sudo[102126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:45:52 devstack sudo[102126]: pam_unix(sudo:session): session closed for user root Jun 17 04:45:52 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-c3d763ed-0313-44e9-9297-999e36dc18c7 tempest-VolumesGetTest-1816202824 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-7051f8fe-8c9f-4c83-b7e5-8a19a898cfcf.15c898f6-bd1b-42f1-8fac-4f3f8deec62e" returned: 0 in 0.606s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:45:52 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-c3d763ed-0313-44e9-9297-999e36dc18c7 tempest-VolumesGetTest-1816202824 None] Lock "cinder-quobyte-15c898f6-bd1b-42f1-8fac-4f3f8deec62e" released by "_delete_snapshot" :: held 2.928s {{(pid=92060) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 04:45:52 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-c3d763ed-0313-44e9-9297-999e36dc18c7 tempest-VolumesGetTest-1816202824 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 25.369s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 04:45:52 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-0009aca0-d4e1-47fa-a1c0-17c53ed1eaba tempest-TestMinimumBasicScenario-1576050866 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 12.168s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 04:45:52 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-0009aca0-d4e1-47fa-a1c0-17c53ed1eaba tempest-TestMinimumBasicScenario-1576050866 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-17T02:45:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-945905414',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fabf3901-486d-462f-a5b1-b697035c8625,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='39e9095f61264537af934d8642eb7dbd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T02:45:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T02:45:40Z,use_quota=True,user_id='ce447da5ff074199963db30b4b763ae5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aad9ce24-93f9-41a6-baa1-5125964f96d1),volume_type_id=aad9ce24-93f9-41a6-baa1-5125964f96d1)}" {{(pid=92060) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 17 04:45:52 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.remotefs [None req-0009aca0-d4e1-47fa-a1c0-17c53ed1eaba tempest-TestMinimumBasicScenario-1576050866 None] Creating volume fabf3901-486d-462f-a5b1-b697035c8625 {{(pid=92060) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 17 04:45:52 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-0009aca0-d4e1-47fa-a1c0-17c53ed1eaba tempest-TestMinimumBasicScenario-1576050866 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 04:45:52 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-0009aca0-d4e1-47fa-a1c0-17c53ed1eaba tempest-TestMinimumBasicScenario-1576050866 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 04:45:52 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-0009aca0-d4e1-47fa-a1c0-17c53ed1eaba tempest-TestMinimumBasicScenario-1576050866 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588': None} {{(pid=92060) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 17 04:45:52 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-0009aca0-d4e1-47fa-a1c0-17c53ed1eaba tempest-TestMinimumBasicScenario-1576050866 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588'] {{(pid=92060) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 17 04:45:52 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-0009aca0-d4e1-47fa-a1c0-17c53ed1eaba tempest-TestMinimumBasicScenario-1576050866 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 04:45:52 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-0009aca0-d4e1-47fa-a1c0-17c53ed1eaba tempest-TestMinimumBasicScenario-1576050866 None] Selected osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588 as target Quobyte volume. {{(pid=92060) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 17 04:45:52 devstack cinder-volume[92060]: INFO cinder.volume.drivers.remotefs [None req-0009aca0-d4e1-47fa-a1c0-17c53ed1eaba tempest-TestMinimumBasicScenario-1576050866 None] casted to osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588 Jun 17 04:45:52 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-0009aca0-d4e1-47fa-a1c0-17c53ed1eaba tempest-TestMinimumBasicScenario-1576050866 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-fabf3901-486d-462f-a5b1-b697035c8625 1073741824 {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:45:52 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-c3d763ed-0313-44e9-9297-999e36dc18c7 tempest-VolumesGetTest-1816202824 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7bb3436a-b020-40b2-8fea-311f6275ecdc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-62250f3f-837c-4fa5-9a78-bce1fb63fe53', 'volume_size': 1, 'source_volid': '7051f8fe-8c9f-4c83-b7e5-8a19a898cfcf', 'source_volstatus': 'available'}' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:45:52 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-c3d763ed-0313-44e9-9297-999e36dc18c7 tempest-VolumesGetTest-1816202824 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bf60a22a-ec53-4b1c-b438-8045f278fac2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:45:52 devstack cinder-volume[92060]: INFO cinder.volume.flows.manager.create_volume [None req-c3d763ed-0313-44e9-9297-999e36dc18c7 tempest-VolumesGetTest-1816202824 None] Volume volume-62250f3f-837c-4fa5-9a78-bce1fb63fe53 (62250f3f-837c-4fa5-9a78-bce1fb63fe53): created successfully Jun 17 04:45:52 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-c3d763ed-0313-44e9-9297-999e36dc18c7 tempest-VolumesGetTest-1816202824 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bf60a22a-ec53-4b1c-b438-8045f278fac2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:45:52 devstack sudo[102129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-fabf3901-486d-462f-a5b1-b697035c8625 1073741824 Jun 17 04:45:52 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-c3d763ed-0313-44e9-9297-999e36dc18c7 tempest-VolumesGetTest-1816202824 None] Flow 'volume_create_manager' (ddf01989-598d-4884-a91f-d759e6783983) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92060) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 17 04:45:52 devstack sudo[102129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:45:52 devstack cinder-volume[92060]: INFO cinder.volume.manager [None req-c3d763ed-0313-44e9-9297-999e36dc18c7 tempest-VolumesGetTest-1816202824 None] Created volume successfully. Jun 17 04:45:53 devstack sudo[102129]: pam_unix(sudo:session): session closed for user root Jun 17 04:45:53 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-0009aca0-d4e1-47fa-a1c0-17c53ed1eaba tempest-TestMinimumBasicScenario-1576050866 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-fabf3901-486d-462f-a5b1-b697035c8625 1073741824" returned: 0 in 0.943s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:45:53 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-0009aca0-d4e1-47fa-a1c0-17c53ed1eaba tempest-TestMinimumBasicScenario-1576050866 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-fabf3901-486d-462f-a5b1-b697035c8625 {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:45:53 devstack sudo[102136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-fabf3901-486d-462f-a5b1-b697035c8625 Jun 17 04:45:53 devstack sudo[102136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:45:53 devstack cinder-volume[92060]: DEBUG cinder.volume.flows.manager.create_volume [None req-7e2196f4-38c0-4fac-b71d-abfb9fa20be9 tempest-VolumesGetTest-1816202824 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92060) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 17 04:45:53 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-7e2196f4-38c0-4fac-b71d-abfb9fa20be9 tempest-VolumesGetTest-1816202824 None] Flow 'volume_create_manager' (0bbe8f22-27f0-4af4-8d2c-feaf48218dcd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 17 04:45:53 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-7e2196f4-38c0-4fac-b71d-abfb9fa20be9 tempest-VolumesGetTest-1816202824 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (49f90805-c874-4c34-a344-2a9ce414940a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:45:53 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-7e2196f4-38c0-4fac-b71d-abfb9fa20be9 tempest-VolumesGetTest-1816202824 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (49f90805-c874-4c34-a344-2a9ce414940a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-17T02:45:54Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1861840174',display_name='tempest-VolumesGetTest-Volume-243454632',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8af4b179-3293-4081-a9e7-8a672efae9e5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c94fdcfcea4840c2a1e58688ac864031',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T02:45:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T02:45:54Z,use_quota=True,user_id='f5c2a6062921435dac6f9e70bb79370a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aad9ce24-93f9-41a6-baa1-5125964f96d1),volume_type_id=aad9ce24-93f9-41a6-baa1-5125964f96d1)' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:45:53 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-7e2196f4-38c0-4fac-b71d-abfb9fa20be9 tempest-VolumesGetTest-1816202824 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8ba05bf8-4b5f-4cb8-8b73-f20a059a63b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:45:53 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-7e2196f4-38c0-4fac-b71d-abfb9fa20be9 tempest-VolumesGetTest-1816202824 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8ba05bf8-4b5f-4cb8-8b73-f20a059a63b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:45:53 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-7e2196f4-38c0-4fac-b71d-abfb9fa20be9 tempest-VolumesGetTest-1816202824 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d5a2749c-caea-4236-a456-1fd4f9ff86fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:45:53 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-7e2196f4-38c0-4fac-b71d-abfb9fa20be9 tempest-VolumesGetTest-1816202824 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d5a2749c-caea-4236-a456-1fd4f9ff86fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8af4b179-3293-4081-a9e7-8a672efae9e5', 'volume_name': 'volume-8af4b179-3293-4081-a9e7-8a672efae9e5', 'volume_size': 1}' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:45:53 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-7e2196f4-38c0-4fac-b71d-abfb9fa20be9 tempest-VolumesGetTest-1816202824 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cf778af1-5110-49b3-946a-3fbbcfcb98fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:45:53 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-7e2196f4-38c0-4fac-b71d-abfb9fa20be9 tempest-VolumesGetTest-1816202824 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cf778af1-5110-49b3-946a-3fbbcfcb98fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:45:53 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-7e2196f4-38c0-4fac-b71d-abfb9fa20be9 tempest-VolumesGetTest-1816202824 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e28bbad7-75e0-4585-b3af-fe5a11bc0957) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:45:53 devstack cinder-volume[92060]: INFO cinder.volume.flows.manager.create_volume [None req-7e2196f4-38c0-4fac-b71d-abfb9fa20be9 tempest-VolumesGetTest-1816202824 None] Volume 8af4b179-3293-4081-a9e7-8a672efae9e5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8af4b179-3293-4081-a9e7-8a672efae9e5', 'volume_size': 1} Jun 17 04:45:53 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-7e2196f4-38c0-4fac-b71d-abfb9fa20be9 tempest-VolumesGetTest-1816202824 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 04:45:54 devstack sudo[102136]: pam_unix(sudo:session): session closed for user root Jun 17 04:45:54 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-0009aca0-d4e1-47fa-a1c0-17c53ed1eaba tempest-TestMinimumBasicScenario-1576050866 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-fabf3901-486d-462f-a5b1-b697035c8625" returned: 0 in 0.772s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:45:54 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-0009aca0-d4e1-47fa-a1c0-17c53ed1eaba tempest-TestMinimumBasicScenario-1576050866 None] <== create_volume: return (1756ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588'} {{(pid=92060) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 17 04:45:54 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-0009aca0-d4e1-47fa-a1c0-17c53ed1eaba tempest-TestMinimumBasicScenario-1576050866 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.762s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 04:45:54 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-7e2196f4-38c0-4fac-b71d-abfb9fa20be9 tempest-VolumesGetTest-1816202824 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.442s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 04:45:54 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-7e2196f4-38c0-4fac-b71d-abfb9fa20be9 tempest-VolumesGetTest-1816202824 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-17T02:45:54Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1861840174',display_name='tempest-VolumesGetTest-Volume-243454632',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8af4b179-3293-4081-a9e7-8a672efae9e5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c94fdcfcea4840c2a1e58688ac864031',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T02:45:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T02:45:54Z,use_quota=True,user_id='f5c2a6062921435dac6f9e70bb79370a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aad9ce24-93f9-41a6-baa1-5125964f96d1),volume_type_id=aad9ce24-93f9-41a6-baa1-5125964f96d1)}" {{(pid=92060) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 17 04:45:54 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.remotefs [None req-7e2196f4-38c0-4fac-b71d-abfb9fa20be9 tempest-VolumesGetTest-1816202824 None] Creating volume 8af4b179-3293-4081-a9e7-8a672efae9e5 {{(pid=92060) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 17 04:45:54 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-7e2196f4-38c0-4fac-b71d-abfb9fa20be9 tempest-VolumesGetTest-1816202824 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 04:45:54 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-7e2196f4-38c0-4fac-b71d-abfb9fa20be9 tempest-VolumesGetTest-1816202824 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 04:45:54 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-7e2196f4-38c0-4fac-b71d-abfb9fa20be9 tempest-VolumesGetTest-1816202824 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588': None} {{(pid=92060) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 17 04:45:54 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-7e2196f4-38c0-4fac-b71d-abfb9fa20be9 tempest-VolumesGetTest-1816202824 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588'] {{(pid=92060) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 17 04:45:54 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-7e2196f4-38c0-4fac-b71d-abfb9fa20be9 tempest-VolumesGetTest-1816202824 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 04:45:54 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-7e2196f4-38c0-4fac-b71d-abfb9fa20be9 tempest-VolumesGetTest-1816202824 None] Selected osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588 as target Quobyte volume. {{(pid=92060) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 17 04:45:54 devstack cinder-volume[92060]: INFO cinder.volume.drivers.remotefs [None req-7e2196f4-38c0-4fac-b71d-abfb9fa20be9 tempest-VolumesGetTest-1816202824 None] casted to osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588 Jun 17 04:45:54 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-7e2196f4-38c0-4fac-b71d-abfb9fa20be9 tempest-VolumesGetTest-1816202824 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-8af4b179-3293-4081-a9e7-8a672efae9e5 1073741824 {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:45:54 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-0009aca0-d4e1-47fa-a1c0-17c53ed1eaba tempest-TestMinimumBasicScenario-1576050866 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f3843b89-2ab0-4a6a-8710-d40f59dd041c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fabf3901-486d-462f-a5b1-b697035c8625', 'volume_size': 1}' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:45:54 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-0009aca0-d4e1-47fa-a1c0-17c53ed1eaba tempest-TestMinimumBasicScenario-1576050866 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3aa62493-aa4a-4bb3-ba7f-0b0efecf9ad7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:45:54 devstack sudo[102140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-8af4b179-3293-4081-a9e7-8a672efae9e5 1073741824 Jun 17 04:45:54 devstack sudo[102140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:45:54 devstack cinder-volume[92060]: INFO cinder.volume.flows.manager.create_volume [None req-0009aca0-d4e1-47fa-a1c0-17c53ed1eaba tempest-TestMinimumBasicScenario-1576050866 None] Volume volume-fabf3901-486d-462f-a5b1-b697035c8625 (fabf3901-486d-462f-a5b1-b697035c8625): created successfully Jun 17 04:45:54 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-0009aca0-d4e1-47fa-a1c0-17c53ed1eaba tempest-TestMinimumBasicScenario-1576050866 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3aa62493-aa4a-4bb3-ba7f-0b0efecf9ad7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:45:54 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-0009aca0-d4e1-47fa-a1c0-17c53ed1eaba tempest-TestMinimumBasicScenario-1576050866 None] Flow 'volume_create_manager' (89311933-f175-4c60-988c-228451afc946) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92060) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 17 04:45:54 devstack cinder-volume[92060]: INFO cinder.volume.manager [None req-0009aca0-d4e1-47fa-a1c0-17c53ed1eaba tempest-TestMinimumBasicScenario-1576050866 None] Created volume successfully. Jun 17 04:45:55 devstack sudo[102140]: pam_unix(sudo:session): session closed for user root Jun 17 04:45:55 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-7e2196f4-38c0-4fac-b71d-abfb9fa20be9 tempest-VolumesGetTest-1816202824 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-8af4b179-3293-4081-a9e7-8a672efae9e5 1073741824" returned: 0 in 1.156s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:45:55 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-7e2196f4-38c0-4fac-b71d-abfb9fa20be9 tempest-VolumesGetTest-1816202824 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-8af4b179-3293-4081-a9e7-8a672efae9e5 {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:45:55 devstack sudo[102146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-8af4b179-3293-4081-a9e7-8a672efae9e5 Jun 17 04:45:55 devstack sudo[102146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:45:56 devstack sudo[102146]: pam_unix(sudo:session): session closed for user root Jun 17 04:45:56 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-7e2196f4-38c0-4fac-b71d-abfb9fa20be9 tempest-VolumesGetTest-1816202824 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-8af4b179-3293-4081-a9e7-8a672efae9e5" returned: 0 in 1.095s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:45:56 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-7e2196f4-38c0-4fac-b71d-abfb9fa20be9 tempest-VolumesGetTest-1816202824 None] <== create_volume: return (2332ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588'} {{(pid=92060) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 17 04:45:56 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-7e2196f4-38c0-4fac-b71d-abfb9fa20be9 tempest-VolumesGetTest-1816202824 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.335s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 04:45:56 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-7e2196f4-38c0-4fac-b71d-abfb9fa20be9 tempest-VolumesGetTest-1816202824 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e28bbad7-75e0-4585-b3af-fe5a11bc0957) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8af4b179-3293-4081-a9e7-8a672efae9e5', 'volume_size': 1}' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:45:56 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-7e2196f4-38c0-4fac-b71d-abfb9fa20be9 tempest-VolumesGetTest-1816202824 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (db6405d0-c86d-4d81-960f-2111643eb7a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:45:56 devstack cinder-volume[92060]: INFO cinder.volume.flows.manager.create_volume [None req-7e2196f4-38c0-4fac-b71d-abfb9fa20be9 tempest-VolumesGetTest-1816202824 None] Volume volume-8af4b179-3293-4081-a9e7-8a672efae9e5 (8af4b179-3293-4081-a9e7-8a672efae9e5): created successfully Jun 17 04:45:56 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-7e2196f4-38c0-4fac-b71d-abfb9fa20be9 tempest-VolumesGetTest-1816202824 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (db6405d0-c86d-4d81-960f-2111643eb7a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:45:56 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-7e2196f4-38c0-4fac-b71d-abfb9fa20be9 tempest-VolumesGetTest-1816202824 None] Flow 'volume_create_manager' (0bbe8f22-27f0-4af4-8d2c-feaf48218dcd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92060) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 17 04:45:56 devstack cinder-volume[92060]: INFO cinder.volume.manager [None req-7e2196f4-38c0-4fac-b71d-abfb9fa20be9 tempest-VolumesGetTest-1816202824 None] Created volume successfully. Jun 17 04:45:57 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-4f2e362f-957f-4463-a52e-c93a6f55b530 tempest-VolumesGetTest-1816202824 None] Acquiring lock "cinder-8af4b179-3293-4081-a9e7-8a672efae9e5-delete_volume" by "delete_volume" {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 04:45:57 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-4f2e362f-957f-4463-a52e-c93a6f55b530 tempest-VolumesGetTest-1816202824 None] Lock "cinder-8af4b179-3293-4081-a9e7-8a672efae9e5-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 04:45:57 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-4f2e362f-957f-4463-a52e-c93a6f55b530 tempest-VolumesGetTest-1816202824 None] Acquiring lock "cinder-quobyte-8af4b179-3293-4081-a9e7-8a672efae9e5" by "delete_volume" {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 04:45:57 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-4f2e362f-957f-4463-a52e-c93a6f55b530 tempest-VolumesGetTest-1816202824 None] Lock "cinder-quobyte-8af4b179-3293-4081-a9e7-8a672efae9e5" acquired by "delete_volume" :: waited 0.015s {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 04:45:57 devstack cinder-volume[92060]: DEBUG oslo.privsep.daemon [-] privsep: reply[23226334-485c-48f3-a717-b9cad7d2582b]: (4, 'qcow2') {{(pid=93130) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 04:45:57 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-4f2e362f-957f-4463-a52e-c93a6f55b530 tempest-VolumesGetTest-1816202824 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-8af4b179-3293-4081-a9e7-8a672efae9e5 {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:45:57 devstack sudo[102149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-8af4b179-3293-4081-a9e7-8a672efae9e5 Jun 17 04:45:57 devstack sudo[102149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:45:58 devstack sudo[102149]: pam_unix(sudo:session): session closed for user root Jun 17 04:45:58 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-4f2e362f-957f-4463-a52e-c93a6f55b530 tempest-VolumesGetTest-1816202824 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-8af4b179-3293-4081-a9e7-8a672efae9e5" returned: 0 in 0.868s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:45:58 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-4f2e362f-957f-4463-a52e-c93a6f55b530 tempest-VolumesGetTest-1816202824 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-8af4b179-3293-4081-a9e7-8a672efae9e5 {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:45:58 devstack sudo[102154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-8af4b179-3293-4081-a9e7-8a672efae9e5 Jun 17 04:45:58 devstack sudo[102154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:45:59 devstack sudo[102154]: pam_unix(sudo:session): session closed for user root Jun 17 04:45:59 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-4f2e362f-957f-4463-a52e-c93a6f55b530 tempest-VolumesGetTest-1816202824 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-8af4b179-3293-4081-a9e7-8a672efae9e5" returned: 0 in 0.845s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:45:59 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-4f2e362f-957f-4463-a52e-c93a6f55b530 tempest-VolumesGetTest-1816202824 None] Lock "cinder-quobyte-8af4b179-3293-4081-a9e7-8a672efae9e5" released by "delete_volume" :: held 1.789s {{(pid=92060) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 04:45:59 devstack cinder-volume[92060]: DEBUG cinder.quota [None req-4f2e362f-957f-4463-a52e-c93a6f55b530 tempest-VolumesGetTest-1816202824 None] Created reservations ['fb07807c-01ef-4aa9-a15f-47e8f50e01d4', '4ac4b346-5a71-4421-b60c-bdf1fd68943a', '5c7226b5-ff81-4799-9634-afb8bceb99a6', '0b53046c-0b30-4eed-9e48-d3411931869b'] {{(pid=92060) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 17 04:45:59 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [req-cd531255-6127-4236-aa36-e950b2cfdf3d req-0cc5f3f2-907c-4def-9ff4-76cf057cca9f tempest-TestMinimumBasicScenario-1576050866 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 04:45:59 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [req-cd531255-6127-4236-aa36-e950b2cfdf3d req-0cc5f3f2-907c-4def-9ff4-76cf057cca9f tempest-TestMinimumBasicScenario-1576050866 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 04:45:59 devstack cinder-volume[92060]: DEBUG cinder.volume.flows.manager.create_volume [None req-23ca48e8-9fac-4c68-9f65-c0619f4d5012 tempest-AttachVolumeNegativeTest-991296233 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92060) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 17 04:45:59 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-23ca48e8-9fac-4c68-9f65-c0619f4d5012 tempest-AttachVolumeNegativeTest-991296233 None] Flow 'volume_create_manager' (e1faf0ad-3c1d-4b34-99b8-4fd32ad6e488) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 17 04:45:59 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-23ca48e8-9fac-4c68-9f65-c0619f4d5012 tempest-AttachVolumeNegativeTest-991296233 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b3123c9c-1491-4032-b12a-d09c18df11e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:45:59 devstack cinder-volume[92060]: DEBUG oslo.privsep.daemon [-] privsep: reply[19948aa6-7dc3-47b8-8efc-17376c98eea9]: (4, 'qcow2') {{(pid=93130) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 04:45:59 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [req-cd531255-6127-4236-aa36-e950b2cfdf3d req-0cc5f3f2-907c-4def-9ff4-76cf057cca9f tempest-TestMinimumBasicScenario-1576050866 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-fabf3901-486d-462f-a5b1-b697035c8625 {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:45:59 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-23ca48e8-9fac-4c68-9f65-c0619f4d5012 tempest-AttachVolumeNegativeTest-991296233 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b3123c9c-1491-4032-b12a-d09c18df11e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-17T02:45:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-2134678762',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4b541ff9-3359-453a-99e0-e6cb6131f0c3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9d0a579338d541c79ff65be0490f47b0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T02:45:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T02:45:59Z,use_quota=True,user_id='994750bc5563495ca183a77999e0ce87',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aad9ce24-93f9-41a6-baa1-5125964f96d1),volume_type_id=aad9ce24-93f9-41a6-baa1-5125964f96d1)' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:45:59 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-23ca48e8-9fac-4c68-9f65-c0619f4d5012 tempest-AttachVolumeNegativeTest-991296233 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e5cc9a69-79a7-4c1b-9e5a-2a89b5aa3567) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:45:59 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-23ca48e8-9fac-4c68-9f65-c0619f4d5012 tempest-AttachVolumeNegativeTest-991296233 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e5cc9a69-79a7-4c1b-9e5a-2a89b5aa3567) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:45:59 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-23ca48e8-9fac-4c68-9f65-c0619f4d5012 tempest-AttachVolumeNegativeTest-991296233 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fabaada6-c6d9-40b9-8cab-cf4931907cf1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:45:59 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-23ca48e8-9fac-4c68-9f65-c0619f4d5012 tempest-AttachVolumeNegativeTest-991296233 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fabaada6-c6d9-40b9-8cab-cf4931907cf1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4b541ff9-3359-453a-99e0-e6cb6131f0c3', 'volume_name': 'volume-4b541ff9-3359-453a-99e0-e6cb6131f0c3', 'volume_size': 1}' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:45:59 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-23ca48e8-9fac-4c68-9f65-c0619f4d5012 tempest-AttachVolumeNegativeTest-991296233 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7cb86b8c-03a9-4975-9a41-7a78f4be5e20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:45:59 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-23ca48e8-9fac-4c68-9f65-c0619f4d5012 tempest-AttachVolumeNegativeTest-991296233 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7cb86b8c-03a9-4975-9a41-7a78f4be5e20) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:45:59 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-23ca48e8-9fac-4c68-9f65-c0619f4d5012 tempest-AttachVolumeNegativeTest-991296233 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aea02d7b-0712-4ca8-8e0e-50f54c3a5f79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:45:59 devstack cinder-volume[92060]: INFO cinder.volume.flows.manager.create_volume [None req-23ca48e8-9fac-4c68-9f65-c0619f4d5012 tempest-AttachVolumeNegativeTest-991296233 None] Volume 4b541ff9-3359-453a-99e0-e6cb6131f0c3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4b541ff9-3359-453a-99e0-e6cb6131f0c3', 'volume_size': 1} Jun 17 04:45:59 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-23ca48e8-9fac-4c68-9f65-c0619f4d5012 tempest-AttachVolumeNegativeTest-991296233 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 04:45:59 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-4f2e362f-957f-4463-a52e-c93a6f55b530 tempest-VolumesGetTest-1816202824 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 04:45:59 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-4f2e362f-957f-4463-a52e-c93a6f55b530 tempest-VolumesGetTest-1816202824 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 04:45:59 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-4f2e362f-957f-4463-a52e-c93a6f55b530 tempest-VolumesGetTest-1816202824 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588': None} {{(pid=92060) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 17 04:45:59 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-4f2e362f-957f-4463-a52e-c93a6f55b530 tempest-VolumesGetTest-1816202824 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588'] {{(pid=92060) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 17 04:45:59 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-4f2e362f-957f-4463-a52e-c93a6f55b530 tempest-VolumesGetTest-1816202824 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 04:45:59 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-4f2e362f-957f-4463-a52e-c93a6f55b530 tempest-VolumesGetTest-1816202824 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:45:59 devstack sudo[102169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a Jun 17 04:45:59 devstack sudo[102169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:45:59 devstack sudo[102168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-fabf3901-486d-462f-a5b1-b697035c8625 Jun 17 04:45:59 devstack sudo[102168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:45:59 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-f3c895cb-9238-40be-9293-56524eb7f3bd tempest-VolumesGetTest-1816202824 None] Acquiring lock "cinder-62250f3f-837c-4fa5-9a78-bce1fb63fe53-delete_volume" by "delete_volume" {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 04:45:59 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-f3c895cb-9238-40be-9293-56524eb7f3bd tempest-VolumesGetTest-1816202824 None] Lock "cinder-62250f3f-837c-4fa5-9a78-bce1fb63fe53-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 04:45:59 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-f3c895cb-9238-40be-9293-56524eb7f3bd tempest-VolumesGetTest-1816202824 None] Acquiring lock "cinder-quobyte-62250f3f-837c-4fa5-9a78-bce1fb63fe53" by "delete_volume" {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 04:45:59 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-f3c895cb-9238-40be-9293-56524eb7f3bd tempest-VolumesGetTest-1816202824 None] Lock "cinder-quobyte-62250f3f-837c-4fa5-9a78-bce1fb63fe53" acquired by "delete_volume" :: waited 0.021s {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 04:45:59 devstack cinder-volume[92060]: DEBUG oslo.privsep.daemon [-] privsep: reply[8817dce3-41fa-4de2-a8b3-eabcccf772c3]: (4, 'qcow2') {{(pid=93130) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 04:45:59 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-f3c895cb-9238-40be-9293-56524eb7f3bd tempest-VolumesGetTest-1816202824 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-62250f3f-837c-4fa5-9a78-bce1fb63fe53 {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:46:00 devstack sudo[102172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-62250f3f-837c-4fa5-9a78-bce1fb63fe53 Jun 17 04:46:00 devstack sudo[102172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:46:00 devstack sudo[102168]: pam_unix(sudo:session): session closed for user root Jun 17 04:46:00 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [req-cd531255-6127-4236-aa36-e950b2cfdf3d req-0cc5f3f2-907c-4def-9ff4-76cf057cca9f tempest-TestMinimumBasicScenario-1576050866 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-fabf3901-486d-462f-a5b1-b697035c8625" returned: 0 in 1.042s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:46:00 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [req-cd531255-6127-4236-aa36-e950b2cfdf3d req-0cc5f3f2-907c-4def-9ff4-76cf057cca9f tempest-TestMinimumBasicScenario-1576050866 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.110s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 04:46:00 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-23ca48e8-9fac-4c68-9f65-c0619f4d5012 tempest-AttachVolumeNegativeTest-991296233 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.966s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 04:46:00 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-23ca48e8-9fac-4c68-9f65-c0619f4d5012 tempest-AttachVolumeNegativeTest-991296233 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-17T02:45:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-2134678762',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4b541ff9-3359-453a-99e0-e6cb6131f0c3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9d0a579338d541c79ff65be0490f47b0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T02:45:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T02:45:59Z,use_quota=True,user_id='994750bc5563495ca183a77999e0ce87',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aad9ce24-93f9-41a6-baa1-5125964f96d1),volume_type_id=aad9ce24-93f9-41a6-baa1-5125964f96d1)}" {{(pid=92060) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 17 04:46:00 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.remotefs [None req-23ca48e8-9fac-4c68-9f65-c0619f4d5012 tempest-AttachVolumeNegativeTest-991296233 None] Creating volume 4b541ff9-3359-453a-99e0-e6cb6131f0c3 {{(pid=92060) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 17 04:46:00 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-23ca48e8-9fac-4c68-9f65-c0619f4d5012 tempest-AttachVolumeNegativeTest-991296233 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 04:46:00 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-23ca48e8-9fac-4c68-9f65-c0619f4d5012 tempest-AttachVolumeNegativeTest-991296233 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.007s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 04:46:00 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-23ca48e8-9fac-4c68-9f65-c0619f4d5012 tempest-AttachVolumeNegativeTest-991296233 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588': None} {{(pid=92060) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 17 04:46:00 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-23ca48e8-9fac-4c68-9f65-c0619f4d5012 tempest-AttachVolumeNegativeTest-991296233 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588'] {{(pid=92060) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 17 04:46:00 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-23ca48e8-9fac-4c68-9f65-c0619f4d5012 tempest-AttachVolumeNegativeTest-991296233 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 04:46:00 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-23ca48e8-9fac-4c68-9f65-c0619f4d5012 tempest-AttachVolumeNegativeTest-991296233 None] Selected osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588 as target Quobyte volume. {{(pid=92060) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 17 04:46:00 devstack cinder-volume[92060]: INFO cinder.volume.drivers.remotefs [None req-23ca48e8-9fac-4c68-9f65-c0619f4d5012 tempest-AttachVolumeNegativeTest-991296233 None] casted to osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588 Jun 17 04:46:00 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-23ca48e8-9fac-4c68-9f65-c0619f4d5012 tempest-AttachVolumeNegativeTest-991296233 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-4b541ff9-3359-453a-99e0-e6cb6131f0c3 1073741824 {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:46:00 devstack sudo[102169]: pam_unix(sudo:session): session closed for user root Jun 17 04:46:00 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-4f2e362f-957f-4463-a52e-c93a6f55b530 tempest-VolumesGetTest-1816202824 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a" returned: 0 in 0.991s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:46:00 devstack cinder-volume[92060]: DEBUG cinder.manager [None req-4f2e362f-957f-4463-a52e-c93a6f55b530 tempest-VolumesGetTest-1816202824 None] Notifying Schedulers of capabilities ... {{(pid=92060) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 17 04:46:00 devstack sudo[102178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-4b541ff9-3359-453a-99e0-e6cb6131f0c3 1073741824 Jun 17 04:46:00 devstack sudo[102178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:46:00 devstack cinder-volume[92060]: INFO cinder.volume.manager [None req-4f2e362f-957f-4463-a52e-c93a6f55b530 tempest-VolumesGetTest-1816202824 None] Deleted volume successfully. Jun 17 04:46:00 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [req-cd531255-6127-4236-aa36-e950b2cfdf3d req-0cc5f3f2-907c-4def-9ff4-76cf057cca9f tempest-TestMinimumBasicScenario-1576050866 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588', 'name': 'volume-fabf3901-486d-462f-a5b1-b697035c8625', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '8a8c3564-d0a7-4209-be4a-3e2fc730d1a0', 'enforce_multipath': True} {{(pid=92060) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 17 04:46:00 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-4f2e362f-957f-4463-a52e-c93a6f55b530 tempest-VolumesGetTest-1816202824 None] Lock "cinder-8af4b179-3293-4081-a9e7-8a672efae9e5-delete_volume" released by "delete_volume" :: held 3.310s {{(pid=92060) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 04:46:00 devstack cinder-volume[92060]: INFO cinder.volume.manager [req-cd531255-6127-4236-aa36-e950b2cfdf3d req-0cc5f3f2-907c-4def-9ff4-76cf057cca9f tempest-TestMinimumBasicScenario-1576050866 None] attachment_update completed successfully. Jun 17 04:46:00 devstack sudo[102172]: pam_unix(sudo:session): session closed for user root Jun 17 04:46:00 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-f3c895cb-9238-40be-9293-56524eb7f3bd tempest-VolumesGetTest-1816202824 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-62250f3f-837c-4fa5-9a78-bce1fb63fe53" returned: 0 in 0.988s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:46:00 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-f3c895cb-9238-40be-9293-56524eb7f3bd tempest-VolumesGetTest-1816202824 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-62250f3f-837c-4fa5-9a78-bce1fb63fe53 {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:46:00 devstack sudo[102184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-62250f3f-837c-4fa5-9a78-bce1fb63fe53 Jun 17 04:46:00 devstack sudo[102184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:46:01 devstack sudo[102184]: pam_unix(sudo:session): session closed for user root Jun 17 04:46:01 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-f3c895cb-9238-40be-9293-56524eb7f3bd tempest-VolumesGetTest-1816202824 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-62250f3f-837c-4fa5-9a78-bce1fb63fe53" returned: 0 in 0.774s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:46:01 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-f3c895cb-9238-40be-9293-56524eb7f3bd tempest-VolumesGetTest-1816202824 None] Lock "cinder-quobyte-62250f3f-837c-4fa5-9a78-bce1fb63fe53" released by "delete_volume" :: held 1.830s {{(pid=92060) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 04:46:01 devstack sudo[102178]: pam_unix(sudo:session): session closed for user root Jun 17 04:46:01 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-23ca48e8-9fac-4c68-9f65-c0619f4d5012 tempest-AttachVolumeNegativeTest-991296233 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-4b541ff9-3359-453a-99e0-e6cb6131f0c3 1073741824" returned: 0 in 1.124s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:46:01 devstack cinder-volume[92060]: DEBUG cinder.quota [None req-f3c895cb-9238-40be-9293-56524eb7f3bd tempest-VolumesGetTest-1816202824 None] Created reservations ['ac291af6-0c21-4947-bc38-4b3f4ec9ca93', '7705e358-a4c9-4746-82ac-0dad60e15e09', 'ed743c7f-110e-4860-96a6-840cd9ef38fe', 'a5bde946-a1cc-48fa-acc8-33b4bda26cbe'] {{(pid=92060) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 17 04:46:01 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-23ca48e8-9fac-4c68-9f65-c0619f4d5012 tempest-AttachVolumeNegativeTest-991296233 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-4b541ff9-3359-453a-99e0-e6cb6131f0c3 {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:46:01 devstack sudo[102259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-4b541ff9-3359-453a-99e0-e6cb6131f0c3 Jun 17 04:46:01 devstack sudo[102259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:46:01 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-f3c895cb-9238-40be-9293-56524eb7f3bd tempest-VolumesGetTest-1816202824 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 04:46:01 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-f3c895cb-9238-40be-9293-56524eb7f3bd tempest-VolumesGetTest-1816202824 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 04:46:01 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-f3c895cb-9238-40be-9293-56524eb7f3bd tempest-VolumesGetTest-1816202824 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588': None} {{(pid=92060) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 17 04:46:01 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-f3c895cb-9238-40be-9293-56524eb7f3bd tempest-VolumesGetTest-1816202824 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588'] {{(pid=92060) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 17 04:46:01 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-f3c895cb-9238-40be-9293-56524eb7f3bd tempest-VolumesGetTest-1816202824 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 04:46:01 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-f3c895cb-9238-40be-9293-56524eb7f3bd tempest-VolumesGetTest-1816202824 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:46:01 devstack sudo[102574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a Jun 17 04:46:01 devstack sudo[102574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:46:02 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-75cc42b3-92f5-4738-9435-25dba5a72997 tempest-VolumesGetTest-1816202824 None] Acquiring lock "cinder-7051f8fe-8c9f-4c83-b7e5-8a19a898cfcf-delete_volume" by "delete_volume" {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 04:46:02 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-75cc42b3-92f5-4738-9435-25dba5a72997 tempest-VolumesGetTest-1816202824 None] Lock "cinder-7051f8fe-8c9f-4c83-b7e5-8a19a898cfcf-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 04:46:02 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-75cc42b3-92f5-4738-9435-25dba5a72997 tempest-VolumesGetTest-1816202824 None] Acquiring lock "cinder-quobyte-7051f8fe-8c9f-4c83-b7e5-8a19a898cfcf" by "delete_volume" {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 04:46:02 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-75cc42b3-92f5-4738-9435-25dba5a72997 tempest-VolumesGetTest-1816202824 None] Lock "cinder-quobyte-7051f8fe-8c9f-4c83-b7e5-8a19a898cfcf" acquired by "delete_volume" :: waited 0.023s {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 04:46:02 devstack cinder-volume[92060]: DEBUG oslo.privsep.daemon [-] privsep: reply[68412046-0c3f-467b-b445-f22afa8547ee]: (4, 'qcow2') {{(pid=93130) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 04:46:02 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-75cc42b3-92f5-4738-9435-25dba5a72997 tempest-VolumesGetTest-1816202824 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-7051f8fe-8c9f-4c83-b7e5-8a19a898cfcf {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:46:02 devstack sudo[102578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-7051f8fe-8c9f-4c83-b7e5-8a19a898cfcf Jun 17 04:46:02 devstack sudo[102578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:46:02 devstack sudo[102259]: pam_unix(sudo:session): session closed for user root Jun 17 04:46:02 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-23ca48e8-9fac-4c68-9f65-c0619f4d5012 tempest-AttachVolumeNegativeTest-991296233 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-4b541ff9-3359-453a-99e0-e6cb6131f0c3" returned: 0 in 0.885s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:46:02 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-23ca48e8-9fac-4c68-9f65-c0619f4d5012 tempest-AttachVolumeNegativeTest-991296233 None] <== create_volume: return (2079ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588'} {{(pid=92060) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 17 04:46:02 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-23ca48e8-9fac-4c68-9f65-c0619f4d5012 tempest-AttachVolumeNegativeTest-991296233 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.088s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 04:46:02 devstack sudo[102574]: pam_unix(sudo:session): session closed for user root Jun 17 04:46:02 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-23ca48e8-9fac-4c68-9f65-c0619f4d5012 tempest-AttachVolumeNegativeTest-991296233 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aea02d7b-0712-4ca8-8e0e-50f54c3a5f79) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4b541ff9-3359-453a-99e0-e6cb6131f0c3', 'volume_size': 1}' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:46:02 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-23ca48e8-9fac-4c68-9f65-c0619f4d5012 tempest-AttachVolumeNegativeTest-991296233 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b3a3c8e2-fdb3-45a2-8ae2-c8154cdd849e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:46:02 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-f3c895cb-9238-40be-9293-56524eb7f3bd tempest-VolumesGetTest-1816202824 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a" returned: 0 in 0.837s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:46:02 devstack cinder-volume[92060]: DEBUG cinder.manager [None req-f3c895cb-9238-40be-9293-56524eb7f3bd tempest-VolumesGetTest-1816202824 None] Notifying Schedulers of capabilities ... {{(pid=92060) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 17 04:46:02 devstack cinder-volume[92060]: INFO cinder.volume.manager [None req-f3c895cb-9238-40be-9293-56524eb7f3bd tempest-VolumesGetTest-1816202824 None] Deleted volume successfully. Jun 17 04:46:02 devstack cinder-volume[92060]: INFO cinder.volume.flows.manager.create_volume [None req-23ca48e8-9fac-4c68-9f65-c0619f4d5012 tempest-AttachVolumeNegativeTest-991296233 None] Volume volume-4b541ff9-3359-453a-99e0-e6cb6131f0c3 (4b541ff9-3359-453a-99e0-e6cb6131f0c3): created successfully Jun 17 04:46:02 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-23ca48e8-9fac-4c68-9f65-c0619f4d5012 tempest-AttachVolumeNegativeTest-991296233 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b3a3c8e2-fdb3-45a2-8ae2-c8154cdd849e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:46:02 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-23ca48e8-9fac-4c68-9f65-c0619f4d5012 tempest-AttachVolumeNegativeTest-991296233 None] Flow 'volume_create_manager' (e1faf0ad-3c1d-4b34-99b8-4fd32ad6e488) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92060) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 17 04:46:02 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-f3c895cb-9238-40be-9293-56524eb7f3bd tempest-VolumesGetTest-1816202824 None] Lock "cinder-62250f3f-837c-4fa5-9a78-bce1fb63fe53-delete_volume" released by "delete_volume" :: held 2.978s {{(pid=92060) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 04:46:02 devstack cinder-volume[92060]: INFO cinder.volume.manager [None req-23ca48e8-9fac-4c68-9f65-c0619f4d5012 tempest-AttachVolumeNegativeTest-991296233 None] Created volume successfully. Jun 17 04:46:03 devstack sudo[102578]: pam_unix(sudo:session): session closed for user root Jun 17 04:46:03 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-75cc42b3-92f5-4738-9435-25dba5a72997 tempest-VolumesGetTest-1816202824 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-7051f8fe-8c9f-4c83-b7e5-8a19a898cfcf" returned: 0 in 0.825s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:46:03 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-75cc42b3-92f5-4738-9435-25dba5a72997 tempest-VolumesGetTest-1816202824 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-7051f8fe-8c9f-4c83-b7e5-8a19a898cfcf {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:46:03 devstack sudo[102585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-7051f8fe-8c9f-4c83-b7e5-8a19a898cfcf Jun 17 04:46:03 devstack sudo[102585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:46:03 devstack sudo[102585]: pam_unix(sudo:session): session closed for user root Jun 17 04:46:03 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-75cc42b3-92f5-4738-9435-25dba5a72997 tempest-VolumesGetTest-1816202824 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-7051f8fe-8c9f-4c83-b7e5-8a19a898cfcf" returned: 0 in 0.655s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:46:03 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-75cc42b3-92f5-4738-9435-25dba5a72997 tempest-VolumesGetTest-1816202824 None] Lock "cinder-quobyte-7051f8fe-8c9f-4c83-b7e5-8a19a898cfcf" released by "delete_volume" :: held 1.559s {{(pid=92060) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 04:46:03 devstack cinder-volume[92060]: DEBUG cinder.quota [None req-75cc42b3-92f5-4738-9435-25dba5a72997 tempest-VolumesGetTest-1816202824 None] Created reservations ['8fd7de04-7e48-46d1-b968-42f75bd4acf8', '2027fb71-d8f2-451f-bea5-1582729dd6d4', '2e80368a-383b-4507-be01-bcfd2b270e68', 'a08c6144-383d-4cda-bc6f-ba9a66be6183'] {{(pid=92060) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 17 04:46:04 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-75cc42b3-92f5-4738-9435-25dba5a72997 tempest-VolumesGetTest-1816202824 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 04:46:04 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-75cc42b3-92f5-4738-9435-25dba5a72997 tempest-VolumesGetTest-1816202824 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 04:46:04 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-75cc42b3-92f5-4738-9435-25dba5a72997 tempest-VolumesGetTest-1816202824 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588': None} {{(pid=92060) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 17 04:46:04 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-75cc42b3-92f5-4738-9435-25dba5a72997 tempest-VolumesGetTest-1816202824 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588'] {{(pid=92060) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 17 04:46:04 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-75cc42b3-92f5-4738-9435-25dba5a72997 tempest-VolumesGetTest-1816202824 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 04:46:04 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-75cc42b3-92f5-4738-9435-25dba5a72997 tempest-VolumesGetTest-1816202824 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:46:04 devstack sudo[102588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a Jun 17 04:46:04 devstack sudo[102588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:46:04 devstack sudo[102588]: pam_unix(sudo:session): session closed for user root Jun 17 04:46:04 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-75cc42b3-92f5-4738-9435-25dba5a72997 tempest-VolumesGetTest-1816202824 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a" returned: 0 in 0.612s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:46:04 devstack cinder-volume[92060]: DEBUG cinder.manager [None req-75cc42b3-92f5-4738-9435-25dba5a72997 tempest-VolumesGetTest-1816202824 None] Notifying Schedulers of capabilities ... {{(pid=92060) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 17 04:46:04 devstack cinder-volume[92060]: INFO cinder.volume.manager [None req-75cc42b3-92f5-4738-9435-25dba5a72997 tempest-VolumesGetTest-1816202824 None] Deleted volume successfully. Jun 17 04:46:04 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-75cc42b3-92f5-4738-9435-25dba5a72997 tempest-VolumesGetTest-1816202824 None] Lock "cinder-7051f8fe-8c9f-4c83-b7e5-8a19a898cfcf-delete_volume" released by "delete_volume" :: held 2.417s {{(pid=92060) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 04:46:05 devstack cinder-volume[92060]: DEBUG cinder.volume.flows.manager.create_volume [None req-2482824e-0b2a-4f7a-a6d9-a3f227046e46 tempest-VolumesGetTest-1816202824 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92060) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 17 04:46:05 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-2482824e-0b2a-4f7a-a6d9-a3f227046e46 tempest-VolumesGetTest-1816202824 None] Flow 'volume_create_manager' (00c22599-9756-4d48-94bb-f08f2e008a47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 17 04:46:05 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-2482824e-0b2a-4f7a-a6d9-a3f227046e46 tempest-VolumesGetTest-1816202824 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e9140cde-13e9-431b-9739-d7338fda53fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:46:05 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-2482824e-0b2a-4f7a-a6d9-a3f227046e46 tempest-VolumesGetTest-1816202824 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e9140cde-13e9-431b-9739-d7338fda53fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-17T02:46:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1330630535',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=47ff51ac-e15c-4372-a7b4-1453726ab716,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='c94fdcfcea4840c2a1e58688ac864031',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T02:46:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T02:46:06Z,use_quota=True,user_id='f5c2a6062921435dac6f9e70bb79370a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aad9ce24-93f9-41a6-baa1-5125964f96d1),volume_type_id=aad9ce24-93f9-41a6-baa1-5125964f96d1)' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:46:05 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-2482824e-0b2a-4f7a-a6d9-a3f227046e46 tempest-VolumesGetTest-1816202824 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dd5e6828-cce9-4dcb-bbc0-bfe27ddbe155) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:46:05 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-2482824e-0b2a-4f7a-a6d9-a3f227046e46 tempest-VolumesGetTest-1816202824 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dd5e6828-cce9-4dcb-bbc0-bfe27ddbe155) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:46:05 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-2482824e-0b2a-4f7a-a6d9-a3f227046e46 tempest-VolumesGetTest-1816202824 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (56397b6a-f1de-4e21-b2cc-b1a30838f6a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:46:05 devstack cinder-volume[92060]: DEBUG cinder.image.glance [None req-2482824e-0b2a-4f7a-a6d9-a3f227046e46 tempest-VolumesGetTest-1816202824 None] Creating Keystone auth plugin from conf {{(pid=92060) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jun 17 04:46:05 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-2482824e-0b2a-4f7a-a6d9-a3f227046e46 tempest-VolumesGetTest-1816202824 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (56397b6a-f1de-4e21-b2cc-b1a30838f6a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '47ff51ac-e15c-4372-a7b4-1453726ab716', 'volume_name': 'volume-47ff51ac-e15c-4372-a7b4-1453726ab716', 'volume_size': 1, 'image_id': '5abcba5c-72fa-4ea5-881e-1f4f187259a5', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/5abcba5c-72fa-4ea5-881e-1f4f187259a5', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'ec7d18cca2734755a53ee22ace21508e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '5abcba5c-72fa-4ea5-881e-1f4f187259a5', 'created_at': datetime.datetime(2026, 6, 17, 2, 29, 47, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 17, 2, 29, 49, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/5abcba5c-72fa-4ea5-881e-1f4f187259a5/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:46:05 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-2482824e-0b2a-4f7a-a6d9-a3f227046e46 tempest-VolumesGetTest-1816202824 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3fd6015e-1815-4a1f-aae9-e512c1cf0ae0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:46:05 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-2482824e-0b2a-4f7a-a6d9-a3f227046e46 tempest-VolumesGetTest-1816202824 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3fd6015e-1815-4a1f-aae9-e512c1cf0ae0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:46:05 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-2482824e-0b2a-4f7a-a6d9-a3f227046e46 tempest-VolumesGetTest-1816202824 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (956130dd-3f43-4608-8130-5134e6f2694c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:46:05 devstack cinder-volume[92060]: INFO cinder.volume.flows.manager.create_volume [None req-2482824e-0b2a-4f7a-a6d9-a3f227046e46 tempest-VolumesGetTest-1816202824 None] Volume 47ff51ac-e15c-4372-a7b4-1453726ab716: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-47ff51ac-e15c-4372-a7b4-1453726ab716', 'volume_size': 1, 'image_id': '5abcba5c-72fa-4ea5-881e-1f4f187259a5', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/5abcba5c-72fa-4ea5-881e-1f4f187259a5', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'ec7d18cca2734755a53ee22ace21508e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '5abcba5c-72fa-4ea5-881e-1f4f187259a5', 'created_at': datetime.datetime(2026, 6, 17, 2, 29, 47, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 17, 2, 29, 49, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/5abcba5c-72fa-4ea5-881e-1f4f187259a5/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jun 17 04:46:05 devstack cinder-volume[92060]: DEBUG cinder.volume.flows.manager.create_volume [None req-2482824e-0b2a-4f7a-a6d9-a3f227046e46 tempest-VolumesGetTest-1816202824 None] Trying to clone 47ff51ac-e15c-4372-a7b4-1453726ab716 from image 5abcba5c-72fa-4ea5-881e-1f4f187259a5 at location (None, [{'url': 'file:///opt/stack/data/glance/images/5abcba5c-72fa-4ea5-881e-1f4f187259a5', 'metadata': {}}]). {{(pid=92060) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jun 17 04:46:06 devstack cinder-volume[92060]: DEBUG cinder.image.image_utils [None req-2482824e-0b2a-4f7a-a6d9-a3f227046e46 tempest-VolumesGetTest-1816202824 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_5abcba5c-72fa-4ea5-881e-1f4f187259a5_tl24_31adevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=92060) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jun 17 04:46:06 devstack cinder-volume[92060]: INFO cinder.image.image_utils [None req-2482824e-0b2a-4f7a-a6d9-a3f227046e46 tempest-VolumesGetTest-1816202824 None] Image download 20.69 MB at 20.69 MB/s Jun 17 04:46:06 devstack cinder-volume[92060]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c300ce1-ecd6-4a83-8d07-2bcd77bc64be]: (4, 'qcow2') {{(pid=93130) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 04:46:06 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-2482824e-0b2a-4f7a-a6d9-a3f227046e46 tempest-VolumesGetTest-1816202824 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5abcba5c-72fa-4ea5-881e-1f4f187259a5_tl24_31adevstack@QuobyteHD {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:46:06 devstack sudo[102594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5abcba5c-72fa-4ea5-881e-1f4f187259a5_tl24_31adevstack@QuobyteHD Jun 17 04:46:06 devstack sudo[102594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:46:06 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [req-4e63a6fa-56bc-4a9f-bfea-2a02045de481 req-36b93a98-6bb5-4277-abdd-3418942be314 tempest-AttachVolumeNegativeTest-991296233 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 04:46:06 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [req-4e63a6fa-56bc-4a9f-bfea-2a02045de481 req-36b93a98-6bb5-4277-abdd-3418942be314 tempest-AttachVolumeNegativeTest-991296233 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 04:46:06 devstack cinder-volume[92060]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6607124-25d1-42f7-a03e-ea46a8bad911]: (4, 'qcow2') {{(pid=93130) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 04:46:06 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [req-4e63a6fa-56bc-4a9f-bfea-2a02045de481 req-36b93a98-6bb5-4277-abdd-3418942be314 tempest-AttachVolumeNegativeTest-991296233 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-4b541ff9-3359-453a-99e0-e6cb6131f0c3 {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:46:07 devstack sudo[102604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-4b541ff9-3359-453a-99e0-e6cb6131f0c3 Jun 17 04:46:07 devstack sudo[102604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:46:07 devstack sudo[102594]: pam_unix(sudo:session): session closed for user root Jun 17 04:46:07 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-2482824e-0b2a-4f7a-a6d9-a3f227046e46 tempest-VolumesGetTest-1816202824 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5abcba5c-72fa-4ea5-881e-1f4f187259a5_tl24_31adevstack@QuobyteHD" returned: 0 in 0.822s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:46:07 devstack cinder-volume[92060]: DEBUG cinder.image.image_utils [None req-2482824e-0b2a-4f7a-a6d9-a3f227046e46 tempest-VolumesGetTest-1816202824 None] Temporary image 5abcba5c-72fa-4ea5-881e-1f4f187259a5 is fetched for user f5c2a6062921435dac6f9e70bb79370a. {{(pid=92060) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jun 17 04:46:07 devstack cinder-volume[92060]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1aff036-06ec-4197-a44a-50a5edb51059]: (4, 'qcow2') {{(pid=93130) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 04:46:07 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-2482824e-0b2a-4f7a-a6d9-a3f227046e46 tempest-VolumesGetTest-1816202824 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5abcba5c-72fa-4ea5-881e-1f4f187259a5_tl24_31adevstack@QuobyteHD {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:46:07 devstack sudo[102610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5abcba5c-72fa-4ea5-881e-1f4f187259a5_tl24_31adevstack@QuobyteHD Jun 17 04:46:07 devstack sudo[102610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:46:07 devstack sudo[102604]: pam_unix(sudo:session): session closed for user root Jun 17 04:46:07 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [req-4e63a6fa-56bc-4a9f-bfea-2a02045de481 req-36b93a98-6bb5-4277-abdd-3418942be314 tempest-AttachVolumeNegativeTest-991296233 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-4b541ff9-3359-453a-99e0-e6cb6131f0c3" returned: 0 in 0.910s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:46:07 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [req-4e63a6fa-56bc-4a9f-bfea-2a02045de481 req-36b93a98-6bb5-4277-abdd-3418942be314 tempest-AttachVolumeNegativeTest-991296233 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.942s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 04:46:07 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [req-4e63a6fa-56bc-4a9f-bfea-2a02045de481 req-36b93a98-6bb5-4277-abdd-3418942be314 tempest-AttachVolumeNegativeTest-991296233 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588', 'name': 'volume-4b541ff9-3359-453a-99e0-e6cb6131f0c3', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'ca4118ed-9b7c-48d0-9f45-55c06ba8f118', 'enforce_multipath': True} {{(pid=92060) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 17 04:46:08 devstack cinder-volume[92060]: INFO cinder.volume.manager [req-4e63a6fa-56bc-4a9f-bfea-2a02045de481 req-36b93a98-6bb5-4277-abdd-3418942be314 tempest-AttachVolumeNegativeTest-991296233 None] attachment_update completed successfully. Jun 17 04:46:08 devstack sudo[102610]: pam_unix(sudo:session): session closed for user root Jun 17 04:46:08 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-2482824e-0b2a-4f7a-a6d9-a3f227046e46 tempest-VolumesGetTest-1816202824 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5abcba5c-72fa-4ea5-881e-1f4f187259a5_tl24_31adevstack@QuobyteHD" returned: 0 in 0.890s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:46:08 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-2482824e-0b2a-4f7a-a6d9-a3f227046e46 tempest-VolumesGetTest-1816202824 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 04:46:08 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-2482824e-0b2a-4f7a-a6d9-a3f227046e46 tempest-VolumesGetTest-1816202824 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 04:46:08 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-2482824e-0b2a-4f7a-a6d9-a3f227046e46 tempest-VolumesGetTest-1816202824 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-17T02:46:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1330630535',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=47ff51ac-e15c-4372-a7b4-1453726ab716,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='c94fdcfcea4840c2a1e58688ac864031',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T02:46:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T02:46:06Z,use_quota=True,user_id='f5c2a6062921435dac6f9e70bb79370a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aad9ce24-93f9-41a6-baa1-5125964f96d1),volume_type_id=aad9ce24-93f9-41a6-baa1-5125964f96d1)}" {{(pid=92060) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 17 04:46:08 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.remotefs [None req-2482824e-0b2a-4f7a-a6d9-a3f227046e46 tempest-VolumesGetTest-1816202824 None] Creating volume 47ff51ac-e15c-4372-a7b4-1453726ab716 {{(pid=92060) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 17 04:46:08 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-2482824e-0b2a-4f7a-a6d9-a3f227046e46 tempest-VolumesGetTest-1816202824 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 04:46:08 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-2482824e-0b2a-4f7a-a6d9-a3f227046e46 tempest-VolumesGetTest-1816202824 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 04:46:08 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-2482824e-0b2a-4f7a-a6d9-a3f227046e46 tempest-VolumesGetTest-1816202824 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588': None} {{(pid=92060) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 17 04:46:08 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-2482824e-0b2a-4f7a-a6d9-a3f227046e46 tempest-VolumesGetTest-1816202824 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588'] {{(pid=92060) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 17 04:46:08 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-2482824e-0b2a-4f7a-a6d9-a3f227046e46 tempest-VolumesGetTest-1816202824 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 04:46:08 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-2482824e-0b2a-4f7a-a6d9-a3f227046e46 tempest-VolumesGetTest-1816202824 None] Selected osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588 as target Quobyte volume. {{(pid=92060) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 17 04:46:08 devstack cinder-volume[92060]: INFO cinder.volume.drivers.remotefs [None req-2482824e-0b2a-4f7a-a6d9-a3f227046e46 tempest-VolumesGetTest-1816202824 None] casted to osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588 Jun 17 04:46:08 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-2482824e-0b2a-4f7a-a6d9-a3f227046e46 tempest-VolumesGetTest-1816202824 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-47ff51ac-e15c-4372-a7b4-1453726ab716 1073741824 {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:46:08 devstack sudo[102624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-47ff51ac-e15c-4372-a7b4-1453726ab716 1073741824 Jun 17 04:46:08 devstack sudo[102624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:46:09 devstack sudo[102624]: pam_unix(sudo:session): session closed for user root Jun 17 04:46:09 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-2482824e-0b2a-4f7a-a6d9-a3f227046e46 tempest-VolumesGetTest-1816202824 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-47ff51ac-e15c-4372-a7b4-1453726ab716 1073741824" returned: 0 in 0.868s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:46:09 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-2482824e-0b2a-4f7a-a6d9-a3f227046e46 tempest-VolumesGetTest-1816202824 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-47ff51ac-e15c-4372-a7b4-1453726ab716 {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:46:09 devstack sudo[102633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-47ff51ac-e15c-4372-a7b4-1453726ab716 Jun 17 04:46:09 devstack sudo[102633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:46:09 devstack sudo[102633]: pam_unix(sudo:session): session closed for user root Jun 17 04:46:09 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-2482824e-0b2a-4f7a-a6d9-a3f227046e46 tempest-VolumesGetTest-1816202824 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-47ff51ac-e15c-4372-a7b4-1453726ab716" returned: 0 in 0.627s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:46:09 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-2482824e-0b2a-4f7a-a6d9-a3f227046e46 tempest-VolumesGetTest-1816202824 None] <== create_volume: return (1546ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588'} {{(pid=92060) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 17 04:46:09 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-2482824e-0b2a-4f7a-a6d9-a3f227046e46 tempest-VolumesGetTest-1816202824 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.555s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 04:46:09 devstack cinder-volume[92060]: DEBUG cinder.volume.volume_utils [None req-2482824e-0b2a-4f7a-a6d9-a3f227046e46 tempest-VolumesGetTest-1816202824 None] Attempting download of 5abcba5c-72fa-4ea5-881e-1f4f187259a5 ((None, [{'url': 'file:///opt/stack/data/glance/images/5abcba5c-72fa-4ea5-881e-1f4f187259a5', 'metadata': {}}])) to volume 47ff51ac-e15c-4372-a7b4-1453726ab716. {{(pid=92060) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jun 17 04:46:09 devstack cinder-volume[92060]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b03ec8b-7701-486d-8e68-a8302a0f2f0b]: (4, 'raw') {{(pid=93130) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 04:46:09 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-2482824e-0b2a-4f7a-a6d9-a3f227046e46 tempest-VolumesGetTest-1816202824 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_5abcba5c-72fa-4ea5-881e-1f4f187259a5_o3s__4ze {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:46:10 devstack sudo[102637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_5abcba5c-72fa-4ea5-881e-1f4f187259a5_o3s__4ze Jun 17 04:46:10 devstack sudo[102637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:46:10 devstack sudo[102637]: pam_unix(sudo:session): session closed for user root Jun 17 04:46:10 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-2482824e-0b2a-4f7a-a6d9-a3f227046e46 tempest-VolumesGetTest-1816202824 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_5abcba5c-72fa-4ea5-881e-1f4f187259a5_o3s__4ze" returned: 0 in 0.726s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:46:10 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-2482824e-0b2a-4f7a-a6d9-a3f227046e46 tempest-VolumesGetTest-1816202824 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5abcba5c-72fa-4ea5-881e-1f4f187259a5_o3s__4ze {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:46:10 devstack sudo[102641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5abcba5c-72fa-4ea5-881e-1f4f187259a5_o3s__4ze Jun 17 04:46:10 devstack sudo[102641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:46:11 devstack sudo[102641]: pam_unix(sudo:session): session closed for user root Jun 17 04:46:11 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-2482824e-0b2a-4f7a-a6d9-a3f227046e46 tempest-VolumesGetTest-1816202824 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5abcba5c-72fa-4ea5-881e-1f4f187259a5_o3s__4ze" returned: 1 in 0.870s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:46:11 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-2482824e-0b2a-4f7a-a6d9-a3f227046e46 tempest-VolumesGetTest-1816202824 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5abcba5c-72fa-4ea5-881e-1f4f187259a5_o3s__4ze' failed. Not Retrying. {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 17 04:46:11 devstack cinder-volume[92060]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f0cbc3d-54bf-42d2-b04a-8e75005a8c46]: (4, 'qcow2') {{(pid=93130) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 04:46:11 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-2482824e-0b2a-4f7a-a6d9-a3f227046e46 tempest-VolumesGetTest-1816202824 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5abcba5c-72fa-4ea5-881e-1f4f187259a5_tl24_31adevstack@QuobyteHD {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:46:11 devstack sudo[102646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5abcba5c-72fa-4ea5-881e-1f4f187259a5_tl24_31adevstack@QuobyteHD Jun 17 04:46:11 devstack sudo[102646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:46:12 devstack sudo[102646]: pam_unix(sudo:session): session closed for user root Jun 17 04:46:12 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-2482824e-0b2a-4f7a-a6d9-a3f227046e46 tempest-VolumesGetTest-1816202824 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5abcba5c-72fa-4ea5-881e-1f4f187259a5_tl24_31adevstack@QuobyteHD" returned: 0 in 0.863s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:46:12 devstack cinder-volume[92060]: DEBUG cinder.image.image_utils [None req-2482824e-0b2a-4f7a-a6d9-a3f227046e46 tempest-VolumesGetTest-1816202824 None] 5abcba5c-72fa-4ea5-881e-1f4f187259a5 was qcow2, converting to raw {{(pid=92060) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jun 17 04:46:12 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-2482824e-0b2a-4f7a-a6d9-a3f227046e46 tempest-VolumesGetTest-1816202824 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_5abcba5c-72fa-4ea5-881e-1f4f187259a5_tl24_31adevstack@QuobyteHD /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-47ff51ac-e15c-4372-a7b4-1453726ab716 {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:46:12 devstack sudo[102651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_5abcba5c-72fa-4ea5-881e-1f4f187259a5_tl24_31adevstack@QuobyteHD /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-47ff51ac-e15c-4372-a7b4-1453726ab716 Jun 17 04:46:12 devstack sudo[102651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:46:14 devstack sudo[102651]: pam_unix(sudo:session): session closed for user root Jun 17 04:46:14 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-2482824e-0b2a-4f7a-a6d9-a3f227046e46 tempest-VolumesGetTest-1816202824 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_5abcba5c-72fa-4ea5-881e-1f4f187259a5_tl24_31adevstack@QuobyteHD /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-47ff51ac-e15c-4372-a7b4-1453726ab716" returned: 0 in 2.521s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:46:14 devstack cinder-volume[92060]: DEBUG cinder.image.image_utils [None req-2482824e-0b2a-4f7a-a6d9-a3f227046e46 tempest-VolumesGetTest-1816202824 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_5abcba5c-72fa-4ea5-881e-1f4f187259a5_tl24_31adevstack@QuobyteHD, size 112.00 MB, duration 2.52 sec, destination /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-47ff51ac-e15c-4372-a7b4-1453726ab716 {{(pid=92060) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 17 04:46:14 devstack cinder-volume[92060]: INFO cinder.image.image_utils [None req-2482824e-0b2a-4f7a-a6d9-a3f227046e46 tempest-VolumesGetTest-1816202824 None] Converted 112.00 MB image at 44.39 MB/s Jun 17 04:46:14 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-2482824e-0b2a-4f7a-a6d9-a3f227046e46 tempest-VolumesGetTest-1816202824 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-47ff51ac-e15c-4372-a7b4-1453726ab716 1G {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:46:14 devstack sudo[102687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-47ff51ac-e15c-4372-a7b4-1453726ab716 1G Jun 17 04:46:14 devstack sudo[102687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:46:15 devstack sudo[102687]: pam_unix(sudo:session): session closed for user root Jun 17 04:46:15 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-2482824e-0b2a-4f7a-a6d9-a3f227046e46 tempest-VolumesGetTest-1816202824 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-47ff51ac-e15c-4372-a7b4-1453726ab716 1G" returned: 0 in 0.704s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:46:15 devstack cinder-volume[92060]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1408eef-8841-443d-85e7-6f0d6feac7fc]: (4, 'raw') {{(pid=93130) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 04:46:15 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-2482824e-0b2a-4f7a-a6d9-a3f227046e46 tempest-VolumesGetTest-1816202824 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-47ff51ac-e15c-4372-a7b4-1453726ab716 {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:46:15 devstack sudo[102692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-47ff51ac-e15c-4372-a7b4-1453726ab716 Jun 17 04:46:15 devstack sudo[102692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:46:16 devstack sudo[102692]: pam_unix(sudo:session): session closed for user root Jun 17 04:46:16 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-2482824e-0b2a-4f7a-a6d9-a3f227046e46 tempest-VolumesGetTest-1816202824 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-47ff51ac-e15c-4372-a7b4-1453726ab716" returned: 0 in 0.973s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:46:16 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-2482824e-0b2a-4f7a-a6d9-a3f227046e46 tempest-VolumesGetTest-1816202824 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-47ff51ac-e15c-4372-a7b4-1453726ab716 {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:46:16 devstack sudo[102701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-47ff51ac-e15c-4372-a7b4-1453726ab716 Jun 17 04:46:16 devstack sudo[102701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:46:17 devstack sudo[102701]: pam_unix(sudo:session): session closed for user root Jun 17 04:46:17 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-2482824e-0b2a-4f7a-a6d9-a3f227046e46 tempest-VolumesGetTest-1816202824 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-47ff51ac-e15c-4372-a7b4-1453726ab716" returned: 1 in 0.751s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:46:17 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-2482824e-0b2a-4f7a-a6d9-a3f227046e46 tempest-VolumesGetTest-1816202824 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-47ff51ac-e15c-4372-a7b4-1453726ab716' failed. Not Retrying. {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 17 04:46:17 devstack cinder-volume[92060]: DEBUG cinder.volume.volume_utils [None req-2482824e-0b2a-4f7a-a6d9-a3f227046e46 tempest-VolumesGetTest-1816202824 None] Downloaded image 5abcba5c-72fa-4ea5-881e-1f4f187259a5 ((None, [{'url': 'file:///opt/stack/data/glance/images/5abcba5c-72fa-4ea5-881e-1f4f187259a5', 'metadata': {}}])) to volume 47ff51ac-e15c-4372-a7b4-1453726ab716 successfully. {{(pid=92060) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jun 17 04:46:17 devstack cinder-volume[92060]: DEBUG cinder.image.image_utils [None req-2482824e-0b2a-4f7a-a6d9-a3f227046e46 tempest-VolumesGetTest-1816202824 None] Temporary image 5abcba5c-72fa-4ea5-881e-1f4f187259a5 for user f5c2a6062921435dac6f9e70bb79370a is deleted. {{(pid=92060) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jun 17 04:46:17 devstack cinder-volume[92060]: DEBUG cinder.volume.volume_utils [None req-2482824e-0b2a-4f7a-a6d9-a3f227046e46 tempest-VolumesGetTest-1816202824 None] Marking volume 47ff51ac-e15c-4372-a7b4-1453726ab716 as bootable. {{(pid=92060) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jun 17 04:46:17 devstack cinder-volume[92060]: DEBUG cinder.volume.flows.manager.create_volume [None req-2482824e-0b2a-4f7a-a6d9-a3f227046e46 tempest-VolumesGetTest-1816202824 None] Copying metadata from image 5abcba5c-72fa-4ea5-881e-1f4f187259a5 to 47ff51ac-e15c-4372-a7b4-1453726ab716. {{(pid=92060) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jun 17 04:46:17 devstack cinder-volume[92060]: DEBUG cinder.volume.flows.manager.create_volume [None req-2482824e-0b2a-4f7a-a6d9-a3f227046e46 tempest-VolumesGetTest-1816202824 None] Creating volume glance metadata for volume 47ff51ac-e15c-4372-a7b4-1453726ab716 backed by image 5abcba5c-72fa-4ea5-881e-1f4f187259a5 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '5abcba5c-72fa-4ea5-881e-1f4f187259a5', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=92060) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jun 17 04:46:17 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-2482824e-0b2a-4f7a-a6d9-a3f227046e46 tempest-VolumesGetTest-1816202824 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (956130dd-3f43-4608-8130-5134e6f2694c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-47ff51ac-e15c-4372-a7b4-1453726ab716', 'volume_size': 1, 'image_id': '5abcba5c-72fa-4ea5-881e-1f4f187259a5', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/5abcba5c-72fa-4ea5-881e-1f4f187259a5', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'ec7d18cca2734755a53ee22ace21508e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '5abcba5c-72fa-4ea5-881e-1f4f187259a5', 'created_at': datetime.datetime(2026, 6, 17, 2, 29, 47, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 17, 2, 29, 49, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/5abcba5c-72fa-4ea5-881e-1f4f187259a5/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:46:17 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-2482824e-0b2a-4f7a-a6d9-a3f227046e46 tempest-VolumesGetTest-1816202824 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (450445cf-b57e-4807-af50-e6e6da179b41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:46:17 devstack cinder-volume[92060]: INFO cinder.volume.flows.manager.create_volume [None req-2482824e-0b2a-4f7a-a6d9-a3f227046e46 tempest-VolumesGetTest-1816202824 None] Volume volume-47ff51ac-e15c-4372-a7b4-1453726ab716 (47ff51ac-e15c-4372-a7b4-1453726ab716): created successfully Jun 17 04:46:17 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-2482824e-0b2a-4f7a-a6d9-a3f227046e46 tempest-VolumesGetTest-1816202824 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (450445cf-b57e-4807-af50-e6e6da179b41) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:46:17 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-2482824e-0b2a-4f7a-a6d9-a3f227046e46 tempest-VolumesGetTest-1816202824 None] Flow 'volume_create_manager' (00c22599-9756-4d48-94bb-f08f2e008a47) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92060) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 17 04:46:17 devstack cinder-volume[92060]: INFO cinder.volume.manager [None req-2482824e-0b2a-4f7a-a6d9-a3f227046e46 tempest-VolumesGetTest-1816202824 None] Created volume successfully. Jun 17 04:46:19 devstack cinder-volume[92060]: DEBUG cinder.volume.flows.manager.create_volume [None req-81d1a66b-7396-44da-ac7b-206f33ee0fe5 tempest-VolumesGetTest-1816202824 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92060) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 17 04:46:19 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-81d1a66b-7396-44da-ac7b-206f33ee0fe5 tempest-VolumesGetTest-1816202824 None] Flow 'volume_create_manager' (197957dd-9d76-4d9b-a546-d0ac2f9bb4bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 17 04:46:19 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-81d1a66b-7396-44da-ac7b-206f33ee0fe5 tempest-VolumesGetTest-1816202824 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9e77ebf5-28ed-4787-9491-95ecb35026e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:46:19 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-81d1a66b-7396-44da-ac7b-206f33ee0fe5 tempest-VolumesGetTest-1816202824 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9e77ebf5-28ed-4787-9491-95ecb35026e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-17T02:46:19Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-604898227',display_name='tempest-VolumesGetTest-Volume-2031242900',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7f2f00a7-00f5-4022-ad68-4189d2889b0c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c94fdcfcea4840c2a1e58688ac864031',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T02:46:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T02:46:20Z,use_quota=True,user_id='f5c2a6062921435dac6f9e70bb79370a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aad9ce24-93f9-41a6-baa1-5125964f96d1),volume_type_id=aad9ce24-93f9-41a6-baa1-5125964f96d1)' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:46:19 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-81d1a66b-7396-44da-ac7b-206f33ee0fe5 tempest-VolumesGetTest-1816202824 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dcd0145a-5429-44b7-b770-555f43febac2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:46:19 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-81d1a66b-7396-44da-ac7b-206f33ee0fe5 tempest-VolumesGetTest-1816202824 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dcd0145a-5429-44b7-b770-555f43febac2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:46:19 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-81d1a66b-7396-44da-ac7b-206f33ee0fe5 tempest-VolumesGetTest-1816202824 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5921b03c-ade9-4753-ba5b-c6066c5780c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:46:19 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-81d1a66b-7396-44da-ac7b-206f33ee0fe5 tempest-VolumesGetTest-1816202824 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5921b03c-ade9-4753-ba5b-c6066c5780c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7f2f00a7-00f5-4022-ad68-4189d2889b0c', 'volume_name': 'volume-7f2f00a7-00f5-4022-ad68-4189d2889b0c', 'volume_size': 1}' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:46:19 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-81d1a66b-7396-44da-ac7b-206f33ee0fe5 tempest-VolumesGetTest-1816202824 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4157f021-8caa-446d-861a-87234aba4b35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:46:19 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-81d1a66b-7396-44da-ac7b-206f33ee0fe5 tempest-VolumesGetTest-1816202824 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4157f021-8caa-446d-861a-87234aba4b35) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:46:19 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-81d1a66b-7396-44da-ac7b-206f33ee0fe5 tempest-VolumesGetTest-1816202824 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8fef0139-1ecb-4fde-94a5-0e9bf6f7efa7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:46:19 devstack cinder-volume[92060]: INFO cinder.volume.flows.manager.create_volume [None req-81d1a66b-7396-44da-ac7b-206f33ee0fe5 tempest-VolumesGetTest-1816202824 None] Volume 7f2f00a7-00f5-4022-ad68-4189d2889b0c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7f2f00a7-00f5-4022-ad68-4189d2889b0c', 'volume_size': 1} Jun 17 04:46:19 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-81d1a66b-7396-44da-ac7b-206f33ee0fe5 tempest-VolumesGetTest-1816202824 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 04:46:19 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-81d1a66b-7396-44da-ac7b-206f33ee0fe5 tempest-VolumesGetTest-1816202824 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 04:46:19 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-81d1a66b-7396-44da-ac7b-206f33ee0fe5 tempest-VolumesGetTest-1816202824 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-17T02:46:19Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-604898227',display_name='tempest-VolumesGetTest-Volume-2031242900',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7f2f00a7-00f5-4022-ad68-4189d2889b0c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c94fdcfcea4840c2a1e58688ac864031',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T02:46:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T02:46:20Z,use_quota=True,user_id='f5c2a6062921435dac6f9e70bb79370a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aad9ce24-93f9-41a6-baa1-5125964f96d1),volume_type_id=aad9ce24-93f9-41a6-baa1-5125964f96d1)}" {{(pid=92060) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 17 04:46:19 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.remotefs [None req-81d1a66b-7396-44da-ac7b-206f33ee0fe5 tempest-VolumesGetTest-1816202824 None] Creating volume 7f2f00a7-00f5-4022-ad68-4189d2889b0c {{(pid=92060) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 17 04:46:19 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-81d1a66b-7396-44da-ac7b-206f33ee0fe5 tempest-VolumesGetTest-1816202824 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 04:46:19 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-81d1a66b-7396-44da-ac7b-206f33ee0fe5 tempest-VolumesGetTest-1816202824 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 04:46:19 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-81d1a66b-7396-44da-ac7b-206f33ee0fe5 tempest-VolumesGetTest-1816202824 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588': None} {{(pid=92060) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 17 04:46:19 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-81d1a66b-7396-44da-ac7b-206f33ee0fe5 tempest-VolumesGetTest-1816202824 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588'] {{(pid=92060) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 17 04:46:19 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-81d1a66b-7396-44da-ac7b-206f33ee0fe5 tempest-VolumesGetTest-1816202824 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 04:46:19 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-81d1a66b-7396-44da-ac7b-206f33ee0fe5 tempest-VolumesGetTest-1816202824 None] Selected osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588 as target Quobyte volume. {{(pid=92060) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 17 04:46:19 devstack cinder-volume[92060]: INFO cinder.volume.drivers.remotefs [None req-81d1a66b-7396-44da-ac7b-206f33ee0fe5 tempest-VolumesGetTest-1816202824 None] casted to osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588 Jun 17 04:46:19 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-81d1a66b-7396-44da-ac7b-206f33ee0fe5 tempest-VolumesGetTest-1816202824 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-7f2f00a7-00f5-4022-ad68-4189d2889b0c 1073741824 {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:46:19 devstack sudo[102806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-7f2f00a7-00f5-4022-ad68-4189d2889b0c 1073741824 Jun 17 04:46:19 devstack sudo[102806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:46:20 devstack sudo[102806]: pam_unix(sudo:session): session closed for user root Jun 17 04:46:20 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-81d1a66b-7396-44da-ac7b-206f33ee0fe5 tempest-VolumesGetTest-1816202824 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-7f2f00a7-00f5-4022-ad68-4189d2889b0c 1073741824" returned: 0 in 1.114s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:46:20 devstack cinder-volume[92060]: DEBUG dbcounter [-] [92060] Writing DB stats cinder:SELECT=63,cinder:UPDATE=63,cinder:INSERT=18,cinder:DELETE=5 {{(pid=92060) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 17 04:46:20 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-81d1a66b-7396-44da-ac7b-206f33ee0fe5 tempest-VolumesGetTest-1816202824 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-7f2f00a7-00f5-4022-ad68-4189d2889b0c {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:46:20 devstack sudo[102813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-7f2f00a7-00f5-4022-ad68-4189d2889b0c Jun 17 04:46:21 devstack sudo[102813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:46:22 devstack sudo[102813]: pam_unix(sudo:session): session closed for user root Jun 17 04:46:22 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-81d1a66b-7396-44da-ac7b-206f33ee0fe5 tempest-VolumesGetTest-1816202824 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-7f2f00a7-00f5-4022-ad68-4189d2889b0c" returned: 0 in 1.086s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:46:22 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-81d1a66b-7396-44da-ac7b-206f33ee0fe5 tempest-VolumesGetTest-1816202824 None] <== create_volume: return (2284ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588'} {{(pid=92060) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 17 04:46:22 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-81d1a66b-7396-44da-ac7b-206f33ee0fe5 tempest-VolumesGetTest-1816202824 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.287s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 04:46:22 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-81d1a66b-7396-44da-ac7b-206f33ee0fe5 tempest-VolumesGetTest-1816202824 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8fef0139-1ecb-4fde-94a5-0e9bf6f7efa7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7f2f00a7-00f5-4022-ad68-4189d2889b0c', 'volume_size': 1}' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:46:22 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-81d1a66b-7396-44da-ac7b-206f33ee0fe5 tempest-VolumesGetTest-1816202824 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7064a7dd-6e0a-4202-93fe-8ebd4b01124e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:46:22 devstack cinder-volume[92060]: INFO cinder.volume.flows.manager.create_volume [None req-81d1a66b-7396-44da-ac7b-206f33ee0fe5 tempest-VolumesGetTest-1816202824 None] Volume volume-7f2f00a7-00f5-4022-ad68-4189d2889b0c (7f2f00a7-00f5-4022-ad68-4189d2889b0c): created successfully Jun 17 04:46:22 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-81d1a66b-7396-44da-ac7b-206f33ee0fe5 tempest-VolumesGetTest-1816202824 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7064a7dd-6e0a-4202-93fe-8ebd4b01124e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:46:22 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-81d1a66b-7396-44da-ac7b-206f33ee0fe5 tempest-VolumesGetTest-1816202824 None] Flow 'volume_create_manager' (197957dd-9d76-4d9b-a546-d0ac2f9bb4bd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92060) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 17 04:46:22 devstack cinder-volume[92060]: INFO cinder.volume.manager [None req-81d1a66b-7396-44da-ac7b-206f33ee0fe5 tempest-VolumesGetTest-1816202824 None] Created volume successfully. Jun 17 04:46:23 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-ae7f972f-9673-4a53-b0f2-4cd4fe3cafed tempest-VolumesGetTest-1816202824 None] Acquiring lock "cinder-7f2f00a7-00f5-4022-ad68-4189d2889b0c-delete_volume" by "delete_volume" {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 04:46:23 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-ae7f972f-9673-4a53-b0f2-4cd4fe3cafed tempest-VolumesGetTest-1816202824 None] Lock "cinder-7f2f00a7-00f5-4022-ad68-4189d2889b0c-delete_volume" acquired by "delete_volume" :: waited 0.120s {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 04:46:23 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-ae7f972f-9673-4a53-b0f2-4cd4fe3cafed tempest-VolumesGetTest-1816202824 None] Acquiring lock "cinder-quobyte-7f2f00a7-00f5-4022-ad68-4189d2889b0c" by "delete_volume" {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 04:46:23 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-ae7f972f-9673-4a53-b0f2-4cd4fe3cafed tempest-VolumesGetTest-1816202824 None] Lock "cinder-quobyte-7f2f00a7-00f5-4022-ad68-4189d2889b0c" acquired by "delete_volume" :: waited 0.041s {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 04:46:23 devstack cinder-volume[92060]: DEBUG oslo.privsep.daemon [-] privsep: reply[550ad1e0-fad2-4128-927b-d7f103bcee37]: (4, 'qcow2') {{(pid=93130) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 04:46:23 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-ae7f972f-9673-4a53-b0f2-4cd4fe3cafed tempest-VolumesGetTest-1816202824 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-7f2f00a7-00f5-4022-ad68-4189d2889b0c {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:46:24 devstack sudo[102950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-7f2f00a7-00f5-4022-ad68-4189d2889b0c Jun 17 04:46:24 devstack sudo[102950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:46:25 devstack sudo[102950]: pam_unix(sudo:session): session closed for user root Jun 17 04:46:25 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-ae7f972f-9673-4a53-b0f2-4cd4fe3cafed tempest-VolumesGetTest-1816202824 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-7f2f00a7-00f5-4022-ad68-4189d2889b0c" returned: 0 in 1.951s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:46:25 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-ae7f972f-9673-4a53-b0f2-4cd4fe3cafed tempest-VolumesGetTest-1816202824 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-7f2f00a7-00f5-4022-ad68-4189d2889b0c {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:46:25 devstack sudo[102968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-7f2f00a7-00f5-4022-ad68-4189d2889b0c Jun 17 04:46:25 devstack sudo[102968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:46:27 devstack sudo[102968]: pam_unix(sudo:session): session closed for user root Jun 17 04:46:27 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-ae7f972f-9673-4a53-b0f2-4cd4fe3cafed tempest-VolumesGetTest-1816202824 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-7f2f00a7-00f5-4022-ad68-4189d2889b0c" returned: 0 in 1.253s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:46:27 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-ae7f972f-9673-4a53-b0f2-4cd4fe3cafed tempest-VolumesGetTest-1816202824 None] Lock "cinder-quobyte-7f2f00a7-00f5-4022-ad68-4189d2889b0c" released by "delete_volume" :: held 3.325s {{(pid=92060) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 04:46:27 devstack cinder-volume[92060]: DEBUG cinder.quota [None req-ae7f972f-9673-4a53-b0f2-4cd4fe3cafed tempest-VolumesGetTest-1816202824 None] Created reservations ['4fffa002-b0c6-4784-adb6-83cccbcf1624', '626b5ff9-c9ab-442b-bf66-875827c50dc1', '93808eb7-c4c8-4358-992c-38d0eea99d91', '7ffa1c48-46b2-4a58-9dc7-e3c93a842dba'] {{(pid=92060) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 17 04:46:27 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-ae7f972f-9673-4a53-b0f2-4cd4fe3cafed tempest-VolumesGetTest-1816202824 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 04:46:27 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-ae7f972f-9673-4a53-b0f2-4cd4fe3cafed tempest-VolumesGetTest-1816202824 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 04:46:27 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-ae7f972f-9673-4a53-b0f2-4cd4fe3cafed tempest-VolumesGetTest-1816202824 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588': None} {{(pid=92060) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 17 04:46:27 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-ae7f972f-9673-4a53-b0f2-4cd4fe3cafed tempest-VolumesGetTest-1816202824 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588'] {{(pid=92060) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 17 04:46:27 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-ae7f972f-9673-4a53-b0f2-4cd4fe3cafed tempest-VolumesGetTest-1816202824 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 04:46:27 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-ae7f972f-9673-4a53-b0f2-4cd4fe3cafed tempest-VolumesGetTest-1816202824 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:46:27 devstack sudo[102972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a Jun 17 04:46:27 devstack sudo[102972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:46:28 devstack sudo[102972]: pam_unix(sudo:session): session closed for user root Jun 17 04:46:28 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-ae7f972f-9673-4a53-b0f2-4cd4fe3cafed tempest-VolumesGetTest-1816202824 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a" returned: 0 in 0.830s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:46:28 devstack cinder-volume[92060]: DEBUG cinder.manager [None req-ae7f972f-9673-4a53-b0f2-4cd4fe3cafed tempest-VolumesGetTest-1816202824 None] Notifying Schedulers of capabilities ... {{(pid=92060) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 17 04:46:28 devstack cinder-volume[92060]: INFO cinder.volume.manager [None req-ae7f972f-9673-4a53-b0f2-4cd4fe3cafed tempest-VolumesGetTest-1816202824 None] Deleted volume successfully. Jun 17 04:46:28 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-ae7f972f-9673-4a53-b0f2-4cd4fe3cafed tempest-VolumesGetTest-1816202824 None] Lock "cinder-7f2f00a7-00f5-4022-ad68-4189d2889b0c-delete_volume" released by "delete_volume" :: held 4.710s {{(pid=92060) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 04:46:28 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-97d9db2a-1acd-46de-bb36-0fb20f82d7a6 tempest-VolumesGetTest-1816202824 None] Acquiring lock "cinder-47ff51ac-e15c-4372-a7b4-1453726ab716-delete_volume" by "delete_volume" {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 04:46:28 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-97d9db2a-1acd-46de-bb36-0fb20f82d7a6 tempest-VolumesGetTest-1816202824 None] Lock "cinder-47ff51ac-e15c-4372-a7b4-1453726ab716-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 04:46:28 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-97d9db2a-1acd-46de-bb36-0fb20f82d7a6 tempest-VolumesGetTest-1816202824 None] Acquiring lock "cinder-quobyte-47ff51ac-e15c-4372-a7b4-1453726ab716" by "delete_volume" {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 04:46:28 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-97d9db2a-1acd-46de-bb36-0fb20f82d7a6 tempest-VolumesGetTest-1816202824 None] Lock "cinder-quobyte-47ff51ac-e15c-4372-a7b4-1453726ab716" acquired by "delete_volume" :: waited 0.018s {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 04:46:28 devstack cinder-volume[92060]: DEBUG oslo.privsep.daemon [-] privsep: reply[05502b27-4bcf-420a-acef-69cba38b142c]: (4, 'raw') {{(pid=93130) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 04:46:28 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-97d9db2a-1acd-46de-bb36-0fb20f82d7a6 tempest-VolumesGetTest-1816202824 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-47ff51ac-e15c-4372-a7b4-1453726ab716 {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:46:28 devstack sudo[102977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-47ff51ac-e15c-4372-a7b4-1453726ab716 Jun 17 04:46:28 devstack sudo[102977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:46:29 devstack sudo[102977]: pam_unix(sudo:session): session closed for user root Jun 17 04:46:29 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-97d9db2a-1acd-46de-bb36-0fb20f82d7a6 tempest-VolumesGetTest-1816202824 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-47ff51ac-e15c-4372-a7b4-1453726ab716" returned: 0 in 0.763s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:46:29 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-97d9db2a-1acd-46de-bb36-0fb20f82d7a6 tempest-VolumesGetTest-1816202824 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-47ff51ac-e15c-4372-a7b4-1453726ab716 {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:46:29 devstack sudo[102981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-47ff51ac-e15c-4372-a7b4-1453726ab716 Jun 17 04:46:29 devstack sudo[102981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:46:30 devstack sudo[102981]: pam_unix(sudo:session): session closed for user root Jun 17 04:46:30 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-97d9db2a-1acd-46de-bb36-0fb20f82d7a6 tempest-VolumesGetTest-1816202824 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-47ff51ac-e15c-4372-a7b4-1453726ab716" returned: 1 in 0.939s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:46:30 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-97d9db2a-1acd-46de-bb36-0fb20f82d7a6 tempest-VolumesGetTest-1816202824 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-47ff51ac-e15c-4372-a7b4-1453726ab716' failed. Not Retrying. {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 17 04:46:30 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-97d9db2a-1acd-46de-bb36-0fb20f82d7a6 tempest-VolumesGetTest-1816202824 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-47ff51ac-e15c-4372-a7b4-1453726ab716 {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:46:30 devstack sudo[102987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-47ff51ac-e15c-4372-a7b4-1453726ab716 Jun 17 04:46:30 devstack sudo[102987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:46:31 devstack sudo[102987]: pam_unix(sudo:session): session closed for user root Jun 17 04:46:31 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-97d9db2a-1acd-46de-bb36-0fb20f82d7a6 tempest-VolumesGetTest-1816202824 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-47ff51ac-e15c-4372-a7b4-1453726ab716" returned: 0 in 0.729s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:46:31 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-97d9db2a-1acd-46de-bb36-0fb20f82d7a6 tempest-VolumesGetTest-1816202824 None] Lock "cinder-quobyte-47ff51ac-e15c-4372-a7b4-1453726ab716" released by "delete_volume" :: held 2.529s {{(pid=92060) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 04:46:31 devstack cinder-volume[92060]: DEBUG cinder.quota [None req-97d9db2a-1acd-46de-bb36-0fb20f82d7a6 tempest-VolumesGetTest-1816202824 None] Created reservations ['56ac38b5-d52e-400c-80a6-f08cbc31f44b', '79534f94-8c6f-467b-938e-fc0f4ebbb4cf', '83dd348f-9cbb-471c-a27a-e74e4f785c99', '89eb3c6b-a9de-4e31-8928-1d2359937460'] {{(pid=92060) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 17 04:46:31 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-97d9db2a-1acd-46de-bb36-0fb20f82d7a6 tempest-VolumesGetTest-1816202824 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 04:46:31 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-97d9db2a-1acd-46de-bb36-0fb20f82d7a6 tempest-VolumesGetTest-1816202824 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 04:46:31 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-97d9db2a-1acd-46de-bb36-0fb20f82d7a6 tempest-VolumesGetTest-1816202824 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588': None} {{(pid=92060) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 17 04:46:31 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-97d9db2a-1acd-46de-bb36-0fb20f82d7a6 tempest-VolumesGetTest-1816202824 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588'] {{(pid=92060) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 17 04:46:31 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-97d9db2a-1acd-46de-bb36-0fb20f82d7a6 tempest-VolumesGetTest-1816202824 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 04:46:31 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-97d9db2a-1acd-46de-bb36-0fb20f82d7a6 tempest-VolumesGetTest-1816202824 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:46:31 devstack sudo[102995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a Jun 17 04:46:31 devstack sudo[102995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:46:32 devstack sudo[102995]: pam_unix(sudo:session): session closed for user root Jun 17 04:46:32 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-97d9db2a-1acd-46de-bb36-0fb20f82d7a6 tempest-VolumesGetTest-1816202824 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a" returned: 0 in 1.020s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:46:32 devstack cinder-volume[92060]: DEBUG cinder.manager [None req-97d9db2a-1acd-46de-bb36-0fb20f82d7a6 tempest-VolumesGetTest-1816202824 None] Notifying Schedulers of capabilities ... {{(pid=92060) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 17 04:46:32 devstack cinder-volume[92060]: INFO cinder.volume.manager [None req-97d9db2a-1acd-46de-bb36-0fb20f82d7a6 tempest-VolumesGetTest-1816202824 None] Deleted volume successfully. Jun 17 04:46:32 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-97d9db2a-1acd-46de-bb36-0fb20f82d7a6 tempest-VolumesGetTest-1816202824 None] Lock "cinder-47ff51ac-e15c-4372-a7b4-1453726ab716-delete_volume" released by "delete_volume" :: held 3.978s {{(pid=92060) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 04:46:41 devstack cinder-volume[92060]: DEBUG dbcounter [-] [92060] Writing DB stats cinder:UPDATE=20,cinder:SELECT=9,cinder:INSERT=6,cinder:DELETE=1 {{(pid=92060) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 17 04:46:42 devstack cinder-volume[92060]: DEBUG dbcounter [-] [92060] Writing DB stats cinder:UPDATE=63,cinder:SELECT=54,cinder:DELETE=5,cinder:INSERT=20 {{(pid=92060) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 17 04:46:44 devstack cinder-volume[92060]: DEBUG oslo_service.periodic_task [None req-60d279ad-ad8c-4d36-a4b8-f593e74fb922 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=92060) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 17 04:46:44 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-60d279ad-ad8c-4d36-a4b8-f593e74fb922 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 04:46:44 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-60d279ad-ad8c-4d36-a4b8-f593e74fb922 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 04:46:44 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-60d279ad-ad8c-4d36-a4b8-f593e74fb922 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588': None} {{(pid=92060) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 17 04:46:44 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-60d279ad-ad8c-4d36-a4b8-f593e74fb922 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588'] {{(pid=92060) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 17 04:46:44 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-60d279ad-ad8c-4d36-a4b8-f593e74fb922 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 04:46:44 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-60d279ad-ad8c-4d36-a4b8-f593e74fb922 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:46:45 devstack sudo[103101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a Jun 17 04:46:45 devstack sudo[103101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:46:45 devstack sudo[103101]: pam_unix(sudo:session): session closed for user root Jun 17 04:46:45 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-60d279ad-ad8c-4d36-a4b8-f593e74fb922 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a" returned: 0 in 0.982s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:46:45 devstack cinder-volume[92060]: DEBUG cinder.manager [None req-60d279ad-ad8c-4d36-a4b8-f593e74fb922 None None] Notifying Schedulers of capabilities ... {{(pid=92060) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 17 04:46:45 devstack cinder-volume[92060]: DEBUG oslo_service.periodic_task [None req-60d279ad-ad8c-4d36-a4b8-f593e74fb922 None None] Running periodic task VolumeManager._thread_info {{(pid=92060) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 17 04:46:45 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-60d279ad-ad8c-4d36-a4b8-f593e74fb922 None None] thread count: 28 {{(pid=92060) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 17 04:46:45 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-60d279ad-ad8c-4d36-a4b8-f593e74fb922 None None] thread info: [<_MainThread(MainThread, started 130061806440576)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=92060) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 17 04:46:46 devstack cinder-volume[92060]: DEBUG cinder.volume.flows.manager.create_volume [None req-9256dd03-1f42-490d-a1cd-2d1888085da9 tempest-TestServerVolumeAttachScenarioOldVersion-172873691 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92060) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 17 04:46:46 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-9256dd03-1f42-490d-a1cd-2d1888085da9 tempest-TestServerVolumeAttachScenarioOldVersion-172873691 None] Flow 'volume_create_manager' (0d1d9443-5003-4583-a1fd-8a26471ef488) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 17 04:46:46 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-9256dd03-1f42-490d-a1cd-2d1888085da9 tempest-TestServerVolumeAttachScenarioOldVersion-172873691 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a9113b54-2e9c-4fc0-9ff6-0ab89a20296a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:46:46 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-9256dd03-1f42-490d-a1cd-2d1888085da9 tempest-TestServerVolumeAttachScenarioOldVersion-172873691 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a9113b54-2e9c-4fc0-9ff6-0ab89a20296a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-17T02:46:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-175314600',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dcfa4242-df33-4068-a515-47fa08696ebc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6f86004e27b6417c90c96672ab902419',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T02:46:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T02:46:46Z,use_quota=True,user_id='e9c85e8723c2462bb104551d85266f92',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aad9ce24-93f9-41a6-baa1-5125964f96d1),volume_type_id=aad9ce24-93f9-41a6-baa1-5125964f96d1)' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:46:46 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-9256dd03-1f42-490d-a1cd-2d1888085da9 tempest-TestServerVolumeAttachScenarioOldVersion-172873691 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9911d5e0-3834-4567-8bd1-9a6cd17590f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:46:46 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-9256dd03-1f42-490d-a1cd-2d1888085da9 tempest-TestServerVolumeAttachScenarioOldVersion-172873691 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9911d5e0-3834-4567-8bd1-9a6cd17590f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:46:46 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-9256dd03-1f42-490d-a1cd-2d1888085da9 tempest-TestServerVolumeAttachScenarioOldVersion-172873691 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (08aeb8f7-62b9-488f-a83d-3a41a039f536) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:46:46 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-9256dd03-1f42-490d-a1cd-2d1888085da9 tempest-TestServerVolumeAttachScenarioOldVersion-172873691 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (08aeb8f7-62b9-488f-a83d-3a41a039f536) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dcfa4242-df33-4068-a515-47fa08696ebc', 'volume_name': 'volume-dcfa4242-df33-4068-a515-47fa08696ebc', 'volume_size': 1}' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:46:46 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-9256dd03-1f42-490d-a1cd-2d1888085da9 tempest-TestServerVolumeAttachScenarioOldVersion-172873691 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (46a8ed7e-c193-4a84-9129-54a9e7ec9ad6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:46:46 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-9256dd03-1f42-490d-a1cd-2d1888085da9 tempest-TestServerVolumeAttachScenarioOldVersion-172873691 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (46a8ed7e-c193-4a84-9129-54a9e7ec9ad6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:46:46 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-9256dd03-1f42-490d-a1cd-2d1888085da9 tempest-TestServerVolumeAttachScenarioOldVersion-172873691 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c06fff24-04d1-43da-9c42-2333d69e8450) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:46:46 devstack cinder-volume[92060]: INFO cinder.volume.flows.manager.create_volume [None req-9256dd03-1f42-490d-a1cd-2d1888085da9 tempest-TestServerVolumeAttachScenarioOldVersion-172873691 None] Volume dcfa4242-df33-4068-a515-47fa08696ebc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dcfa4242-df33-4068-a515-47fa08696ebc', 'volume_size': 1} Jun 17 04:46:46 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-9256dd03-1f42-490d-a1cd-2d1888085da9 tempest-TestServerVolumeAttachScenarioOldVersion-172873691 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 04:46:46 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-9256dd03-1f42-490d-a1cd-2d1888085da9 tempest-TestServerVolumeAttachScenarioOldVersion-172873691 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 04:46:46 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-9256dd03-1f42-490d-a1cd-2d1888085da9 tempest-TestServerVolumeAttachScenarioOldVersion-172873691 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-17T02:46:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-175314600',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dcfa4242-df33-4068-a515-47fa08696ebc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6f86004e27b6417c90c96672ab902419',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T02:46:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T02:46:46Z,use_quota=True,user_id='e9c85e8723c2462bb104551d85266f92',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aad9ce24-93f9-41a6-baa1-5125964f96d1),volume_type_id=aad9ce24-93f9-41a6-baa1-5125964f96d1)}" {{(pid=92060) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 17 04:46:46 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.remotefs [None req-9256dd03-1f42-490d-a1cd-2d1888085da9 tempest-TestServerVolumeAttachScenarioOldVersion-172873691 None] Creating volume dcfa4242-df33-4068-a515-47fa08696ebc {{(pid=92060) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 17 04:46:46 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-9256dd03-1f42-490d-a1cd-2d1888085da9 tempest-TestServerVolumeAttachScenarioOldVersion-172873691 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 04:46:46 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-9256dd03-1f42-490d-a1cd-2d1888085da9 tempest-TestServerVolumeAttachScenarioOldVersion-172873691 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 04:46:46 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-9256dd03-1f42-490d-a1cd-2d1888085da9 tempest-TestServerVolumeAttachScenarioOldVersion-172873691 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588': None} {{(pid=92060) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 17 04:46:46 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-9256dd03-1f42-490d-a1cd-2d1888085da9 tempest-TestServerVolumeAttachScenarioOldVersion-172873691 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588'] {{(pid=92060) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 17 04:46:46 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-9256dd03-1f42-490d-a1cd-2d1888085da9 tempest-TestServerVolumeAttachScenarioOldVersion-172873691 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 04:46:46 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-9256dd03-1f42-490d-a1cd-2d1888085da9 tempest-TestServerVolumeAttachScenarioOldVersion-172873691 None] Selected osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588 as target Quobyte volume. {{(pid=92060) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 17 04:46:46 devstack cinder-volume[92060]: INFO cinder.volume.drivers.remotefs [None req-9256dd03-1f42-490d-a1cd-2d1888085da9 tempest-TestServerVolumeAttachScenarioOldVersion-172873691 None] casted to osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588 Jun 17 04:46:46 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-9256dd03-1f42-490d-a1cd-2d1888085da9 tempest-TestServerVolumeAttachScenarioOldVersion-172873691 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-dcfa4242-df33-4068-a515-47fa08696ebc 1073741824 {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:46:46 devstack sudo[103104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-dcfa4242-df33-4068-a515-47fa08696ebc 1073741824 Jun 17 04:46:46 devstack sudo[103104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:46:48 devstack sudo[103104]: pam_unix(sudo:session): session closed for user root Jun 17 04:46:48 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-9256dd03-1f42-490d-a1cd-2d1888085da9 tempest-TestServerVolumeAttachScenarioOldVersion-172873691 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-dcfa4242-df33-4068-a515-47fa08696ebc 1073741824" returned: 0 in 1.300s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:46:48 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-9256dd03-1f42-490d-a1cd-2d1888085da9 tempest-TestServerVolumeAttachScenarioOldVersion-172873691 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-dcfa4242-df33-4068-a515-47fa08696ebc {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:46:48 devstack sudo[103134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-dcfa4242-df33-4068-a515-47fa08696ebc Jun 17 04:46:48 devstack sudo[103134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:46:48 devstack sudo[103134]: pam_unix(sudo:session): session closed for user root Jun 17 04:46:48 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-9256dd03-1f42-490d-a1cd-2d1888085da9 tempest-TestServerVolumeAttachScenarioOldVersion-172873691 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-dcfa4242-df33-4068-a515-47fa08696ebc" returned: 0 in 0.751s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:46:48 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-9256dd03-1f42-490d-a1cd-2d1888085da9 tempest-TestServerVolumeAttachScenarioOldVersion-172873691 None] <== create_volume: return (2105ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588'} {{(pid=92060) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 17 04:46:48 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-9256dd03-1f42-490d-a1cd-2d1888085da9 tempest-TestServerVolumeAttachScenarioOldVersion-172873691 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.111s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 04:46:48 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-9256dd03-1f42-490d-a1cd-2d1888085da9 tempest-TestServerVolumeAttachScenarioOldVersion-172873691 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c06fff24-04d1-43da-9c42-2333d69e8450) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dcfa4242-df33-4068-a515-47fa08696ebc', 'volume_size': 1}' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:46:48 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-9256dd03-1f42-490d-a1cd-2d1888085da9 tempest-TestServerVolumeAttachScenarioOldVersion-172873691 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (666155e8-7260-4c82-a510-3ea9ec58ceb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:46:48 devstack cinder-volume[92060]: INFO cinder.volume.flows.manager.create_volume [None req-9256dd03-1f42-490d-a1cd-2d1888085da9 tempest-TestServerVolumeAttachScenarioOldVersion-172873691 None] Volume volume-dcfa4242-df33-4068-a515-47fa08696ebc (dcfa4242-df33-4068-a515-47fa08696ebc): created successfully Jun 17 04:46:48 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-9256dd03-1f42-490d-a1cd-2d1888085da9 tempest-TestServerVolumeAttachScenarioOldVersion-172873691 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (666155e8-7260-4c82-a510-3ea9ec58ceb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:46:48 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-9256dd03-1f42-490d-a1cd-2d1888085da9 tempest-TestServerVolumeAttachScenarioOldVersion-172873691 None] Flow 'volume_create_manager' (0d1d9443-5003-4583-a1fd-8a26471ef488) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92060) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 17 04:46:48 devstack cinder-volume[92060]: INFO cinder.volume.manager [None req-9256dd03-1f42-490d-a1cd-2d1888085da9 tempest-TestServerVolumeAttachScenarioOldVersion-172873691 None] Created volume successfully. Jun 17 04:46:51 devstack cinder-volume[92060]: INFO cinder.volume.manager [req-90837f38-956b-4ae1-96cc-a0b759cf6273 req-86d87865-06a1-4948-aa51-fd01101924de tempest-TestMinimumBasicScenario-1576050866 None] Terminate volume connection completed successfully. Jun 17 04:46:51 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [req-90837f38-956b-4ae1-96cc-a0b759cf6273 req-86d87865-06a1-4948-aa51-fd01101924de tempest-TestMinimumBasicScenario-1576050866 None] Deleting attachment 8a8c3564-d0a7-4209-be4a-3e2fc730d1a0. {{(pid=92060) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 17 04:46:52 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [req-2e609da4-aa7c-4026-97b8-b2dd9269acc8 req-0da67875-ebbe-4914-88a9-1f655eebbcd6 tempest-TestServerVolumeAttachScenarioOldVersion-172873691 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 04:46:52 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [req-2e609da4-aa7c-4026-97b8-b2dd9269acc8 req-0da67875-ebbe-4914-88a9-1f655eebbcd6 tempest-TestServerVolumeAttachScenarioOldVersion-172873691 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 04:46:52 devstack cinder-volume[92060]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0f5a791-0a00-4db4-8688-ab8aa6839df0]: (4, 'qcow2') {{(pid=93130) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 04:46:52 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [req-2e609da4-aa7c-4026-97b8-b2dd9269acc8 req-0da67875-ebbe-4914-88a9-1f655eebbcd6 tempest-TestServerVolumeAttachScenarioOldVersion-172873691 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-dcfa4242-df33-4068-a515-47fa08696ebc {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:46:53 devstack sudo[103153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-dcfa4242-df33-4068-a515-47fa08696ebc Jun 17 04:46:53 devstack sudo[103153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:46:53 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-1471a049-47b2-4b42-a41f-b981254b61f5 tempest-TestMinimumBasicScenario-1576050866 None] Acquiring lock "cinder-fabf3901-486d-462f-a5b1-b697035c8625-delete_volume" by "delete_volume" {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 04:46:53 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-1471a049-47b2-4b42-a41f-b981254b61f5 tempest-TestMinimumBasicScenario-1576050866 None] Lock "cinder-fabf3901-486d-462f-a5b1-b697035c8625-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 04:46:53 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-1471a049-47b2-4b42-a41f-b981254b61f5 tempest-TestMinimumBasicScenario-1576050866 None] Acquiring lock "cinder-quobyte-fabf3901-486d-462f-a5b1-b697035c8625" by "delete_volume" {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 04:46:53 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-1471a049-47b2-4b42-a41f-b981254b61f5 tempest-TestMinimumBasicScenario-1576050866 None] Lock "cinder-quobyte-fabf3901-486d-462f-a5b1-b697035c8625" acquired by "delete_volume" :: waited 0.021s {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 04:46:53 devstack cinder-volume[92060]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f49fc3e-c140-45ce-9349-aa5b1fc558cf]: (4, 'qcow2') {{(pid=93130) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 04:46:53 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-1471a049-47b2-4b42-a41f-b981254b61f5 tempest-TestMinimumBasicScenario-1576050866 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-fabf3901-486d-462f-a5b1-b697035c8625 {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:46:53 devstack sudo[103155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-fabf3901-486d-462f-a5b1-b697035c8625 Jun 17 04:46:53 devstack sudo[103155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:46:53 devstack sudo[103153]: pam_unix(sudo:session): session closed for user root Jun 17 04:46:53 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [req-2e609da4-aa7c-4026-97b8-b2dd9269acc8 req-0da67875-ebbe-4914-88a9-1f655eebbcd6 tempest-TestServerVolumeAttachScenarioOldVersion-172873691 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-dcfa4242-df33-4068-a515-47fa08696ebc" returned: 0 in 0.834s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:46:53 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [req-2e609da4-aa7c-4026-97b8-b2dd9269acc8 req-0da67875-ebbe-4914-88a9-1f655eebbcd6 tempest-TestServerVolumeAttachScenarioOldVersion-172873691 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.863s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 04:46:53 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [req-2e609da4-aa7c-4026-97b8-b2dd9269acc8 req-0da67875-ebbe-4914-88a9-1f655eebbcd6 tempest-TestServerVolumeAttachScenarioOldVersion-172873691 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588', 'name': 'volume-dcfa4242-df33-4068-a515-47fa08696ebc', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '7c7f9cd7-fcc1-4640-bb43-53d9400b54b0', 'enforce_multipath': True} {{(pid=92060) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 17 04:46:53 devstack cinder-volume[92060]: INFO cinder.volume.manager [req-2e609da4-aa7c-4026-97b8-b2dd9269acc8 req-0da67875-ebbe-4914-88a9-1f655eebbcd6 tempest-TestServerVolumeAttachScenarioOldVersion-172873691 None] attachment_update completed successfully. Jun 17 04:46:54 devstack sudo[103155]: pam_unix(sudo:session): session closed for user root Jun 17 04:46:54 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-1471a049-47b2-4b42-a41f-b981254b61f5 tempest-TestMinimumBasicScenario-1576050866 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-fabf3901-486d-462f-a5b1-b697035c8625" returned: 0 in 0.776s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:46:54 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-1471a049-47b2-4b42-a41f-b981254b61f5 tempest-TestMinimumBasicScenario-1576050866 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-fabf3901-486d-462f-a5b1-b697035c8625 {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:46:54 devstack sudo[103163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-fabf3901-486d-462f-a5b1-b697035c8625 Jun 17 04:46:54 devstack sudo[103163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:46:54 devstack sudo[103163]: pam_unix(sudo:session): session closed for user root Jun 17 04:46:54 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-1471a049-47b2-4b42-a41f-b981254b61f5 tempest-TestMinimumBasicScenario-1576050866 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-fabf3901-486d-462f-a5b1-b697035c8625" returned: 0 in 0.704s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:46:54 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-1471a049-47b2-4b42-a41f-b981254b61f5 tempest-TestMinimumBasicScenario-1576050866 None] Lock "cinder-quobyte-fabf3901-486d-462f-a5b1-b697035c8625" released by "delete_volume" :: held 1.538s {{(pid=92060) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 04:46:55 devstack cinder-volume[92060]: DEBUG cinder.quota [None req-1471a049-47b2-4b42-a41f-b981254b61f5 tempest-TestMinimumBasicScenario-1576050866 None] Created reservations ['a610ef40-3d15-46b8-bb79-a34078db0b3d', '26e229dd-8526-45eb-a6c0-b5e6d9858f0a', '45e0a983-37ed-4d95-a49d-7fb8aebc9969', '7d28d308-5d4a-4d5d-91f3-b7e7671e36fc'] {{(pid=92060) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 17 04:46:55 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-1471a049-47b2-4b42-a41f-b981254b61f5 tempest-TestMinimumBasicScenario-1576050866 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 04:46:55 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-1471a049-47b2-4b42-a41f-b981254b61f5 tempest-TestMinimumBasicScenario-1576050866 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 04:46:55 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-1471a049-47b2-4b42-a41f-b981254b61f5 tempest-TestMinimumBasicScenario-1576050866 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588': None} {{(pid=92060) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 17 04:46:55 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-1471a049-47b2-4b42-a41f-b981254b61f5 tempest-TestMinimumBasicScenario-1576050866 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588'] {{(pid=92060) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 17 04:46:55 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-1471a049-47b2-4b42-a41f-b981254b61f5 tempest-TestMinimumBasicScenario-1576050866 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 04:46:55 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-1471a049-47b2-4b42-a41f-b981254b61f5 tempest-TestMinimumBasicScenario-1576050866 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:46:55 devstack sudo[103169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a Jun 17 04:46:55 devstack sudo[103169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:46:55 devstack sudo[103169]: pam_unix(sudo:session): session closed for user root Jun 17 04:46:55 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-1471a049-47b2-4b42-a41f-b981254b61f5 tempest-TestMinimumBasicScenario-1576050866 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a" returned: 0 in 0.757s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:46:55 devstack cinder-volume[92060]: DEBUG cinder.manager [None req-1471a049-47b2-4b42-a41f-b981254b61f5 tempest-TestMinimumBasicScenario-1576050866 None] Notifying Schedulers of capabilities ... {{(pid=92060) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 17 04:46:55 devstack cinder-volume[92060]: INFO cinder.volume.manager [None req-1471a049-47b2-4b42-a41f-b981254b61f5 tempest-TestMinimumBasicScenario-1576050866 None] Deleted volume successfully. Jun 17 04:46:55 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-1471a049-47b2-4b42-a41f-b981254b61f5 tempest-TestMinimumBasicScenario-1576050866 None] Lock "cinder-fabf3901-486d-462f-a5b1-b697035c8625-delete_volume" released by "delete_volume" :: held 2.563s {{(pid=92060) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 04:47:02 devstack cinder-volume[92060]: INFO cinder.volume.manager [req-53549698-f1fd-43ab-87a5-201237d8aabc req-a09569e3-4139-4796-8ee8-f4e5a36086ae tempest-TestServerVolumeAttachScenarioOldVersion-172873691 None] Terminate volume connection completed successfully. Jun 17 04:47:02 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [req-53549698-f1fd-43ab-87a5-201237d8aabc req-a09569e3-4139-4796-8ee8-f4e5a36086ae tempest-TestServerVolumeAttachScenarioOldVersion-172873691 None] Deleting attachment 7c7f9cd7-fcc1-4640-bb43-53d9400b54b0. {{(pid=92060) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 17 04:47:04 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-60d2790a-bff2-4ad1-9835-0292f265cd9b tempest-TestServerVolumeAttachScenarioOldVersion-172873691 None] Acquiring lock "cinder-dcfa4242-df33-4068-a515-47fa08696ebc-delete_volume" by "delete_volume" {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 04:47:04 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-60d2790a-bff2-4ad1-9835-0292f265cd9b tempest-TestServerVolumeAttachScenarioOldVersion-172873691 None] Lock "cinder-dcfa4242-df33-4068-a515-47fa08696ebc-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 04:47:04 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-60d2790a-bff2-4ad1-9835-0292f265cd9b tempest-TestServerVolumeAttachScenarioOldVersion-172873691 None] Acquiring lock "cinder-quobyte-dcfa4242-df33-4068-a515-47fa08696ebc" by "delete_volume" {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 04:47:04 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-60d2790a-bff2-4ad1-9835-0292f265cd9b tempest-TestServerVolumeAttachScenarioOldVersion-172873691 None] Lock "cinder-quobyte-dcfa4242-df33-4068-a515-47fa08696ebc" acquired by "delete_volume" :: waited 0.023s {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 04:47:04 devstack cinder-volume[92060]: DEBUG oslo.privsep.daemon [-] privsep: reply[482a7bab-1a35-4797-8c51-4e2e56b7cd71]: (4, 'qcow2') {{(pid=93130) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 04:47:04 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-60d2790a-bff2-4ad1-9835-0292f265cd9b tempest-TestServerVolumeAttachScenarioOldVersion-172873691 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-dcfa4242-df33-4068-a515-47fa08696ebc {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:47:04 devstack sudo[103247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-dcfa4242-df33-4068-a515-47fa08696ebc Jun 17 04:47:04 devstack sudo[103247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:47:05 devstack sudo[103247]: pam_unix(sudo:session): session closed for user root Jun 17 04:47:05 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-60d2790a-bff2-4ad1-9835-0292f265cd9b tempest-TestServerVolumeAttachScenarioOldVersion-172873691 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-dcfa4242-df33-4068-a515-47fa08696ebc" returned: 0 in 0.860s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:47:05 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-60d2790a-bff2-4ad1-9835-0292f265cd9b tempest-TestServerVolumeAttachScenarioOldVersion-172873691 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-dcfa4242-df33-4068-a515-47fa08696ebc {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:47:05 devstack sudo[103252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-dcfa4242-df33-4068-a515-47fa08696ebc Jun 17 04:47:05 devstack sudo[103252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:47:06 devstack sudo[103252]: pam_unix(sudo:session): session closed for user root Jun 17 04:47:06 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-60d2790a-bff2-4ad1-9835-0292f265cd9b tempest-TestServerVolumeAttachScenarioOldVersion-172873691 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-dcfa4242-df33-4068-a515-47fa08696ebc" returned: 0 in 0.812s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:47:06 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-60d2790a-bff2-4ad1-9835-0292f265cd9b tempest-TestServerVolumeAttachScenarioOldVersion-172873691 None] Lock "cinder-quobyte-dcfa4242-df33-4068-a515-47fa08696ebc" released by "delete_volume" :: held 1.751s {{(pid=92060) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 04:47:06 devstack cinder-volume[92060]: DEBUG cinder.quota [None req-60d2790a-bff2-4ad1-9835-0292f265cd9b tempest-TestServerVolumeAttachScenarioOldVersion-172873691 None] Created reservations ['e0568324-fd51-464a-91aa-9a78872cb705', '8c3af9b2-fdec-4ab0-aea5-0561ca5d2bc8', '3b178cee-3dad-42de-b9b9-031fb6c393ee', '0478ff97-f12c-41d9-859a-97ea04070e89'] {{(pid=92060) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 17 04:47:06 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-60d2790a-bff2-4ad1-9835-0292f265cd9b tempest-TestServerVolumeAttachScenarioOldVersion-172873691 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 04:47:06 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-60d2790a-bff2-4ad1-9835-0292f265cd9b tempest-TestServerVolumeAttachScenarioOldVersion-172873691 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 04:47:06 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-60d2790a-bff2-4ad1-9835-0292f265cd9b tempest-TestServerVolumeAttachScenarioOldVersion-172873691 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588': None} {{(pid=92060) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 17 04:47:06 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-60d2790a-bff2-4ad1-9835-0292f265cd9b tempest-TestServerVolumeAttachScenarioOldVersion-172873691 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588'] {{(pid=92060) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 17 04:47:06 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-60d2790a-bff2-4ad1-9835-0292f265cd9b tempest-TestServerVolumeAttachScenarioOldVersion-172873691 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 04:47:06 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-60d2790a-bff2-4ad1-9835-0292f265cd9b tempest-TestServerVolumeAttachScenarioOldVersion-172873691 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:47:06 devstack sudo[103256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a Jun 17 04:47:06 devstack sudo[103256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:47:06 devstack sudo[103256]: pam_unix(sudo:session): session closed for user root Jun 17 04:47:06 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-60d2790a-bff2-4ad1-9835-0292f265cd9b tempest-TestServerVolumeAttachScenarioOldVersion-172873691 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a" returned: 0 in 0.784s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:47:06 devstack cinder-volume[92060]: DEBUG cinder.manager [None req-60d2790a-bff2-4ad1-9835-0292f265cd9b tempest-TestServerVolumeAttachScenarioOldVersion-172873691 None] Notifying Schedulers of capabilities ... {{(pid=92060) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 17 04:47:06 devstack cinder-volume[92060]: INFO cinder.volume.manager [None req-60d2790a-bff2-4ad1-9835-0292f265cd9b tempest-TestServerVolumeAttachScenarioOldVersion-172873691 None] Deleted volume successfully. Jun 17 04:47:07 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-60d2790a-bff2-4ad1-9835-0292f265cd9b tempest-TestServerVolumeAttachScenarioOldVersion-172873691 None] Lock "cinder-dcfa4242-df33-4068-a515-47fa08696ebc-delete_volume" released by "delete_volume" :: held 2.810s {{(pid=92060) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 04:47:07 devstack cinder-volume[92060]: DEBUG cinder.volume.flows.manager.create_volume [None req-fb4e6c81-f1df-4d3b-bc62-3a88e4e52712 tempest-TestInstancesWithCinderVolumes-729947751 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92060) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 17 04:47:07 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-fb4e6c81-f1df-4d3b-bc62-3a88e4e52712 tempest-TestInstancesWithCinderVolumes-729947751 None] Flow 'volume_create_manager' (73f6ef70-a12d-4268-8119-2019a7a64c67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 17 04:47:07 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-fb4e6c81-f1df-4d3b-bc62-3a88e4e52712 tempest-TestInstancesWithCinderVolumes-729947751 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6a243c59-0e69-4dea-8414-3641e2990c2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:47:07 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-fb4e6c81-f1df-4d3b-bc62-3a88e4e52712 tempest-TestInstancesWithCinderVolumes-729947751 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6a243c59-0e69-4dea-8414-3641e2990c2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-17T02:47:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-596621145',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1bdbda56-f74d-4574-a81c-741cf74d19a9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='44b49649c6b54bd5b17e3c481ffa806a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T02:47:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T02:47:07Z,use_quota=True,user_id='4ef94c0ee9434ef5a07e1de9280b8bc7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(92c1a2f4-b549-4bc0-bb7f-3201254aff9a),volume_type_id=92c1a2f4-b549-4bc0-bb7f-3201254aff9a)' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:47:07 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-fb4e6c81-f1df-4d3b-bc62-3a88e4e52712 tempest-TestInstancesWithCinderVolumes-729947751 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (93c4afa7-00af-4fea-8554-5c0d4bd8944c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:47:07 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-fb4e6c81-f1df-4d3b-bc62-3a88e4e52712 tempest-TestInstancesWithCinderVolumes-729947751 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (93c4afa7-00af-4fea-8554-5c0d4bd8944c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:47:07 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-fb4e6c81-f1df-4d3b-bc62-3a88e4e52712 tempest-TestInstancesWithCinderVolumes-729947751 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e9aa858c-496c-4b94-8650-fab93b6b0c74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:47:07 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-fb4e6c81-f1df-4d3b-bc62-3a88e4e52712 tempest-TestInstancesWithCinderVolumes-729947751 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e9aa858c-496c-4b94-8650-fab93b6b0c74) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1bdbda56-f74d-4574-a81c-741cf74d19a9', 'volume_name': 'volume-1bdbda56-f74d-4574-a81c-741cf74d19a9', 'volume_size': 1}' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:47:07 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-fb4e6c81-f1df-4d3b-bc62-3a88e4e52712 tempest-TestInstancesWithCinderVolumes-729947751 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (61feec18-1395-4b0c-b4ff-659231e3d4fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:47:07 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-fb4e6c81-f1df-4d3b-bc62-3a88e4e52712 tempest-TestInstancesWithCinderVolumes-729947751 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (61feec18-1395-4b0c-b4ff-659231e3d4fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:47:07 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-fb4e6c81-f1df-4d3b-bc62-3a88e4e52712 tempest-TestInstancesWithCinderVolumes-729947751 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8adccefc-deca-4d54-9e2f-9ab7b70f5462) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:47:07 devstack cinder-volume[92060]: INFO cinder.volume.flows.manager.create_volume [None req-fb4e6c81-f1df-4d3b-bc62-3a88e4e52712 tempest-TestInstancesWithCinderVolumes-729947751 None] Volume 1bdbda56-f74d-4574-a81c-741cf74d19a9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1bdbda56-f74d-4574-a81c-741cf74d19a9', 'volume_size': 1} Jun 17 04:47:07 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-fb4e6c81-f1df-4d3b-bc62-3a88e4e52712 tempest-TestInstancesWithCinderVolumes-729947751 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 04:47:07 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-fb4e6c81-f1df-4d3b-bc62-3a88e4e52712 tempest-TestInstancesWithCinderVolumes-729947751 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 04:47:07 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-fb4e6c81-f1df-4d3b-bc62-3a88e4e52712 tempest-TestInstancesWithCinderVolumes-729947751 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-17T02:47:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-596621145',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1bdbda56-f74d-4574-a81c-741cf74d19a9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='44b49649c6b54bd5b17e3c481ffa806a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T02:47:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T02:47:07Z,use_quota=True,user_id='4ef94c0ee9434ef5a07e1de9280b8bc7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(92c1a2f4-b549-4bc0-bb7f-3201254aff9a),volume_type_id=92c1a2f4-b549-4bc0-bb7f-3201254aff9a)}" {{(pid=92060) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 17 04:47:07 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.remotefs [None req-fb4e6c81-f1df-4d3b-bc62-3a88e4e52712 tempest-TestInstancesWithCinderVolumes-729947751 None] Creating volume 1bdbda56-f74d-4574-a81c-741cf74d19a9 {{(pid=92060) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 17 04:47:07 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-fb4e6c81-f1df-4d3b-bc62-3a88e4e52712 tempest-TestInstancesWithCinderVolumes-729947751 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 04:47:07 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-fb4e6c81-f1df-4d3b-bc62-3a88e4e52712 tempest-TestInstancesWithCinderVolumes-729947751 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 04:47:07 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-fb4e6c81-f1df-4d3b-bc62-3a88e4e52712 tempest-TestInstancesWithCinderVolumes-729947751 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588': None} {{(pid=92060) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 17 04:47:07 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-fb4e6c81-f1df-4d3b-bc62-3a88e4e52712 tempest-TestInstancesWithCinderVolumes-729947751 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588'] {{(pid=92060) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 17 04:47:07 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-fb4e6c81-f1df-4d3b-bc62-3a88e4e52712 tempest-TestInstancesWithCinderVolumes-729947751 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 04:47:07 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-fb4e6c81-f1df-4d3b-bc62-3a88e4e52712 tempest-TestInstancesWithCinderVolumes-729947751 None] Selected osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588 as target Quobyte volume. {{(pid=92060) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 17 04:47:07 devstack cinder-volume[92060]: INFO cinder.volume.drivers.remotefs [None req-fb4e6c81-f1df-4d3b-bc62-3a88e4e52712 tempest-TestInstancesWithCinderVolumes-729947751 None] casted to osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588 Jun 17 04:47:07 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-fb4e6c81-f1df-4d3b-bc62-3a88e4e52712 tempest-TestInstancesWithCinderVolumes-729947751 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-1bdbda56-f74d-4574-a81c-741cf74d19a9 1073741824 {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:47:07 devstack sudo[103259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-1bdbda56-f74d-4574-a81c-741cf74d19a9 1073741824 Jun 17 04:47:07 devstack sudo[103259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:47:07 devstack cinder-volume[92060]: DEBUG cinder.volume.flows.manager.create_volume [None req-7aa4e267-c046-4f16-865d-d29646b5e15d tempest-TestInstancesWithCinderVolumes-729947751 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92060) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 17 04:47:07 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-7aa4e267-c046-4f16-865d-d29646b5e15d tempest-TestInstancesWithCinderVolumes-729947751 None] Flow 'volume_create_manager' (fb6ef7f0-d2cc-403f-960d-e650d6151bcb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 17 04:47:07 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-7aa4e267-c046-4f16-865d-d29646b5e15d tempest-TestInstancesWithCinderVolumes-729947751 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1af4f893-348d-42ab-91e9-67cad6dd09a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:47:07 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-7aa4e267-c046-4f16-865d-d29646b5e15d tempest-TestInstancesWithCinderVolumes-729947751 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1af4f893-348d-42ab-91e9-67cad6dd09a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-17T02:47:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1325420930',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7ad20cd3-2204-4cad-8706-e9d0e0ae3442,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='44b49649c6b54bd5b17e3c481ffa806a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T02:47:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T02:47:08Z,use_quota=True,user_id='4ef94c0ee9434ef5a07e1de9280b8bc7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ac756d64-c7cc-4362-8998-81b20232de04),volume_type_id=ac756d64-c7cc-4362-8998-81b20232de04)' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:47:07 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-7aa4e267-c046-4f16-865d-d29646b5e15d tempest-TestInstancesWithCinderVolumes-729947751 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6b187c37-1efc-4276-9ed8-8c655b1e5eda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:47:07 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-7aa4e267-c046-4f16-865d-d29646b5e15d tempest-TestInstancesWithCinderVolumes-729947751 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6b187c37-1efc-4276-9ed8-8c655b1e5eda) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:47:07 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-7aa4e267-c046-4f16-865d-d29646b5e15d tempest-TestInstancesWithCinderVolumes-729947751 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a15683ae-1295-4f30-a0ff-d4fb0e4e98d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:47:07 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-7aa4e267-c046-4f16-865d-d29646b5e15d tempest-TestInstancesWithCinderVolumes-729947751 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a15683ae-1295-4f30-a0ff-d4fb0e4e98d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7ad20cd3-2204-4cad-8706-e9d0e0ae3442', 'volume_name': 'volume-7ad20cd3-2204-4cad-8706-e9d0e0ae3442', 'volume_size': 1}' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:47:07 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-7aa4e267-c046-4f16-865d-d29646b5e15d tempest-TestInstancesWithCinderVolumes-729947751 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d816f8e0-d6b8-4eb1-adfd-6e4f54d1d491) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:47:07 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-7aa4e267-c046-4f16-865d-d29646b5e15d tempest-TestInstancesWithCinderVolumes-729947751 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d816f8e0-d6b8-4eb1-adfd-6e4f54d1d491) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:47:07 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-7aa4e267-c046-4f16-865d-d29646b5e15d tempest-TestInstancesWithCinderVolumes-729947751 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ec8a00d6-fd5b-4b31-91d6-9dc4da2935b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:47:07 devstack cinder-volume[92060]: INFO cinder.volume.flows.manager.create_volume [None req-7aa4e267-c046-4f16-865d-d29646b5e15d tempest-TestInstancesWithCinderVolumes-729947751 None] Volume 7ad20cd3-2204-4cad-8706-e9d0e0ae3442: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7ad20cd3-2204-4cad-8706-e9d0e0ae3442', 'volume_size': 1} Jun 17 04:47:07 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-7aa4e267-c046-4f16-865d-d29646b5e15d tempest-TestInstancesWithCinderVolumes-729947751 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 04:47:08 devstack cinder-volume[92060]: DEBUG cinder.volume.flows.manager.create_volume [None req-0558062f-4406-475e-95ac-86755c2f85fb tempest-TestInstancesWithCinderVolumes-729947751 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92060) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 17 04:47:08 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-0558062f-4406-475e-95ac-86755c2f85fb tempest-TestInstancesWithCinderVolumes-729947751 None] Flow 'volume_create_manager' (046c5d49-654e-4362-adb4-85a30cdf2cf6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 17 04:47:08 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-0558062f-4406-475e-95ac-86755c2f85fb tempest-TestInstancesWithCinderVolumes-729947751 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dc4484e6-79a6-4b5e-9a1f-5bd630da7467) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:47:08 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-0558062f-4406-475e-95ac-86755c2f85fb tempest-TestInstancesWithCinderVolumes-729947751 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dc4484e6-79a6-4b5e-9a1f-5bd630da7467) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-17T02:47:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1686722239',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7dc2c78d-7e4c-4e39-b276-4c1e36d07215,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='44b49649c6b54bd5b17e3c481ffa806a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T02:47:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T02:47:09Z,use_quota=True,user_id='4ef94c0ee9434ef5a07e1de9280b8bc7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d2fdd8a-8e42-450e-ac18-caa4e725ac9d),volume_type_id=9d2fdd8a-8e42-450e-ac18-caa4e725ac9d)' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:47:08 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-0558062f-4406-475e-95ac-86755c2f85fb tempest-TestInstancesWithCinderVolumes-729947751 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (455eb275-0153-4831-a77a-1391b0018678) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:47:08 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-0558062f-4406-475e-95ac-86755c2f85fb tempest-TestInstancesWithCinderVolumes-729947751 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (455eb275-0153-4831-a77a-1391b0018678) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:47:08 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-0558062f-4406-475e-95ac-86755c2f85fb tempest-TestInstancesWithCinderVolumes-729947751 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (38ad7449-63d8-4e94-ba09-41a181e4b496) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:47:08 devstack cinder-volume[92060]: DEBUG cinder.image.glance [None req-0558062f-4406-475e-95ac-86755c2f85fb tempest-TestInstancesWithCinderVolumes-729947751 None] Creating Keystone auth plugin from conf {{(pid=92060) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jun 17 04:47:08 devstack sudo[103259]: pam_unix(sudo:session): session closed for user root Jun 17 04:47:08 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-fb4e6c81-f1df-4d3b-bc62-3a88e4e52712 tempest-TestInstancesWithCinderVolumes-729947751 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-1bdbda56-f74d-4574-a81c-741cf74d19a9 1073741824" returned: 0 in 1.495s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:47:08 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-fb4e6c81-f1df-4d3b-bc62-3a88e4e52712 tempest-TestInstancesWithCinderVolumes-729947751 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-1bdbda56-f74d-4574-a81c-741cf74d19a9 {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:47:08 devstack sudo[103305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-1bdbda56-f74d-4574-a81c-741cf74d19a9 Jun 17 04:47:08 devstack sudo[103305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:47:09 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-0558062f-4406-475e-95ac-86755c2f85fb tempest-TestInstancesWithCinderVolumes-729947751 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (38ad7449-63d8-4e94-ba09-41a181e4b496) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '7dc2c78d-7e4c-4e39-b276-4c1e36d07215', 'volume_name': 'volume-7dc2c78d-7e4c-4e39-b276-4c1e36d07215', 'volume_size': 1, 'image_id': '11597dd5-e97a-429a-b6df-73d39911c009', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/11597dd5-e97a-429a-b6df-73d39911c009', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1509857773', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '44b49649c6b54bd5b17e3c481ffa806a', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '11597dd5-e97a-429a-b6df-73d39911c009', 'created_at': datetime.datetime(2026, 6, 17, 2, 47, 4, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 17, 2, 47, 6, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/11597dd5-e97a-429a-b6df-73d39911c009/file', 'properties': {}}, 'image_service': }' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:47:09 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-0558062f-4406-475e-95ac-86755c2f85fb tempest-TestInstancesWithCinderVolumes-729947751 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (123c06f8-abbd-4bf6-bcad-676173acab32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:47:09 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-0558062f-4406-475e-95ac-86755c2f85fb tempest-TestInstancesWithCinderVolumes-729947751 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (123c06f8-abbd-4bf6-bcad-676173acab32) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:47:09 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-0558062f-4406-475e-95ac-86755c2f85fb tempest-TestInstancesWithCinderVolumes-729947751 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0c01b8c0-eff8-490c-a53a-5aea340ff490) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:47:09 devstack cinder-volume[92060]: INFO cinder.volume.flows.manager.create_volume [None req-0558062f-4406-475e-95ac-86755c2f85fb tempest-TestInstancesWithCinderVolumes-729947751 None] Volume 7dc2c78d-7e4c-4e39-b276-4c1e36d07215: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-7dc2c78d-7e4c-4e39-b276-4c1e36d07215', 'volume_size': 1, 'image_id': '11597dd5-e97a-429a-b6df-73d39911c009', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/11597dd5-e97a-429a-b6df-73d39911c009', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1509857773', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '44b49649c6b54bd5b17e3c481ffa806a', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '11597dd5-e97a-429a-b6df-73d39911c009', 'created_at': datetime.datetime(2026, 6, 17, 2, 47, 4, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 17, 2, 47, 6, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/11597dd5-e97a-429a-b6df-73d39911c009/file', 'properties': {}}, 'image_service': } Jun 17 04:47:09 devstack cinder-volume[92060]: DEBUG cinder.volume.flows.manager.create_volume [None req-0558062f-4406-475e-95ac-86755c2f85fb tempest-TestInstancesWithCinderVolumes-729947751 None] Trying to clone 7dc2c78d-7e4c-4e39-b276-4c1e36d07215 from image 11597dd5-e97a-429a-b6df-73d39911c009 at location (None, [{'url': 'file:///opt/stack/data/glance/images/11597dd5-e97a-429a-b6df-73d39911c009', 'metadata': {}}]). {{(pid=92060) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jun 17 04:47:09 devstack sudo[103305]: pam_unix(sudo:session): session closed for user root Jun 17 04:47:09 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-fb4e6c81-f1df-4d3b-bc62-3a88e4e52712 tempest-TestInstancesWithCinderVolumes-729947751 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-1bdbda56-f74d-4574-a81c-741cf74d19a9" returned: 0 in 1.026s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:47:09 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-fb4e6c81-f1df-4d3b-bc62-3a88e4e52712 tempest-TestInstancesWithCinderVolumes-729947751 None] <== create_volume: return (2601ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588'} {{(pid=92060) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 17 04:47:09 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-fb4e6c81-f1df-4d3b-bc62-3a88e4e52712 tempest-TestInstancesWithCinderVolumes-729947751 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.606s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 04:47:09 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-7aa4e267-c046-4f16-865d-d29646b5e15d tempest-TestInstancesWithCinderVolumes-729947751 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.109s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 04:47:09 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-7aa4e267-c046-4f16-865d-d29646b5e15d tempest-TestInstancesWithCinderVolumes-729947751 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-17T02:47:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1325420930',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7ad20cd3-2204-4cad-8706-e9d0e0ae3442,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='44b49649c6b54bd5b17e3c481ffa806a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T02:47:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T02:47:08Z,use_quota=True,user_id='4ef94c0ee9434ef5a07e1de9280b8bc7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ac756d64-c7cc-4362-8998-81b20232de04),volume_type_id=ac756d64-c7cc-4362-8998-81b20232de04)}" {{(pid=92060) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 17 04:47:09 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.remotefs [None req-7aa4e267-c046-4f16-865d-d29646b5e15d tempest-TestInstancesWithCinderVolumes-729947751 None] Creating volume 7ad20cd3-2204-4cad-8706-e9d0e0ae3442 {{(pid=92060) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 17 04:47:09 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-7aa4e267-c046-4f16-865d-d29646b5e15d tempest-TestInstancesWithCinderVolumes-729947751 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 04:47:09 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-7aa4e267-c046-4f16-865d-d29646b5e15d tempest-TestInstancesWithCinderVolumes-729947751 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 04:47:09 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-7aa4e267-c046-4f16-865d-d29646b5e15d tempest-TestInstancesWithCinderVolumes-729947751 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588': None} {{(pid=92060) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 17 04:47:09 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-7aa4e267-c046-4f16-865d-d29646b5e15d tempest-TestInstancesWithCinderVolumes-729947751 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588'] {{(pid=92060) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 17 04:47:09 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-7aa4e267-c046-4f16-865d-d29646b5e15d tempest-TestInstancesWithCinderVolumes-729947751 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 04:47:09 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-7aa4e267-c046-4f16-865d-d29646b5e15d tempest-TestInstancesWithCinderVolumes-729947751 None] Selected osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588 as target Quobyte volume. {{(pid=92060) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 17 04:47:09 devstack cinder-volume[92060]: INFO cinder.volume.drivers.remotefs [None req-7aa4e267-c046-4f16-865d-d29646b5e15d tempest-TestInstancesWithCinderVolumes-729947751 None] casted to osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588 Jun 17 04:47:09 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-7aa4e267-c046-4f16-865d-d29646b5e15d tempest-TestInstancesWithCinderVolumes-729947751 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-7ad20cd3-2204-4cad-8706-e9d0e0ae3442 1073741824 {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:47:10 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-fb4e6c81-f1df-4d3b-bc62-3a88e4e52712 tempest-TestInstancesWithCinderVolumes-729947751 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8adccefc-deca-4d54-9e2f-9ab7b70f5462) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1bdbda56-f74d-4574-a81c-741cf74d19a9', 'volume_size': 1}' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:47:10 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-fb4e6c81-f1df-4d3b-bc62-3a88e4e52712 tempest-TestInstancesWithCinderVolumes-729947751 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7c264b7b-ccde-437c-a549-fe3d2517f0db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:47:10 devstack sudo[103309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-7ad20cd3-2204-4cad-8706-e9d0e0ae3442 1073741824 Jun 17 04:47:10 devstack sudo[103309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:47:10 devstack cinder-volume[92060]: INFO cinder.volume.flows.manager.create_volume [None req-fb4e6c81-f1df-4d3b-bc62-3a88e4e52712 tempest-TestInstancesWithCinderVolumes-729947751 None] Volume volume-1bdbda56-f74d-4574-a81c-741cf74d19a9 (1bdbda56-f74d-4574-a81c-741cf74d19a9): created successfully Jun 17 04:47:10 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-fb4e6c81-f1df-4d3b-bc62-3a88e4e52712 tempest-TestInstancesWithCinderVolumes-729947751 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7c264b7b-ccde-437c-a549-fe3d2517f0db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:47:10 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-fb4e6c81-f1df-4d3b-bc62-3a88e4e52712 tempest-TestInstancesWithCinderVolumes-729947751 None] Flow 'volume_create_manager' (73f6ef70-a12d-4268-8119-2019a7a64c67) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92060) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 17 04:47:10 devstack cinder-volume[92060]: INFO cinder.volume.manager [None req-fb4e6c81-f1df-4d3b-bc62-3a88e4e52712 tempest-TestInstancesWithCinderVolumes-729947751 None] Created volume successfully. Jun 17 04:47:11 devstack sudo[103309]: pam_unix(sudo:session): session closed for user root Jun 17 04:47:11 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-7aa4e267-c046-4f16-865d-d29646b5e15d tempest-TestInstancesWithCinderVolumes-729947751 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-7ad20cd3-2204-4cad-8706-e9d0e0ae3442 1073741824" returned: 0 in 1.290s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:47:11 devstack cinder-volume[92060]: INFO cinder.volume.manager [req-40488758-c18f-43f7-9716-33217b9a70c0 req-fa5a6084-979b-43b7-a9a6-3ff093365751 tempest-AttachVolumeNegativeTest-991296233 None] Terminate volume connection completed successfully. Jun 17 04:47:11 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [req-40488758-c18f-43f7-9716-33217b9a70c0 req-fa5a6084-979b-43b7-a9a6-3ff093365751 tempest-AttachVolumeNegativeTest-991296233 None] Deleting attachment ca4118ed-9b7c-48d0-9f45-55c06ba8f118. {{(pid=92060) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 17 04:47:11 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-7aa4e267-c046-4f16-865d-d29646b5e15d tempest-TestInstancesWithCinderVolumes-729947751 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-7ad20cd3-2204-4cad-8706-e9d0e0ae3442 {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:47:11 devstack sudo[103322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-7ad20cd3-2204-4cad-8706-e9d0e0ae3442 Jun 17 04:47:11 devstack sudo[103322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:47:11 devstack sudo[103322]: pam_unix(sudo:session): session closed for user root Jun 17 04:47:11 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-7aa4e267-c046-4f16-865d-d29646b5e15d tempest-TestInstancesWithCinderVolumes-729947751 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-7ad20cd3-2204-4cad-8706-e9d0e0ae3442" returned: 0 in 0.637s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:47:11 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-7aa4e267-c046-4f16-865d-d29646b5e15d tempest-TestInstancesWithCinderVolumes-729947751 None] <== create_volume: return (1985ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588'} {{(pid=92060) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 17 04:47:11 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-7aa4e267-c046-4f16-865d-d29646b5e15d tempest-TestInstancesWithCinderVolumes-729947751 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.988s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 04:47:11 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-7aa4e267-c046-4f16-865d-d29646b5e15d tempest-TestInstancesWithCinderVolumes-729947751 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ec8a00d6-fd5b-4b31-91d6-9dc4da2935b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7ad20cd3-2204-4cad-8706-e9d0e0ae3442', 'volume_size': 1}' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:47:11 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-7aa4e267-c046-4f16-865d-d29646b5e15d tempest-TestInstancesWithCinderVolumes-729947751 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c98ccfb7-e218-41db-a14a-7f1915063a87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:47:12 devstack cinder-volume[92060]: INFO cinder.volume.flows.manager.create_volume [None req-7aa4e267-c046-4f16-865d-d29646b5e15d tempest-TestInstancesWithCinderVolumes-729947751 None] Volume volume-7ad20cd3-2204-4cad-8706-e9d0e0ae3442 (7ad20cd3-2204-4cad-8706-e9d0e0ae3442): created successfully Jun 17 04:47:12 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-7aa4e267-c046-4f16-865d-d29646b5e15d tempest-TestInstancesWithCinderVolumes-729947751 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c98ccfb7-e218-41db-a14a-7f1915063a87) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:47:12 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-7aa4e267-c046-4f16-865d-d29646b5e15d tempest-TestInstancesWithCinderVolumes-729947751 None] Flow 'volume_create_manager' (fb6ef7f0-d2cc-403f-960d-e650d6151bcb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92060) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 17 04:47:12 devstack cinder-volume[92060]: INFO cinder.volume.manager [None req-7aa4e267-c046-4f16-865d-d29646b5e15d tempest-TestInstancesWithCinderVolumes-729947751 None] Created volume successfully. Jun 17 04:47:14 devstack cinder-volume[92060]: DEBUG cinder.image.image_utils [None req-0558062f-4406-475e-95ac-86755c2f85fb tempest-TestInstancesWithCinderVolumes-729947751 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_11597dd5-e97a-429a-b6df-73d39911c009_17fgv6prdevstack@QuobyteHD, size 20.69 MB, duration 4.72 sec {{(pid=92060) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jun 17 04:47:14 devstack cinder-volume[92060]: INFO cinder.image.image_utils [None req-0558062f-4406-475e-95ac-86755c2f85fb tempest-TestInstancesWithCinderVolumes-729947751 None] Image download 20.69 MB at 4.38 MB/s Jun 17 04:47:14 devstack cinder-volume[92060]: DEBUG oslo.privsep.daemon [-] privsep: reply[00b0b4b8-7b4c-445d-9d99-97b265feca8a]: (4, 'qcow2') {{(pid=93130) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 04:47:14 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-0558062f-4406-475e-95ac-86755c2f85fb tempest-TestInstancesWithCinderVolumes-729947751 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_11597dd5-e97a-429a-b6df-73d39911c009_17fgv6prdevstack@QuobyteHD {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:47:14 devstack sudo[103326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_11597dd5-e97a-429a-b6df-73d39911c009_17fgv6prdevstack@QuobyteHD Jun 17 04:47:14 devstack sudo[103326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:47:15 devstack sudo[103326]: pam_unix(sudo:session): session closed for user root Jun 17 04:47:15 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-0558062f-4406-475e-95ac-86755c2f85fb tempest-TestInstancesWithCinderVolumes-729947751 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_11597dd5-e97a-429a-b6df-73d39911c009_17fgv6prdevstack@QuobyteHD" returned: 0 in 0.934s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:47:15 devstack cinder-volume[92060]: DEBUG cinder.image.image_utils [None req-0558062f-4406-475e-95ac-86755c2f85fb tempest-TestInstancesWithCinderVolumes-729947751 None] Temporary image 11597dd5-e97a-429a-b6df-73d39911c009 is fetched for user 4ef94c0ee9434ef5a07e1de9280b8bc7. {{(pid=92060) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jun 17 04:47:15 devstack cinder-volume[92060]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b62418d-5210-4a0c-9095-844bec6b0b7a]: (4, 'qcow2') {{(pid=93130) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 04:47:15 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-0558062f-4406-475e-95ac-86755c2f85fb tempest-TestInstancesWithCinderVolumes-729947751 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_11597dd5-e97a-429a-b6df-73d39911c009_17fgv6prdevstack@QuobyteHD {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:47:15 devstack sudo[103373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_11597dd5-e97a-429a-b6df-73d39911c009_17fgv6prdevstack@QuobyteHD Jun 17 04:47:15 devstack sudo[103373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:47:16 devstack sudo[103373]: pam_unix(sudo:session): session closed for user root Jun 17 04:47:16 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-0558062f-4406-475e-95ac-86755c2f85fb tempest-TestInstancesWithCinderVolumes-729947751 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_11597dd5-e97a-429a-b6df-73d39911c009_17fgv6prdevstack@QuobyteHD" returned: 0 in 0.845s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:47:16 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-0558062f-4406-475e-95ac-86755c2f85fb tempest-TestInstancesWithCinderVolumes-729947751 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 04:47:16 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-0558062f-4406-475e-95ac-86755c2f85fb tempest-TestInstancesWithCinderVolumes-729947751 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 04:47:16 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-0558062f-4406-475e-95ac-86755c2f85fb tempest-TestInstancesWithCinderVolumes-729947751 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-17T02:47:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1686722239',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7dc2c78d-7e4c-4e39-b276-4c1e36d07215,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='44b49649c6b54bd5b17e3c481ffa806a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T02:47:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T02:47:09Z,use_quota=True,user_id='4ef94c0ee9434ef5a07e1de9280b8bc7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d2fdd8a-8e42-450e-ac18-caa4e725ac9d),volume_type_id=9d2fdd8a-8e42-450e-ac18-caa4e725ac9d)}" {{(pid=92060) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 17 04:47:16 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.remotefs [None req-0558062f-4406-475e-95ac-86755c2f85fb tempest-TestInstancesWithCinderVolumes-729947751 None] Creating volume 7dc2c78d-7e4c-4e39-b276-4c1e36d07215 {{(pid=92060) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 17 04:47:16 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-0558062f-4406-475e-95ac-86755c2f85fb tempest-TestInstancesWithCinderVolumes-729947751 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 04:47:16 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-0558062f-4406-475e-95ac-86755c2f85fb tempest-TestInstancesWithCinderVolumes-729947751 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 04:47:16 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-0558062f-4406-475e-95ac-86755c2f85fb tempest-TestInstancesWithCinderVolumes-729947751 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588': None} {{(pid=92060) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 17 04:47:16 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-0558062f-4406-475e-95ac-86755c2f85fb tempest-TestInstancesWithCinderVolumes-729947751 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588'] {{(pid=92060) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 17 04:47:16 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-0558062f-4406-475e-95ac-86755c2f85fb tempest-TestInstancesWithCinderVolumes-729947751 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 04:47:16 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-0558062f-4406-475e-95ac-86755c2f85fb tempest-TestInstancesWithCinderVolumes-729947751 None] Selected osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588 as target Quobyte volume. {{(pid=92060) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 17 04:47:16 devstack cinder-volume[92060]: INFO cinder.volume.drivers.remotefs [None req-0558062f-4406-475e-95ac-86755c2f85fb tempest-TestInstancesWithCinderVolumes-729947751 None] casted to osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588 Jun 17 04:47:16 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-0558062f-4406-475e-95ac-86755c2f85fb tempest-TestInstancesWithCinderVolumes-729947751 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-7dc2c78d-7e4c-4e39-b276-4c1e36d07215 1073741824 {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:47:16 devstack sudo[103379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-7dc2c78d-7e4c-4e39-b276-4c1e36d07215 1073741824 Jun 17 04:47:16 devstack sudo[103379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:47:17 devstack sudo[103379]: pam_unix(sudo:session): session closed for user root Jun 17 04:47:17 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-0558062f-4406-475e-95ac-86755c2f85fb tempest-TestInstancesWithCinderVolumes-729947751 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-7dc2c78d-7e4c-4e39-b276-4c1e36d07215 1073741824" returned: 0 in 1.122s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:47:17 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-0558062f-4406-475e-95ac-86755c2f85fb tempest-TestInstancesWithCinderVolumes-729947751 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-7dc2c78d-7e4c-4e39-b276-4c1e36d07215 {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:47:17 devstack sudo[103387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-7dc2c78d-7e4c-4e39-b276-4c1e36d07215 Jun 17 04:47:17 devstack sudo[103387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:47:17 devstack sudo[103387]: pam_unix(sudo:session): session closed for user root Jun 17 04:47:17 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-0558062f-4406-475e-95ac-86755c2f85fb tempest-TestInstancesWithCinderVolumes-729947751 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-7dc2c78d-7e4c-4e39-b276-4c1e36d07215" returned: 0 in 0.647s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:47:17 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-0558062f-4406-475e-95ac-86755c2f85fb tempest-TestInstancesWithCinderVolumes-729947751 None] <== create_volume: return (1817ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588'} {{(pid=92060) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 17 04:47:17 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-0558062f-4406-475e-95ac-86755c2f85fb tempest-TestInstancesWithCinderVolumes-729947751 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.821s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 04:47:18 devstack cinder-volume[92060]: DEBUG cinder.volume.volume_utils [None req-0558062f-4406-475e-95ac-86755c2f85fb tempest-TestInstancesWithCinderVolumes-729947751 None] Attempting download of 11597dd5-e97a-429a-b6df-73d39911c009 ((None, [{'url': 'file:///opt/stack/data/glance/images/11597dd5-e97a-429a-b6df-73d39911c009', 'metadata': {}}])) to volume 7dc2c78d-7e4c-4e39-b276-4c1e36d07215. {{(pid=92060) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jun 17 04:47:18 devstack cinder-volume[92060]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5f31e0b-2583-4012-9e9f-68f243636c2d]: (4, 'raw') {{(pid=93130) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 04:47:18 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-0558062f-4406-475e-95ac-86755c2f85fb tempest-TestInstancesWithCinderVolumes-729947751 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_11597dd5-e97a-429a-b6df-73d39911c009_nedygw3w {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:47:18 devstack sudo[103390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_11597dd5-e97a-429a-b6df-73d39911c009_nedygw3w Jun 17 04:47:18 devstack sudo[103390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:47:18 devstack sudo[103390]: pam_unix(sudo:session): session closed for user root Jun 17 04:47:18 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-0558062f-4406-475e-95ac-86755c2f85fb tempest-TestInstancesWithCinderVolumes-729947751 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_11597dd5-e97a-429a-b6df-73d39911c009_nedygw3w" returned: 0 in 0.812s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:47:18 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-0558062f-4406-475e-95ac-86755c2f85fb tempest-TestInstancesWithCinderVolumes-729947751 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_11597dd5-e97a-429a-b6df-73d39911c009_nedygw3w {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:47:19 devstack sudo[103396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_11597dd5-e97a-429a-b6df-73d39911c009_nedygw3w Jun 17 04:47:19 devstack sudo[103396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:47:19 devstack sudo[103396]: pam_unix(sudo:session): session closed for user root Jun 17 04:47:19 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-0558062f-4406-475e-95ac-86755c2f85fb tempest-TestInstancesWithCinderVolumes-729947751 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_11597dd5-e97a-429a-b6df-73d39911c009_nedygw3w" returned: 1 in 0.781s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:47:19 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-0558062f-4406-475e-95ac-86755c2f85fb tempest-TestInstancesWithCinderVolumes-729947751 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_11597dd5-e97a-429a-b6df-73d39911c009_nedygw3w' failed. Not Retrying. {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 17 04:47:19 devstack cinder-volume[92060]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b3624d5-6bdc-4879-989f-0e775f750233]: (4, 'qcow2') {{(pid=93130) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 04:47:19 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-0558062f-4406-475e-95ac-86755c2f85fb tempest-TestInstancesWithCinderVolumes-729947751 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_11597dd5-e97a-429a-b6df-73d39911c009_17fgv6prdevstack@QuobyteHD {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:47:19 devstack cinder-volume[92060]: DEBUG cinder.volume.flows.manager.create_volume [None req-db164714-62eb-4ea7-9fe2-b649e544f166 tempest-CreateVolumesFromImageTest-473003405 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92060) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 17 04:47:19 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-db164714-62eb-4ea7-9fe2-b649e544f166 tempest-CreateVolumesFromImageTest-473003405 None] Flow 'volume_create_manager' (4876198f-fb43-4836-9e2a-30771feac55a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 17 04:47:19 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-db164714-62eb-4ea7-9fe2-b649e544f166 tempest-CreateVolumesFromImageTest-473003405 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2e07a166-39c8-49b9-b1a2-1956b46db529) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:47:19 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-db164714-62eb-4ea7-9fe2-b649e544f166 tempest-CreateVolumesFromImageTest-473003405 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2e07a166-39c8-49b9-b1a2-1956b46db529) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-17T02:47:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1747449336',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=75b304ef-c1fe-4ce6-9378-6280c405e300,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a334909aea7644029950b211784296dd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T02:47:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T02:47:20Z,use_quota=True,user_id='b9d12aa579d440ec9f8dabcb249c8148',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aad9ce24-93f9-41a6-baa1-5125964f96d1),volume_type_id=aad9ce24-93f9-41a6-baa1-5125964f96d1)' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:47:19 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-db164714-62eb-4ea7-9fe2-b649e544f166 tempest-CreateVolumesFromImageTest-473003405 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7f852667-cd8a-41e8-ac9b-d4fb7e706785) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:47:19 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-db164714-62eb-4ea7-9fe2-b649e544f166 tempest-CreateVolumesFromImageTest-473003405 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7f852667-cd8a-41e8-ac9b-d4fb7e706785) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:47:19 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-db164714-62eb-4ea7-9fe2-b649e544f166 tempest-CreateVolumesFromImageTest-473003405 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1a6905ef-fa4f-482b-a5fe-3b80825cfdba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:47:19 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-db164714-62eb-4ea7-9fe2-b649e544f166 tempest-CreateVolumesFromImageTest-473003405 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1a6905ef-fa4f-482b-a5fe-3b80825cfdba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '75b304ef-c1fe-4ce6-9378-6280c405e300', 'volume_name': 'volume-75b304ef-c1fe-4ce6-9378-6280c405e300', 'volume_size': 1}' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:47:19 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-db164714-62eb-4ea7-9fe2-b649e544f166 tempest-CreateVolumesFromImageTest-473003405 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fe7dcfff-053e-4ed7-8d2f-adbe772c834f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:47:19 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-db164714-62eb-4ea7-9fe2-b649e544f166 tempest-CreateVolumesFromImageTest-473003405 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fe7dcfff-053e-4ed7-8d2f-adbe772c834f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:47:19 devstack sudo[103434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_11597dd5-e97a-429a-b6df-73d39911c009_17fgv6prdevstack@QuobyteHD Jun 17 04:47:19 devstack sudo[103434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:47:19 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-db164714-62eb-4ea7-9fe2-b649e544f166 tempest-CreateVolumesFromImageTest-473003405 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (631ad348-ce56-4b23-ba52-6b258c6d960c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:47:19 devstack cinder-volume[92060]: INFO cinder.volume.flows.manager.create_volume [None req-db164714-62eb-4ea7-9fe2-b649e544f166 tempest-CreateVolumesFromImageTest-473003405 None] Volume 75b304ef-c1fe-4ce6-9378-6280c405e300: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-75b304ef-c1fe-4ce6-9378-6280c405e300', 'volume_size': 1} Jun 17 04:47:19 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-db164714-62eb-4ea7-9fe2-b649e544f166 tempest-CreateVolumesFromImageTest-473003405 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 04:47:19 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-db164714-62eb-4ea7-9fe2-b649e544f166 tempest-CreateVolumesFromImageTest-473003405 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 04:47:19 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-db164714-62eb-4ea7-9fe2-b649e544f166 tempest-CreateVolumesFromImageTest-473003405 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-17T02:47:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1747449336',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=75b304ef-c1fe-4ce6-9378-6280c405e300,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a334909aea7644029950b211784296dd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T02:47:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T02:47:20Z,use_quota=True,user_id='b9d12aa579d440ec9f8dabcb249c8148',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aad9ce24-93f9-41a6-baa1-5125964f96d1),volume_type_id=aad9ce24-93f9-41a6-baa1-5125964f96d1)}" {{(pid=92060) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 17 04:47:19 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.remotefs [None req-db164714-62eb-4ea7-9fe2-b649e544f166 tempest-CreateVolumesFromImageTest-473003405 None] Creating volume 75b304ef-c1fe-4ce6-9378-6280c405e300 {{(pid=92060) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 17 04:47:19 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-db164714-62eb-4ea7-9fe2-b649e544f166 tempest-CreateVolumesFromImageTest-473003405 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 04:47:19 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-db164714-62eb-4ea7-9fe2-b649e544f166 tempest-CreateVolumesFromImageTest-473003405 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 04:47:19 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-db164714-62eb-4ea7-9fe2-b649e544f166 tempest-CreateVolumesFromImageTest-473003405 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588': None} {{(pid=92060) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 17 04:47:19 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-db164714-62eb-4ea7-9fe2-b649e544f166 tempest-CreateVolumesFromImageTest-473003405 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588'] {{(pid=92060) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 17 04:47:19 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-db164714-62eb-4ea7-9fe2-b649e544f166 tempest-CreateVolumesFromImageTest-473003405 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 04:47:19 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-db164714-62eb-4ea7-9fe2-b649e544f166 tempest-CreateVolumesFromImageTest-473003405 None] Selected osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588 as target Quobyte volume. {{(pid=92060) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 17 04:47:19 devstack cinder-volume[92060]: INFO cinder.volume.drivers.remotefs [None req-db164714-62eb-4ea7-9fe2-b649e544f166 tempest-CreateVolumesFromImageTest-473003405 None] casted to osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588 Jun 17 04:47:19 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-db164714-62eb-4ea7-9fe2-b649e544f166 tempest-CreateVolumesFromImageTest-473003405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-75b304ef-c1fe-4ce6-9378-6280c405e300 1073741824 {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:47:20 devstack sudo[103438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-75b304ef-c1fe-4ce6-9378-6280c405e300 1073741824 Jun 17 04:47:20 devstack sudo[103438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:47:20 devstack cinder-volume[92060]: DEBUG cinder.volume.flows.manager.create_volume [None req-921c15cb-f3d5-4381-a701-b0f61079e7a2 tempest-CreateVolumesFromImageTest-473003405 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92060) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 17 04:47:20 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-921c15cb-f3d5-4381-a701-b0f61079e7a2 tempest-CreateVolumesFromImageTest-473003405 None] Flow 'volume_create_manager' (15be1ad9-4e3c-4bec-8ee5-6c50e6ccfb96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 17 04:47:20 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-921c15cb-f3d5-4381-a701-b0f61079e7a2 tempest-CreateVolumesFromImageTest-473003405 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b2b67956-d0e3-4983-87d7-0c6ef92700bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:47:20 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-921c15cb-f3d5-4381-a701-b0f61079e7a2 tempest-CreateVolumesFromImageTest-473003405 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b2b67956-d0e3-4983-87d7-0c6ef92700bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-17T02:47:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1076404581',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5e26ad42-847e-4351-bc81-1d313131cc47,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a334909aea7644029950b211784296dd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T02:47:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T02:47:20Z,use_quota=True,user_id='b9d12aa579d440ec9f8dabcb249c8148',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aad9ce24-93f9-41a6-baa1-5125964f96d1),volume_type_id=aad9ce24-93f9-41a6-baa1-5125964f96d1)' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:47:20 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-921c15cb-f3d5-4381-a701-b0f61079e7a2 tempest-CreateVolumesFromImageTest-473003405 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (771cf720-da0c-46dd-9cd5-2234e39df28e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:47:20 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-921c15cb-f3d5-4381-a701-b0f61079e7a2 tempest-CreateVolumesFromImageTest-473003405 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (771cf720-da0c-46dd-9cd5-2234e39df28e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:47:20 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-921c15cb-f3d5-4381-a701-b0f61079e7a2 tempest-CreateVolumesFromImageTest-473003405 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c731663a-6d0c-4c10-baa1-8acbcf9612f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:47:20 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-921c15cb-f3d5-4381-a701-b0f61079e7a2 tempest-CreateVolumesFromImageTest-473003405 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c731663a-6d0c-4c10-baa1-8acbcf9612f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5e26ad42-847e-4351-bc81-1d313131cc47', 'volume_name': 'volume-5e26ad42-847e-4351-bc81-1d313131cc47', 'volume_size': 1}' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:47:20 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-921c15cb-f3d5-4381-a701-b0f61079e7a2 tempest-CreateVolumesFromImageTest-473003405 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d047f6a8-a1a3-4196-9c91-14c0be1adb34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:47:20 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-921c15cb-f3d5-4381-a701-b0f61079e7a2 tempest-CreateVolumesFromImageTest-473003405 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d047f6a8-a1a3-4196-9c91-14c0be1adb34) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:47:20 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-921c15cb-f3d5-4381-a701-b0f61079e7a2 tempest-CreateVolumesFromImageTest-473003405 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fe612872-3365-471a-95ce-287a5729c70b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:47:20 devstack cinder-volume[92060]: INFO cinder.volume.flows.manager.create_volume [None req-921c15cb-f3d5-4381-a701-b0f61079e7a2 tempest-CreateVolumesFromImageTest-473003405 None] Volume 5e26ad42-847e-4351-bc81-1d313131cc47: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5e26ad42-847e-4351-bc81-1d313131cc47', 'volume_size': 1} Jun 17 04:47:20 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-921c15cb-f3d5-4381-a701-b0f61079e7a2 tempest-CreateVolumesFromImageTest-473003405 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 04:47:20 devstack cinder-volume[92060]: DEBUG cinder.volume.flows.manager.create_volume [None req-06c411f5-3e05-4fe6-8fa5-7ffceb117437 tempest-CreateVolumesFromImageTest-473003405 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92060) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 17 04:47:20 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-06c411f5-3e05-4fe6-8fa5-7ffceb117437 tempest-CreateVolumesFromImageTest-473003405 None] Flow 'volume_create_manager' (90f34091-10ae-408f-aaf5-8df10fceb45b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 17 04:47:20 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-06c411f5-3e05-4fe6-8fa5-7ffceb117437 tempest-CreateVolumesFromImageTest-473003405 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8cdd14d2-80f4-4480-8cce-02705a0b2e44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:47:21 devstack sudo[103434]: pam_unix(sudo:session): session closed for user root Jun 17 04:47:21 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-06c411f5-3e05-4fe6-8fa5-7ffceb117437 tempest-CreateVolumesFromImageTest-473003405 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8cdd14d2-80f4-4480-8cce-02705a0b2e44) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-17T02:47:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2078684295',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3b0770d2-e473-4ca7-bf82-2fc4aee41ec8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a334909aea7644029950b211784296dd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T02:47:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T02:47:21Z,use_quota=True,user_id='b9d12aa579d440ec9f8dabcb249c8148',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aad9ce24-93f9-41a6-baa1-5125964f96d1),volume_type_id=aad9ce24-93f9-41a6-baa1-5125964f96d1)' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:47:21 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-06c411f5-3e05-4fe6-8fa5-7ffceb117437 tempest-CreateVolumesFromImageTest-473003405 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (91455d95-d8de-418c-9014-f8d6ff4f58c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:47:21 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-06c411f5-3e05-4fe6-8fa5-7ffceb117437 tempest-CreateVolumesFromImageTest-473003405 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (91455d95-d8de-418c-9014-f8d6ff4f58c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:47:21 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-06c411f5-3e05-4fe6-8fa5-7ffceb117437 tempest-CreateVolumesFromImageTest-473003405 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (16b5c6ef-81d3-4946-9857-8f119d4145b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:47:21 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-06c411f5-3e05-4fe6-8fa5-7ffceb117437 tempest-CreateVolumesFromImageTest-473003405 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (16b5c6ef-81d3-4946-9857-8f119d4145b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3b0770d2-e473-4ca7-bf82-2fc4aee41ec8', 'volume_name': 'volume-3b0770d2-e473-4ca7-bf82-2fc4aee41ec8', 'volume_size': 1}' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:47:21 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-06c411f5-3e05-4fe6-8fa5-7ffceb117437 tempest-CreateVolumesFromImageTest-473003405 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (28c4f971-aa20-4ea1-ba49-8dfc7c084f69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:47:21 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-06c411f5-3e05-4fe6-8fa5-7ffceb117437 tempest-CreateVolumesFromImageTest-473003405 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (28c4f971-aa20-4ea1-ba49-8dfc7c084f69) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:47:21 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-06c411f5-3e05-4fe6-8fa5-7ffceb117437 tempest-CreateVolumesFromImageTest-473003405 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6d085771-1f6b-43e8-90da-7e7fac010f59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:47:21 devstack cinder-volume[92060]: INFO cinder.volume.flows.manager.create_volume [None req-06c411f5-3e05-4fe6-8fa5-7ffceb117437 tempest-CreateVolumesFromImageTest-473003405 None] Volume 3b0770d2-e473-4ca7-bf82-2fc4aee41ec8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3b0770d2-e473-4ca7-bf82-2fc4aee41ec8', 'volume_size': 1} Jun 17 04:47:21 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-06c411f5-3e05-4fe6-8fa5-7ffceb117437 tempest-CreateVolumesFromImageTest-473003405 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 04:47:21 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-0558062f-4406-475e-95ac-86755c2f85fb tempest-TestInstancesWithCinderVolumes-729947751 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_11597dd5-e97a-429a-b6df-73d39911c009_17fgv6prdevstack@QuobyteHD" returned: 0 in 1.407s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:47:21 devstack cinder-volume[92060]: DEBUG cinder.image.image_utils [None req-0558062f-4406-475e-95ac-86755c2f85fb tempest-TestInstancesWithCinderVolumes-729947751 None] 11597dd5-e97a-429a-b6df-73d39911c009 was qcow2, converting to raw {{(pid=92060) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jun 17 04:47:21 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-0558062f-4406-475e-95ac-86755c2f85fb tempest-TestInstancesWithCinderVolumes-729947751 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_11597dd5-e97a-429a-b6df-73d39911c009_17fgv6prdevstack@QuobyteHD /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-7dc2c78d-7e4c-4e39-b276-4c1e36d07215 {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:47:21 devstack sudo[103448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_11597dd5-e97a-429a-b6df-73d39911c009_17fgv6prdevstack@QuobyteHD /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-7dc2c78d-7e4c-4e39-b276-4c1e36d07215 Jun 17 04:47:21 devstack sudo[103448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:47:21 devstack sudo[103438]: pam_unix(sudo:session): session closed for user root Jun 17 04:47:21 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-db164714-62eb-4ea7-9fe2-b649e544f166 tempest-CreateVolumesFromImageTest-473003405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-75b304ef-c1fe-4ce6-9378-6280c405e300 1073741824" returned: 0 in 1.282s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:47:21 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-db164714-62eb-4ea7-9fe2-b649e544f166 tempest-CreateVolumesFromImageTest-473003405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-75b304ef-c1fe-4ce6-9378-6280c405e300 {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:47:21 devstack sudo[103450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-75b304ef-c1fe-4ce6-9378-6280c405e300 Jun 17 04:47:21 devstack sudo[103450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:47:21 devstack cinder-volume[92060]: DEBUG cinder.volume.flows.manager.create_volume [None req-d94a3e1b-fa27-4488-baac-f5df003a82d4 tempest-CreateVolumesFromImageTest-473003405 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92060) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 17 04:47:21 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-d94a3e1b-fa27-4488-baac-f5df003a82d4 tempest-CreateVolumesFromImageTest-473003405 None] Flow 'volume_create_manager' (54e803e8-3188-4ebd-a51d-d9c43b7906b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 17 04:47:21 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-d94a3e1b-fa27-4488-baac-f5df003a82d4 tempest-CreateVolumesFromImageTest-473003405 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c74fb65d-e5cf-483e-9079-e0725e6cf043) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:47:21 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-d94a3e1b-fa27-4488-baac-f5df003a82d4 tempest-CreateVolumesFromImageTest-473003405 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c74fb65d-e5cf-483e-9079-e0725e6cf043) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-17T02:47:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-547731205',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1d59dc8b-04d1-47b0-a900-e02113ea8f97,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a334909aea7644029950b211784296dd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T02:47:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T02:47:21Z,use_quota=True,user_id='b9d12aa579d440ec9f8dabcb249c8148',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aad9ce24-93f9-41a6-baa1-5125964f96d1),volume_type_id=aad9ce24-93f9-41a6-baa1-5125964f96d1)' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:47:21 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-d94a3e1b-fa27-4488-baac-f5df003a82d4 tempest-CreateVolumesFromImageTest-473003405 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (74f5662b-456b-43d9-be23-098595346fcb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:47:21 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-d94a3e1b-fa27-4488-baac-f5df003a82d4 tempest-CreateVolumesFromImageTest-473003405 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (74f5662b-456b-43d9-be23-098595346fcb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:47:21 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-d94a3e1b-fa27-4488-baac-f5df003a82d4 tempest-CreateVolumesFromImageTest-473003405 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (be0baee2-5bc9-42c1-b41e-2696163072c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:47:21 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-d94a3e1b-fa27-4488-baac-f5df003a82d4 tempest-CreateVolumesFromImageTest-473003405 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (be0baee2-5bc9-42c1-b41e-2696163072c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1d59dc8b-04d1-47b0-a900-e02113ea8f97', 'volume_name': 'volume-1d59dc8b-04d1-47b0-a900-e02113ea8f97', 'volume_size': 1}' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:47:21 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-d94a3e1b-fa27-4488-baac-f5df003a82d4 tempest-CreateVolumesFromImageTest-473003405 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (70996ccd-1c21-4407-bbe2-71f8edfbebd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:47:21 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-d94a3e1b-fa27-4488-baac-f5df003a82d4 tempest-CreateVolumesFromImageTest-473003405 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (70996ccd-1c21-4407-bbe2-71f8edfbebd7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:47:21 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-d94a3e1b-fa27-4488-baac-f5df003a82d4 tempest-CreateVolumesFromImageTest-473003405 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5026fc19-df21-4041-9d7c-d5c4de3e0181) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:47:21 devstack cinder-volume[92060]: INFO cinder.volume.flows.manager.create_volume [None req-d94a3e1b-fa27-4488-baac-f5df003a82d4 tempest-CreateVolumesFromImageTest-473003405 None] Volume 1d59dc8b-04d1-47b0-a900-e02113ea8f97: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1d59dc8b-04d1-47b0-a900-e02113ea8f97', 'volume_size': 1} Jun 17 04:47:21 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-d94a3e1b-fa27-4488-baac-f5df003a82d4 tempest-CreateVolumesFromImageTest-473003405 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 04:47:22 devstack cinder-volume[92060]: DEBUG cinder.volume.flows.manager.create_volume [None req-e6b9e22e-db43-4d6f-a223-a61f7532802f tempest-CreateVolumesFromImageTest-473003405 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92060) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 17 04:47:22 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-e6b9e22e-db43-4d6f-a223-a61f7532802f tempest-CreateVolumesFromImageTest-473003405 None] Flow 'volume_create_manager' (a891597d-fb8c-456a-83b1-5837999bf555) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 17 04:47:22 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-e6b9e22e-db43-4d6f-a223-a61f7532802f tempest-CreateVolumesFromImageTest-473003405 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (794ae4d0-084b-4a77-9812-5fa1caabfaec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:47:22 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-e6b9e22e-db43-4d6f-a223-a61f7532802f tempest-CreateVolumesFromImageTest-473003405 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (794ae4d0-084b-4a77-9812-5fa1caabfaec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-17T02:47:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-87969035',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b3e79e16-6ca9-4fef-a2ff-b957a53a4b0d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a334909aea7644029950b211784296dd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T02:47:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T02:47:22Z,use_quota=True,user_id='b9d12aa579d440ec9f8dabcb249c8148',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aad9ce24-93f9-41a6-baa1-5125964f96d1),volume_type_id=aad9ce24-93f9-41a6-baa1-5125964f96d1)' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:47:22 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-e6b9e22e-db43-4d6f-a223-a61f7532802f tempest-CreateVolumesFromImageTest-473003405 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f9591499-aaf2-4463-9a61-0e142014539b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:47:22 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-e6b9e22e-db43-4d6f-a223-a61f7532802f tempest-CreateVolumesFromImageTest-473003405 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f9591499-aaf2-4463-9a61-0e142014539b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:47:22 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-e6b9e22e-db43-4d6f-a223-a61f7532802f tempest-CreateVolumesFromImageTest-473003405 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b820cf6d-e6c6-4a81-ac30-9669786f8a05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:47:22 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-e6b9e22e-db43-4d6f-a223-a61f7532802f tempest-CreateVolumesFromImageTest-473003405 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b820cf6d-e6c6-4a81-ac30-9669786f8a05) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b3e79e16-6ca9-4fef-a2ff-b957a53a4b0d', 'volume_name': 'volume-b3e79e16-6ca9-4fef-a2ff-b957a53a4b0d', 'volume_size': 1}' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:47:22 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-e6b9e22e-db43-4d6f-a223-a61f7532802f tempest-CreateVolumesFromImageTest-473003405 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c78ac7d9-8c98-4027-8a9e-faa81e48b957) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:47:22 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-e6b9e22e-db43-4d6f-a223-a61f7532802f tempest-CreateVolumesFromImageTest-473003405 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c78ac7d9-8c98-4027-8a9e-faa81e48b957) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:47:22 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-e6b9e22e-db43-4d6f-a223-a61f7532802f tempest-CreateVolumesFromImageTest-473003405 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (23387f8f-eae2-4ae2-9a18-fed05bae7e7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:47:22 devstack cinder-volume[92060]: INFO cinder.volume.flows.manager.create_volume [None req-e6b9e22e-db43-4d6f-a223-a61f7532802f tempest-CreateVolumesFromImageTest-473003405 None] Volume b3e79e16-6ca9-4fef-a2ff-b957a53a4b0d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b3e79e16-6ca9-4fef-a2ff-b957a53a4b0d', 'volume_size': 1} Jun 17 04:47:22 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-e6b9e22e-db43-4d6f-a223-a61f7532802f tempest-CreateVolumesFromImageTest-473003405 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 04:47:22 devstack sudo[103450]: pam_unix(sudo:session): session closed for user root Jun 17 04:47:22 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-db164714-62eb-4ea7-9fe2-b649e544f166 tempest-CreateVolumesFromImageTest-473003405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-75b304ef-c1fe-4ce6-9378-6280c405e300" returned: 0 in 1.027s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:47:22 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-db164714-62eb-4ea7-9fe2-b649e544f166 tempest-CreateVolumesFromImageTest-473003405 None] <== create_volume: return (2383ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588'} {{(pid=92060) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 17 04:47:22 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-db164714-62eb-4ea7-9fe2-b649e544f166 tempest-CreateVolumesFromImageTest-473003405 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.390s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 04:47:22 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-921c15cb-f3d5-4381-a701-b0f61079e7a2 tempest-CreateVolumesFromImageTest-473003405 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.693s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 04:47:22 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-921c15cb-f3d5-4381-a701-b0f61079e7a2 tempest-CreateVolumesFromImageTest-473003405 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-17T02:47:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1076404581',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5e26ad42-847e-4351-bc81-1d313131cc47,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a334909aea7644029950b211784296dd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T02:47:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T02:47:20Z,use_quota=True,user_id='b9d12aa579d440ec9f8dabcb249c8148',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aad9ce24-93f9-41a6-baa1-5125964f96d1),volume_type_id=aad9ce24-93f9-41a6-baa1-5125964f96d1)}" {{(pid=92060) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 17 04:47:22 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.remotefs [None req-921c15cb-f3d5-4381-a701-b0f61079e7a2 tempest-CreateVolumesFromImageTest-473003405 None] Creating volume 5e26ad42-847e-4351-bc81-1d313131cc47 {{(pid=92060) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 17 04:47:22 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-921c15cb-f3d5-4381-a701-b0f61079e7a2 tempest-CreateVolumesFromImageTest-473003405 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 04:47:22 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-921c15cb-f3d5-4381-a701-b0f61079e7a2 tempest-CreateVolumesFromImageTest-473003405 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 04:47:22 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-921c15cb-f3d5-4381-a701-b0f61079e7a2 tempest-CreateVolumesFromImageTest-473003405 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588': None} {{(pid=92060) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 17 04:47:22 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-921c15cb-f3d5-4381-a701-b0f61079e7a2 tempest-CreateVolumesFromImageTest-473003405 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588'] {{(pid=92060) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 17 04:47:22 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-921c15cb-f3d5-4381-a701-b0f61079e7a2 tempest-CreateVolumesFromImageTest-473003405 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 04:47:22 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-921c15cb-f3d5-4381-a701-b0f61079e7a2 tempest-CreateVolumesFromImageTest-473003405 None] Selected osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588 as target Quobyte volume. {{(pid=92060) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 17 04:47:22 devstack cinder-volume[92060]: INFO cinder.volume.drivers.remotefs [None req-921c15cb-f3d5-4381-a701-b0f61079e7a2 tempest-CreateVolumesFromImageTest-473003405 None] casted to osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588 Jun 17 04:47:22 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-921c15cb-f3d5-4381-a701-b0f61079e7a2 tempest-CreateVolumesFromImageTest-473003405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-5e26ad42-847e-4351-bc81-1d313131cc47 1073741824 {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:47:22 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-db164714-62eb-4ea7-9fe2-b649e544f166 tempest-CreateVolumesFromImageTest-473003405 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (631ad348-ce56-4b23-ba52-6b258c6d960c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-75b304ef-c1fe-4ce6-9378-6280c405e300', 'volume_size': 1}' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:47:22 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-db164714-62eb-4ea7-9fe2-b649e544f166 tempest-CreateVolumesFromImageTest-473003405 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (74d02ab7-44bd-465f-9775-275351783733) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:47:22 devstack sudo[103461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-5e26ad42-847e-4351-bc81-1d313131cc47 1073741824 Jun 17 04:47:22 devstack sudo[103461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:47:22 devstack cinder-volume[92060]: INFO cinder.volume.flows.manager.create_volume [None req-db164714-62eb-4ea7-9fe2-b649e544f166 tempest-CreateVolumesFromImageTest-473003405 None] Volume volume-75b304ef-c1fe-4ce6-9378-6280c405e300 (75b304ef-c1fe-4ce6-9378-6280c405e300): created successfully Jun 17 04:47:22 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-db164714-62eb-4ea7-9fe2-b649e544f166 tempest-CreateVolumesFromImageTest-473003405 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (74d02ab7-44bd-465f-9775-275351783733) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:47:22 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-db164714-62eb-4ea7-9fe2-b649e544f166 tempest-CreateVolumesFromImageTest-473003405 None] Flow 'volume_create_manager' (4876198f-fb43-4836-9e2a-30771feac55a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92060) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 17 04:47:22 devstack cinder-volume[92060]: INFO cinder.volume.manager [None req-db164714-62eb-4ea7-9fe2-b649e544f166 tempest-CreateVolumesFromImageTest-473003405 None] Created volume successfully. Jun 17 04:47:23 devstack sudo[103461]: pam_unix(sudo:session): session closed for user root Jun 17 04:47:23 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-921c15cb-f3d5-4381-a701-b0f61079e7a2 tempest-CreateVolumesFromImageTest-473003405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-5e26ad42-847e-4351-bc81-1d313131cc47 1073741824" returned: 0 in 1.180s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:47:23 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-921c15cb-f3d5-4381-a701-b0f61079e7a2 tempest-CreateVolumesFromImageTest-473003405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-5e26ad42-847e-4351-bc81-1d313131cc47 {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:47:23 devstack sudo[103467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-5e26ad42-847e-4351-bc81-1d313131cc47 Jun 17 04:47:23 devstack sudo[103467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:47:23 devstack sudo[103448]: pam_unix(sudo:session): session closed for user root Jun 17 04:47:23 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-0558062f-4406-475e-95ac-86755c2f85fb tempest-TestInstancesWithCinderVolumes-729947751 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_11597dd5-e97a-429a-b6df-73d39911c009_17fgv6prdevstack@QuobyteHD /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-7dc2c78d-7e4c-4e39-b276-4c1e36d07215" returned: 0 in 2.832s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:47:23 devstack cinder-volume[92060]: DEBUG cinder.image.image_utils [None req-0558062f-4406-475e-95ac-86755c2f85fb tempest-TestInstancesWithCinderVolumes-729947751 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_11597dd5-e97a-429a-b6df-73d39911c009_17fgv6prdevstack@QuobyteHD, size 112.00 MB, duration 2.84 sec, destination /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-7dc2c78d-7e4c-4e39-b276-4c1e36d07215 {{(pid=92060) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 17 04:47:23 devstack cinder-volume[92060]: INFO cinder.image.image_utils [None req-0558062f-4406-475e-95ac-86755c2f85fb tempest-TestInstancesWithCinderVolumes-729947751 None] Converted 112.00 MB image at 39.47 MB/s Jun 17 04:47:23 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-0558062f-4406-475e-95ac-86755c2f85fb tempest-TestInstancesWithCinderVolumes-729947751 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-7dc2c78d-7e4c-4e39-b276-4c1e36d07215 1G {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:47:23 devstack sudo[103470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-7dc2c78d-7e4c-4e39-b276-4c1e36d07215 1G Jun 17 04:47:23 devstack sudo[103470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:47:24 devstack sudo[103467]: pam_unix(sudo:session): session closed for user root Jun 17 04:47:24 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-921c15cb-f3d5-4381-a701-b0f61079e7a2 tempest-CreateVolumesFromImageTest-473003405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-5e26ad42-847e-4351-bc81-1d313131cc47" returned: 0 in 0.837s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:47:24 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-921c15cb-f3d5-4381-a701-b0f61079e7a2 tempest-CreateVolumesFromImageTest-473003405 None] <== create_volume: return (2077ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588'} {{(pid=92060) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 17 04:47:24 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-921c15cb-f3d5-4381-a701-b0f61079e7a2 tempest-CreateVolumesFromImageTest-473003405 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.081s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 04:47:24 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-06c411f5-3e05-4fe6-8fa5-7ffceb117437 tempest-CreateVolumesFromImageTest-473003405 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.363s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 04:47:24 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-06c411f5-3e05-4fe6-8fa5-7ffceb117437 tempest-CreateVolumesFromImageTest-473003405 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-17T02:47:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2078684295',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3b0770d2-e473-4ca7-bf82-2fc4aee41ec8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a334909aea7644029950b211784296dd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T02:47:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T02:47:21Z,use_quota=True,user_id='b9d12aa579d440ec9f8dabcb249c8148',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aad9ce24-93f9-41a6-baa1-5125964f96d1),volume_type_id=aad9ce24-93f9-41a6-baa1-5125964f96d1)}" {{(pid=92060) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 17 04:47:24 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.remotefs [None req-06c411f5-3e05-4fe6-8fa5-7ffceb117437 tempest-CreateVolumesFromImageTest-473003405 None] Creating volume 3b0770d2-e473-4ca7-bf82-2fc4aee41ec8 {{(pid=92060) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 17 04:47:24 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-06c411f5-3e05-4fe6-8fa5-7ffceb117437 tempest-CreateVolumesFromImageTest-473003405 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 04:47:24 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-06c411f5-3e05-4fe6-8fa5-7ffceb117437 tempest-CreateVolumesFromImageTest-473003405 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 04:47:24 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-06c411f5-3e05-4fe6-8fa5-7ffceb117437 tempest-CreateVolumesFromImageTest-473003405 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588': None} {{(pid=92060) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 17 04:47:24 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-06c411f5-3e05-4fe6-8fa5-7ffceb117437 tempest-CreateVolumesFromImageTest-473003405 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588'] {{(pid=92060) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 17 04:47:24 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-06c411f5-3e05-4fe6-8fa5-7ffceb117437 tempest-CreateVolumesFromImageTest-473003405 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 04:47:24 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-06c411f5-3e05-4fe6-8fa5-7ffceb117437 tempest-CreateVolumesFromImageTest-473003405 None] Selected osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588 as target Quobyte volume. {{(pid=92060) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 17 04:47:24 devstack cinder-volume[92060]: INFO cinder.volume.drivers.remotefs [None req-06c411f5-3e05-4fe6-8fa5-7ffceb117437 tempest-CreateVolumesFromImageTest-473003405 None] casted to osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588 Jun 17 04:47:24 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-06c411f5-3e05-4fe6-8fa5-7ffceb117437 tempest-CreateVolumesFromImageTest-473003405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-3b0770d2-e473-4ca7-bf82-2fc4aee41ec8 1073741824 {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:47:24 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-921c15cb-f3d5-4381-a701-b0f61079e7a2 tempest-CreateVolumesFromImageTest-473003405 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fe612872-3365-471a-95ce-287a5729c70b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5e26ad42-847e-4351-bc81-1d313131cc47', 'volume_size': 1}' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:47:24 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-921c15cb-f3d5-4381-a701-b0f61079e7a2 tempest-CreateVolumesFromImageTest-473003405 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (81705c65-9efe-4a6d-9b58-47a405e12340) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:47:24 devstack sudo[103473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-3b0770d2-e473-4ca7-bf82-2fc4aee41ec8 1073741824 Jun 17 04:47:24 devstack sudo[103473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:47:24 devstack cinder-volume[92060]: INFO cinder.volume.flows.manager.create_volume [None req-921c15cb-f3d5-4381-a701-b0f61079e7a2 tempest-CreateVolumesFromImageTest-473003405 None] Volume volume-5e26ad42-847e-4351-bc81-1d313131cc47 (5e26ad42-847e-4351-bc81-1d313131cc47): created successfully Jun 17 04:47:24 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-921c15cb-f3d5-4381-a701-b0f61079e7a2 tempest-CreateVolumesFromImageTest-473003405 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (81705c65-9efe-4a6d-9b58-47a405e12340) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:47:24 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-921c15cb-f3d5-4381-a701-b0f61079e7a2 tempest-CreateVolumesFromImageTest-473003405 None] Flow 'volume_create_manager' (15be1ad9-4e3c-4bec-8ee5-6c50e6ccfb96) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92060) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 17 04:47:24 devstack cinder-volume[92060]: INFO cinder.volume.manager [None req-921c15cb-f3d5-4381-a701-b0f61079e7a2 tempest-CreateVolumesFromImageTest-473003405 None] Created volume successfully. Jun 17 04:47:24 devstack sudo[103470]: pam_unix(sudo:session): session closed for user root Jun 17 04:47:24 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-0558062f-4406-475e-95ac-86755c2f85fb tempest-TestInstancesWithCinderVolumes-729947751 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-7dc2c78d-7e4c-4e39-b276-4c1e36d07215 1G" returned: 0 in 0.808s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:47:24 devstack cinder-volume[92060]: DEBUG oslo.privsep.daemon [-] privsep: reply[21d3bdb6-d8f4-4686-b43b-aa551ffbb950]: (4, 'raw') {{(pid=93130) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 04:47:24 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-0558062f-4406-475e-95ac-86755c2f85fb tempest-TestInstancesWithCinderVolumes-729947751 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-7dc2c78d-7e4c-4e39-b276-4c1e36d07215 {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:47:24 devstack sudo[103478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-7dc2c78d-7e4c-4e39-b276-4c1e36d07215 Jun 17 04:47:24 devstack sudo[103478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:47:25 devstack sudo[103473]: pam_unix(sudo:session): session closed for user root Jun 17 04:47:25 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-06c411f5-3e05-4fe6-8fa5-7ffceb117437 tempest-CreateVolumesFromImageTest-473003405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-3b0770d2-e473-4ca7-bf82-2fc4aee41ec8 1073741824" returned: 0 in 1.071s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:47:25 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-06c411f5-3e05-4fe6-8fa5-7ffceb117437 tempest-CreateVolumesFromImageTest-473003405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-3b0770d2-e473-4ca7-bf82-2fc4aee41ec8 {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:47:25 devstack sudo[103484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-3b0770d2-e473-4ca7-bf82-2fc4aee41ec8 Jun 17 04:47:25 devstack sudo[103484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:47:25 devstack sudo[103478]: pam_unix(sudo:session): session closed for user root Jun 17 04:47:25 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-0558062f-4406-475e-95ac-86755c2f85fb tempest-TestInstancesWithCinderVolumes-729947751 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-7dc2c78d-7e4c-4e39-b276-4c1e36d07215" returned: 0 in 1.050s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:47:25 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-0558062f-4406-475e-95ac-86755c2f85fb tempest-TestInstancesWithCinderVolumes-729947751 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-7dc2c78d-7e4c-4e39-b276-4c1e36d07215 {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:47:25 devstack sudo[103488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-7dc2c78d-7e4c-4e39-b276-4c1e36d07215 Jun 17 04:47:25 devstack sudo[103488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:47:26 devstack sudo[103484]: pam_unix(sudo:session): session closed for user root Jun 17 04:47:26 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-06c411f5-3e05-4fe6-8fa5-7ffceb117437 tempest-CreateVolumesFromImageTest-473003405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-3b0770d2-e473-4ca7-bf82-2fc4aee41ec8" returned: 0 in 0.720s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:47:26 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-06c411f5-3e05-4fe6-8fa5-7ffceb117437 tempest-CreateVolumesFromImageTest-473003405 None] <== create_volume: return (1849ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588'} {{(pid=92060) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 17 04:47:26 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-06c411f5-3e05-4fe6-8fa5-7ffceb117437 tempest-CreateVolumesFromImageTest-473003405 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.852s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 04:47:26 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-d94a3e1b-fa27-4488-baac-f5df003a82d4 tempest-CreateVolumesFromImageTest-473003405 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.653s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 04:47:26 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-d94a3e1b-fa27-4488-baac-f5df003a82d4 tempest-CreateVolumesFromImageTest-473003405 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-17T02:47:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-547731205',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1d59dc8b-04d1-47b0-a900-e02113ea8f97,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a334909aea7644029950b211784296dd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T02:47:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T02:47:21Z,use_quota=True,user_id='b9d12aa579d440ec9f8dabcb249c8148',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aad9ce24-93f9-41a6-baa1-5125964f96d1),volume_type_id=aad9ce24-93f9-41a6-baa1-5125964f96d1)}" {{(pid=92060) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 17 04:47:26 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.remotefs [None req-d94a3e1b-fa27-4488-baac-f5df003a82d4 tempest-CreateVolumesFromImageTest-473003405 None] Creating volume 1d59dc8b-04d1-47b0-a900-e02113ea8f97 {{(pid=92060) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 17 04:47:26 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-d94a3e1b-fa27-4488-baac-f5df003a82d4 tempest-CreateVolumesFromImageTest-473003405 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 04:47:26 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-d94a3e1b-fa27-4488-baac-f5df003a82d4 tempest-CreateVolumesFromImageTest-473003405 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 04:47:26 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-d94a3e1b-fa27-4488-baac-f5df003a82d4 tempest-CreateVolumesFromImageTest-473003405 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588': None} {{(pid=92060) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 17 04:47:26 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-d94a3e1b-fa27-4488-baac-f5df003a82d4 tempest-CreateVolumesFromImageTest-473003405 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588'] {{(pid=92060) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 17 04:47:26 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-d94a3e1b-fa27-4488-baac-f5df003a82d4 tempest-CreateVolumesFromImageTest-473003405 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 04:47:26 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-d94a3e1b-fa27-4488-baac-f5df003a82d4 tempest-CreateVolumesFromImageTest-473003405 None] Selected osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588 as target Quobyte volume. {{(pid=92060) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 17 04:47:26 devstack cinder-volume[92060]: INFO cinder.volume.drivers.remotefs [None req-d94a3e1b-fa27-4488-baac-f5df003a82d4 tempest-CreateVolumesFromImageTest-473003405 None] casted to osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588 Jun 17 04:47:26 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-d94a3e1b-fa27-4488-baac-f5df003a82d4 tempest-CreateVolumesFromImageTest-473003405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-1d59dc8b-04d1-47b0-a900-e02113ea8f97 1073741824 {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:47:26 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-06c411f5-3e05-4fe6-8fa5-7ffceb117437 tempest-CreateVolumesFromImageTest-473003405 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6d085771-1f6b-43e8-90da-7e7fac010f59) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3b0770d2-e473-4ca7-bf82-2fc4aee41ec8', 'volume_size': 1}' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:47:26 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-06c411f5-3e05-4fe6-8fa5-7ffceb117437 tempest-CreateVolumesFromImageTest-473003405 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (331cd018-4f22-4972-b129-7ea024bdf108) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:47:26 devstack sudo[103491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-1d59dc8b-04d1-47b0-a900-e02113ea8f97 1073741824 Jun 17 04:47:26 devstack sudo[103491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:47:26 devstack cinder-volume[92060]: INFO cinder.volume.flows.manager.create_volume [None req-06c411f5-3e05-4fe6-8fa5-7ffceb117437 tempest-CreateVolumesFromImageTest-473003405 None] Volume volume-3b0770d2-e473-4ca7-bf82-2fc4aee41ec8 (3b0770d2-e473-4ca7-bf82-2fc4aee41ec8): created successfully Jun 17 04:47:26 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-06c411f5-3e05-4fe6-8fa5-7ffceb117437 tempest-CreateVolumesFromImageTest-473003405 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (331cd018-4f22-4972-b129-7ea024bdf108) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:47:26 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-06c411f5-3e05-4fe6-8fa5-7ffceb117437 tempest-CreateVolumesFromImageTest-473003405 None] Flow 'volume_create_manager' (90f34091-10ae-408f-aaf5-8df10fceb45b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92060) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 17 04:47:26 devstack cinder-volume[92060]: INFO cinder.volume.manager [None req-06c411f5-3e05-4fe6-8fa5-7ffceb117437 tempest-CreateVolumesFromImageTest-473003405 None] Created volume successfully. Jun 17 04:47:26 devstack sudo[103488]: pam_unix(sudo:session): session closed for user root Jun 17 04:47:26 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-0558062f-4406-475e-95ac-86755c2f85fb tempest-TestInstancesWithCinderVolumes-729947751 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-7dc2c78d-7e4c-4e39-b276-4c1e36d07215" returned: 1 in 0.969s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:47:26 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-0558062f-4406-475e-95ac-86755c2f85fb tempest-TestInstancesWithCinderVolumes-729947751 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-7dc2c78d-7e4c-4e39-b276-4c1e36d07215' failed. Not Retrying. {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 17 04:47:26 devstack cinder-volume[92060]: DEBUG cinder.volume.volume_utils [None req-0558062f-4406-475e-95ac-86755c2f85fb tempest-TestInstancesWithCinderVolumes-729947751 None] Downloaded image 11597dd5-e97a-429a-b6df-73d39911c009 ((None, [{'url': 'file:///opt/stack/data/glance/images/11597dd5-e97a-429a-b6df-73d39911c009', 'metadata': {}}])) to volume 7dc2c78d-7e4c-4e39-b276-4c1e36d07215 successfully. {{(pid=92060) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jun 17 04:47:26 devstack cinder-volume[92060]: DEBUG cinder.image.image_utils [None req-0558062f-4406-475e-95ac-86755c2f85fb tempest-TestInstancesWithCinderVolumes-729947751 None] Temporary image 11597dd5-e97a-429a-b6df-73d39911c009 for user 4ef94c0ee9434ef5a07e1de9280b8bc7 is deleted. {{(pid=92060) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jun 17 04:47:26 devstack cinder-volume[92060]: DEBUG cinder.volume.volume_utils [None req-0558062f-4406-475e-95ac-86755c2f85fb tempest-TestInstancesWithCinderVolumes-729947751 None] Marking volume 7dc2c78d-7e4c-4e39-b276-4c1e36d07215 as bootable. {{(pid=92060) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jun 17 04:47:26 devstack cinder-volume[92060]: DEBUG cinder.volume.flows.manager.create_volume [None req-0558062f-4406-475e-95ac-86755c2f85fb tempest-TestInstancesWithCinderVolumes-729947751 None] Copying metadata from image 11597dd5-e97a-429a-b6df-73d39911c009 to 7dc2c78d-7e4c-4e39-b276-4c1e36d07215. {{(pid=92060) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jun 17 04:47:26 devstack cinder-volume[92060]: DEBUG cinder.volume.flows.manager.create_volume [None req-0558062f-4406-475e-95ac-86755c2f85fb tempest-TestInstancesWithCinderVolumes-729947751 None] Creating volume glance metadata for volume 7dc2c78d-7e4c-4e39-b276-4c1e36d07215 backed by image 11597dd5-e97a-429a-b6df-73d39911c009 with: {'image_id': '11597dd5-e97a-429a-b6df-73d39911c009', 'image_name': 'tempest-scenario-img--1509857773', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=92060) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jun 17 04:47:26 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-0558062f-4406-475e-95ac-86755c2f85fb tempest-TestInstancesWithCinderVolumes-729947751 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0c01b8c0-eff8-490c-a53a-5aea340ff490) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7dc2c78d-7e4c-4e39-b276-4c1e36d07215', 'volume_size': 1, 'image_id': '11597dd5-e97a-429a-b6df-73d39911c009', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/11597dd5-e97a-429a-b6df-73d39911c009', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1509857773', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '44b49649c6b54bd5b17e3c481ffa806a', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '11597dd5-e97a-429a-b6df-73d39911c009', 'created_at': datetime.datetime(2026, 6, 17, 2, 47, 4, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 17, 2, 47, 6, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/11597dd5-e97a-429a-b6df-73d39911c009/file', 'properties': {}}, 'image_service': }' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:47:26 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-0558062f-4406-475e-95ac-86755c2f85fb tempest-TestInstancesWithCinderVolumes-729947751 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f3e48583-e32c-4d53-9061-a9734c63a3bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:47:26 devstack cinder-volume[92060]: INFO cinder.volume.flows.manager.create_volume [None req-0558062f-4406-475e-95ac-86755c2f85fb tempest-TestInstancesWithCinderVolumes-729947751 None] Volume volume-7dc2c78d-7e4c-4e39-b276-4c1e36d07215 (7dc2c78d-7e4c-4e39-b276-4c1e36d07215): created successfully Jun 17 04:47:26 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-0558062f-4406-475e-95ac-86755c2f85fb tempest-TestInstancesWithCinderVolumes-729947751 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f3e48583-e32c-4d53-9061-a9734c63a3bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:47:26 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-0558062f-4406-475e-95ac-86755c2f85fb tempest-TestInstancesWithCinderVolumes-729947751 None] Flow 'volume_create_manager' (046c5d49-654e-4362-adb4-85a30cdf2cf6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92060) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 17 04:47:26 devstack cinder-volume[92060]: INFO cinder.volume.manager [None req-0558062f-4406-475e-95ac-86755c2f85fb tempest-TestInstancesWithCinderVolumes-729947751 None] Created volume successfully. Jun 17 04:47:27 devstack sudo[103491]: pam_unix(sudo:session): session closed for user root Jun 17 04:47:27 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-d94a3e1b-fa27-4488-baac-f5df003a82d4 tempest-CreateVolumesFromImageTest-473003405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-1d59dc8b-04d1-47b0-a900-e02113ea8f97 1073741824" returned: 0 in 1.019s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:47:27 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-d94a3e1b-fa27-4488-baac-f5df003a82d4 tempest-CreateVolumesFromImageTest-473003405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-1d59dc8b-04d1-47b0-a900-e02113ea8f97 {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:47:27 devstack sudo[103503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-1d59dc8b-04d1-47b0-a900-e02113ea8f97 Jun 17 04:47:27 devstack sudo[103503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:47:28 devstack sudo[103503]: pam_unix(sudo:session): session closed for user root Jun 17 04:47:28 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-d94a3e1b-fa27-4488-baac-f5df003a82d4 tempest-CreateVolumesFromImageTest-473003405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-1d59dc8b-04d1-47b0-a900-e02113ea8f97" returned: 0 in 0.702s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:47:28 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-d94a3e1b-fa27-4488-baac-f5df003a82d4 tempest-CreateVolumesFromImageTest-473003405 None] <== create_volume: return (1776ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588'} {{(pid=92060) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 17 04:47:28 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-d94a3e1b-fa27-4488-baac-f5df003a82d4 tempest-CreateVolumesFromImageTest-473003405 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.778s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 04:47:28 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-e6b9e22e-db43-4d6f-a223-a61f7532802f tempest-CreateVolumesFromImageTest-473003405 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.819s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 04:47:28 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-e6b9e22e-db43-4d6f-a223-a61f7532802f tempest-CreateVolumesFromImageTest-473003405 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-17T02:47:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-87969035',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b3e79e16-6ca9-4fef-a2ff-b957a53a4b0d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a334909aea7644029950b211784296dd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T02:47:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T02:47:22Z,use_quota=True,user_id='b9d12aa579d440ec9f8dabcb249c8148',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aad9ce24-93f9-41a6-baa1-5125964f96d1),volume_type_id=aad9ce24-93f9-41a6-baa1-5125964f96d1)}" {{(pid=92060) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 17 04:47:28 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.remotefs [None req-e6b9e22e-db43-4d6f-a223-a61f7532802f tempest-CreateVolumesFromImageTest-473003405 None] Creating volume b3e79e16-6ca9-4fef-a2ff-b957a53a4b0d {{(pid=92060) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 17 04:47:28 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-e6b9e22e-db43-4d6f-a223-a61f7532802f tempest-CreateVolumesFromImageTest-473003405 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 04:47:28 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-e6b9e22e-db43-4d6f-a223-a61f7532802f tempest-CreateVolumesFromImageTest-473003405 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 04:47:28 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-e6b9e22e-db43-4d6f-a223-a61f7532802f tempest-CreateVolumesFromImageTest-473003405 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588': None} {{(pid=92060) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 17 04:47:28 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-e6b9e22e-db43-4d6f-a223-a61f7532802f tempest-CreateVolumesFromImageTest-473003405 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588'] {{(pid=92060) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 17 04:47:28 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-e6b9e22e-db43-4d6f-a223-a61f7532802f tempest-CreateVolumesFromImageTest-473003405 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 04:47:28 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-e6b9e22e-db43-4d6f-a223-a61f7532802f tempest-CreateVolumesFromImageTest-473003405 None] Selected osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588 as target Quobyte volume. {{(pid=92060) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 17 04:47:28 devstack cinder-volume[92060]: INFO cinder.volume.drivers.remotefs [None req-e6b9e22e-db43-4d6f-a223-a61f7532802f tempest-CreateVolumesFromImageTest-473003405 None] casted to osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588 Jun 17 04:47:28 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-e6b9e22e-db43-4d6f-a223-a61f7532802f tempest-CreateVolumesFromImageTest-473003405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-b3e79e16-6ca9-4fef-a2ff-b957a53a4b0d 1073741824 {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:47:28 devstack sudo[103506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-b3e79e16-6ca9-4fef-a2ff-b957a53a4b0d 1073741824 Jun 17 04:47:28 devstack sudo[103506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:47:28 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-d94a3e1b-fa27-4488-baac-f5df003a82d4 tempest-CreateVolumesFromImageTest-473003405 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5026fc19-df21-4041-9d7c-d5c4de3e0181) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1d59dc8b-04d1-47b0-a900-e02113ea8f97', 'volume_size': 1}' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:47:28 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-d94a3e1b-fa27-4488-baac-f5df003a82d4 tempest-CreateVolumesFromImageTest-473003405 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8cd42346-0841-4dd3-b69f-fec544d5bbde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:47:28 devstack cinder-volume[92060]: INFO cinder.volume.flows.manager.create_volume [None req-d94a3e1b-fa27-4488-baac-f5df003a82d4 tempest-CreateVolumesFromImageTest-473003405 None] Volume volume-1d59dc8b-04d1-47b0-a900-e02113ea8f97 (1d59dc8b-04d1-47b0-a900-e02113ea8f97): created successfully Jun 17 04:47:28 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-d94a3e1b-fa27-4488-baac-f5df003a82d4 tempest-CreateVolumesFromImageTest-473003405 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8cd42346-0841-4dd3-b69f-fec544d5bbde) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:47:28 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-d94a3e1b-fa27-4488-baac-f5df003a82d4 tempest-CreateVolumesFromImageTest-473003405 None] Flow 'volume_create_manager' (54e803e8-3188-4ebd-a51d-d9c43b7906b9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92060) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 17 04:47:28 devstack cinder-volume[92060]: INFO cinder.volume.manager [None req-d94a3e1b-fa27-4488-baac-f5df003a82d4 tempest-CreateVolumesFromImageTest-473003405 None] Created volume successfully. Jun 17 04:47:29 devstack sudo[103506]: pam_unix(sudo:session): session closed for user root Jun 17 04:47:29 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-e6b9e22e-db43-4d6f-a223-a61f7532802f tempest-CreateVolumesFromImageTest-473003405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-b3e79e16-6ca9-4fef-a2ff-b957a53a4b0d 1073741824" returned: 0 in 1.163s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:47:29 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-e6b9e22e-db43-4d6f-a223-a61f7532802f tempest-CreateVolumesFromImageTest-473003405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-b3e79e16-6ca9-4fef-a2ff-b957a53a4b0d {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:47:29 devstack sudo[103514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-b3e79e16-6ca9-4fef-a2ff-b957a53a4b0d Jun 17 04:47:29 devstack sudo[103514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:47:29 devstack sudo[103514]: pam_unix(sudo:session): session closed for user root Jun 17 04:47:29 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-e6b9e22e-db43-4d6f-a223-a61f7532802f tempest-CreateVolumesFromImageTest-473003405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-b3e79e16-6ca9-4fef-a2ff-b957a53a4b0d" returned: 0 in 0.640s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:47:29 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-e6b9e22e-db43-4d6f-a223-a61f7532802f tempest-CreateVolumesFromImageTest-473003405 None] <== create_volume: return (1852ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588'} {{(pid=92060) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 17 04:47:29 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-e6b9e22e-db43-4d6f-a223-a61f7532802f tempest-CreateVolumesFromImageTest-473003405 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.857s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 04:47:29 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-e6b9e22e-db43-4d6f-a223-a61f7532802f tempest-CreateVolumesFromImageTest-473003405 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (23387f8f-eae2-4ae2-9a18-fed05bae7e7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b3e79e16-6ca9-4fef-a2ff-b957a53a4b0d', 'volume_size': 1}' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:47:29 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-e6b9e22e-db43-4d6f-a223-a61f7532802f tempest-CreateVolumesFromImageTest-473003405 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ff1e4a5f-09f6-464d-944b-3d9bf06b7640) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:47:30 devstack cinder-volume[92060]: INFO cinder.volume.flows.manager.create_volume [None req-e6b9e22e-db43-4d6f-a223-a61f7532802f tempest-CreateVolumesFromImageTest-473003405 None] Volume volume-b3e79e16-6ca9-4fef-a2ff-b957a53a4b0d (b3e79e16-6ca9-4fef-a2ff-b957a53a4b0d): created successfully Jun 17 04:47:30 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-e6b9e22e-db43-4d6f-a223-a61f7532802f tempest-CreateVolumesFromImageTest-473003405 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ff1e4a5f-09f6-464d-944b-3d9bf06b7640) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:47:30 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-e6b9e22e-db43-4d6f-a223-a61f7532802f tempest-CreateVolumesFromImageTest-473003405 None] Flow 'volume_create_manager' (a891597d-fb8c-456a-83b1-5837999bf555) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92060) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 17 04:47:30 devstack cinder-volume[92060]: INFO cinder.volume.manager [None req-e6b9e22e-db43-4d6f-a223-a61f7532802f tempest-CreateVolumesFromImageTest-473003405 None] Created volume successfully. Jun 17 04:47:30 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-397839e5-c74a-4f42-884a-cd3a6bb76342 tempest-CreateVolumesFromImageTest-473003405 None] Acquiring lock "cinder-b3e79e16-6ca9-4fef-a2ff-b957a53a4b0d-delete_volume" by "delete_volume" {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 04:47:30 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-397839e5-c74a-4f42-884a-cd3a6bb76342 tempest-CreateVolumesFromImageTest-473003405 None] Lock "cinder-b3e79e16-6ca9-4fef-a2ff-b957a53a4b0d-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 04:47:30 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-397839e5-c74a-4f42-884a-cd3a6bb76342 tempest-CreateVolumesFromImageTest-473003405 None] Acquiring lock "cinder-quobyte-b3e79e16-6ca9-4fef-a2ff-b957a53a4b0d" by "delete_volume" {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 04:47:30 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-397839e5-c74a-4f42-884a-cd3a6bb76342 tempest-CreateVolumesFromImageTest-473003405 None] Lock "cinder-quobyte-b3e79e16-6ca9-4fef-a2ff-b957a53a4b0d" acquired by "delete_volume" :: waited 0.018s {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 04:47:30 devstack cinder-volume[92060]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1ae004c-68f2-4bcc-bab3-4e50a47f4cff]: (4, 'qcow2') {{(pid=93130) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 04:47:30 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-397839e5-c74a-4f42-884a-cd3a6bb76342 tempest-CreateVolumesFromImageTest-473003405 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-b3e79e16-6ca9-4fef-a2ff-b957a53a4b0d {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:47:30 devstack cinder-volume[92060]: DEBUG cinder.volume.flows.manager.create_volume [None req-47fd8b7b-7cd6-45ca-be54-81460d18cbfb tempest-CreateVolumesFromSourceVolumeTest-1670988288 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92060) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 17 04:47:30 devstack sudo[103517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-b3e79e16-6ca9-4fef-a2ff-b957a53a4b0d Jun 17 04:47:30 devstack sudo[103517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:47:30 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-47fd8b7b-7cd6-45ca-be54-81460d18cbfb tempest-CreateVolumesFromSourceVolumeTest-1670988288 None] Flow 'volume_create_manager' (7c598d48-7e43-4510-9cd1-2a044199ddd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 17 04:47:30 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-47fd8b7b-7cd6-45ca-be54-81460d18cbfb tempest-CreateVolumesFromSourceVolumeTest-1670988288 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1d37c459-6bda-4829-8cc8-592b3bcf3c10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:47:30 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-47fd8b7b-7cd6-45ca-be54-81460d18cbfb tempest-CreateVolumesFromSourceVolumeTest-1670988288 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1d37c459-6bda-4829-8cc8-592b3bcf3c10) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-17T02:47:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1256343922',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1725d18b-ab8b-4b12-ab2a-3d937b1c3579,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9b14ec02238849b8b484ea9024018b7f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T02:47:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T02:47:30Z,use_quota=True,user_id='8e8e34ae463a488aab972d557e016a4c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aad9ce24-93f9-41a6-baa1-5125964f96d1),volume_type_id=aad9ce24-93f9-41a6-baa1-5125964f96d1)' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:47:30 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-47fd8b7b-7cd6-45ca-be54-81460d18cbfb tempest-CreateVolumesFromSourceVolumeTest-1670988288 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (224002ab-aa24-4f49-9c52-04524cce445b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:47:30 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-47fd8b7b-7cd6-45ca-be54-81460d18cbfb tempest-CreateVolumesFromSourceVolumeTest-1670988288 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (224002ab-aa24-4f49-9c52-04524cce445b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:47:30 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-47fd8b7b-7cd6-45ca-be54-81460d18cbfb tempest-CreateVolumesFromSourceVolumeTest-1670988288 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (81d9f97a-722e-4ac9-b40f-b459a224b85e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:47:30 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-47fd8b7b-7cd6-45ca-be54-81460d18cbfb tempest-CreateVolumesFromSourceVolumeTest-1670988288 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (81d9f97a-722e-4ac9-b40f-b459a224b85e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1725d18b-ab8b-4b12-ab2a-3d937b1c3579', 'volume_name': 'volume-1725d18b-ab8b-4b12-ab2a-3d937b1c3579', 'volume_size': 1}' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:47:30 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-47fd8b7b-7cd6-45ca-be54-81460d18cbfb tempest-CreateVolumesFromSourceVolumeTest-1670988288 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (42047619-e6d3-4316-8221-f35ab263242b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:47:30 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-47fd8b7b-7cd6-45ca-be54-81460d18cbfb tempest-CreateVolumesFromSourceVolumeTest-1670988288 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (42047619-e6d3-4316-8221-f35ab263242b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:47:30 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-47fd8b7b-7cd6-45ca-be54-81460d18cbfb tempest-CreateVolumesFromSourceVolumeTest-1670988288 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c654605a-8075-4de7-a869-eccb94a925bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:47:30 devstack cinder-volume[92060]: INFO cinder.volume.flows.manager.create_volume [None req-47fd8b7b-7cd6-45ca-be54-81460d18cbfb tempest-CreateVolumesFromSourceVolumeTest-1670988288 None] Volume 1725d18b-ab8b-4b12-ab2a-3d937b1c3579: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1725d18b-ab8b-4b12-ab2a-3d937b1c3579', 'volume_size': 1} Jun 17 04:47:30 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-47fd8b7b-7cd6-45ca-be54-81460d18cbfb tempest-CreateVolumesFromSourceVolumeTest-1670988288 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 04:47:30 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-47fd8b7b-7cd6-45ca-be54-81460d18cbfb tempest-CreateVolumesFromSourceVolumeTest-1670988288 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 04:47:30 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-47fd8b7b-7cd6-45ca-be54-81460d18cbfb tempest-CreateVolumesFromSourceVolumeTest-1670988288 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-17T02:47:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1256343922',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1725d18b-ab8b-4b12-ab2a-3d937b1c3579,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9b14ec02238849b8b484ea9024018b7f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T02:47:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T02:47:30Z,use_quota=True,user_id='8e8e34ae463a488aab972d557e016a4c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aad9ce24-93f9-41a6-baa1-5125964f96d1),volume_type_id=aad9ce24-93f9-41a6-baa1-5125964f96d1)}" {{(pid=92060) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 17 04:47:30 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.remotefs [None req-47fd8b7b-7cd6-45ca-be54-81460d18cbfb tempest-CreateVolumesFromSourceVolumeTest-1670988288 None] Creating volume 1725d18b-ab8b-4b12-ab2a-3d937b1c3579 {{(pid=92060) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 17 04:47:30 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-47fd8b7b-7cd6-45ca-be54-81460d18cbfb tempest-CreateVolumesFromSourceVolumeTest-1670988288 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 04:47:30 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-47fd8b7b-7cd6-45ca-be54-81460d18cbfb tempest-CreateVolumesFromSourceVolumeTest-1670988288 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 04:47:30 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-47fd8b7b-7cd6-45ca-be54-81460d18cbfb tempest-CreateVolumesFromSourceVolumeTest-1670988288 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588': None} {{(pid=92060) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 17 04:47:30 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-47fd8b7b-7cd6-45ca-be54-81460d18cbfb tempest-CreateVolumesFromSourceVolumeTest-1670988288 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588'] {{(pid=92060) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 17 04:47:30 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-47fd8b7b-7cd6-45ca-be54-81460d18cbfb tempest-CreateVolumesFromSourceVolumeTest-1670988288 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 04:47:30 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-47fd8b7b-7cd6-45ca-be54-81460d18cbfb tempest-CreateVolumesFromSourceVolumeTest-1670988288 None] Selected osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588 as target Quobyte volume. {{(pid=92060) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 17 04:47:30 devstack cinder-volume[92060]: INFO cinder.volume.drivers.remotefs [None req-47fd8b7b-7cd6-45ca-be54-81460d18cbfb tempest-CreateVolumesFromSourceVolumeTest-1670988288 None] casted to osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588 Jun 17 04:47:30 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-47fd8b7b-7cd6-45ca-be54-81460d18cbfb tempest-CreateVolumesFromSourceVolumeTest-1670988288 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-1725d18b-ab8b-4b12-ab2a-3d937b1c3579 1073741824 {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:47:30 devstack sudo[103520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-1725d18b-ab8b-4b12-ab2a-3d937b1c3579 1073741824 Jun 17 04:47:30 devstack sudo[103520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:47:31 devstack sudo[103517]: pam_unix(sudo:session): session closed for user root Jun 17 04:47:31 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-397839e5-c74a-4f42-884a-cd3a6bb76342 tempest-CreateVolumesFromImageTest-473003405 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-b3e79e16-6ca9-4fef-a2ff-b957a53a4b0d" returned: 0 in 0.917s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:47:31 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-397839e5-c74a-4f42-884a-cd3a6bb76342 tempest-CreateVolumesFromImageTest-473003405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-b3e79e16-6ca9-4fef-a2ff-b957a53a4b0d {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:47:31 devstack sudo[103530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-b3e79e16-6ca9-4fef-a2ff-b957a53a4b0d Jun 17 04:47:31 devstack sudo[103530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:47:31 devstack sudo[103520]: pam_unix(sudo:session): session closed for user root Jun 17 04:47:31 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-47fd8b7b-7cd6-45ca-be54-81460d18cbfb tempest-CreateVolumesFromSourceVolumeTest-1670988288 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-1725d18b-ab8b-4b12-ab2a-3d937b1c3579 1073741824" returned: 0 in 0.924s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:47:31 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-47fd8b7b-7cd6-45ca-be54-81460d18cbfb tempest-CreateVolumesFromSourceVolumeTest-1670988288 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-1725d18b-ab8b-4b12-ab2a-3d937b1c3579 {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:47:31 devstack sudo[103533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-1725d18b-ab8b-4b12-ab2a-3d937b1c3579 Jun 17 04:47:31 devstack sudo[103533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:47:32 devstack sudo[103530]: pam_unix(sudo:session): session closed for user root Jun 17 04:47:32 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-397839e5-c74a-4f42-884a-cd3a6bb76342 tempest-CreateVolumesFromImageTest-473003405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-b3e79e16-6ca9-4fef-a2ff-b957a53a4b0d" returned: 0 in 0.779s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:47:32 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-397839e5-c74a-4f42-884a-cd3a6bb76342 tempest-CreateVolumesFromImageTest-473003405 None] Lock "cinder-quobyte-b3e79e16-6ca9-4fef-a2ff-b957a53a4b0d" released by "delete_volume" :: held 1.761s {{(pid=92060) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 04:47:32 devstack cinder-volume[92060]: DEBUG cinder.quota [None req-397839e5-c74a-4f42-884a-cd3a6bb76342 tempest-CreateVolumesFromImageTest-473003405 None] Created reservations ['b9d3b258-77ed-402d-9487-4002d29dda15', 'c0ed8e63-fbe3-487a-9e93-258f74fe8293', '683fa8ca-b87d-476e-920c-c819580cb518', 'adf443f0-6cc4-45f3-ac3e-a0ff42602d78'] {{(pid=92060) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 17 04:47:32 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-397839e5-c74a-4f42-884a-cd3a6bb76342 tempest-CreateVolumesFromImageTest-473003405 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 04:47:32 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-397839e5-c74a-4f42-884a-cd3a6bb76342 tempest-CreateVolumesFromImageTest-473003405 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 04:47:32 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-397839e5-c74a-4f42-884a-cd3a6bb76342 tempest-CreateVolumesFromImageTest-473003405 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588': None} {{(pid=92060) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 17 04:47:32 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-397839e5-c74a-4f42-884a-cd3a6bb76342 tempest-CreateVolumesFromImageTest-473003405 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588'] {{(pid=92060) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 17 04:47:32 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-397839e5-c74a-4f42-884a-cd3a6bb76342 tempest-CreateVolumesFromImageTest-473003405 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 04:47:32 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-397839e5-c74a-4f42-884a-cd3a6bb76342 tempest-CreateVolumesFromImageTest-473003405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:47:32 devstack sudo[103537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a Jun 17 04:47:32 devstack sudo[103537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:47:32 devstack sudo[103533]: pam_unix(sudo:session): session closed for user root Jun 17 04:47:32 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-47fd8b7b-7cd6-45ca-be54-81460d18cbfb tempest-CreateVolumesFromSourceVolumeTest-1670988288 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-1725d18b-ab8b-4b12-ab2a-3d937b1c3579" returned: 0 in 0.764s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:47:32 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-47fd8b7b-7cd6-45ca-be54-81460d18cbfb tempest-CreateVolumesFromSourceVolumeTest-1670988288 None] <== create_volume: return (1755ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588'} {{(pid=92060) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 17 04:47:32 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-47fd8b7b-7cd6-45ca-be54-81460d18cbfb tempest-CreateVolumesFromSourceVolumeTest-1670988288 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.758s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 04:47:32 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-47fd8b7b-7cd6-45ca-be54-81460d18cbfb tempest-CreateVolumesFromSourceVolumeTest-1670988288 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c654605a-8075-4de7-a869-eccb94a925bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1725d18b-ab8b-4b12-ab2a-3d937b1c3579', 'volume_size': 1}' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:47:32 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-47fd8b7b-7cd6-45ca-be54-81460d18cbfb tempest-CreateVolumesFromSourceVolumeTest-1670988288 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c0a1e1bf-d24c-4699-8eeb-620a20dd7bae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:47:32 devstack cinder-volume[92060]: INFO cinder.volume.flows.manager.create_volume [None req-47fd8b7b-7cd6-45ca-be54-81460d18cbfb tempest-CreateVolumesFromSourceVolumeTest-1670988288 None] Volume volume-1725d18b-ab8b-4b12-ab2a-3d937b1c3579 (1725d18b-ab8b-4b12-ab2a-3d937b1c3579): created successfully Jun 17 04:47:32 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-47fd8b7b-7cd6-45ca-be54-81460d18cbfb tempest-CreateVolumesFromSourceVolumeTest-1670988288 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c0a1e1bf-d24c-4699-8eeb-620a20dd7bae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:47:32 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-47fd8b7b-7cd6-45ca-be54-81460d18cbfb tempest-CreateVolumesFromSourceVolumeTest-1670988288 None] Flow 'volume_create_manager' (7c598d48-7e43-4510-9cd1-2a044199ddd7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92060) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 17 04:47:32 devstack cinder-volume[92060]: INFO cinder.volume.manager [None req-47fd8b7b-7cd6-45ca-be54-81460d18cbfb tempest-CreateVolumesFromSourceVolumeTest-1670988288 None] Created volume successfully. Jun 17 04:47:32 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-4c1cefa5-04de-4005-82ce-df17b5058c09 tempest-CreateVolumesFromImageTest-473003405 None] Acquiring lock "cinder-1d59dc8b-04d1-47b0-a900-e02113ea8f97-delete_volume" by "delete_volume" {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 04:47:32 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-4c1cefa5-04de-4005-82ce-df17b5058c09 tempest-CreateVolumesFromImageTest-473003405 None] Lock "cinder-1d59dc8b-04d1-47b0-a900-e02113ea8f97-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 04:47:32 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-4c1cefa5-04de-4005-82ce-df17b5058c09 tempest-CreateVolumesFromImageTest-473003405 None] Acquiring lock "cinder-quobyte-1d59dc8b-04d1-47b0-a900-e02113ea8f97" by "delete_volume" {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 04:47:32 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-4c1cefa5-04de-4005-82ce-df17b5058c09 tempest-CreateVolumesFromImageTest-473003405 None] Lock "cinder-quobyte-1d59dc8b-04d1-47b0-a900-e02113ea8f97" acquired by "delete_volume" :: waited 0.016s {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 04:47:32 devstack cinder-volume[92060]: DEBUG oslo.privsep.daemon [-] privsep: reply[87ffb1da-9a82-4108-b947-adb31b065697]: (4, 'qcow2') {{(pid=93130) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 04:47:32 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-4c1cefa5-04de-4005-82ce-df17b5058c09 tempest-CreateVolumesFromImageTest-473003405 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-1d59dc8b-04d1-47b0-a900-e02113ea8f97 {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:47:32 devstack sudo[103539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-1d59dc8b-04d1-47b0-a900-e02113ea8f97 Jun 17 04:47:32 devstack sudo[103539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:47:33 devstack sudo[103537]: pam_unix(sudo:session): session closed for user root Jun 17 04:47:33 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-397839e5-c74a-4f42-884a-cd3a6bb76342 tempest-CreateVolumesFromImageTest-473003405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a" returned: 0 in 0.912s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:47:33 devstack cinder-volume[92060]: DEBUG cinder.manager [None req-397839e5-c74a-4f42-884a-cd3a6bb76342 tempest-CreateVolumesFromImageTest-473003405 None] Notifying Schedulers of capabilities ... {{(pid=92060) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 17 04:47:33 devstack cinder-volume[92060]: INFO cinder.volume.manager [None req-397839e5-c74a-4f42-884a-cd3a6bb76342 tempest-CreateVolumesFromImageTest-473003405 None] Deleted volume successfully. Jun 17 04:47:33 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-397839e5-c74a-4f42-884a-cd3a6bb76342 tempest-CreateVolumesFromImageTest-473003405 None] Lock "cinder-b3e79e16-6ca9-4fef-a2ff-b957a53a4b0d-delete_volume" released by "delete_volume" :: held 2.980s {{(pid=92060) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 04:47:33 devstack cinder-volume[92060]: DEBUG cinder.volume.flows.manager.create_volume [None req-c666ed31-b834-4201-9d49-39f4e33a5468 tempest-CreateVolumesFromSourceVolumeTest-1670988288 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92060) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 17 04:47:33 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-c666ed31-b834-4201-9d49-39f4e33a5468 tempest-CreateVolumesFromSourceVolumeTest-1670988288 None] Flow 'volume_create_manager' (6db48480-f361-43e4-bcaf-daa90efec84c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 17 04:47:33 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-c666ed31-b834-4201-9d49-39f4e33a5468 tempest-CreateVolumesFromSourceVolumeTest-1670988288 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0c795606-49d2-4535-b1a2-79671b4252fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:47:33 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-c666ed31-b834-4201-9d49-39f4e33a5468 tempest-CreateVolumesFromSourceVolumeTest-1670988288 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0c795606-49d2-4535-b1a2-79671b4252fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-17T02:47:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-506303796',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3e28ffd7-708e-4973-906b-7ae90e2284a0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9b14ec02238849b8b484ea9024018b7f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T02:47:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T02:47:33Z,use_quota=True,user_id='8e8e34ae463a488aab972d557e016a4c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aad9ce24-93f9-41a6-baa1-5125964f96d1),volume_type_id=aad9ce24-93f9-41a6-baa1-5125964f96d1)' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:47:33 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-c666ed31-b834-4201-9d49-39f4e33a5468 tempest-CreateVolumesFromSourceVolumeTest-1670988288 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (02be4a5b-e688-4f13-958a-0a85ee20785e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:47:33 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-c666ed31-b834-4201-9d49-39f4e33a5468 tempest-CreateVolumesFromSourceVolumeTest-1670988288 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (02be4a5b-e688-4f13-958a-0a85ee20785e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:47:33 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-c666ed31-b834-4201-9d49-39f4e33a5468 tempest-CreateVolumesFromSourceVolumeTest-1670988288 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0faa1497-0832-4907-916d-dfd169eae21c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:47:33 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-c666ed31-b834-4201-9d49-39f4e33a5468 tempest-CreateVolumesFromSourceVolumeTest-1670988288 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0faa1497-0832-4907-916d-dfd169eae21c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3e28ffd7-708e-4973-906b-7ae90e2284a0', 'volume_name': 'volume-3e28ffd7-708e-4973-906b-7ae90e2284a0', 'volume_size': 1}' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:47:33 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-c666ed31-b834-4201-9d49-39f4e33a5468 tempest-CreateVolumesFromSourceVolumeTest-1670988288 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c5385226-64a4-4377-a0ab-5df914c14fab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:47:33 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-c666ed31-b834-4201-9d49-39f4e33a5468 tempest-CreateVolumesFromSourceVolumeTest-1670988288 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c5385226-64a4-4377-a0ab-5df914c14fab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:47:33 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-c666ed31-b834-4201-9d49-39f4e33a5468 tempest-CreateVolumesFromSourceVolumeTest-1670988288 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cc7afaac-b326-477a-9846-5457e6156b5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:47:33 devstack cinder-volume[92060]: INFO cinder.volume.flows.manager.create_volume [None req-c666ed31-b834-4201-9d49-39f4e33a5468 tempest-CreateVolumesFromSourceVolumeTest-1670988288 None] Volume 3e28ffd7-708e-4973-906b-7ae90e2284a0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3e28ffd7-708e-4973-906b-7ae90e2284a0', 'volume_size': 1} Jun 17 04:47:33 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-c666ed31-b834-4201-9d49-39f4e33a5468 tempest-CreateVolumesFromSourceVolumeTest-1670988288 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 04:47:33 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-c666ed31-b834-4201-9d49-39f4e33a5468 tempest-CreateVolumesFromSourceVolumeTest-1670988288 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 04:47:33 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-c666ed31-b834-4201-9d49-39f4e33a5468 tempest-CreateVolumesFromSourceVolumeTest-1670988288 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-17T02:47:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-506303796',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3e28ffd7-708e-4973-906b-7ae90e2284a0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9b14ec02238849b8b484ea9024018b7f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T02:47:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T02:47:33Z,use_quota=True,user_id='8e8e34ae463a488aab972d557e016a4c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aad9ce24-93f9-41a6-baa1-5125964f96d1),volume_type_id=aad9ce24-93f9-41a6-baa1-5125964f96d1)}" {{(pid=92060) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 17 04:47:33 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.remotefs [None req-c666ed31-b834-4201-9d49-39f4e33a5468 tempest-CreateVolumesFromSourceVolumeTest-1670988288 None] Creating volume 3e28ffd7-708e-4973-906b-7ae90e2284a0 {{(pid=92060) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 17 04:47:33 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-c666ed31-b834-4201-9d49-39f4e33a5468 tempest-CreateVolumesFromSourceVolumeTest-1670988288 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 04:47:33 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-c666ed31-b834-4201-9d49-39f4e33a5468 tempest-CreateVolumesFromSourceVolumeTest-1670988288 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 04:47:33 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-c666ed31-b834-4201-9d49-39f4e33a5468 tempest-CreateVolumesFromSourceVolumeTest-1670988288 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588': None} {{(pid=92060) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 17 04:47:33 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-c666ed31-b834-4201-9d49-39f4e33a5468 tempest-CreateVolumesFromSourceVolumeTest-1670988288 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588'] {{(pid=92060) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 17 04:47:33 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-c666ed31-b834-4201-9d49-39f4e33a5468 tempest-CreateVolumesFromSourceVolumeTest-1670988288 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 04:47:33 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-c666ed31-b834-4201-9d49-39f4e33a5468 tempest-CreateVolumesFromSourceVolumeTest-1670988288 None] Selected osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588 as target Quobyte volume. {{(pid=92060) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 17 04:47:33 devstack cinder-volume[92060]: INFO cinder.volume.drivers.remotefs [None req-c666ed31-b834-4201-9d49-39f4e33a5468 tempest-CreateVolumesFromSourceVolumeTest-1670988288 None] casted to osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588 Jun 17 04:47:33 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-c666ed31-b834-4201-9d49-39f4e33a5468 tempest-CreateVolumesFromSourceVolumeTest-1670988288 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-3e28ffd7-708e-4973-906b-7ae90e2284a0 1073741824 {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:47:33 devstack sudo[103557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-3e28ffd7-708e-4973-906b-7ae90e2284a0 1073741824 Jun 17 04:47:33 devstack sudo[103557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:47:33 devstack sudo[103539]: pam_unix(sudo:session): session closed for user root Jun 17 04:47:33 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-4c1cefa5-04de-4005-82ce-df17b5058c09 tempest-CreateVolumesFromImageTest-473003405 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-1d59dc8b-04d1-47b0-a900-e02113ea8f97" returned: 0 in 1.181s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:47:33 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-4c1cefa5-04de-4005-82ce-df17b5058c09 tempest-CreateVolumesFromImageTest-473003405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-1d59dc8b-04d1-47b0-a900-e02113ea8f97 {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:47:34 devstack sudo[103563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-1d59dc8b-04d1-47b0-a900-e02113ea8f97 Jun 17 04:47:34 devstack sudo[103563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:47:34 devstack cinder-volume[92060]: DEBUG cinder.volume.flows.manager.create_volume [None req-e4ffe806-0742-4219-8154-eed804e76ce1 tempest-CreateVolumesFromSourceVolumeTest-1670988288 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92060) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 17 04:47:34 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-e4ffe806-0742-4219-8154-eed804e76ce1 tempest-CreateVolumesFromSourceVolumeTest-1670988288 None] Flow 'volume_create_manager' (107ef3b8-c87c-4bef-a0cb-5dc19c8b5685) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 17 04:47:34 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-e4ffe806-0742-4219-8154-eed804e76ce1 tempest-CreateVolumesFromSourceVolumeTest-1670988288 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (86e93d29-5aad-464e-835c-16ac01df0722) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:47:34 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-e4ffe806-0742-4219-8154-eed804e76ce1 tempest-CreateVolumesFromSourceVolumeTest-1670988288 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (86e93d29-5aad-464e-835c-16ac01df0722) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-17T02:47:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1554309402',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4453b522-3e0c-471d-b5b3-a9d4c9f9f92a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9b14ec02238849b8b484ea9024018b7f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T02:47:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T02:47:34Z,use_quota=True,user_id='8e8e34ae463a488aab972d557e016a4c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aad9ce24-93f9-41a6-baa1-5125964f96d1),volume_type_id=aad9ce24-93f9-41a6-baa1-5125964f96d1)' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:47:34 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-e4ffe806-0742-4219-8154-eed804e76ce1 tempest-CreateVolumesFromSourceVolumeTest-1670988288 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2ad603b5-f2b9-4ca7-9767-ddb4ce2eac40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:47:34 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-e4ffe806-0742-4219-8154-eed804e76ce1 tempest-CreateVolumesFromSourceVolumeTest-1670988288 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2ad603b5-f2b9-4ca7-9767-ddb4ce2eac40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:47:34 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-e4ffe806-0742-4219-8154-eed804e76ce1 tempest-CreateVolumesFromSourceVolumeTest-1670988288 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (98e69f6c-d05c-46a8-aab0-377aa99eca71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:47:34 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-e4ffe806-0742-4219-8154-eed804e76ce1 tempest-CreateVolumesFromSourceVolumeTest-1670988288 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (98e69f6c-d05c-46a8-aab0-377aa99eca71) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4453b522-3e0c-471d-b5b3-a9d4c9f9f92a', 'volume_name': 'volume-4453b522-3e0c-471d-b5b3-a9d4c9f9f92a', 'volume_size': 1}' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:47:34 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-e4ffe806-0742-4219-8154-eed804e76ce1 tempest-CreateVolumesFromSourceVolumeTest-1670988288 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (503f2b91-39a8-4789-9fff-7dde22d825b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:47:34 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-e4ffe806-0742-4219-8154-eed804e76ce1 tempest-CreateVolumesFromSourceVolumeTest-1670988288 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (503f2b91-39a8-4789-9fff-7dde22d825b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:47:34 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-e4ffe806-0742-4219-8154-eed804e76ce1 tempest-CreateVolumesFromSourceVolumeTest-1670988288 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f050b1bd-4bab-4edf-aaef-53107df587ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:47:34 devstack cinder-volume[92060]: INFO cinder.volume.flows.manager.create_volume [None req-e4ffe806-0742-4219-8154-eed804e76ce1 tempest-CreateVolumesFromSourceVolumeTest-1670988288 None] Volume 4453b522-3e0c-471d-b5b3-a9d4c9f9f92a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4453b522-3e0c-471d-b5b3-a9d4c9f9f92a', 'volume_size': 1} Jun 17 04:47:34 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-e4ffe806-0742-4219-8154-eed804e76ce1 tempest-CreateVolumesFromSourceVolumeTest-1670988288 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 04:47:35 devstack cinder-volume[92060]: DEBUG cinder.volume.flows.manager.create_volume [None req-7948a6de-70af-4029-a837-80a56e482e92 tempest-CreateVolumesFromSourceVolumeTest-1670988288 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92060) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 17 04:47:35 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-7948a6de-70af-4029-a837-80a56e482e92 tempest-CreateVolumesFromSourceVolumeTest-1670988288 None] Flow 'volume_create_manager' (47b2f272-45ac-4748-afca-ae3f9feb7f02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 17 04:47:35 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-7948a6de-70af-4029-a837-80a56e482e92 tempest-CreateVolumesFromSourceVolumeTest-1670988288 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2c426698-e34b-4ef1-8b86-ecbb84f843e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:47:35 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-7948a6de-70af-4029-a837-80a56e482e92 tempest-CreateVolumesFromSourceVolumeTest-1670988288 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2c426698-e34b-4ef1-8b86-ecbb84f843e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-17T02:47:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-593534940',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f5fb428e-4b8b-42b3-9f83-aebdb7e3371b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9b14ec02238849b8b484ea9024018b7f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T02:47:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T02:47:35Z,use_quota=True,user_id='8e8e34ae463a488aab972d557e016a4c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aad9ce24-93f9-41a6-baa1-5125964f96d1),volume_type_id=aad9ce24-93f9-41a6-baa1-5125964f96d1)' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:47:35 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-7948a6de-70af-4029-a837-80a56e482e92 tempest-CreateVolumesFromSourceVolumeTest-1670988288 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7a7b03a7-6adb-404e-8e8f-6951af5b7b81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:47:35 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-7948a6de-70af-4029-a837-80a56e482e92 tempest-CreateVolumesFromSourceVolumeTest-1670988288 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7a7b03a7-6adb-404e-8e8f-6951af5b7b81) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:47:35 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-7948a6de-70af-4029-a837-80a56e482e92 tempest-CreateVolumesFromSourceVolumeTest-1670988288 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5fc2cf73-eeb9-4f86-bfe9-c6e62ef64014) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:47:35 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-7948a6de-70af-4029-a837-80a56e482e92 tempest-CreateVolumesFromSourceVolumeTest-1670988288 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5fc2cf73-eeb9-4f86-bfe9-c6e62ef64014) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f5fb428e-4b8b-42b3-9f83-aebdb7e3371b', 'volume_name': 'volume-f5fb428e-4b8b-42b3-9f83-aebdb7e3371b', 'volume_size': 1}' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:47:35 devstack sudo[103563]: pam_unix(sudo:session): session closed for user root Jun 17 04:47:35 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-7948a6de-70af-4029-a837-80a56e482e92 tempest-CreateVolumesFromSourceVolumeTest-1670988288 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d12eb216-a16c-477f-b303-18291716e0c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:47:35 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-7948a6de-70af-4029-a837-80a56e482e92 tempest-CreateVolumesFromSourceVolumeTest-1670988288 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d12eb216-a16c-477f-b303-18291716e0c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:47:35 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-7948a6de-70af-4029-a837-80a56e482e92 tempest-CreateVolumesFromSourceVolumeTest-1670988288 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e87abfb0-89e5-4f8e-a436-e88399623dbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:47:35 devstack cinder-volume[92060]: INFO cinder.volume.flows.manager.create_volume [None req-7948a6de-70af-4029-a837-80a56e482e92 tempest-CreateVolumesFromSourceVolumeTest-1670988288 None] Volume f5fb428e-4b8b-42b3-9f83-aebdb7e3371b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f5fb428e-4b8b-42b3-9f83-aebdb7e3371b', 'volume_size': 1} Jun 17 04:47:35 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-7948a6de-70af-4029-a837-80a56e482e92 tempest-CreateVolumesFromSourceVolumeTest-1670988288 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 04:47:35 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-4c1cefa5-04de-4005-82ce-df17b5058c09 tempest-CreateVolumesFromImageTest-473003405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-1d59dc8b-04d1-47b0-a900-e02113ea8f97" returned: 0 in 1.188s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:47:35 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-4c1cefa5-04de-4005-82ce-df17b5058c09 tempest-CreateVolumesFromImageTest-473003405 None] Lock "cinder-quobyte-1d59dc8b-04d1-47b0-a900-e02113ea8f97" released by "delete_volume" :: held 2.438s {{(pid=92060) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 04:47:35 devstack sudo[103557]: pam_unix(sudo:session): session closed for user root Jun 17 04:47:35 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-c666ed31-b834-4201-9d49-39f4e33a5468 tempest-CreateVolumesFromSourceVolumeTest-1670988288 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-3e28ffd7-708e-4973-906b-7ae90e2284a0 1073741824" returned: 0 in 1.529s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:47:35 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-c666ed31-b834-4201-9d49-39f4e33a5468 tempest-CreateVolumesFromSourceVolumeTest-1670988288 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-3e28ffd7-708e-4973-906b-7ae90e2284a0 {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:47:35 devstack cinder-volume[92060]: DEBUG cinder.quota [None req-4c1cefa5-04de-4005-82ce-df17b5058c09 tempest-CreateVolumesFromImageTest-473003405 None] Created reservations ['33e32d3a-7509-4a7b-bb9d-312f4955d33a', 'd95d2528-4e9e-4b37-9e78-0be0c1880ccf', '6a96b91f-1b22-483c-aa73-2d739b863ec5', 'ca6f9ce4-9ed8-4060-b3ef-8550db5d3241'] {{(pid=92060) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 17 04:47:35 devstack sudo[103580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-3e28ffd7-708e-4973-906b-7ae90e2284a0 Jun 17 04:47:35 devstack sudo[103580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:47:35 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [req-84570b63-6c24-49a6-a055-3d5ece37abcc req-5c7e2a40-afa0-45c7-8c77-69836d0f5c2a tempest-TestInstancesWithCinderVolumes-729947751 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 04:47:35 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-4c1cefa5-04de-4005-82ce-df17b5058c09 tempest-CreateVolumesFromImageTest-473003405 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 04:47:35 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-4c1cefa5-04de-4005-82ce-df17b5058c09 tempest-CreateVolumesFromImageTest-473003405 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 04:47:35 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-4c1cefa5-04de-4005-82ce-df17b5058c09 tempest-CreateVolumesFromImageTest-473003405 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588': None} {{(pid=92060) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 17 04:47:35 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-4c1cefa5-04de-4005-82ce-df17b5058c09 tempest-CreateVolumesFromImageTest-473003405 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588'] {{(pid=92060) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 17 04:47:35 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-4c1cefa5-04de-4005-82ce-df17b5058c09 tempest-CreateVolumesFromImageTest-473003405 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 04:47:35 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-4c1cefa5-04de-4005-82ce-df17b5058c09 tempest-CreateVolumesFromImageTest-473003405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:47:35 devstack sudo[103582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a Jun 17 04:47:35 devstack sudo[103582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:47:35 devstack cinder-volume[92060]: DEBUG cinder.volume.flows.manager.create_volume [None req-a890fcbb-c2df-41f6-88f8-c4a52c763b99 tempest-CreateVolumesFromSourceVolumeTest-1670988288 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92060) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 17 04:47:35 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-a890fcbb-c2df-41f6-88f8-c4a52c763b99 tempest-CreateVolumesFromSourceVolumeTest-1670988288 None] Flow 'volume_create_manager' (8bb07078-94c5-4c0d-bef2-c0ddc40e2049) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 17 04:47:35 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-a890fcbb-c2df-41f6-88f8-c4a52c763b99 tempest-CreateVolumesFromSourceVolumeTest-1670988288 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6dcddc8e-74c9-4eec-8cf6-cc303a2b40e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:47:35 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-a890fcbb-c2df-41f6-88f8-c4a52c763b99 tempest-CreateVolumesFromSourceVolumeTest-1670988288 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6dcddc8e-74c9-4eec-8cf6-cc303a2b40e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-17T02:47:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-208380783',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0bd158f0-adea-43f3-a539-ae98c8ac0a55,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9b14ec02238849b8b484ea9024018b7f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T02:47:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T02:47:36Z,use_quota=True,user_id='8e8e34ae463a488aab972d557e016a4c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aad9ce24-93f9-41a6-baa1-5125964f96d1),volume_type_id=aad9ce24-93f9-41a6-baa1-5125964f96d1)' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:47:35 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-a890fcbb-c2df-41f6-88f8-c4a52c763b99 tempest-CreateVolumesFromSourceVolumeTest-1670988288 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2f36b0bd-3e6a-498a-b816-6858627df70b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:47:35 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-a890fcbb-c2df-41f6-88f8-c4a52c763b99 tempest-CreateVolumesFromSourceVolumeTest-1670988288 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2f36b0bd-3e6a-498a-b816-6858627df70b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:47:35 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-a890fcbb-c2df-41f6-88f8-c4a52c763b99 tempest-CreateVolumesFromSourceVolumeTest-1670988288 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0a6602e1-4884-4775-86b1-783f5bba4fb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:47:35 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-a890fcbb-c2df-41f6-88f8-c4a52c763b99 tempest-CreateVolumesFromSourceVolumeTest-1670988288 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0a6602e1-4884-4775-86b1-783f5bba4fb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0bd158f0-adea-43f3-a539-ae98c8ac0a55', 'volume_name': 'volume-0bd158f0-adea-43f3-a539-ae98c8ac0a55', 'volume_size': 1}' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:47:35 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-a890fcbb-c2df-41f6-88f8-c4a52c763b99 tempest-CreateVolumesFromSourceVolumeTest-1670988288 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4d04ea8b-69b5-48b7-82f8-dfe6e1c45be0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:47:35 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-a890fcbb-c2df-41f6-88f8-c4a52c763b99 tempest-CreateVolumesFromSourceVolumeTest-1670988288 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4d04ea8b-69b5-48b7-82f8-dfe6e1c45be0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:47:35 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-a890fcbb-c2df-41f6-88f8-c4a52c763b99 tempest-CreateVolumesFromSourceVolumeTest-1670988288 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a2a9b77f-a2c5-4ab1-a9f2-b20a30e2e4f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:47:35 devstack cinder-volume[92060]: INFO cinder.volume.flows.manager.create_volume [None req-a890fcbb-c2df-41f6-88f8-c4a52c763b99 tempest-CreateVolumesFromSourceVolumeTest-1670988288 None] Volume 0bd158f0-adea-43f3-a539-ae98c8ac0a55: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0bd158f0-adea-43f3-a539-ae98c8ac0a55', 'volume_size': 1} Jun 17 04:47:35 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-a890fcbb-c2df-41f6-88f8-c4a52c763b99 tempest-CreateVolumesFromSourceVolumeTest-1670988288 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 04:47:36 devstack cinder-volume[92060]: DEBUG cinder.volume.flows.manager.create_volume [None req-4e0e48a2-ec82-4e27-8882-cd4cf2f6d176 tempest-CreateVolumesFromSourceVolumeTest-1670988288 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92060) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 17 04:47:36 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-4e0e48a2-ec82-4e27-8882-cd4cf2f6d176 tempest-CreateVolumesFromSourceVolumeTest-1670988288 None] Flow 'volume_create_manager' (6abcb0a7-c0b3-430b-9eb2-dd131c305f37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 17 04:47:36 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-4e0e48a2-ec82-4e27-8882-cd4cf2f6d176 tempest-CreateVolumesFromSourceVolumeTest-1670988288 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ea9616fb-c563-41c7-b74a-9a87967b3600) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:47:36 devstack sudo[103580]: pam_unix(sudo:session): session closed for user root Jun 17 04:47:36 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-c666ed31-b834-4201-9d49-39f4e33a5468 tempest-CreateVolumesFromSourceVolumeTest-1670988288 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-3e28ffd7-708e-4973-906b-7ae90e2284a0" returned: 0 in 0.966s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:47:36 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-c666ed31-b834-4201-9d49-39f4e33a5468 tempest-CreateVolumesFromSourceVolumeTest-1670988288 None] <== create_volume: return (2608ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588'} {{(pid=92060) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 17 04:47:36 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-c666ed31-b834-4201-9d49-39f4e33a5468 tempest-CreateVolumesFromSourceVolumeTest-1670988288 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.614s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 04:47:36 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-e4ffe806-0742-4219-8154-eed804e76ce1 tempest-CreateVolumesFromSourceVolumeTest-1670988288 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.802s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 04:47:36 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-e4ffe806-0742-4219-8154-eed804e76ce1 tempest-CreateVolumesFromSourceVolumeTest-1670988288 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-17T02:47:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1554309402',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4453b522-3e0c-471d-b5b3-a9d4c9f9f92a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9b14ec02238849b8b484ea9024018b7f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T02:47:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T02:47:34Z,use_quota=True,user_id='8e8e34ae463a488aab972d557e016a4c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aad9ce24-93f9-41a6-baa1-5125964f96d1),volume_type_id=aad9ce24-93f9-41a6-baa1-5125964f96d1)}" {{(pid=92060) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 17 04:47:36 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.remotefs [None req-e4ffe806-0742-4219-8154-eed804e76ce1 tempest-CreateVolumesFromSourceVolumeTest-1670988288 None] Creating volume 4453b522-3e0c-471d-b5b3-a9d4c9f9f92a {{(pid=92060) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 17 04:47:36 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-e4ffe806-0742-4219-8154-eed804e76ce1 tempest-CreateVolumesFromSourceVolumeTest-1670988288 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 04:47:36 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-e4ffe806-0742-4219-8154-eed804e76ce1 tempest-CreateVolumesFromSourceVolumeTest-1670988288 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 04:47:36 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-e4ffe806-0742-4219-8154-eed804e76ce1 tempest-CreateVolumesFromSourceVolumeTest-1670988288 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588': None} {{(pid=92060) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 17 04:47:36 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-e4ffe806-0742-4219-8154-eed804e76ce1 tempest-CreateVolumesFromSourceVolumeTest-1670988288 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588'] {{(pid=92060) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 17 04:47:36 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-e4ffe806-0742-4219-8154-eed804e76ce1 tempest-CreateVolumesFromSourceVolumeTest-1670988288 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 04:47:36 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-e4ffe806-0742-4219-8154-eed804e76ce1 tempest-CreateVolumesFromSourceVolumeTest-1670988288 None] Selected osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588 as target Quobyte volume. {{(pid=92060) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 17 04:47:36 devstack cinder-volume[92060]: INFO cinder.volume.drivers.remotefs [None req-e4ffe806-0742-4219-8154-eed804e76ce1 tempest-CreateVolumesFromSourceVolumeTest-1670988288 None] casted to osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588 Jun 17 04:47:36 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-e4ffe806-0742-4219-8154-eed804e76ce1 tempest-CreateVolumesFromSourceVolumeTest-1670988288 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-4453b522-3e0c-471d-b5b3-a9d4c9f9f92a 1073741824 {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:47:36 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-4e0e48a2-ec82-4e27-8882-cd4cf2f6d176 tempest-CreateVolumesFromSourceVolumeTest-1670988288 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ea9616fb-c563-41c7-b74a-9a87967b3600) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-17T02:47:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-998566204',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bd3bc7c1-04cc-46bb-b619-f5dc17884eb4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9b14ec02238849b8b484ea9024018b7f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T02:47:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T02:47:36Z,use_quota=True,user_id='8e8e34ae463a488aab972d557e016a4c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aad9ce24-93f9-41a6-baa1-5125964f96d1),volume_type_id=aad9ce24-93f9-41a6-baa1-5125964f96d1)' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:47:36 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-4e0e48a2-ec82-4e27-8882-cd4cf2f6d176 tempest-CreateVolumesFromSourceVolumeTest-1670988288 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5f98ac75-8f2c-41a0-ab08-eadb8fb9c99b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:47:36 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-4e0e48a2-ec82-4e27-8882-cd4cf2f6d176 tempest-CreateVolumesFromSourceVolumeTest-1670988288 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5f98ac75-8f2c-41a0-ab08-eadb8fb9c99b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:47:36 devstack sudo[103585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-4453b522-3e0c-471d-b5b3-a9d4c9f9f92a 1073741824 Jun 17 04:47:36 devstack sudo[103585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:47:36 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-4e0e48a2-ec82-4e27-8882-cd4cf2f6d176 tempest-CreateVolumesFromSourceVolumeTest-1670988288 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (936f0269-cd5a-4d93-b9d4-1fa60ae56754) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:47:36 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-4e0e48a2-ec82-4e27-8882-cd4cf2f6d176 tempest-CreateVolumesFromSourceVolumeTest-1670988288 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (936f0269-cd5a-4d93-b9d4-1fa60ae56754) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bd3bc7c1-04cc-46bb-b619-f5dc17884eb4', 'volume_name': 'volume-bd3bc7c1-04cc-46bb-b619-f5dc17884eb4', 'volume_size': 1}' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:47:36 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-4e0e48a2-ec82-4e27-8882-cd4cf2f6d176 tempest-CreateVolumesFromSourceVolumeTest-1670988288 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (10dac924-c33c-49f3-8e93-d2fa18a7b4d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:47:36 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-4e0e48a2-ec82-4e27-8882-cd4cf2f6d176 tempest-CreateVolumesFromSourceVolumeTest-1670988288 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (10dac924-c33c-49f3-8e93-d2fa18a7b4d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:47:36 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-4e0e48a2-ec82-4e27-8882-cd4cf2f6d176 tempest-CreateVolumesFromSourceVolumeTest-1670988288 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (56510a6c-2d7e-4f46-8ba4-63efd7d17340) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:47:36 devstack cinder-volume[92060]: INFO cinder.volume.flows.manager.create_volume [None req-4e0e48a2-ec82-4e27-8882-cd4cf2f6d176 tempest-CreateVolumesFromSourceVolumeTest-1670988288 None] Volume bd3bc7c1-04cc-46bb-b619-f5dc17884eb4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bd3bc7c1-04cc-46bb-b619-f5dc17884eb4', 'volume_size': 1} Jun 17 04:47:36 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-4e0e48a2-ec82-4e27-8882-cd4cf2f6d176 tempest-CreateVolumesFromSourceVolumeTest-1670988288 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 04:47:36 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-c666ed31-b834-4201-9d49-39f4e33a5468 tempest-CreateVolumesFromSourceVolumeTest-1670988288 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cc7afaac-b326-477a-9846-5457e6156b5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3e28ffd7-708e-4973-906b-7ae90e2284a0', 'volume_size': 1}' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:47:36 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-c666ed31-b834-4201-9d49-39f4e33a5468 tempest-CreateVolumesFromSourceVolumeTest-1670988288 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6566226c-ed33-4246-9864-809b7e4b8998) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:47:36 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-41680c2e-766c-42be-8e62-590dde3dc52d tempest-CreateVolumesFromImageTest-473003405 None] Acquiring lock "cinder-3b0770d2-e473-4ca7-bf82-2fc4aee41ec8-delete_volume" by "delete_volume" {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 04:47:36 devstack cinder-volume[92060]: INFO cinder.volume.flows.manager.create_volume [None req-c666ed31-b834-4201-9d49-39f4e33a5468 tempest-CreateVolumesFromSourceVolumeTest-1670988288 None] Volume volume-3e28ffd7-708e-4973-906b-7ae90e2284a0 (3e28ffd7-708e-4973-906b-7ae90e2284a0): created successfully Jun 17 04:47:36 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-c666ed31-b834-4201-9d49-39f4e33a5468 tempest-CreateVolumesFromSourceVolumeTest-1670988288 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6566226c-ed33-4246-9864-809b7e4b8998) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:47:36 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-c666ed31-b834-4201-9d49-39f4e33a5468 tempest-CreateVolumesFromSourceVolumeTest-1670988288 None] Flow 'volume_create_manager' (6db48480-f361-43e4-bcaf-daa90efec84c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92060) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 17 04:47:36 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-41680c2e-766c-42be-8e62-590dde3dc52d tempest-CreateVolumesFromImageTest-473003405 None] Lock "cinder-3b0770d2-e473-4ca7-bf82-2fc4aee41ec8-delete_volume" acquired by "delete_volume" :: waited 0.055s {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 04:47:36 devstack cinder-volume[92060]: INFO cinder.volume.manager [None req-c666ed31-b834-4201-9d49-39f4e33a5468 tempest-CreateVolumesFromSourceVolumeTest-1670988288 None] Created volume successfully. Jun 17 04:47:36 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-41680c2e-766c-42be-8e62-590dde3dc52d tempest-CreateVolumesFromImageTest-473003405 None] Acquiring lock "cinder-quobyte-3b0770d2-e473-4ca7-bf82-2fc4aee41ec8" by "delete_volume" {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 04:47:36 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-41680c2e-766c-42be-8e62-590dde3dc52d tempest-CreateVolumesFromImageTest-473003405 None] Lock "cinder-quobyte-3b0770d2-e473-4ca7-bf82-2fc4aee41ec8" acquired by "delete_volume" :: waited 0.019s {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 04:47:36 devstack cinder-volume[92060]: DEBUG oslo.privsep.daemon [-] privsep: reply[98f0a05e-b865-4638-9083-e163220aff7f]: (4, 'qcow2') {{(pid=93130) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 04:47:36 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-41680c2e-766c-42be-8e62-590dde3dc52d tempest-CreateVolumesFromImageTest-473003405 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-3b0770d2-e473-4ca7-bf82-2fc4aee41ec8 {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:47:36 devstack sudo[103582]: pam_unix(sudo:session): session closed for user root Jun 17 04:47:36 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-4c1cefa5-04de-4005-82ce-df17b5058c09 tempest-CreateVolumesFromImageTest-473003405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a" returned: 0 in 1.065s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:47:36 devstack cinder-volume[92060]: DEBUG cinder.manager [None req-4c1cefa5-04de-4005-82ce-df17b5058c09 tempest-CreateVolumesFromImageTest-473003405 None] Notifying Schedulers of capabilities ... {{(pid=92060) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 17 04:47:36 devstack cinder-volume[92060]: INFO cinder.volume.manager [None req-4c1cefa5-04de-4005-82ce-df17b5058c09 tempest-CreateVolumesFromImageTest-473003405 None] Deleted volume successfully. Jun 17 04:47:36 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-4c1cefa5-04de-4005-82ce-df17b5058c09 tempest-CreateVolumesFromImageTest-473003405 None] Lock "cinder-1d59dc8b-04d1-47b0-a900-e02113ea8f97-delete_volume" released by "delete_volume" :: held 4.000s {{(pid=92060) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 04:47:36 devstack sudo[103588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-3b0770d2-e473-4ca7-bf82-2fc4aee41ec8 Jun 17 04:47:36 devstack sudo[103588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:47:37 devstack sudo[103585]: pam_unix(sudo:session): session closed for user root Jun 17 04:47:37 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-e4ffe806-0742-4219-8154-eed804e76ce1 tempest-CreateVolumesFromSourceVolumeTest-1670988288 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-4453b522-3e0c-471d-b5b3-a9d4c9f9f92a 1073741824" returned: 0 in 1.206s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:47:37 devstack sudo[103588]: pam_unix(sudo:session): session closed for user root Jun 17 04:47:37 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-41680c2e-766c-42be-8e62-590dde3dc52d tempest-CreateVolumesFromImageTest-473003405 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-3b0770d2-e473-4ca7-bf82-2fc4aee41ec8" returned: 0 in 0.917s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:47:37 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-41680c2e-766c-42be-8e62-590dde3dc52d tempest-CreateVolumesFromImageTest-473003405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-3b0770d2-e473-4ca7-bf82-2fc4aee41ec8 {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:47:37 devstack sudo[103598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-3b0770d2-e473-4ca7-bf82-2fc4aee41ec8 Jun 17 04:47:37 devstack sudo[103598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:47:37 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-e4ffe806-0742-4219-8154-eed804e76ce1 tempest-CreateVolumesFromSourceVolumeTest-1670988288 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-4453b522-3e0c-471d-b5b3-a9d4c9f9f92a {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:47:37 devstack sudo[103600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-4453b522-3e0c-471d-b5b3-a9d4c9f9f92a Jun 17 04:47:37 devstack sudo[103600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:47:38 devstack sudo[103598]: pam_unix(sudo:session): session closed for user root Jun 17 04:47:38 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-41680c2e-766c-42be-8e62-590dde3dc52d tempest-CreateVolumesFromImageTest-473003405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-3b0770d2-e473-4ca7-bf82-2fc4aee41ec8" returned: 0 in 0.610s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:47:38 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-41680c2e-766c-42be-8e62-590dde3dc52d tempest-CreateVolumesFromImageTest-473003405 None] Lock "cinder-quobyte-3b0770d2-e473-4ca7-bf82-2fc4aee41ec8" released by "delete_volume" :: held 1.588s {{(pid=92060) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 04:47:38 devstack cinder-volume[92060]: DEBUG cinder.quota [None req-41680c2e-766c-42be-8e62-590dde3dc52d tempest-CreateVolumesFromImageTest-473003405 None] Created reservations ['fc8998f0-aec6-49dc-9e74-b017b7063f81', '4adee132-6914-49bb-8494-99723563bf61', 'f2862800-5280-415a-b243-b1e88f39d9a7', '13cc1238-3686-4741-be4e-d5550a9cd0d6'] {{(pid=92060) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 17 04:47:38 devstack sudo[103600]: pam_unix(sudo:session): session closed for user root Jun 17 04:47:38 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-e4ffe806-0742-4219-8154-eed804e76ce1 tempest-CreateVolumesFromSourceVolumeTest-1670988288 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-4453b522-3e0c-471d-b5b3-a9d4c9f9f92a" returned: 0 in 0.672s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:47:38 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-e4ffe806-0742-4219-8154-eed804e76ce1 tempest-CreateVolumesFromSourceVolumeTest-1670988288 None] <== create_volume: return (1939ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588'} {{(pid=92060) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 17 04:47:38 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-e4ffe806-0742-4219-8154-eed804e76ce1 tempest-CreateVolumesFromSourceVolumeTest-1670988288 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.941s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 04:47:38 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-7948a6de-70af-4029-a837-80a56e482e92 tempest-CreateVolumesFromSourceVolumeTest-1670988288 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.042s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 04:47:38 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-7948a6de-70af-4029-a837-80a56e482e92 tempest-CreateVolumesFromSourceVolumeTest-1670988288 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-17T02:47:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-593534940',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f5fb428e-4b8b-42b3-9f83-aebdb7e3371b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9b14ec02238849b8b484ea9024018b7f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T02:47:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T02:47:35Z,use_quota=True,user_id='8e8e34ae463a488aab972d557e016a4c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aad9ce24-93f9-41a6-baa1-5125964f96d1),volume_type_id=aad9ce24-93f9-41a6-baa1-5125964f96d1)}" {{(pid=92060) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 17 04:47:38 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.remotefs [None req-7948a6de-70af-4029-a837-80a56e482e92 tempest-CreateVolumesFromSourceVolumeTest-1670988288 None] Creating volume f5fb428e-4b8b-42b3-9f83-aebdb7e3371b {{(pid=92060) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 17 04:47:38 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-7948a6de-70af-4029-a837-80a56e482e92 tempest-CreateVolumesFromSourceVolumeTest-1670988288 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 04:47:38 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-7948a6de-70af-4029-a837-80a56e482e92 tempest-CreateVolumesFromSourceVolumeTest-1670988288 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 04:47:38 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-7948a6de-70af-4029-a837-80a56e482e92 tempest-CreateVolumesFromSourceVolumeTest-1670988288 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588': None} {{(pid=92060) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 17 04:47:38 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-7948a6de-70af-4029-a837-80a56e482e92 tempest-CreateVolumesFromSourceVolumeTest-1670988288 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588'] {{(pid=92060) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 17 04:47:38 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-7948a6de-70af-4029-a837-80a56e482e92 tempest-CreateVolumesFromSourceVolumeTest-1670988288 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 04:47:38 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-7948a6de-70af-4029-a837-80a56e482e92 tempest-CreateVolumesFromSourceVolumeTest-1670988288 None] Selected osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588 as target Quobyte volume. {{(pid=92060) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 17 04:47:38 devstack cinder-volume[92060]: INFO cinder.volume.drivers.remotefs [None req-7948a6de-70af-4029-a837-80a56e482e92 tempest-CreateVolumesFromSourceVolumeTest-1670988288 None] casted to osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588 Jun 17 04:47:38 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-7948a6de-70af-4029-a837-80a56e482e92 tempest-CreateVolumesFromSourceVolumeTest-1670988288 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-f5fb428e-4b8b-42b3-9f83-aebdb7e3371b 1073741824 {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:47:38 devstack sudo[103607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-f5fb428e-4b8b-42b3-9f83-aebdb7e3371b 1073741824 Jun 17 04:47:38 devstack sudo[103607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:47:38 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-e4ffe806-0742-4219-8154-eed804e76ce1 tempest-CreateVolumesFromSourceVolumeTest-1670988288 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f050b1bd-4bab-4edf-aaef-53107df587ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4453b522-3e0c-471d-b5b3-a9d4c9f9f92a', 'volume_size': 1}' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:47:38 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-e4ffe806-0742-4219-8154-eed804e76ce1 tempest-CreateVolumesFromSourceVolumeTest-1670988288 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f4889437-674d-4406-9097-b21185b5990c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:47:38 devstack cinder-volume[92060]: INFO cinder.volume.flows.manager.create_volume [None req-e4ffe806-0742-4219-8154-eed804e76ce1 tempest-CreateVolumesFromSourceVolumeTest-1670988288 None] Volume volume-4453b522-3e0c-471d-b5b3-a9d4c9f9f92a (4453b522-3e0c-471d-b5b3-a9d4c9f9f92a): created successfully Jun 17 04:47:38 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-e4ffe806-0742-4219-8154-eed804e76ce1 tempest-CreateVolumesFromSourceVolumeTest-1670988288 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f4889437-674d-4406-9097-b21185b5990c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:47:38 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-e4ffe806-0742-4219-8154-eed804e76ce1 tempest-CreateVolumesFromSourceVolumeTest-1670988288 None] Flow 'volume_create_manager' (107ef3b8-c87c-4bef-a0cb-5dc19c8b5685) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92060) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 17 04:47:38 devstack cinder-volume[92060]: INFO cinder.volume.manager [None req-e4ffe806-0742-4219-8154-eed804e76ce1 tempest-CreateVolumesFromSourceVolumeTest-1670988288 None] Created volume successfully. Jun 17 04:47:38 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-41680c2e-766c-42be-8e62-590dde3dc52d tempest-CreateVolumesFromImageTest-473003405 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 04:47:38 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-41680c2e-766c-42be-8e62-590dde3dc52d tempest-CreateVolumesFromImageTest-473003405 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 04:47:38 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-41680c2e-766c-42be-8e62-590dde3dc52d tempest-CreateVolumesFromImageTest-473003405 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588': None} {{(pid=92060) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 17 04:47:38 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-41680c2e-766c-42be-8e62-590dde3dc52d tempest-CreateVolumesFromImageTest-473003405 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588'] {{(pid=92060) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 17 04:47:38 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-41680c2e-766c-42be-8e62-590dde3dc52d tempest-CreateVolumesFromImageTest-473003405 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 04:47:38 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-41680c2e-766c-42be-8e62-590dde3dc52d tempest-CreateVolumesFromImageTest-473003405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:47:38 devstack sudo[103609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a Jun 17 04:47:38 devstack sudo[103609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:47:38 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-ba755b3f-34bd-4bba-81a8-24cb85c2dba3 tempest-CreateVolumesFromImageTest-473003405 None] Acquiring lock "cinder-5e26ad42-847e-4351-bc81-1d313131cc47-delete_volume" by "delete_volume" {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 04:47:38 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-ba755b3f-34bd-4bba-81a8-24cb85c2dba3 tempest-CreateVolumesFromImageTest-473003405 None] Lock "cinder-5e26ad42-847e-4351-bc81-1d313131cc47-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 04:47:38 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-ba755b3f-34bd-4bba-81a8-24cb85c2dba3 tempest-CreateVolumesFromImageTest-473003405 None] Acquiring lock "cinder-quobyte-5e26ad42-847e-4351-bc81-1d313131cc47" by "delete_volume" {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 04:47:38 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-ba755b3f-34bd-4bba-81a8-24cb85c2dba3 tempest-CreateVolumesFromImageTest-473003405 None] Lock "cinder-quobyte-5e26ad42-847e-4351-bc81-1d313131cc47" acquired by "delete_volume" :: waited 0.019s {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 04:47:38 devstack cinder-volume[92060]: DEBUG oslo.privsep.daemon [-] privsep: reply[729193bc-7ae4-4756-ab60-657832b7dfba]: (4, 'qcow2') {{(pid=93130) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 04:47:38 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-ba755b3f-34bd-4bba-81a8-24cb85c2dba3 tempest-CreateVolumesFromImageTest-473003405 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-5e26ad42-847e-4351-bc81-1d313131cc47 {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:47:38 devstack sudo[103611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-5e26ad42-847e-4351-bc81-1d313131cc47 Jun 17 04:47:38 devstack sudo[103611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:47:38 devstack sudo[103609]: pam_unix(sudo:session): session closed for user root Jun 17 04:47:38 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-41680c2e-766c-42be-8e62-590dde3dc52d tempest-CreateVolumesFromImageTest-473003405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a" returned: 0 in 0.637s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:47:38 devstack cinder-volume[92060]: DEBUG cinder.manager [None req-41680c2e-766c-42be-8e62-590dde3dc52d tempest-CreateVolumesFromImageTest-473003405 None] Notifying Schedulers of capabilities ... {{(pid=92060) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 17 04:47:38 devstack cinder-volume[92060]: INFO cinder.volume.manager [None req-41680c2e-766c-42be-8e62-590dde3dc52d tempest-CreateVolumesFromImageTest-473003405 None] Deleted volume successfully. Jun 17 04:47:39 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-41680c2e-766c-42be-8e62-590dde3dc52d tempest-CreateVolumesFromImageTest-473003405 None] Lock "cinder-3b0770d2-e473-4ca7-bf82-2fc4aee41ec8-delete_volume" released by "delete_volume" :: held 2.557s {{(pid=92060) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 04:47:39 devstack sudo[103607]: pam_unix(sudo:session): session closed for user root Jun 17 04:47:39 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-7948a6de-70af-4029-a837-80a56e482e92 tempest-CreateVolumesFromSourceVolumeTest-1670988288 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-f5fb428e-4b8b-42b3-9f83-aebdb7e3371b 1073741824" returned: 0 in 0.980s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:47:39 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-7948a6de-70af-4029-a837-80a56e482e92 tempest-CreateVolumesFromSourceVolumeTest-1670988288 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-f5fb428e-4b8b-42b3-9f83-aebdb7e3371b {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:47:39 devstack sudo[103617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-f5fb428e-4b8b-42b3-9f83-aebdb7e3371b Jun 17 04:47:39 devstack sudo[103617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:47:39 devstack sudo[103611]: pam_unix(sudo:session): session closed for user root Jun 17 04:47:39 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-ba755b3f-34bd-4bba-81a8-24cb85c2dba3 tempest-CreateVolumesFromImageTest-473003405 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-5e26ad42-847e-4351-bc81-1d313131cc47" returned: 0 in 0.939s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:47:39 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-ba755b3f-34bd-4bba-81a8-24cb85c2dba3 tempest-CreateVolumesFromImageTest-473003405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-5e26ad42-847e-4351-bc81-1d313131cc47 {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:47:39 devstack sudo[103643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-5e26ad42-847e-4351-bc81-1d313131cc47 Jun 17 04:47:39 devstack sudo[103643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:47:40 devstack sudo[103617]: pam_unix(sudo:session): session closed for user root Jun 17 04:47:40 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-7948a6de-70af-4029-a837-80a56e482e92 tempest-CreateVolumesFromSourceVolumeTest-1670988288 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-f5fb428e-4b8b-42b3-9f83-aebdb7e3371b" returned: 0 in 0.987s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:47:40 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-7948a6de-70af-4029-a837-80a56e482e92 tempest-CreateVolumesFromSourceVolumeTest-1670988288 None] <== create_volume: return (2011ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588'} {{(pid=92060) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 17 04:47:40 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-7948a6de-70af-4029-a837-80a56e482e92 tempest-CreateVolumesFromSourceVolumeTest-1670988288 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.014s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 04:47:40 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [req-84570b63-6c24-49a6-a055-3d5ece37abcc req-5c7e2a40-afa0-45c7-8c77-69836d0f5c2a tempest-TestInstancesWithCinderVolumes-729947751 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 4.759s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 04:47:40 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-7948a6de-70af-4029-a837-80a56e482e92 tempest-CreateVolumesFromSourceVolumeTest-1670988288 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e87abfb0-89e5-4f8e-a436-e88399623dbf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f5fb428e-4b8b-42b3-9f83-aebdb7e3371b', 'volume_size': 1}' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:47:40 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-7948a6de-70af-4029-a837-80a56e482e92 tempest-CreateVolumesFromSourceVolumeTest-1670988288 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4170340f-3b78-4b3d-aece-0623dc133834) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:47:40 devstack cinder-volume[92060]: INFO cinder.volume.flows.manager.create_volume [None req-7948a6de-70af-4029-a837-80a56e482e92 tempest-CreateVolumesFromSourceVolumeTest-1670988288 None] Volume volume-f5fb428e-4b8b-42b3-9f83-aebdb7e3371b (f5fb428e-4b8b-42b3-9f83-aebdb7e3371b): created successfully Jun 17 04:47:40 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-7948a6de-70af-4029-a837-80a56e482e92 tempest-CreateVolumesFromSourceVolumeTest-1670988288 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4170340f-3b78-4b3d-aece-0623dc133834) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:47:40 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-7948a6de-70af-4029-a837-80a56e482e92 tempest-CreateVolumesFromSourceVolumeTest-1670988288 None] Flow 'volume_create_manager' (47b2f272-45ac-4748-afca-ae3f9feb7f02) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92060) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 17 04:47:40 devstack cinder-volume[92060]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ea7e20b-4e3a-4292-9228-05e317ce1f7d]: (4, 'raw') {{(pid=93130) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 04:47:40 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [req-84570b63-6c24-49a6-a055-3d5ece37abcc req-5c7e2a40-afa0-45c7-8c77-69836d0f5c2a tempest-TestInstancesWithCinderVolumes-729947751 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-7dc2c78d-7e4c-4e39-b276-4c1e36d07215 {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:47:40 devstack cinder-volume[92060]: INFO cinder.volume.manager [None req-7948a6de-70af-4029-a837-80a56e482e92 tempest-CreateVolumesFromSourceVolumeTest-1670988288 None] Created volume successfully. Jun 17 04:47:40 devstack sudo[103682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-7dc2c78d-7e4c-4e39-b276-4c1e36d07215 Jun 17 04:47:40 devstack sudo[103682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:47:40 devstack sudo[103643]: pam_unix(sudo:session): session closed for user root Jun 17 04:47:40 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-ba755b3f-34bd-4bba-81a8-24cb85c2dba3 tempest-CreateVolumesFromImageTest-473003405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-5e26ad42-847e-4351-bc81-1d313131cc47" returned: 0 in 1.157s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:47:40 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-ba755b3f-34bd-4bba-81a8-24cb85c2dba3 tempest-CreateVolumesFromImageTest-473003405 None] Lock "cinder-quobyte-5e26ad42-847e-4351-bc81-1d313131cc47" released by "delete_volume" :: held 2.158s {{(pid=92060) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 04:47:40 devstack cinder-volume[92060]: DEBUG cinder.quota [None req-ba755b3f-34bd-4bba-81a8-24cb85c2dba3 tempest-CreateVolumesFromImageTest-473003405 None] Created reservations ['842948f2-72d8-43d4-b51b-882a207ce335', '34d3361c-9238-4557-87d7-777be84e0a25', 'cb264187-95a9-4609-a409-56ca054d6413', '043bc2b6-5a65-480b-b164-189ea5274c67'] {{(pid=92060) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 17 04:47:41 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-ba755b3f-34bd-4bba-81a8-24cb85c2dba3 tempest-CreateVolumesFromImageTest-473003405 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 04:47:41 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-ba755b3f-34bd-4bba-81a8-24cb85c2dba3 tempest-CreateVolumesFromImageTest-473003405 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 04:47:41 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-ba755b3f-34bd-4bba-81a8-24cb85c2dba3 tempest-CreateVolumesFromImageTest-473003405 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588': None} {{(pid=92060) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 17 04:47:41 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-ba755b3f-34bd-4bba-81a8-24cb85c2dba3 tempest-CreateVolumesFromImageTest-473003405 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588'] {{(pid=92060) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 17 04:47:41 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-ba755b3f-34bd-4bba-81a8-24cb85c2dba3 tempest-CreateVolumesFromImageTest-473003405 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 04:47:41 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-ba755b3f-34bd-4bba-81a8-24cb85c2dba3 tempest-CreateVolumesFromImageTest-473003405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:47:41 devstack sudo[103690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a Jun 17 04:47:41 devstack sudo[103690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:47:41 devstack sudo[103682]: pam_unix(sudo:session): session closed for user root Jun 17 04:47:41 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [req-84570b63-6c24-49a6-a055-3d5ece37abcc req-5c7e2a40-afa0-45c7-8c77-69836d0f5c2a tempest-TestInstancesWithCinderVolumes-729947751 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-7dc2c78d-7e4c-4e39-b276-4c1e36d07215" returned: 0 in 1.038s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:47:41 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [req-84570b63-6c24-49a6-a055-3d5ece37abcc req-5c7e2a40-afa0-45c7-8c77-69836d0f5c2a tempest-TestInstancesWithCinderVolumes-729947751 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-7dc2c78d-7e4c-4e39-b276-4c1e36d07215 {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:47:41 devstack sudo[103697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-7dc2c78d-7e4c-4e39-b276-4c1e36d07215 Jun 17 04:47:41 devstack sudo[103697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:47:41 devstack sudo[103690]: pam_unix(sudo:session): session closed for user root Jun 17 04:47:41 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-ba755b3f-34bd-4bba-81a8-24cb85c2dba3 tempest-CreateVolumesFromImageTest-473003405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a" returned: 0 in 0.823s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:47:41 devstack cinder-volume[92060]: DEBUG cinder.manager [None req-ba755b3f-34bd-4bba-81a8-24cb85c2dba3 tempest-CreateVolumesFromImageTest-473003405 None] Notifying Schedulers of capabilities ... {{(pid=92060) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 17 04:47:41 devstack cinder-volume[92060]: INFO cinder.volume.manager [None req-ba755b3f-34bd-4bba-81a8-24cb85c2dba3 tempest-CreateVolumesFromImageTest-473003405 None] Deleted volume successfully. Jun 17 04:47:41 devstack cinder-volume[92060]: DEBUG dbcounter [-] [92060] Writing DB stats cinder:SELECT=78,cinder:UPDATE=89,cinder:INSERT=27,cinder:DELETE=11 {{(pid=92060) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 17 04:47:42 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-ba755b3f-34bd-4bba-81a8-24cb85c2dba3 tempest-CreateVolumesFromImageTest-473003405 None] Lock "cinder-5e26ad42-847e-4351-bc81-1d313131cc47-delete_volume" released by "delete_volume" :: held 3.343s {{(pid=92060) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 04:47:42 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-3a74a1b6-53b9-4a10-a87b-032b46b92fdc tempest-CreateVolumesFromImageTest-473003405 None] Acquiring lock "cinder-75b304ef-c1fe-4ce6-9378-6280c405e300-delete_volume" by "delete_volume" {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 04:47:42 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-3a74a1b6-53b9-4a10-a87b-032b46b92fdc tempest-CreateVolumesFromImageTest-473003405 None] Lock "cinder-75b304ef-c1fe-4ce6-9378-6280c405e300-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 04:47:42 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-3a74a1b6-53b9-4a10-a87b-032b46b92fdc tempest-CreateVolumesFromImageTest-473003405 None] Acquiring lock "cinder-quobyte-75b304ef-c1fe-4ce6-9378-6280c405e300" by "delete_volume" {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 04:47:42 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-3a74a1b6-53b9-4a10-a87b-032b46b92fdc tempest-CreateVolumesFromImageTest-473003405 None] Lock "cinder-quobyte-75b304ef-c1fe-4ce6-9378-6280c405e300" acquired by "delete_volume" :: waited 0.020s {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 04:47:42 devstack cinder-volume[92060]: DEBUG oslo.privsep.daemon [-] privsep: reply[5babe69e-e61b-467e-b2dd-daa3457cba2d]: (4, 'qcow2') {{(pid=93130) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 04:47:42 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-3a74a1b6-53b9-4a10-a87b-032b46b92fdc tempest-CreateVolumesFromImageTest-473003405 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-75b304ef-c1fe-4ce6-9378-6280c405e300 {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:47:42 devstack sudo[103697]: pam_unix(sudo:session): session closed for user root Jun 17 04:47:42 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [req-84570b63-6c24-49a6-a055-3d5ece37abcc req-5c7e2a40-afa0-45c7-8c77-69836d0f5c2a tempest-TestInstancesWithCinderVolumes-729947751 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-7dc2c78d-7e4c-4e39-b276-4c1e36d07215" returned: 1 in 0.857s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:47:42 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [req-84570b63-6c24-49a6-a055-3d5ece37abcc req-5c7e2a40-afa0-45c7-8c77-69836d0f5c2a tempest-TestInstancesWithCinderVolumes-729947751 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-7dc2c78d-7e4c-4e39-b276-4c1e36d07215' failed. Not Retrying. {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 17 04:47:42 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [req-84570b63-6c24-49a6-a055-3d5ece37abcc req-5c7e2a40-afa0-45c7-8c77-69836d0f5c2a tempest-TestInstancesWithCinderVolumes-729947751 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 2.009s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 04:47:42 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-a890fcbb-c2df-41f6-88f8-c4a52c763b99 tempest-CreateVolumesFromSourceVolumeTest-1670988288 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.344s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 04:47:42 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-a890fcbb-c2df-41f6-88f8-c4a52c763b99 tempest-CreateVolumesFromSourceVolumeTest-1670988288 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-17T02:47:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-208380783',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0bd158f0-adea-43f3-a539-ae98c8ac0a55,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9b14ec02238849b8b484ea9024018b7f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T02:47:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T02:47:36Z,use_quota=True,user_id='8e8e34ae463a488aab972d557e016a4c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aad9ce24-93f9-41a6-baa1-5125964f96d1),volume_type_id=aad9ce24-93f9-41a6-baa1-5125964f96d1)}" {{(pid=92060) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 17 04:47:42 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.remotefs [None req-a890fcbb-c2df-41f6-88f8-c4a52c763b99 tempest-CreateVolumesFromSourceVolumeTest-1670988288 None] Creating volume 0bd158f0-adea-43f3-a539-ae98c8ac0a55 {{(pid=92060) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 17 04:47:42 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-a890fcbb-c2df-41f6-88f8-c4a52c763b99 tempest-CreateVolumesFromSourceVolumeTest-1670988288 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 04:47:42 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-a890fcbb-c2df-41f6-88f8-c4a52c763b99 tempest-CreateVolumesFromSourceVolumeTest-1670988288 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 04:47:42 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-a890fcbb-c2df-41f6-88f8-c4a52c763b99 tempest-CreateVolumesFromSourceVolumeTest-1670988288 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588': None} {{(pid=92060) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 17 04:47:42 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-a890fcbb-c2df-41f6-88f8-c4a52c763b99 tempest-CreateVolumesFromSourceVolumeTest-1670988288 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588'] {{(pid=92060) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 17 04:47:42 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-a890fcbb-c2df-41f6-88f8-c4a52c763b99 tempest-CreateVolumesFromSourceVolumeTest-1670988288 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 04:47:42 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-a890fcbb-c2df-41f6-88f8-c4a52c763b99 tempest-CreateVolumesFromSourceVolumeTest-1670988288 None] Selected osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588 as target Quobyte volume. {{(pid=92060) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 17 04:47:42 devstack cinder-volume[92060]: INFO cinder.volume.drivers.remotefs [None req-a890fcbb-c2df-41f6-88f8-c4a52c763b99 tempest-CreateVolumesFromSourceVolumeTest-1670988288 None] casted to osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588 Jun 17 04:47:42 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-a890fcbb-c2df-41f6-88f8-c4a52c763b99 tempest-CreateVolumesFromSourceVolumeTest-1670988288 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-0bd158f0-adea-43f3-a539-ae98c8ac0a55 1073741824 {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:47:42 devstack sudo[103703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-75b304ef-c1fe-4ce6-9378-6280c405e300 Jun 17 04:47:42 devstack sudo[103703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:47:42 devstack sudo[103704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-0bd158f0-adea-43f3-a539-ae98c8ac0a55 1073741824 Jun 17 04:47:42 devstack sudo[103704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:47:42 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [req-84570b63-6c24-49a6-a055-3d5ece37abcc req-5c7e2a40-afa0-45c7-8c77-69836d0f5c2a tempest-TestInstancesWithCinderVolumes-729947751 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588', 'name': 'volume-7dc2c78d-7e4c-4e39-b276-4c1e36d07215', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '77b6fd2b-3523-45f6-ac80-a3b5aee9b041', 'enforce_multipath': True} {{(pid=92060) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 17 04:47:42 devstack cinder-volume[92060]: INFO cinder.volume.manager [req-84570b63-6c24-49a6-a055-3d5ece37abcc req-5c7e2a40-afa0-45c7-8c77-69836d0f5c2a tempest-TestInstancesWithCinderVolumes-729947751 None] attachment_update completed successfully. Jun 17 04:47:43 devstack sudo[103703]: pam_unix(sudo:session): session closed for user root Jun 17 04:47:43 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-3a74a1b6-53b9-4a10-a87b-032b46b92fdc tempest-CreateVolumesFromImageTest-473003405 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-75b304ef-c1fe-4ce6-9378-6280c405e300" returned: 0 in 1.160s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:47:43 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-3a74a1b6-53b9-4a10-a87b-032b46b92fdc tempest-CreateVolumesFromImageTest-473003405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-75b304ef-c1fe-4ce6-9378-6280c405e300 {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:47:43 devstack sudo[103716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-75b304ef-c1fe-4ce6-9378-6280c405e300 Jun 17 04:47:43 devstack sudo[103716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:47:43 devstack sudo[103704]: pam_unix(sudo:session): session closed for user root Jun 17 04:47:43 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-a890fcbb-c2df-41f6-88f8-c4a52c763b99 tempest-CreateVolumesFromSourceVolumeTest-1670988288 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-0bd158f0-adea-43f3-a539-ae98c8ac0a55 1073741824" returned: 0 in 1.163s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:47:43 devstack cinder-volume[92060]: DEBUG dbcounter [-] [92060] Writing DB stats cinder:SELECT=71,cinder:UPDATE=96,cinder:DELETE=8,cinder:INSERT=19 {{(pid=92060) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 17 04:47:43 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-a890fcbb-c2df-41f6-88f8-c4a52c763b99 tempest-CreateVolumesFromSourceVolumeTest-1670988288 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-0bd158f0-adea-43f3-a539-ae98c8ac0a55 {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:47:43 devstack sudo[103718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-0bd158f0-adea-43f3-a539-ae98c8ac0a55 Jun 17 04:47:43 devstack sudo[103718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:47:44 devstack sudo[103718]: pam_unix(sudo:session): session closed for user root Jun 17 04:47:44 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-a890fcbb-c2df-41f6-88f8-c4a52c763b99 tempest-CreateVolumesFromSourceVolumeTest-1670988288 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-0bd158f0-adea-43f3-a539-ae98c8ac0a55" returned: 0 in 0.994s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:47:44 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-a890fcbb-c2df-41f6-88f8-c4a52c763b99 tempest-CreateVolumesFromSourceVolumeTest-1670988288 None] <== create_volume: return (2219ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588'} {{(pid=92060) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 17 04:47:44 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-a890fcbb-c2df-41f6-88f8-c4a52c763b99 tempest-CreateVolumesFromSourceVolumeTest-1670988288 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.222s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 04:47:44 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-4e0e48a2-ec82-4e27-8882-cd4cf2f6d176 tempest-CreateVolumesFromSourceVolumeTest-1670988288 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.107s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 04:47:44 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-4e0e48a2-ec82-4e27-8882-cd4cf2f6d176 tempest-CreateVolumesFromSourceVolumeTest-1670988288 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-17T02:47:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-998566204',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bd3bc7c1-04cc-46bb-b619-f5dc17884eb4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9b14ec02238849b8b484ea9024018b7f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T02:47:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T02:47:36Z,use_quota=True,user_id='8e8e34ae463a488aab972d557e016a4c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aad9ce24-93f9-41a6-baa1-5125964f96d1),volume_type_id=aad9ce24-93f9-41a6-baa1-5125964f96d1)}" {{(pid=92060) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 17 04:47:44 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.remotefs [None req-4e0e48a2-ec82-4e27-8882-cd4cf2f6d176 tempest-CreateVolumesFromSourceVolumeTest-1670988288 None] Creating volume bd3bc7c1-04cc-46bb-b619-f5dc17884eb4 {{(pid=92060) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 17 04:47:44 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-4e0e48a2-ec82-4e27-8882-cd4cf2f6d176 tempest-CreateVolumesFromSourceVolumeTest-1670988288 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 04:47:44 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-4e0e48a2-ec82-4e27-8882-cd4cf2f6d176 tempest-CreateVolumesFromSourceVolumeTest-1670988288 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 04:47:44 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-4e0e48a2-ec82-4e27-8882-cd4cf2f6d176 tempest-CreateVolumesFromSourceVolumeTest-1670988288 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588': None} {{(pid=92060) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 17 04:47:44 devstack sudo[103716]: pam_unix(sudo:session): session closed for user root Jun 17 04:47:44 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-4e0e48a2-ec82-4e27-8882-cd4cf2f6d176 tempest-CreateVolumesFromSourceVolumeTest-1670988288 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588'] {{(pid=92060) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 17 04:47:44 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-4e0e48a2-ec82-4e27-8882-cd4cf2f6d176 tempest-CreateVolumesFromSourceVolumeTest-1670988288 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 04:47:44 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-4e0e48a2-ec82-4e27-8882-cd4cf2f6d176 tempest-CreateVolumesFromSourceVolumeTest-1670988288 None] Selected osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588 as target Quobyte volume. {{(pid=92060) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 17 04:47:44 devstack cinder-volume[92060]: INFO cinder.volume.drivers.remotefs [None req-4e0e48a2-ec82-4e27-8882-cd4cf2f6d176 tempest-CreateVolumesFromSourceVolumeTest-1670988288 None] casted to osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588 Jun 17 04:47:44 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-4e0e48a2-ec82-4e27-8882-cd4cf2f6d176 tempest-CreateVolumesFromSourceVolumeTest-1670988288 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-bd3bc7c1-04cc-46bb-b619-f5dc17884eb4 1073741824 {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:47:44 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-3a74a1b6-53b9-4a10-a87b-032b46b92fdc tempest-CreateVolumesFromImageTest-473003405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-75b304ef-c1fe-4ce6-9378-6280c405e300" returned: 0 in 1.185s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:47:44 devstack sudo[103723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-bd3bc7c1-04cc-46bb-b619-f5dc17884eb4 1073741824 Jun 17 04:47:44 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-a890fcbb-c2df-41f6-88f8-c4a52c763b99 tempest-CreateVolumesFromSourceVolumeTest-1670988288 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a2a9b77f-a2c5-4ab1-a9f2-b20a30e2e4f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0bd158f0-adea-43f3-a539-ae98c8ac0a55', 'volume_size': 1}' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:47:44 devstack sudo[103723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:47:44 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-a890fcbb-c2df-41f6-88f8-c4a52c763b99 tempest-CreateVolumesFromSourceVolumeTest-1670988288 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (30fd723c-90bd-462a-af97-0036dd435b47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:47:44 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-3a74a1b6-53b9-4a10-a87b-032b46b92fdc tempest-CreateVolumesFromImageTest-473003405 None] Lock "cinder-quobyte-75b304ef-c1fe-4ce6-9378-6280c405e300" released by "delete_volume" :: held 2.416s {{(pid=92060) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 04:47:44 devstack cinder-volume[92060]: INFO cinder.volume.flows.manager.create_volume [None req-a890fcbb-c2df-41f6-88f8-c4a52c763b99 tempest-CreateVolumesFromSourceVolumeTest-1670988288 None] Volume volume-0bd158f0-adea-43f3-a539-ae98c8ac0a55 (0bd158f0-adea-43f3-a539-ae98c8ac0a55): created successfully Jun 17 04:47:44 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-a890fcbb-c2df-41f6-88f8-c4a52c763b99 tempest-CreateVolumesFromSourceVolumeTest-1670988288 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (30fd723c-90bd-462a-af97-0036dd435b47) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:47:44 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-a890fcbb-c2df-41f6-88f8-c4a52c763b99 tempest-CreateVolumesFromSourceVolumeTest-1670988288 None] Flow 'volume_create_manager' (8bb07078-94c5-4c0d-bef2-c0ddc40e2049) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92060) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 17 04:47:44 devstack cinder-volume[92060]: INFO cinder.volume.manager [None req-a890fcbb-c2df-41f6-88f8-c4a52c763b99 tempest-CreateVolumesFromSourceVolumeTest-1670988288 None] Created volume successfully. Jun 17 04:47:44 devstack cinder-volume[92060]: DEBUG cinder.quota [None req-3a74a1b6-53b9-4a10-a87b-032b46b92fdc tempest-CreateVolumesFromImageTest-473003405 None] Created reservations ['aa091523-df95-462e-ba00-72161495d5df', 'e23273e6-7fa8-45d2-94c8-2fc0bf699343', '117da11e-8495-44d4-85ce-9bb58c414d86', '690da4b8-fdbf-4b3b-b307-8f533d33ae40'] {{(pid=92060) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 17 04:47:44 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-3a74a1b6-53b9-4a10-a87b-032b46b92fdc tempest-CreateVolumesFromImageTest-473003405 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 04:47:44 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-3a74a1b6-53b9-4a10-a87b-032b46b92fdc tempest-CreateVolumesFromImageTest-473003405 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 04:47:44 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-3a74a1b6-53b9-4a10-a87b-032b46b92fdc tempest-CreateVolumesFromImageTest-473003405 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588': None} {{(pid=92060) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 17 04:47:44 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-3a74a1b6-53b9-4a10-a87b-032b46b92fdc tempest-CreateVolumesFromImageTest-473003405 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588'] {{(pid=92060) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 17 04:47:44 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-3a74a1b6-53b9-4a10-a87b-032b46b92fdc tempest-CreateVolumesFromImageTest-473003405 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 04:47:44 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-3a74a1b6-53b9-4a10-a87b-032b46b92fdc tempest-CreateVolumesFromImageTest-473003405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:47:44 devstack sudo[103726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a Jun 17 04:47:44 devstack sudo[103726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:47:44 devstack cinder-volume[92060]: DEBUG oslo_service.periodic_task [None req-60d279ad-ad8c-4d36-a4b8-f593e74fb922 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=92060) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 17 04:47:44 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-60d279ad-ad8c-4d36-a4b8-f593e74fb922 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 04:47:44 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-60d279ad-ad8c-4d36-a4b8-f593e74fb922 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 04:47:44 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-60d279ad-ad8c-4d36-a4b8-f593e74fb922 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588': None} {{(pid=92060) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 17 04:47:44 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-60d279ad-ad8c-4d36-a4b8-f593e74fb922 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588'] {{(pid=92060) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 17 04:47:44 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-60d279ad-ad8c-4d36-a4b8-f593e74fb922 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 04:47:44 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-60d279ad-ad8c-4d36-a4b8-f593e74fb922 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:47:45 devstack sudo[103774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a Jun 17 04:47:45 devstack sudo[103774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:47:45 devstack sudo[103726]: pam_unix(sudo:session): session closed for user root Jun 17 04:47:45 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-3a74a1b6-53b9-4a10-a87b-032b46b92fdc tempest-CreateVolumesFromImageTest-473003405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a" returned: 0 in 1.099s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:47:45 devstack cinder-volume[92060]: DEBUG cinder.manager [None req-3a74a1b6-53b9-4a10-a87b-032b46b92fdc tempest-CreateVolumesFromImageTest-473003405 None] Notifying Schedulers of capabilities ... {{(pid=92060) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 17 04:47:45 devstack cinder-volume[92060]: INFO cinder.volume.manager [None req-3a74a1b6-53b9-4a10-a87b-032b46b92fdc tempest-CreateVolumesFromImageTest-473003405 None] Deleted volume successfully. Jun 17 04:47:45 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-3a74a1b6-53b9-4a10-a87b-032b46b92fdc tempest-CreateVolumesFromImageTest-473003405 None] Lock "cinder-75b304ef-c1fe-4ce6-9378-6280c405e300-delete_volume" released by "delete_volume" :: held 3.808s {{(pid=92060) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 04:47:45 devstack sudo[103723]: pam_unix(sudo:session): session closed for user root Jun 17 04:47:45 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-4e0e48a2-ec82-4e27-8882-cd4cf2f6d176 tempest-CreateVolumesFromSourceVolumeTest-1670988288 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-bd3bc7c1-04cc-46bb-b619-f5dc17884eb4 1073741824" returned: 0 in 1.437s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:47:45 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-4e0e48a2-ec82-4e27-8882-cd4cf2f6d176 tempest-CreateVolumesFromSourceVolumeTest-1670988288 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-bd3bc7c1-04cc-46bb-b619-f5dc17884eb4 {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:47:46 devstack sudo[103802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-bd3bc7c1-04cc-46bb-b619-f5dc17884eb4 Jun 17 04:47:46 devstack sudo[103802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:47:46 devstack sudo[103774]: pam_unix(sudo:session): session closed for user root Jun 17 04:47:46 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-60d279ad-ad8c-4d36-a4b8-f593e74fb922 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a" returned: 0 in 1.056s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:47:46 devstack cinder-volume[92060]: DEBUG cinder.manager [None req-60d279ad-ad8c-4d36-a4b8-f593e74fb922 None None] Notifying Schedulers of capabilities ... {{(pid=92060) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 17 04:47:46 devstack cinder-volume[92060]: DEBUG oslo_service.periodic_task [None req-60d279ad-ad8c-4d36-a4b8-f593e74fb922 None None] Running periodic task VolumeManager._thread_info {{(pid=92060) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 17 04:47:46 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-60d279ad-ad8c-4d36-a4b8-f593e74fb922 None None] thread count: 28 {{(pid=92060) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 17 04:47:46 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-60d279ad-ad8c-4d36-a4b8-f593e74fb922 None None] thread info: [<_MainThread(MainThread, started 130061806440576)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=92060) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 17 04:47:46 devstack sudo[103802]: pam_unix(sudo:session): session closed for user root Jun 17 04:47:46 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-4e0e48a2-ec82-4e27-8882-cd4cf2f6d176 tempest-CreateVolumesFromSourceVolumeTest-1670988288 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-bd3bc7c1-04cc-46bb-b619-f5dc17884eb4" returned: 0 in 0.761s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:47:46 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-4e0e48a2-ec82-4e27-8882-cd4cf2f6d176 tempest-CreateVolumesFromSourceVolumeTest-1670988288 None] <== create_volume: return (2254ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588'} {{(pid=92060) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 17 04:47:46 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-4e0e48a2-ec82-4e27-8882-cd4cf2f6d176 tempest-CreateVolumesFromSourceVolumeTest-1670988288 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.257s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 04:47:46 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-4e0e48a2-ec82-4e27-8882-cd4cf2f6d176 tempest-CreateVolumesFromSourceVolumeTest-1670988288 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (56510a6c-2d7e-4f46-8ba4-63efd7d17340) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bd3bc7c1-04cc-46bb-b619-f5dc17884eb4', 'volume_size': 1}' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:47:46 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-4e0e48a2-ec82-4e27-8882-cd4cf2f6d176 tempest-CreateVolumesFromSourceVolumeTest-1670988288 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ad3aa0e0-08d9-4441-bd97-5ca41fdf6c03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:47:46 devstack cinder-volume[92060]: INFO cinder.volume.flows.manager.create_volume [None req-4e0e48a2-ec82-4e27-8882-cd4cf2f6d176 tempest-CreateVolumesFromSourceVolumeTest-1670988288 None] Volume volume-bd3bc7c1-04cc-46bb-b619-f5dc17884eb4 (bd3bc7c1-04cc-46bb-b619-f5dc17884eb4): created successfully Jun 17 04:47:46 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-4e0e48a2-ec82-4e27-8882-cd4cf2f6d176 tempest-CreateVolumesFromSourceVolumeTest-1670988288 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ad3aa0e0-08d9-4441-bd97-5ca41fdf6c03) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:47:46 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-4e0e48a2-ec82-4e27-8882-cd4cf2f6d176 tempest-CreateVolumesFromSourceVolumeTest-1670988288 None] Flow 'volume_create_manager' (6abcb0a7-c0b3-430b-9eb2-dd131c305f37) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92060) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 17 04:47:46 devstack cinder-volume[92060]: INFO cinder.volume.manager [None req-4e0e48a2-ec82-4e27-8882-cd4cf2f6d176 tempest-CreateVolumesFromSourceVolumeTest-1670988288 None] Created volume successfully. Jun 17 04:47:47 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-d5b64a44-0556-418f-af18-a4a29c491702 tempest-CreateVolumesFromSourceVolumeTest-1670988288 None] Acquiring lock "cinder-bd3bc7c1-04cc-46bb-b619-f5dc17884eb4-delete_volume" by "delete_volume" {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 04:47:47 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-d5b64a44-0556-418f-af18-a4a29c491702 tempest-CreateVolumesFromSourceVolumeTest-1670988288 None] Lock "cinder-bd3bc7c1-04cc-46bb-b619-f5dc17884eb4-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 04:47:47 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-d5b64a44-0556-418f-af18-a4a29c491702 tempest-CreateVolumesFromSourceVolumeTest-1670988288 None] Acquiring lock "cinder-quobyte-bd3bc7c1-04cc-46bb-b619-f5dc17884eb4" by "delete_volume" {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 04:47:47 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-d5b64a44-0556-418f-af18-a4a29c491702 tempest-CreateVolumesFromSourceVolumeTest-1670988288 None] Lock "cinder-quobyte-bd3bc7c1-04cc-46bb-b619-f5dc17884eb4" acquired by "delete_volume" :: waited 0.022s {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 04:47:47 devstack cinder-volume[92060]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bfe5dfc-def2-4c60-a8f0-20943c74dfef]: (4, 'qcow2') {{(pid=93130) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 04:47:47 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-d5b64a44-0556-418f-af18-a4a29c491702 tempest-CreateVolumesFromSourceVolumeTest-1670988288 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-bd3bc7c1-04cc-46bb-b619-f5dc17884eb4 {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:47:47 devstack sudo[103809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-bd3bc7c1-04cc-46bb-b619-f5dc17884eb4 Jun 17 04:47:47 devstack sudo[103809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:47:49 devstack sudo[103809]: pam_unix(sudo:session): session closed for user root Jun 17 04:47:49 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-d5b64a44-0556-418f-af18-a4a29c491702 tempest-CreateVolumesFromSourceVolumeTest-1670988288 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-bd3bc7c1-04cc-46bb-b619-f5dc17884eb4" returned: 0 in 1.533s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:47:49 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-d5b64a44-0556-418f-af18-a4a29c491702 tempest-CreateVolumesFromSourceVolumeTest-1670988288 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-bd3bc7c1-04cc-46bb-b619-f5dc17884eb4 {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:47:49 devstack sudo[104184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-bd3bc7c1-04cc-46bb-b619-f5dc17884eb4 Jun 17 04:47:49 devstack sudo[104184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:47:50 devstack sudo[104184]: pam_unix(sudo:session): session closed for user root Jun 17 04:47:50 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-d5b64a44-0556-418f-af18-a4a29c491702 tempest-CreateVolumesFromSourceVolumeTest-1670988288 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-bd3bc7c1-04cc-46bb-b619-f5dc17884eb4" returned: 0 in 0.940s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:47:50 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-d5b64a44-0556-418f-af18-a4a29c491702 tempest-CreateVolumesFromSourceVolumeTest-1670988288 None] Lock "cinder-quobyte-bd3bc7c1-04cc-46bb-b619-f5dc17884eb4" released by "delete_volume" :: held 2.534s {{(pid=92060) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 04:47:50 devstack cinder-volume[92060]: DEBUG cinder.volume.flows.manager.create_volume [None req-b5cd2110-0076-463c-aa6a-0c3c6188d14c tempest-CreateVolumesFromSnapshotTest-904120229 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92060) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 17 04:47:50 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-b5cd2110-0076-463c-aa6a-0c3c6188d14c tempest-CreateVolumesFromSnapshotTest-904120229 None] Flow 'volume_create_manager' (fd8cd5f9-bc29-4fd4-be66-77e1e75a3b17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 17 04:47:50 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-b5cd2110-0076-463c-aa6a-0c3c6188d14c tempest-CreateVolumesFromSnapshotTest-904120229 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (34de7346-0922-4459-8013-688ef40a2811) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:47:50 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-b5cd2110-0076-463c-aa6a-0c3c6188d14c tempest-CreateVolumesFromSnapshotTest-904120229 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (34de7346-0922-4459-8013-688ef40a2811) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-17T02:47:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-115023556',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=92658ecb-9bb8-4dfe-96a3-6923fa844c3e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='89814f039bd544088837aa3c1874f94c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T02:47:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T02:47:50Z,use_quota=True,user_id='92d84b8d76cf4646a45de55995ea1c91',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aad9ce24-93f9-41a6-baa1-5125964f96d1),volume_type_id=aad9ce24-93f9-41a6-baa1-5125964f96d1)' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:47:50 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-b5cd2110-0076-463c-aa6a-0c3c6188d14c tempest-CreateVolumesFromSnapshotTest-904120229 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e42eb55a-6111-4830-97a5-f419fcffe94e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:47:50 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-b5cd2110-0076-463c-aa6a-0c3c6188d14c tempest-CreateVolumesFromSnapshotTest-904120229 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e42eb55a-6111-4830-97a5-f419fcffe94e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:47:50 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-b5cd2110-0076-463c-aa6a-0c3c6188d14c tempest-CreateVolumesFromSnapshotTest-904120229 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (51a68c18-f5b7-420b-a441-4a56e89feff7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:47:50 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-b5cd2110-0076-463c-aa6a-0c3c6188d14c tempest-CreateVolumesFromSnapshotTest-904120229 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (51a68c18-f5b7-420b-a441-4a56e89feff7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '92658ecb-9bb8-4dfe-96a3-6923fa844c3e', 'volume_name': 'volume-92658ecb-9bb8-4dfe-96a3-6923fa844c3e', 'volume_size': 1}' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:47:50 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-b5cd2110-0076-463c-aa6a-0c3c6188d14c tempest-CreateVolumesFromSnapshotTest-904120229 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (66a76410-f34a-4a73-b391-265b771833ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:47:50 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-b5cd2110-0076-463c-aa6a-0c3c6188d14c tempest-CreateVolumesFromSnapshotTest-904120229 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (66a76410-f34a-4a73-b391-265b771833ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:47:50 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-b5cd2110-0076-463c-aa6a-0c3c6188d14c tempest-CreateVolumesFromSnapshotTest-904120229 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6572d9d5-1e74-466e-9d34-36f868348ea8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:47:50 devstack cinder-volume[92060]: INFO cinder.volume.flows.manager.create_volume [None req-b5cd2110-0076-463c-aa6a-0c3c6188d14c tempest-CreateVolumesFromSnapshotTest-904120229 None] Volume 92658ecb-9bb8-4dfe-96a3-6923fa844c3e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-92658ecb-9bb8-4dfe-96a3-6923fa844c3e', 'volume_size': 1} Jun 17 04:47:50 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-b5cd2110-0076-463c-aa6a-0c3c6188d14c tempest-CreateVolumesFromSnapshotTest-904120229 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 04:47:50 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-b5cd2110-0076-463c-aa6a-0c3c6188d14c tempest-CreateVolumesFromSnapshotTest-904120229 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 04:47:50 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-b5cd2110-0076-463c-aa6a-0c3c6188d14c tempest-CreateVolumesFromSnapshotTest-904120229 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-17T02:47:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-115023556',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=92658ecb-9bb8-4dfe-96a3-6923fa844c3e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='89814f039bd544088837aa3c1874f94c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T02:47:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T02:47:50Z,use_quota=True,user_id='92d84b8d76cf4646a45de55995ea1c91',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aad9ce24-93f9-41a6-baa1-5125964f96d1),volume_type_id=aad9ce24-93f9-41a6-baa1-5125964f96d1)}" {{(pid=92060) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 17 04:47:50 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.remotefs [None req-b5cd2110-0076-463c-aa6a-0c3c6188d14c tempest-CreateVolumesFromSnapshotTest-904120229 None] Creating volume 92658ecb-9bb8-4dfe-96a3-6923fa844c3e {{(pid=92060) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 17 04:47:50 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-b5cd2110-0076-463c-aa6a-0c3c6188d14c tempest-CreateVolumesFromSnapshotTest-904120229 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 04:47:50 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-b5cd2110-0076-463c-aa6a-0c3c6188d14c tempest-CreateVolumesFromSnapshotTest-904120229 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 04:47:50 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-b5cd2110-0076-463c-aa6a-0c3c6188d14c tempest-CreateVolumesFromSnapshotTest-904120229 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588': None} {{(pid=92060) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 17 04:47:50 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-b5cd2110-0076-463c-aa6a-0c3c6188d14c tempest-CreateVolumesFromSnapshotTest-904120229 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588'] {{(pid=92060) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 17 04:47:50 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-b5cd2110-0076-463c-aa6a-0c3c6188d14c tempest-CreateVolumesFromSnapshotTest-904120229 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 04:47:50 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-b5cd2110-0076-463c-aa6a-0c3c6188d14c tempest-CreateVolumesFromSnapshotTest-904120229 None] Selected osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588 as target Quobyte volume. {{(pid=92060) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 17 04:47:50 devstack cinder-volume[92060]: INFO cinder.volume.drivers.remotefs [None req-b5cd2110-0076-463c-aa6a-0c3c6188d14c tempest-CreateVolumesFromSnapshotTest-904120229 None] casted to osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588 Jun 17 04:47:50 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-b5cd2110-0076-463c-aa6a-0c3c6188d14c tempest-CreateVolumesFromSnapshotTest-904120229 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-92658ecb-9bb8-4dfe-96a3-6923fa844c3e 1073741824 {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:47:50 devstack sudo[104191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-92658ecb-9bb8-4dfe-96a3-6923fa844c3e 1073741824 Jun 17 04:47:50 devstack sudo[104191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:47:50 devstack cinder-volume[92060]: DEBUG cinder.quota [None req-d5b64a44-0556-418f-af18-a4a29c491702 tempest-CreateVolumesFromSourceVolumeTest-1670988288 None] Created reservations ['51838210-d7ba-4192-95f1-e486eb8c5e19', 'e21ad709-92df-4568-b15b-8d50cc1dc254', '3665b050-5a0a-441e-b217-2bfd550ba228', '7adb3c5f-6b05-4726-910b-006fa8bc6b0a'] {{(pid=92060) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 17 04:47:50 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-d5b64a44-0556-418f-af18-a4a29c491702 tempest-CreateVolumesFromSourceVolumeTest-1670988288 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 04:47:50 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-d5b64a44-0556-418f-af18-a4a29c491702 tempest-CreateVolumesFromSourceVolumeTest-1670988288 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 04:47:50 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-d5b64a44-0556-418f-af18-a4a29c491702 tempest-CreateVolumesFromSourceVolumeTest-1670988288 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588': None} {{(pid=92060) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 17 04:47:50 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-d5b64a44-0556-418f-af18-a4a29c491702 tempest-CreateVolumesFromSourceVolumeTest-1670988288 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588'] {{(pid=92060) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 17 04:47:50 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-d5b64a44-0556-418f-af18-a4a29c491702 tempest-CreateVolumesFromSourceVolumeTest-1670988288 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 04:47:50 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-d5b64a44-0556-418f-af18-a4a29c491702 tempest-CreateVolumesFromSourceVolumeTest-1670988288 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:47:50 devstack sudo[104193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a Jun 17 04:47:50 devstack sudo[104193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:47:51 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-56ce10b8-9e4f-485d-9445-2a671dee8861 tempest-CreateVolumesFromSourceVolumeTest-1670988288 None] Acquiring lock "cinder-0bd158f0-adea-43f3-a539-ae98c8ac0a55-delete_volume" by "delete_volume" {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 04:47:51 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-56ce10b8-9e4f-485d-9445-2a671dee8861 tempest-CreateVolumesFromSourceVolumeTest-1670988288 None] Lock "cinder-0bd158f0-adea-43f3-a539-ae98c8ac0a55-delete_volume" acquired by "delete_volume" :: waited 0.088s {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 04:47:51 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-56ce10b8-9e4f-485d-9445-2a671dee8861 tempest-CreateVolumesFromSourceVolumeTest-1670988288 None] Acquiring lock "cinder-quobyte-0bd158f0-adea-43f3-a539-ae98c8ac0a55" by "delete_volume" {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 04:47:51 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-56ce10b8-9e4f-485d-9445-2a671dee8861 tempest-CreateVolumesFromSourceVolumeTest-1670988288 None] Lock "cinder-quobyte-0bd158f0-adea-43f3-a539-ae98c8ac0a55" acquired by "delete_volume" :: waited 0.031s {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 04:47:51 devstack cinder-volume[92060]: DEBUG oslo.privsep.daemon [-] privsep: reply[8936034b-4609-43ec-a3cf-fd12a95dcc8d]: (4, 'qcow2') {{(pid=93130) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 04:47:51 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-56ce10b8-9e4f-485d-9445-2a671dee8861 tempest-CreateVolumesFromSourceVolumeTest-1670988288 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-0bd158f0-adea-43f3-a539-ae98c8ac0a55 {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:47:51 devstack sudo[104193]: pam_unix(sudo:session): session closed for user root Jun 17 04:47:51 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-d5b64a44-0556-418f-af18-a4a29c491702 tempest-CreateVolumesFromSourceVolumeTest-1670988288 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a" returned: 0 in 1.184s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:47:51 devstack cinder-volume[92060]: DEBUG cinder.manager [None req-d5b64a44-0556-418f-af18-a4a29c491702 tempest-CreateVolumesFromSourceVolumeTest-1670988288 None] Notifying Schedulers of capabilities ... {{(pid=92060) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 17 04:47:51 devstack sudo[104200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-0bd158f0-adea-43f3-a539-ae98c8ac0a55 Jun 17 04:47:51 devstack sudo[104200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:47:51 devstack cinder-volume[92060]: INFO cinder.volume.manager [None req-d5b64a44-0556-418f-af18-a4a29c491702 tempest-CreateVolumesFromSourceVolumeTest-1670988288 None] Deleted volume successfully. Jun 17 04:47:51 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-d5b64a44-0556-418f-af18-a4a29c491702 tempest-CreateVolumesFromSourceVolumeTest-1670988288 None] Lock "cinder-bd3bc7c1-04cc-46bb-b619-f5dc17884eb4-delete_volume" released by "delete_volume" :: held 4.203s {{(pid=92060) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 04:47:51 devstack sudo[104191]: pam_unix(sudo:session): session closed for user root Jun 17 04:47:51 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-b5cd2110-0076-463c-aa6a-0c3c6188d14c tempest-CreateVolumesFromSnapshotTest-904120229 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-92658ecb-9bb8-4dfe-96a3-6923fa844c3e 1073741824" returned: 0 in 1.581s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:47:52 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-b5cd2110-0076-463c-aa6a-0c3c6188d14c tempest-CreateVolumesFromSnapshotTest-904120229 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-92658ecb-9bb8-4dfe-96a3-6923fa844c3e {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:47:52 devstack sudo[104202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-92658ecb-9bb8-4dfe-96a3-6923fa844c3e Jun 17 04:47:52 devstack sudo[104202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:47:52 devstack sudo[104200]: pam_unix(sudo:session): session closed for user root Jun 17 04:47:52 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-56ce10b8-9e4f-485d-9445-2a671dee8861 tempest-CreateVolumesFromSourceVolumeTest-1670988288 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-0bd158f0-adea-43f3-a539-ae98c8ac0a55" returned: 0 in 1.327s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:47:52 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-56ce10b8-9e4f-485d-9445-2a671dee8861 tempest-CreateVolumesFromSourceVolumeTest-1670988288 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-0bd158f0-adea-43f3-a539-ae98c8ac0a55 {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:47:52 devstack sudo[104208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-0bd158f0-adea-43f3-a539-ae98c8ac0a55 Jun 17 04:47:52 devstack sudo[104208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:47:53 devstack sudo[104202]: pam_unix(sudo:session): session closed for user root Jun 17 04:47:53 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-b5cd2110-0076-463c-aa6a-0c3c6188d14c tempest-CreateVolumesFromSnapshotTest-904120229 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-92658ecb-9bb8-4dfe-96a3-6923fa844c3e" returned: 0 in 1.454s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:47:53 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-b5cd2110-0076-463c-aa6a-0c3c6188d14c tempest-CreateVolumesFromSnapshotTest-904120229 None] <== create_volume: return (3130ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588'} {{(pid=92060) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 17 04:47:53 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-b5cd2110-0076-463c-aa6a-0c3c6188d14c tempest-CreateVolumesFromSnapshotTest-904120229 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.134s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 04:47:53 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-b5cd2110-0076-463c-aa6a-0c3c6188d14c tempest-CreateVolumesFromSnapshotTest-904120229 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6572d9d5-1e74-466e-9d34-36f868348ea8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-92658ecb-9bb8-4dfe-96a3-6923fa844c3e', 'volume_size': 1}' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:47:53 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-b5cd2110-0076-463c-aa6a-0c3c6188d14c tempest-CreateVolumesFromSnapshotTest-904120229 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (45fe3592-58e0-484e-8fc0-056b9a674a1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:47:53 devstack cinder-volume[92060]: INFO cinder.volume.flows.manager.create_volume [None req-b5cd2110-0076-463c-aa6a-0c3c6188d14c tempest-CreateVolumesFromSnapshotTest-904120229 None] Volume volume-92658ecb-9bb8-4dfe-96a3-6923fa844c3e (92658ecb-9bb8-4dfe-96a3-6923fa844c3e): created successfully Jun 17 04:47:53 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-b5cd2110-0076-463c-aa6a-0c3c6188d14c tempest-CreateVolumesFromSnapshotTest-904120229 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (45fe3592-58e0-484e-8fc0-056b9a674a1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:47:53 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-b5cd2110-0076-463c-aa6a-0c3c6188d14c tempest-CreateVolumesFromSnapshotTest-904120229 None] Flow 'volume_create_manager' (fd8cd5f9-bc29-4fd4-be66-77e1e75a3b17) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92060) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 17 04:47:53 devstack cinder-volume[92060]: INFO cinder.volume.manager [None req-b5cd2110-0076-463c-aa6a-0c3c6188d14c tempest-CreateVolumesFromSnapshotTest-904120229 None] Created volume successfully. Jun 17 04:47:53 devstack sudo[104208]: pam_unix(sudo:session): session closed for user root Jun 17 04:47:53 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-56ce10b8-9e4f-485d-9445-2a671dee8861 tempest-CreateVolumesFromSourceVolumeTest-1670988288 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-0bd158f0-adea-43f3-a539-ae98c8ac0a55" returned: 0 in 1.069s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:47:53 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-56ce10b8-9e4f-485d-9445-2a671dee8861 tempest-CreateVolumesFromSourceVolumeTest-1670988288 None] Lock "cinder-quobyte-0bd158f0-adea-43f3-a539-ae98c8ac0a55" released by "delete_volume" :: held 2.479s {{(pid=92060) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 04:47:54 devstack cinder-volume[92060]: DEBUG cinder.quota [None req-56ce10b8-9e4f-485d-9445-2a671dee8861 tempest-CreateVolumesFromSourceVolumeTest-1670988288 None] Created reservations ['5a839a55-9bd1-4294-9662-ed9f60e33130', '0cf01727-95a9-478f-a305-2c1493f1e226', '2acbe2f7-f648-402b-affb-81def0241f8a', '1f9d09b2-6eb4-4bcc-8ea0-d58410359664'] {{(pid=92060) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 17 04:47:54 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-56ce10b8-9e4f-485d-9445-2a671dee8861 tempest-CreateVolumesFromSourceVolumeTest-1670988288 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 04:47:54 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-56ce10b8-9e4f-485d-9445-2a671dee8861 tempest-CreateVolumesFromSourceVolumeTest-1670988288 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 04:47:54 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-56ce10b8-9e4f-485d-9445-2a671dee8861 tempest-CreateVolumesFromSourceVolumeTest-1670988288 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588': None} {{(pid=92060) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 17 04:47:54 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-56ce10b8-9e4f-485d-9445-2a671dee8861 tempest-CreateVolumesFromSourceVolumeTest-1670988288 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588'] {{(pid=92060) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 17 04:47:54 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-56ce10b8-9e4f-485d-9445-2a671dee8861 tempest-CreateVolumesFromSourceVolumeTest-1670988288 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 04:47:54 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-56ce10b8-9e4f-485d-9445-2a671dee8861 tempest-CreateVolumesFromSourceVolumeTest-1670988288 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:47:54 devstack sudo[104224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a Jun 17 04:47:54 devstack sudo[104224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:47:54 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-459f61a3-be20-4caa-91ff-c1cb72117b3b tempest-CreateVolumesFromSourceVolumeTest-1670988288 None] Acquiring lock "cinder-f5fb428e-4b8b-42b3-9f83-aebdb7e3371b-delete_volume" by "delete_volume" {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 04:47:54 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-459f61a3-be20-4caa-91ff-c1cb72117b3b tempest-CreateVolumesFromSourceVolumeTest-1670988288 None] Lock "cinder-f5fb428e-4b8b-42b3-9f83-aebdb7e3371b-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 04:47:54 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-459f61a3-be20-4caa-91ff-c1cb72117b3b tempest-CreateVolumesFromSourceVolumeTest-1670988288 None] Acquiring lock "cinder-quobyte-f5fb428e-4b8b-42b3-9f83-aebdb7e3371b" by "delete_volume" {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 04:47:55 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-459f61a3-be20-4caa-91ff-c1cb72117b3b tempest-CreateVolumesFromSourceVolumeTest-1670988288 None] Lock "cinder-quobyte-f5fb428e-4b8b-42b3-9f83-aebdb7e3371b" acquired by "delete_volume" :: waited 0.032s {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 04:47:55 devstack cinder-volume[92060]: DEBUG oslo.privsep.daemon [-] privsep: reply[64978943-d607-4841-b9da-599b4ae63d3e]: (4, 'qcow2') {{(pid=93130) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 04:47:55 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-459f61a3-be20-4caa-91ff-c1cb72117b3b tempest-CreateVolumesFromSourceVolumeTest-1670988288 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-f5fb428e-4b8b-42b3-9f83-aebdb7e3371b {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:47:55 devstack sudo[104224]: pam_unix(sudo:session): session closed for user root Jun 17 04:47:55 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-56ce10b8-9e4f-485d-9445-2a671dee8861 tempest-CreateVolumesFromSourceVolumeTest-1670988288 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a" returned: 0 in 1.098s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:47:55 devstack cinder-volume[92060]: DEBUG cinder.manager [None req-56ce10b8-9e4f-485d-9445-2a671dee8861 tempest-CreateVolumesFromSourceVolumeTest-1670988288 None] Notifying Schedulers of capabilities ... {{(pid=92060) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 17 04:47:55 devstack cinder-volume[92060]: INFO cinder.volume.manager [None req-56ce10b8-9e4f-485d-9445-2a671dee8861 tempest-CreateVolumesFromSourceVolumeTest-1670988288 None] Deleted volume successfully. Jun 17 04:47:55 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-56ce10b8-9e4f-485d-9445-2a671dee8861 tempest-CreateVolumesFromSourceVolumeTest-1670988288 None] Lock "cinder-0bd158f0-adea-43f3-a539-ae98c8ac0a55-delete_volume" released by "delete_volume" :: held 4.017s {{(pid=92060) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 04:47:55 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-cccd8961-fa85-4fb2-94ea-df72776843be tempest-CreateVolumesFromSnapshotTest-904120229 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 04:47:55 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-cccd8961-fa85-4fb2-94ea-df72776843be tempest-CreateVolumesFromSnapshotTest-904120229 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 04:47:55 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.remotefs [None req-cccd8961-fa85-4fb2-94ea-df72776843be tempest-CreateVolumesFromSnapshotTest-904120229 None] Creating offline snapshot f6f90d56-9018-49ed-8ee6-3ea2d9a85d62 of volume 92658ecb-9bb8-4dfe-96a3-6923fa844c3e {{(pid=92060) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 17 04:47:55 devstack cinder-volume[92060]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d3630bd-23f8-404e-8514-fb9604f02b4a]: (4, 'qcow2') {{(pid=93130) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 04:47:55 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-cccd8961-fa85-4fb2-94ea-df72776843be tempest-CreateVolumesFromSnapshotTest-904120229 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-92658ecb-9bb8-4dfe-96a3-6923fa844c3e {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:47:55 devstack sudo[104232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-f5fb428e-4b8b-42b3-9f83-aebdb7e3371b Jun 17 04:47:55 devstack sudo[104232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:47:55 devstack sudo[104234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-92658ecb-9bb8-4dfe-96a3-6923fa844c3e Jun 17 04:47:55 devstack sudo[104234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:47:56 devstack sudo[104232]: pam_unix(sudo:session): session closed for user root Jun 17 04:47:56 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-459f61a3-be20-4caa-91ff-c1cb72117b3b tempest-CreateVolumesFromSourceVolumeTest-1670988288 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-f5fb428e-4b8b-42b3-9f83-aebdb7e3371b" returned: 0 in 1.087s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:47:56 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-459f61a3-be20-4caa-91ff-c1cb72117b3b tempest-CreateVolumesFromSourceVolumeTest-1670988288 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-f5fb428e-4b8b-42b3-9f83-aebdb7e3371b {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:47:56 devstack sudo[104240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-f5fb428e-4b8b-42b3-9f83-aebdb7e3371b Jun 17 04:47:56 devstack sudo[104240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:47:56 devstack sudo[104234]: pam_unix(sudo:session): session closed for user root Jun 17 04:47:56 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-cccd8961-fa85-4fb2-94ea-df72776843be tempest-CreateVolumesFromSnapshotTest-904120229 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-92658ecb-9bb8-4dfe-96a3-6923fa844c3e" returned: 0 in 1.057s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:47:56 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-cccd8961-fa85-4fb2-94ea-df72776843be tempest-CreateVolumesFromSnapshotTest-904120229 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-92658ecb-9bb8-4dfe-96a3-6923fa844c3e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-92658ecb-9bb8-4dfe-96a3-6923fa844c3e.f6f90d56-9018-49ed-8ee6-3ea2d9a85d62 1G {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:47:56 devstack sudo[104245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-92658ecb-9bb8-4dfe-96a3-6923fa844c3e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-92658ecb-9bb8-4dfe-96a3-6923fa844c3e.f6f90d56-9018-49ed-8ee6-3ea2d9a85d62 1G Jun 17 04:47:56 devstack sudo[104245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:47:57 devstack sudo[104240]: pam_unix(sudo:session): session closed for user root Jun 17 04:47:57 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-459f61a3-be20-4caa-91ff-c1cb72117b3b tempest-CreateVolumesFromSourceVolumeTest-1670988288 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-f5fb428e-4b8b-42b3-9f83-aebdb7e3371b" returned: 0 in 1.295s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:47:57 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-459f61a3-be20-4caa-91ff-c1cb72117b3b tempest-CreateVolumesFromSourceVolumeTest-1670988288 None] Lock "cinder-quobyte-f5fb428e-4b8b-42b3-9f83-aebdb7e3371b" released by "delete_volume" :: held 2.464s {{(pid=92060) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 04:47:57 devstack cinder-volume[92060]: DEBUG cinder.quota [None req-459f61a3-be20-4caa-91ff-c1cb72117b3b tempest-CreateVolumesFromSourceVolumeTest-1670988288 None] Created reservations ['7b155b56-a2db-4060-873e-bbeea4553216', '571fdc8f-93ee-4755-b4b6-566bb9113944', 'a1c077ff-0cd0-4164-8445-f13720ba9a4a', '87c7badc-ab46-46a1-be97-af44ba555dbd'] {{(pid=92060) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 17 04:47:57 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-459f61a3-be20-4caa-91ff-c1cb72117b3b tempest-CreateVolumesFromSourceVolumeTest-1670988288 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 04:47:57 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-459f61a3-be20-4caa-91ff-c1cb72117b3b tempest-CreateVolumesFromSourceVolumeTest-1670988288 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 04:47:57 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-459f61a3-be20-4caa-91ff-c1cb72117b3b tempest-CreateVolumesFromSourceVolumeTest-1670988288 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588': None} {{(pid=92060) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 17 04:47:57 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-459f61a3-be20-4caa-91ff-c1cb72117b3b tempest-CreateVolumesFromSourceVolumeTest-1670988288 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588'] {{(pid=92060) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 17 04:47:57 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-459f61a3-be20-4caa-91ff-c1cb72117b3b tempest-CreateVolumesFromSourceVolumeTest-1670988288 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 04:47:57 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-459f61a3-be20-4caa-91ff-c1cb72117b3b tempest-CreateVolumesFromSourceVolumeTest-1670988288 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:47:57 devstack sudo[104253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a Jun 17 04:47:57 devstack sudo[104253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:47:57 devstack sudo[104245]: pam_unix(sudo:session): session closed for user root Jun 17 04:47:57 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-cccd8961-fa85-4fb2-94ea-df72776843be tempest-CreateVolumesFromSnapshotTest-904120229 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-92658ecb-9bb8-4dfe-96a3-6923fa844c3e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-92658ecb-9bb8-4dfe-96a3-6923fa844c3e.f6f90d56-9018-49ed-8ee6-3ea2d9a85d62 1G" returned: 0 in 1.428s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:47:57 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-cccd8961-fa85-4fb2-94ea-df72776843be tempest-CreateVolumesFromSnapshotTest-904120229 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-92658ecb-9bb8-4dfe-96a3-6923fa844c3e -F qcow2 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-92658ecb-9bb8-4dfe-96a3-6923fa844c3e.f6f90d56-9018-49ed-8ee6-3ea2d9a85d62 {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:47:57 devstack sudo[104255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-92658ecb-9bb8-4dfe-96a3-6923fa844c3e -F qcow2 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-92658ecb-9bb8-4dfe-96a3-6923fa844c3e.f6f90d56-9018-49ed-8ee6-3ea2d9a85d62 Jun 17 04:47:57 devstack sudo[104255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:47:58 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-826382fb-09bb-41aa-9374-a88ea2e9ce5f tempest-CreateVolumesFromSourceVolumeTest-1670988288 None] Acquiring lock "cinder-4453b522-3e0c-471d-b5b3-a9d4c9f9f92a-delete_volume" by "delete_volume" {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 04:47:58 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-826382fb-09bb-41aa-9374-a88ea2e9ce5f tempest-CreateVolumesFromSourceVolumeTest-1670988288 None] Lock "cinder-4453b522-3e0c-471d-b5b3-a9d4c9f9f92a-delete_volume" acquired by "delete_volume" :: waited 0.070s {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 04:47:58 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-826382fb-09bb-41aa-9374-a88ea2e9ce5f tempest-CreateVolumesFromSourceVolumeTest-1670988288 None] Acquiring lock "cinder-quobyte-4453b522-3e0c-471d-b5b3-a9d4c9f9f92a" by "delete_volume" {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 04:47:58 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-826382fb-09bb-41aa-9374-a88ea2e9ce5f tempest-CreateVolumesFromSourceVolumeTest-1670988288 None] Lock "cinder-quobyte-4453b522-3e0c-471d-b5b3-a9d4c9f9f92a" acquired by "delete_volume" :: waited 0.022s {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 04:47:58 devstack cinder-volume[92060]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b2fdded-36d0-4bf6-b684-315d7d3c2152]: (4, 'qcow2') {{(pid=93130) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 04:47:58 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-826382fb-09bb-41aa-9374-a88ea2e9ce5f tempest-CreateVolumesFromSourceVolumeTest-1670988288 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-4453b522-3e0c-471d-b5b3-a9d4c9f9f92a {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:47:58 devstack sudo[104253]: pam_unix(sudo:session): session closed for user root Jun 17 04:47:58 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-459f61a3-be20-4caa-91ff-c1cb72117b3b tempest-CreateVolumesFromSourceVolumeTest-1670988288 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a" returned: 0 in 1.136s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:47:58 devstack cinder-volume[92060]: DEBUG cinder.manager [None req-459f61a3-be20-4caa-91ff-c1cb72117b3b tempest-CreateVolumesFromSourceVolumeTest-1670988288 None] Notifying Schedulers of capabilities ... {{(pid=92060) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 17 04:47:58 devstack cinder-volume[92060]: INFO cinder.volume.manager [None req-459f61a3-be20-4caa-91ff-c1cb72117b3b tempest-CreateVolumesFromSourceVolumeTest-1670988288 None] Deleted volume successfully. Jun 17 04:47:58 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-459f61a3-be20-4caa-91ff-c1cb72117b3b tempest-CreateVolumesFromSourceVolumeTest-1670988288 None] Lock "cinder-f5fb428e-4b8b-42b3-9f83-aebdb7e3371b-delete_volume" released by "delete_volume" :: held 3.955s {{(pid=92060) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 04:47:58 devstack sudo[104258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-4453b522-3e0c-471d-b5b3-a9d4c9f9f92a Jun 17 04:47:58 devstack sudo[104258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:47:59 devstack sudo[104255]: pam_unix(sudo:session): session closed for user root Jun 17 04:47:59 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-cccd8961-fa85-4fb2-94ea-df72776843be tempest-CreateVolumesFromSnapshotTest-904120229 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-92658ecb-9bb8-4dfe-96a3-6923fa844c3e -F qcow2 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-92658ecb-9bb8-4dfe-96a3-6923fa844c3e.f6f90d56-9018-49ed-8ee6-3ea2d9a85d62" returned: 0 in 1.167s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:47:59 devstack cinder-volume[92060]: WARNING cinder.volume.drivers.remotefs [None req-cccd8961-fa85-4fb2-94ea-df72776843be tempest-CreateVolumesFromSnapshotTest-904120229 None] /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-92658ecb-9bb8-4dfe-96a3-6923fa844c3e.f6f90d56-9018-49ed-8ee6-3ea2d9a85d62 is being set with open permissions: ugo+rw Jun 17 04:47:59 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-cccd8961-fa85-4fb2-94ea-df72776843be tempest-CreateVolumesFromSnapshotTest-904120229 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-92658ecb-9bb8-4dfe-96a3-6923fa844c3e.f6f90d56-9018-49ed-8ee6-3ea2d9a85d62 {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:47:59 devstack sudo[104263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-92658ecb-9bb8-4dfe-96a3-6923fa844c3e.f6f90d56-9018-49ed-8ee6-3ea2d9a85d62 Jun 17 04:47:59 devstack sudo[104263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:47:59 devstack sudo[104263]: pam_unix(sudo:session): session closed for user root Jun 17 04:47:59 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-cccd8961-fa85-4fb2-94ea-df72776843be tempest-CreateVolumesFromSnapshotTest-904120229 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-92658ecb-9bb8-4dfe-96a3-6923fa844c3e.f6f90d56-9018-49ed-8ee6-3ea2d9a85d62" returned: 0 in 0.853s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:47:59 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-cccd8961-fa85-4fb2-94ea-df72776843be tempest-CreateVolumesFromSnapshotTest-904120229 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-92658ecb-9bb8-4dfe-96a3-6923fa844c3e.info {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:47:59 devstack sudo[104266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-92658ecb-9bb8-4dfe-96a3-6923fa844c3e.info Jun 17 04:47:59 devstack sudo[104266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:48:00 devstack sudo[104258]: pam_unix(sudo:session): session closed for user root Jun 17 04:48:00 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-826382fb-09bb-41aa-9374-a88ea2e9ce5f tempest-CreateVolumesFromSourceVolumeTest-1670988288 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-4453b522-3e0c-471d-b5b3-a9d4c9f9f92a" returned: 0 in 1.679s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:48:00 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-826382fb-09bb-41aa-9374-a88ea2e9ce5f tempest-CreateVolumesFromSourceVolumeTest-1670988288 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-4453b522-3e0c-471d-b5b3-a9d4c9f9f92a {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:48:00 devstack sudo[104271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-4453b522-3e0c-471d-b5b3-a9d4c9f9f92a Jun 17 04:48:00 devstack sudo[104271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:48:00 devstack sudo[104266]: pam_unix(sudo:session): session closed for user root Jun 17 04:48:00 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-cccd8961-fa85-4fb2-94ea-df72776843be tempest-CreateVolumesFromSnapshotTest-904120229 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-92658ecb-9bb8-4dfe-96a3-6923fa844c3e.info" returned: 0 in 0.970s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:48:00 devstack cinder-volume[92060]: WARNING cinder.volume.drivers.remotefs [None req-cccd8961-fa85-4fb2-94ea-df72776843be tempest-CreateVolumesFromSnapshotTest-904120229 None] /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-92658ecb-9bb8-4dfe-96a3-6923fa844c3e.info is being set with open permissions: ugo+rw Jun 17 04:48:00 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-cccd8961-fa85-4fb2-94ea-df72776843be tempest-CreateVolumesFromSnapshotTest-904120229 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-92658ecb-9bb8-4dfe-96a3-6923fa844c3e.info {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:48:00 devstack sudo[104274]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-92658ecb-9bb8-4dfe-96a3-6923fa844c3e.info Jun 17 04:48:00 devstack sudo[104274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:48:01 devstack sudo[104271]: pam_unix(sudo:session): session closed for user root Jun 17 04:48:01 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-826382fb-09bb-41aa-9374-a88ea2e9ce5f tempest-CreateVolumesFromSourceVolumeTest-1670988288 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-4453b522-3e0c-471d-b5b3-a9d4c9f9f92a" returned: 0 in 1.016s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:48:01 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-826382fb-09bb-41aa-9374-a88ea2e9ce5f tempest-CreateVolumesFromSourceVolumeTest-1670988288 None] Lock "cinder-quobyte-4453b522-3e0c-471d-b5b3-a9d4c9f9f92a" released by "delete_volume" :: held 2.773s {{(pid=92060) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 04:48:01 devstack cinder-volume[92060]: DEBUG cinder.quota [None req-826382fb-09bb-41aa-9374-a88ea2e9ce5f tempest-CreateVolumesFromSourceVolumeTest-1670988288 None] Created reservations ['4502b138-a791-4208-bebf-beed3736cf54', '81f5e4a6-1d5f-48cf-ab68-91aae5a90b3b', 'f7e39d50-c6a0-4e27-8840-550e698a333c', '5805edaf-f25f-4c5a-b1dc-f2f401933619'] {{(pid=92060) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 17 04:48:01 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-826382fb-09bb-41aa-9374-a88ea2e9ce5f tempest-CreateVolumesFromSourceVolumeTest-1670988288 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 04:48:01 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-826382fb-09bb-41aa-9374-a88ea2e9ce5f tempest-CreateVolumesFromSourceVolumeTest-1670988288 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 04:48:01 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-826382fb-09bb-41aa-9374-a88ea2e9ce5f tempest-CreateVolumesFromSourceVolumeTest-1670988288 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588': None} {{(pid=92060) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 17 04:48:01 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-826382fb-09bb-41aa-9374-a88ea2e9ce5f tempest-CreateVolumesFromSourceVolumeTest-1670988288 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588'] {{(pid=92060) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 17 04:48:01 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-826382fb-09bb-41aa-9374-a88ea2e9ce5f tempest-CreateVolumesFromSourceVolumeTest-1670988288 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 04:48:01 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-826382fb-09bb-41aa-9374-a88ea2e9ce5f tempest-CreateVolumesFromSourceVolumeTest-1670988288 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:48:01 devstack sudo[104278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a Jun 17 04:48:01 devstack sudo[104278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:48:01 devstack sudo[104274]: pam_unix(sudo:session): session closed for user root Jun 17 04:48:01 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-cccd8961-fa85-4fb2-94ea-df72776843be tempest-CreateVolumesFromSnapshotTest-904120229 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-92658ecb-9bb8-4dfe-96a3-6923fa844c3e.info" returned: 0 in 0.963s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:48:01 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-cccd8961-fa85-4fb2-94ea-df72776843be tempest-CreateVolumesFromSnapshotTest-904120229 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 6.585s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 04:48:01 devstack cinder-volume[92060]: INFO cinder.volume.manager [None req-cccd8961-fa85-4fb2-94ea-df72776843be tempest-CreateVolumesFromSnapshotTest-904120229 None] Create snapshot completed successfully Jun 17 04:48:02 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-5068212f-15c9-4eeb-b57d-b24998ea2cc8 tempest-CreateVolumesFromSourceVolumeTest-1670988288 None] Acquiring lock "cinder-3e28ffd7-708e-4973-906b-7ae90e2284a0-delete_volume" by "delete_volume" {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 04:48:02 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-5068212f-15c9-4eeb-b57d-b24998ea2cc8 tempest-CreateVolumesFromSourceVolumeTest-1670988288 None] Lock "cinder-3e28ffd7-708e-4973-906b-7ae90e2284a0-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 04:48:02 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-5068212f-15c9-4eeb-b57d-b24998ea2cc8 tempest-CreateVolumesFromSourceVolumeTest-1670988288 None] Acquiring lock "cinder-quobyte-3e28ffd7-708e-4973-906b-7ae90e2284a0" by "delete_volume" {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 04:48:02 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-5068212f-15c9-4eeb-b57d-b24998ea2cc8 tempest-CreateVolumesFromSourceVolumeTest-1670988288 None] Lock "cinder-quobyte-3e28ffd7-708e-4973-906b-7ae90e2284a0" acquired by "delete_volume" :: waited 0.041s {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 04:48:02 devstack cinder-volume[92060]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0d93c6c-f824-4eea-beef-b2a5547441e3]: (4, 'qcow2') {{(pid=93130) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 04:48:02 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-5068212f-15c9-4eeb-b57d-b24998ea2cc8 tempest-CreateVolumesFromSourceVolumeTest-1670988288 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-3e28ffd7-708e-4973-906b-7ae90e2284a0 {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:48:02 devstack sudo[104282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-3e28ffd7-708e-4973-906b-7ae90e2284a0 Jun 17 04:48:02 devstack sudo[104282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:48:02 devstack sudo[104278]: pam_unix(sudo:session): session closed for user root Jun 17 04:48:02 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-826382fb-09bb-41aa-9374-a88ea2e9ce5f tempest-CreateVolumesFromSourceVolumeTest-1670988288 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a" returned: 0 in 1.161s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:48:02 devstack cinder-volume[92060]: DEBUG cinder.manager [None req-826382fb-09bb-41aa-9374-a88ea2e9ce5f tempest-CreateVolumesFromSourceVolumeTest-1670988288 None] Notifying Schedulers of capabilities ... {{(pid=92060) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 17 04:48:02 devstack cinder-volume[92060]: INFO cinder.volume.manager [None req-826382fb-09bb-41aa-9374-a88ea2e9ce5f tempest-CreateVolumesFromSourceVolumeTest-1670988288 None] Deleted volume successfully. Jun 17 04:48:02 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-826382fb-09bb-41aa-9374-a88ea2e9ce5f tempest-CreateVolumesFromSourceVolumeTest-1670988288 None] Lock "cinder-4453b522-3e0c-471d-b5b3-a9d4c9f9f92a-delete_volume" released by "delete_volume" :: held 4.382s {{(pid=92060) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 04:48:03 devstack sudo[104282]: pam_unix(sudo:session): session closed for user root Jun 17 04:48:03 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-5068212f-15c9-4eeb-b57d-b24998ea2cc8 tempest-CreateVolumesFromSourceVolumeTest-1670988288 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-3e28ffd7-708e-4973-906b-7ae90e2284a0" returned: 0 in 0.955s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:48:03 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-5068212f-15c9-4eeb-b57d-b24998ea2cc8 tempest-CreateVolumesFromSourceVolumeTest-1670988288 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-3e28ffd7-708e-4973-906b-7ae90e2284a0 {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:48:03 devstack sudo[104288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-3e28ffd7-708e-4973-906b-7ae90e2284a0 Jun 17 04:48:03 devstack sudo[104288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:48:03 devstack cinder-volume[92060]: DEBUG cinder.volume.flows.manager.create_volume [None req-f5e71211-f3cf-451a-9954-71f42e7b8763 tempest-CreateVolumesFromSnapshotTest-904120229 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92060) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 17 04:48:03 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-f5e71211-f3cf-451a-9954-71f42e7b8763 tempest-CreateVolumesFromSnapshotTest-904120229 None] Flow 'volume_create_manager' (f62314bf-2377-4984-bb4d-e7d0d8bf772e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 17 04:48:03 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-f5e71211-f3cf-451a-9954-71f42e7b8763 tempest-CreateVolumesFromSnapshotTest-904120229 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b4891897-e855-4cfe-9550-566d74cc02d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:48:03 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-f5e71211-f3cf-451a-9954-71f42e7b8763 tempest-CreateVolumesFromSnapshotTest-904120229 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b4891897-e855-4cfe-9550-566d74cc02d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-17T02:48:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1404170265',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8b32166a-6c1c-4d7a-9752-c8c6e58fc97f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='89814f039bd544088837aa3c1874f94c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T02:48:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T02:48:03Z,use_quota=True,user_id='92d84b8d76cf4646a45de55995ea1c91',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aad9ce24-93f9-41a6-baa1-5125964f96d1),volume_type_id=aad9ce24-93f9-41a6-baa1-5125964f96d1)' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:48:03 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-f5e71211-f3cf-451a-9954-71f42e7b8763 tempest-CreateVolumesFromSnapshotTest-904120229 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e53a4f45-6dea-403b-83a5-3264072d41e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:48:03 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-f5e71211-f3cf-451a-9954-71f42e7b8763 tempest-CreateVolumesFromSnapshotTest-904120229 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e53a4f45-6dea-403b-83a5-3264072d41e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:48:03 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-f5e71211-f3cf-451a-9954-71f42e7b8763 tempest-CreateVolumesFromSnapshotTest-904120229 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bdfdcb2b-f959-4377-88ee-e63ed10f6034) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:48:03 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-f5e71211-f3cf-451a-9954-71f42e7b8763 tempest-CreateVolumesFromSnapshotTest-904120229 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bdfdcb2b-f959-4377-88ee-e63ed10f6034) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8b32166a-6c1c-4d7a-9752-c8c6e58fc97f', 'volume_name': 'volume-8b32166a-6c1c-4d7a-9752-c8c6e58fc97f', 'volume_size': 1}' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:48:03 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-f5e71211-f3cf-451a-9954-71f42e7b8763 tempest-CreateVolumesFromSnapshotTest-904120229 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (47d52db7-33a8-4bfd-84ae-e4a791e5483c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:48:03 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-f5e71211-f3cf-451a-9954-71f42e7b8763 tempest-CreateVolumesFromSnapshotTest-904120229 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (47d52db7-33a8-4bfd-84ae-e4a791e5483c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:48:03 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-f5e71211-f3cf-451a-9954-71f42e7b8763 tempest-CreateVolumesFromSnapshotTest-904120229 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b1dcca9c-479d-41c6-b58b-cfdfd6174ae3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:48:03 devstack cinder-volume[92060]: INFO cinder.volume.flows.manager.create_volume [None req-f5e71211-f3cf-451a-9954-71f42e7b8763 tempest-CreateVolumesFromSnapshotTest-904120229 None] Volume 8b32166a-6c1c-4d7a-9752-c8c6e58fc97f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8b32166a-6c1c-4d7a-9752-c8c6e58fc97f', 'volume_size': 1} Jun 17 04:48:03 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-f5e71211-f3cf-451a-9954-71f42e7b8763 tempest-CreateVolumesFromSnapshotTest-904120229 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 04:48:03 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-f5e71211-f3cf-451a-9954-71f42e7b8763 tempest-CreateVolumesFromSnapshotTest-904120229 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 04:48:03 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-f5e71211-f3cf-451a-9954-71f42e7b8763 tempest-CreateVolumesFromSnapshotTest-904120229 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-17T02:48:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1404170265',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8b32166a-6c1c-4d7a-9752-c8c6e58fc97f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='89814f039bd544088837aa3c1874f94c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T02:48:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T02:48:03Z,use_quota=True,user_id='92d84b8d76cf4646a45de55995ea1c91',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aad9ce24-93f9-41a6-baa1-5125964f96d1),volume_type_id=aad9ce24-93f9-41a6-baa1-5125964f96d1)}" {{(pid=92060) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 17 04:48:03 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.remotefs [None req-f5e71211-f3cf-451a-9954-71f42e7b8763 tempest-CreateVolumesFromSnapshotTest-904120229 None] Creating volume 8b32166a-6c1c-4d7a-9752-c8c6e58fc97f {{(pid=92060) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 17 04:48:03 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-f5e71211-f3cf-451a-9954-71f42e7b8763 tempest-CreateVolumesFromSnapshotTest-904120229 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 04:48:03 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-f5e71211-f3cf-451a-9954-71f42e7b8763 tempest-CreateVolumesFromSnapshotTest-904120229 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 04:48:03 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-f5e71211-f3cf-451a-9954-71f42e7b8763 tempest-CreateVolumesFromSnapshotTest-904120229 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588': None} {{(pid=92060) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 17 04:48:03 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-f5e71211-f3cf-451a-9954-71f42e7b8763 tempest-CreateVolumesFromSnapshotTest-904120229 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588'] {{(pid=92060) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 17 04:48:03 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-f5e71211-f3cf-451a-9954-71f42e7b8763 tempest-CreateVolumesFromSnapshotTest-904120229 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 04:48:03 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-f5e71211-f3cf-451a-9954-71f42e7b8763 tempest-CreateVolumesFromSnapshotTest-904120229 None] Selected osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588 as target Quobyte volume. {{(pid=92060) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 17 04:48:03 devstack cinder-volume[92060]: INFO cinder.volume.drivers.remotefs [None req-f5e71211-f3cf-451a-9954-71f42e7b8763 tempest-CreateVolumesFromSnapshotTest-904120229 None] casted to osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588 Jun 17 04:48:03 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-f5e71211-f3cf-451a-9954-71f42e7b8763 tempest-CreateVolumesFromSnapshotTest-904120229 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-8b32166a-6c1c-4d7a-9752-c8c6e58fc97f 1073741824 {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:48:03 devstack sudo[104290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-8b32166a-6c1c-4d7a-9752-c8c6e58fc97f 1073741824 Jun 17 04:48:03 devstack sudo[104290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:48:04 devstack cinder-volume[92060]: DEBUG cinder.volume.flows.manager.create_volume [None req-ed465243-aa9e-4f9c-82e9-1dd09159333a tempest-CreateVolumesFromSnapshotTest-904120229 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92060) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 17 04:48:04 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-ed465243-aa9e-4f9c-82e9-1dd09159333a tempest-CreateVolumesFromSnapshotTest-904120229 None] Flow 'volume_create_manager' (573998d5-f656-4d35-a130-0ea880817ce1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 17 04:48:04 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-ed465243-aa9e-4f9c-82e9-1dd09159333a tempest-CreateVolumesFromSnapshotTest-904120229 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1543ed8a-cd46-4a3d-8d4a-76f19f4cbbc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:48:04 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-ed465243-aa9e-4f9c-82e9-1dd09159333a tempest-CreateVolumesFromSnapshotTest-904120229 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1543ed8a-cd46-4a3d-8d4a-76f19f4cbbc3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-17T02:48:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2105328259',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d2ac9a58-bdc3-4db4-a17a-4b55b1e95c79,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='89814f039bd544088837aa3c1874f94c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T02:48:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T02:48:04Z,use_quota=True,user_id='92d84b8d76cf4646a45de55995ea1c91',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aad9ce24-93f9-41a6-baa1-5125964f96d1),volume_type_id=aad9ce24-93f9-41a6-baa1-5125964f96d1)' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:48:04 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-ed465243-aa9e-4f9c-82e9-1dd09159333a tempest-CreateVolumesFromSnapshotTest-904120229 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (150bfd9f-9aed-4f35-8c3a-681b521bebd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:48:04 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-ed465243-aa9e-4f9c-82e9-1dd09159333a tempest-CreateVolumesFromSnapshotTest-904120229 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (150bfd9f-9aed-4f35-8c3a-681b521bebd0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:48:04 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-ed465243-aa9e-4f9c-82e9-1dd09159333a tempest-CreateVolumesFromSnapshotTest-904120229 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2b756e87-d077-4074-89ba-fd64e4e5da64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:48:04 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-ed465243-aa9e-4f9c-82e9-1dd09159333a tempest-CreateVolumesFromSnapshotTest-904120229 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2b756e87-d077-4074-89ba-fd64e4e5da64) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd2ac9a58-bdc3-4db4-a17a-4b55b1e95c79', 'volume_name': 'volume-d2ac9a58-bdc3-4db4-a17a-4b55b1e95c79', 'volume_size': 1}' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:48:04 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-ed465243-aa9e-4f9c-82e9-1dd09159333a tempest-CreateVolumesFromSnapshotTest-904120229 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bd301e09-a7c8-4d2a-9e90-35d3f93c2489) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:48:04 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-ed465243-aa9e-4f9c-82e9-1dd09159333a tempest-CreateVolumesFromSnapshotTest-904120229 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bd301e09-a7c8-4d2a-9e90-35d3f93c2489) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:48:04 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-ed465243-aa9e-4f9c-82e9-1dd09159333a tempest-CreateVolumesFromSnapshotTest-904120229 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (167f3ae2-e325-4da2-ad4e-deba99138f83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:48:04 devstack cinder-volume[92060]: INFO cinder.volume.flows.manager.create_volume [None req-ed465243-aa9e-4f9c-82e9-1dd09159333a tempest-CreateVolumesFromSnapshotTest-904120229 None] Volume d2ac9a58-bdc3-4db4-a17a-4b55b1e95c79: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d2ac9a58-bdc3-4db4-a17a-4b55b1e95c79', 'volume_size': 1} Jun 17 04:48:04 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-ed465243-aa9e-4f9c-82e9-1dd09159333a tempest-CreateVolumesFromSnapshotTest-904120229 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 04:48:04 devstack sudo[104288]: pam_unix(sudo:session): session closed for user root Jun 17 04:48:04 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-5068212f-15c9-4eeb-b57d-b24998ea2cc8 tempest-CreateVolumesFromSourceVolumeTest-1670988288 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-3e28ffd7-708e-4973-906b-7ae90e2284a0" returned: 0 in 1.289s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:48:04 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-5068212f-15c9-4eeb-b57d-b24998ea2cc8 tempest-CreateVolumesFromSourceVolumeTest-1670988288 None] Lock "cinder-quobyte-3e28ffd7-708e-4973-906b-7ae90e2284a0" released by "delete_volume" :: held 2.345s {{(pid=92060) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 04:48:04 devstack cinder-volume[92060]: DEBUG cinder.quota [None req-5068212f-15c9-4eeb-b57d-b24998ea2cc8 tempest-CreateVolumesFromSourceVolumeTest-1670988288 None] Created reservations ['1b297ba7-5ccd-4124-8e7d-9481c1b85af8', '2e79eb0b-6a32-4282-b0b6-67f645efd99c', '890d2989-4c23-4a44-acfb-3ba4680cf86b', '9d4e4e2e-9acd-4715-9875-8183a6898a08'] {{(pid=92060) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 17 04:48:04 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-5068212f-15c9-4eeb-b57d-b24998ea2cc8 tempest-CreateVolumesFromSourceVolumeTest-1670988288 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 04:48:04 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-5068212f-15c9-4eeb-b57d-b24998ea2cc8 tempest-CreateVolumesFromSourceVolumeTest-1670988288 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 04:48:04 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-5068212f-15c9-4eeb-b57d-b24998ea2cc8 tempest-CreateVolumesFromSourceVolumeTest-1670988288 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588': None} {{(pid=92060) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 17 04:48:04 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-5068212f-15c9-4eeb-b57d-b24998ea2cc8 tempest-CreateVolumesFromSourceVolumeTest-1670988288 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588'] {{(pid=92060) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 17 04:48:04 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-5068212f-15c9-4eeb-b57d-b24998ea2cc8 tempest-CreateVolumesFromSourceVolumeTest-1670988288 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 04:48:04 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-5068212f-15c9-4eeb-b57d-b24998ea2cc8 tempest-CreateVolumesFromSourceVolumeTest-1670988288 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:48:04 devstack cinder-volume[92060]: DEBUG cinder.volume.flows.manager.create_volume [None req-6e2ff343-d96c-42a7-bf0f-fe4d2562e44f tempest-CreateVolumesFromSnapshotTest-904120229 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92060) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 17 04:48:04 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-6e2ff343-d96c-42a7-bf0f-fe4d2562e44f tempest-CreateVolumesFromSnapshotTest-904120229 None] Flow 'volume_create_manager' (c752cfc6-dba4-4c31-a383-e4efbe32df53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 17 04:48:04 devstack sudo[104298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a Jun 17 04:48:04 devstack sudo[104298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:48:04 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-6e2ff343-d96c-42a7-bf0f-fe4d2562e44f tempest-CreateVolumesFromSnapshotTest-904120229 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (87e1f71a-efe1-421e-a7d1-19d32607ab97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:48:04 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-6e2ff343-d96c-42a7-bf0f-fe4d2562e44f tempest-CreateVolumesFromSnapshotTest-904120229 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (87e1f71a-efe1-421e-a7d1-19d32607ab97) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-17T02:48:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-263244563',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9072c1a3-3b76-48b7-9145-d3ebddbcdc88,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='89814f039bd544088837aa3c1874f94c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T02:48:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T02:48:05Z,use_quota=True,user_id='92d84b8d76cf4646a45de55995ea1c91',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aad9ce24-93f9-41a6-baa1-5125964f96d1),volume_type_id=aad9ce24-93f9-41a6-baa1-5125964f96d1)' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:48:04 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-6e2ff343-d96c-42a7-bf0f-fe4d2562e44f tempest-CreateVolumesFromSnapshotTest-904120229 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7b318e91-2983-43c8-9029-b8ff8be65b1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:48:04 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-6e2ff343-d96c-42a7-bf0f-fe4d2562e44f tempest-CreateVolumesFromSnapshotTest-904120229 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7b318e91-2983-43c8-9029-b8ff8be65b1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:48:05 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-6e2ff343-d96c-42a7-bf0f-fe4d2562e44f tempest-CreateVolumesFromSnapshotTest-904120229 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b54e026d-643e-4dd7-af1f-f9b674d29694) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:48:05 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-6e2ff343-d96c-42a7-bf0f-fe4d2562e44f tempest-CreateVolumesFromSnapshotTest-904120229 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b54e026d-643e-4dd7-af1f-f9b674d29694) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9072c1a3-3b76-48b7-9145-d3ebddbcdc88', 'volume_name': 'volume-9072c1a3-3b76-48b7-9145-d3ebddbcdc88', 'volume_size': 1}' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:48:05 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-6e2ff343-d96c-42a7-bf0f-fe4d2562e44f tempest-CreateVolumesFromSnapshotTest-904120229 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3f860b1e-27ee-4d25-8be6-1776d0148dd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:48:05 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-6e2ff343-d96c-42a7-bf0f-fe4d2562e44f tempest-CreateVolumesFromSnapshotTest-904120229 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3f860b1e-27ee-4d25-8be6-1776d0148dd6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:48:05 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-6e2ff343-d96c-42a7-bf0f-fe4d2562e44f tempest-CreateVolumesFromSnapshotTest-904120229 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bbbe8486-619e-450b-b44b-1d2dc732e304) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:48:05 devstack cinder-volume[92060]: INFO cinder.volume.flows.manager.create_volume [None req-6e2ff343-d96c-42a7-bf0f-fe4d2562e44f tempest-CreateVolumesFromSnapshotTest-904120229 None] Volume 9072c1a3-3b76-48b7-9145-d3ebddbcdc88: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9072c1a3-3b76-48b7-9145-d3ebddbcdc88', 'volume_size': 1} Jun 17 04:48:05 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-6e2ff343-d96c-42a7-bf0f-fe4d2562e44f tempest-CreateVolumesFromSnapshotTest-904120229 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 04:48:05 devstack sudo[104290]: pam_unix(sudo:session): session closed for user root Jun 17 04:48:05 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-f5e71211-f3cf-451a-9954-71f42e7b8763 tempest-CreateVolumesFromSnapshotTest-904120229 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-8b32166a-6c1c-4d7a-9752-c8c6e58fc97f 1073741824" returned: 0 in 1.585s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:48:05 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-f5e71211-f3cf-451a-9954-71f42e7b8763 tempest-CreateVolumesFromSnapshotTest-904120229 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-8b32166a-6c1c-4d7a-9752-c8c6e58fc97f {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:48:05 devstack cinder-volume[92060]: DEBUG cinder.volume.flows.manager.create_volume [None req-606e1a1d-722b-4ab5-a30e-8b09c2a58aa1 tempest-CreateVolumesFromSnapshotTest-904120229 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92060) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 17 04:48:05 devstack sudo[104324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-8b32166a-6c1c-4d7a-9752-c8c6e58fc97f Jun 17 04:48:05 devstack sudo[104324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:48:05 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-606e1a1d-722b-4ab5-a30e-8b09c2a58aa1 tempest-CreateVolumesFromSnapshotTest-904120229 None] Flow 'volume_create_manager' (b9088a6b-3163-433a-aee3-42d959310757) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 17 04:48:05 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-606e1a1d-722b-4ab5-a30e-8b09c2a58aa1 tempest-CreateVolumesFromSnapshotTest-904120229 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c8b7c750-9b2d-4e67-bda7-7c0cc8d28c39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:48:05 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-606e1a1d-722b-4ab5-a30e-8b09c2a58aa1 tempest-CreateVolumesFromSnapshotTest-904120229 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c8b7c750-9b2d-4e67-bda7-7c0cc8d28c39) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-17T02:48:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-190387081',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aa34913e-37c2-43e9-afdb-9a698e12830b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='89814f039bd544088837aa3c1874f94c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T02:48:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T02:48:05Z,use_quota=True,user_id='92d84b8d76cf4646a45de55995ea1c91',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aad9ce24-93f9-41a6-baa1-5125964f96d1),volume_type_id=aad9ce24-93f9-41a6-baa1-5125964f96d1)' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:48:05 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-606e1a1d-722b-4ab5-a30e-8b09c2a58aa1 tempest-CreateVolumesFromSnapshotTest-904120229 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (432802c9-2afc-4358-a913-6d031dc39622) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:48:05 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-606e1a1d-722b-4ab5-a30e-8b09c2a58aa1 tempest-CreateVolumesFromSnapshotTest-904120229 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (432802c9-2afc-4358-a913-6d031dc39622) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:48:05 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-606e1a1d-722b-4ab5-a30e-8b09c2a58aa1 tempest-CreateVolumesFromSnapshotTest-904120229 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (81756e3c-2cbc-4341-83c1-6ed68725fde7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:48:05 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-606e1a1d-722b-4ab5-a30e-8b09c2a58aa1 tempest-CreateVolumesFromSnapshotTest-904120229 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (81756e3c-2cbc-4341-83c1-6ed68725fde7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'aa34913e-37c2-43e9-afdb-9a698e12830b', 'volume_name': 'volume-aa34913e-37c2-43e9-afdb-9a698e12830b', 'volume_size': 1}' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:48:05 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-606e1a1d-722b-4ab5-a30e-8b09c2a58aa1 tempest-CreateVolumesFromSnapshotTest-904120229 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1826abe7-8ed5-4158-96f9-798408afbfa8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:48:05 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-606e1a1d-722b-4ab5-a30e-8b09c2a58aa1 tempest-CreateVolumesFromSnapshotTest-904120229 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1826abe7-8ed5-4158-96f9-798408afbfa8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:48:05 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-606e1a1d-722b-4ab5-a30e-8b09c2a58aa1 tempest-CreateVolumesFromSnapshotTest-904120229 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8b8a3b37-6184-4ffd-8fd7-0c405602bd2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:48:05 devstack cinder-volume[92060]: INFO cinder.volume.flows.manager.create_volume [None req-606e1a1d-722b-4ab5-a30e-8b09c2a58aa1 tempest-CreateVolumesFromSnapshotTest-904120229 None] Volume aa34913e-37c2-43e9-afdb-9a698e12830b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-aa34913e-37c2-43e9-afdb-9a698e12830b', 'volume_size': 1} Jun 17 04:48:05 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-606e1a1d-722b-4ab5-a30e-8b09c2a58aa1 tempest-CreateVolumesFromSnapshotTest-904120229 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 04:48:05 devstack cinder-volume[92060]: DEBUG cinder.volume.flows.manager.create_volume [None req-ca44abe1-3122-4e9f-b934-aa045d1a72ad tempest-AttachVolumeNegativeTest-991296233 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92060) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 17 04:48:05 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-ca44abe1-3122-4e9f-b934-aa045d1a72ad tempest-AttachVolumeNegativeTest-991296233 None] Flow 'volume_create_manager' (5cc65d5c-5a25-439a-a154-84770eb67e78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 17 04:48:05 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-ca44abe1-3122-4e9f-b934-aa045d1a72ad tempest-AttachVolumeNegativeTest-991296233 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c466eaa5-a5ec-4fb6-9171-0430e3b05f1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:48:05 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-0dadb44f-904a-4054-bfbe-a32a1a2e6651 tempest-CreateVolumesFromSourceVolumeTest-1670988288 None] Acquiring lock "cinder-1725d18b-ab8b-4b12-ab2a-3d937b1c3579-delete_volume" by "delete_volume" {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 04:48:05 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-0dadb44f-904a-4054-bfbe-a32a1a2e6651 tempest-CreateVolumesFromSourceVolumeTest-1670988288 None] Lock "cinder-1725d18b-ab8b-4b12-ab2a-3d937b1c3579-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 04:48:05 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-ca44abe1-3122-4e9f-b934-aa045d1a72ad tempest-AttachVolumeNegativeTest-991296233 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c466eaa5-a5ec-4fb6-9171-0430e3b05f1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-17T02:48:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-2114435129',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f3bc4daf-94fb-4638-b601-1f86d479d4de,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9d0a579338d541c79ff65be0490f47b0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T02:48:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T02:48:05Z,use_quota=True,user_id='994750bc5563495ca183a77999e0ce87',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aad9ce24-93f9-41a6-baa1-5125964f96d1),volume_type_id=aad9ce24-93f9-41a6-baa1-5125964f96d1)' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:48:05 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-ca44abe1-3122-4e9f-b934-aa045d1a72ad tempest-AttachVolumeNegativeTest-991296233 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (df1f8f84-3a56-43e1-9990-1bd5d0d3cc58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:48:05 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-ca44abe1-3122-4e9f-b934-aa045d1a72ad tempest-AttachVolumeNegativeTest-991296233 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (df1f8f84-3a56-43e1-9990-1bd5d0d3cc58) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:48:05 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-ca44abe1-3122-4e9f-b934-aa045d1a72ad tempest-AttachVolumeNegativeTest-991296233 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (94da6d6e-c052-4374-a486-628bea3cd09d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:48:05 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-ca44abe1-3122-4e9f-b934-aa045d1a72ad tempest-AttachVolumeNegativeTest-991296233 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (94da6d6e-c052-4374-a486-628bea3cd09d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f3bc4daf-94fb-4638-b601-1f86d479d4de', 'volume_name': 'volume-f3bc4daf-94fb-4638-b601-1f86d479d4de', 'volume_size': 1}' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:48:05 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-ca44abe1-3122-4e9f-b934-aa045d1a72ad tempest-AttachVolumeNegativeTest-991296233 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bbaaaca0-ac39-4b4f-95fa-51e19bd58c7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:48:05 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-ca44abe1-3122-4e9f-b934-aa045d1a72ad tempest-AttachVolumeNegativeTest-991296233 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bbaaaca0-ac39-4b4f-95fa-51e19bd58c7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:48:05 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-ca44abe1-3122-4e9f-b934-aa045d1a72ad tempest-AttachVolumeNegativeTest-991296233 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (173df87c-9d3d-4749-a936-7f89695636d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:48:05 devstack cinder-volume[92060]: INFO cinder.volume.flows.manager.create_volume [None req-ca44abe1-3122-4e9f-b934-aa045d1a72ad tempest-AttachVolumeNegativeTest-991296233 None] Volume f3bc4daf-94fb-4638-b601-1f86d479d4de: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f3bc4daf-94fb-4638-b601-1f86d479d4de', 'volume_size': 1} Jun 17 04:48:05 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-ca44abe1-3122-4e9f-b934-aa045d1a72ad tempest-AttachVolumeNegativeTest-991296233 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 04:48:05 devstack sudo[104298]: pam_unix(sudo:session): session closed for user root Jun 17 04:48:05 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-5068212f-15c9-4eeb-b57d-b24998ea2cc8 tempest-CreateVolumesFromSourceVolumeTest-1670988288 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a" returned: 0 in 1.100s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:48:05 devstack cinder-volume[92060]: DEBUG cinder.manager [None req-5068212f-15c9-4eeb-b57d-b24998ea2cc8 tempest-CreateVolumesFromSourceVolumeTest-1670988288 None] Notifying Schedulers of capabilities ... {{(pid=92060) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 17 04:48:05 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-0dadb44f-904a-4054-bfbe-a32a1a2e6651 tempest-CreateVolumesFromSourceVolumeTest-1670988288 None] Acquiring lock "cinder-quobyte-1725d18b-ab8b-4b12-ab2a-3d937b1c3579" by "delete_volume" {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 04:48:05 devstack cinder-volume[92060]: INFO cinder.volume.manager [None req-5068212f-15c9-4eeb-b57d-b24998ea2cc8 tempest-CreateVolumesFromSourceVolumeTest-1670988288 None] Deleted volume successfully. Jun 17 04:48:05 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-0dadb44f-904a-4054-bfbe-a32a1a2e6651 tempest-CreateVolumesFromSourceVolumeTest-1670988288 None] Lock "cinder-quobyte-1725d18b-ab8b-4b12-ab2a-3d937b1c3579" acquired by "delete_volume" :: waited 0.031s {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 04:48:05 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-5068212f-15c9-4eeb-b57d-b24998ea2cc8 tempest-CreateVolumesFromSourceVolumeTest-1670988288 None] Lock "cinder-3e28ffd7-708e-4973-906b-7ae90e2284a0-delete_volume" released by "delete_volume" :: held 3.957s {{(pid=92060) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 04:48:06 devstack cinder-volume[92060]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5313088-a14d-4121-992f-fd291e4821dc]: (4, 'qcow2') {{(pid=93130) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 04:48:06 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-0dadb44f-904a-4054-bfbe-a32a1a2e6651 tempest-CreateVolumesFromSourceVolumeTest-1670988288 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-1725d18b-ab8b-4b12-ab2a-3d937b1c3579 {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:48:06 devstack sudo[104327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-1725d18b-ab8b-4b12-ab2a-3d937b1c3579 Jun 17 04:48:06 devstack sudo[104327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:48:06 devstack cinder-volume[92060]: DEBUG cinder.volume.flows.manager.create_volume [None req-d937dcaa-8e7b-461f-9c24-a77b8b455f7a tempest-CreateVolumesFromSnapshotTest-904120229 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92060) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 17 04:48:06 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-d937dcaa-8e7b-461f-9c24-a77b8b455f7a tempest-CreateVolumesFromSnapshotTest-904120229 None] Flow 'volume_create_manager' (546e099a-0fab-43d1-9e82-0288c47e87f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 17 04:48:06 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-d937dcaa-8e7b-461f-9c24-a77b8b455f7a tempest-CreateVolumesFromSnapshotTest-904120229 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aa2fb819-a55d-4de3-a264-b842b6c8f5d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:48:06 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-d937dcaa-8e7b-461f-9c24-a77b8b455f7a tempest-CreateVolumesFromSnapshotTest-904120229 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aa2fb819-a55d-4de3-a264-b842b6c8f5d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-17T02:48:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1135472637',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=543f148e-4d95-428d-abfb-8fb5b53935db,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='89814f039bd544088837aa3c1874f94c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T02:48:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T02:48:06Z,use_quota=True,user_id='92d84b8d76cf4646a45de55995ea1c91',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aad9ce24-93f9-41a6-baa1-5125964f96d1),volume_type_id=aad9ce24-93f9-41a6-baa1-5125964f96d1)' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:48:06 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-d937dcaa-8e7b-461f-9c24-a77b8b455f7a tempest-CreateVolumesFromSnapshotTest-904120229 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cbce42ab-e5a9-4215-b817-8d1b1b607526) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:48:06 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-d937dcaa-8e7b-461f-9c24-a77b8b455f7a tempest-CreateVolumesFromSnapshotTest-904120229 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cbce42ab-e5a9-4215-b817-8d1b1b607526) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:48:06 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-d937dcaa-8e7b-461f-9c24-a77b8b455f7a tempest-CreateVolumesFromSnapshotTest-904120229 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e2c51ab2-fe80-4956-aaa4-52b285bca160) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:48:06 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-d937dcaa-8e7b-461f-9c24-a77b8b455f7a tempest-CreateVolumesFromSnapshotTest-904120229 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e2c51ab2-fe80-4956-aaa4-52b285bca160) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '543f148e-4d95-428d-abfb-8fb5b53935db', 'volume_name': 'volume-543f148e-4d95-428d-abfb-8fb5b53935db', 'volume_size': 1}' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:48:06 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-d937dcaa-8e7b-461f-9c24-a77b8b455f7a tempest-CreateVolumesFromSnapshotTest-904120229 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (20563f63-34be-4bd2-9fa6-dd1f7237cdf4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:48:06 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-d937dcaa-8e7b-461f-9c24-a77b8b455f7a tempest-CreateVolumesFromSnapshotTest-904120229 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (20563f63-34be-4bd2-9fa6-dd1f7237cdf4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:48:06 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-d937dcaa-8e7b-461f-9c24-a77b8b455f7a tempest-CreateVolumesFromSnapshotTest-904120229 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (161ded02-46da-450a-a5f7-9a6cdcd164ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:48:06 devstack cinder-volume[92060]: INFO cinder.volume.flows.manager.create_volume [None req-d937dcaa-8e7b-461f-9c24-a77b8b455f7a tempest-CreateVolumesFromSnapshotTest-904120229 None] Volume 543f148e-4d95-428d-abfb-8fb5b53935db: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-543f148e-4d95-428d-abfb-8fb5b53935db', 'volume_size': 1} Jun 17 04:48:06 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-d937dcaa-8e7b-461f-9c24-a77b8b455f7a tempest-CreateVolumesFromSnapshotTest-904120229 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 04:48:06 devstack sudo[104324]: pam_unix(sudo:session): session closed for user root Jun 17 04:48:06 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-f5e71211-f3cf-451a-9954-71f42e7b8763 tempest-CreateVolumesFromSnapshotTest-904120229 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-8b32166a-6c1c-4d7a-9752-c8c6e58fc97f" returned: 0 in 1.052s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:48:06 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-f5e71211-f3cf-451a-9954-71f42e7b8763 tempest-CreateVolumesFromSnapshotTest-904120229 None] <== create_volume: return (2833ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588'} {{(pid=92060) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 17 04:48:06 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-f5e71211-f3cf-451a-9954-71f42e7b8763 tempest-CreateVolumesFromSnapshotTest-904120229 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.839s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 04:48:06 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-ed465243-aa9e-4f9c-82e9-1dd09159333a tempest-CreateVolumesFromSnapshotTest-904120229 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.049s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 04:48:06 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-ed465243-aa9e-4f9c-82e9-1dd09159333a tempest-CreateVolumesFromSnapshotTest-904120229 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-17T02:48:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2105328259',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d2ac9a58-bdc3-4db4-a17a-4b55b1e95c79,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='89814f039bd544088837aa3c1874f94c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T02:48:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T02:48:04Z,use_quota=True,user_id='92d84b8d76cf4646a45de55995ea1c91',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aad9ce24-93f9-41a6-baa1-5125964f96d1),volume_type_id=aad9ce24-93f9-41a6-baa1-5125964f96d1)}" {{(pid=92060) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 17 04:48:06 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.remotefs [None req-ed465243-aa9e-4f9c-82e9-1dd09159333a tempest-CreateVolumesFromSnapshotTest-904120229 None] Creating volume d2ac9a58-bdc3-4db4-a17a-4b55b1e95c79 {{(pid=92060) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 17 04:48:06 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-ed465243-aa9e-4f9c-82e9-1dd09159333a tempest-CreateVolumesFromSnapshotTest-904120229 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 04:48:06 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-ed465243-aa9e-4f9c-82e9-1dd09159333a tempest-CreateVolumesFromSnapshotTest-904120229 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 04:48:06 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-ed465243-aa9e-4f9c-82e9-1dd09159333a tempest-CreateVolumesFromSnapshotTest-904120229 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588': None} {{(pid=92060) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 17 04:48:06 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-ed465243-aa9e-4f9c-82e9-1dd09159333a tempest-CreateVolumesFromSnapshotTest-904120229 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588'] {{(pid=92060) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 17 04:48:06 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-ed465243-aa9e-4f9c-82e9-1dd09159333a tempest-CreateVolumesFromSnapshotTest-904120229 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 04:48:06 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-ed465243-aa9e-4f9c-82e9-1dd09159333a tempest-CreateVolumesFromSnapshotTest-904120229 None] Selected osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588 as target Quobyte volume. {{(pid=92060) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 17 04:48:06 devstack cinder-volume[92060]: INFO cinder.volume.drivers.remotefs [None req-ed465243-aa9e-4f9c-82e9-1dd09159333a tempest-CreateVolumesFromSnapshotTest-904120229 None] casted to osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588 Jun 17 04:48:06 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-ed465243-aa9e-4f9c-82e9-1dd09159333a tempest-CreateVolumesFromSnapshotTest-904120229 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-d2ac9a58-bdc3-4db4-a17a-4b55b1e95c79 1073741824 {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:48:06 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-f5e71211-f3cf-451a-9954-71f42e7b8763 tempest-CreateVolumesFromSnapshotTest-904120229 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b1dcca9c-479d-41c6-b58b-cfdfd6174ae3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8b32166a-6c1c-4d7a-9752-c8c6e58fc97f', 'volume_size': 1}' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:48:06 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-f5e71211-f3cf-451a-9954-71f42e7b8763 tempest-CreateVolumesFromSnapshotTest-904120229 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b1051f87-57c1-46b6-bb6c-09ba984c0421) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:48:06 devstack sudo[104330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-d2ac9a58-bdc3-4db4-a17a-4b55b1e95c79 1073741824 Jun 17 04:48:06 devstack sudo[104330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:48:06 devstack cinder-volume[92060]: INFO cinder.volume.flows.manager.create_volume [None req-f5e71211-f3cf-451a-9954-71f42e7b8763 tempest-CreateVolumesFromSnapshotTest-904120229 None] Volume volume-8b32166a-6c1c-4d7a-9752-c8c6e58fc97f (8b32166a-6c1c-4d7a-9752-c8c6e58fc97f): created successfully Jun 17 04:48:06 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-f5e71211-f3cf-451a-9954-71f42e7b8763 tempest-CreateVolumesFromSnapshotTest-904120229 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b1051f87-57c1-46b6-bb6c-09ba984c0421) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:48:06 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-f5e71211-f3cf-451a-9954-71f42e7b8763 tempest-CreateVolumesFromSnapshotTest-904120229 None] Flow 'volume_create_manager' (f62314bf-2377-4984-bb4d-e7d0d8bf772e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92060) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 17 04:48:06 devstack cinder-volume[92060]: INFO cinder.volume.manager [None req-f5e71211-f3cf-451a-9954-71f42e7b8763 tempest-CreateVolumesFromSnapshotTest-904120229 None] Created volume successfully. Jun 17 04:48:06 devstack sudo[104327]: pam_unix(sudo:session): session closed for user root Jun 17 04:48:06 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-0dadb44f-904a-4054-bfbe-a32a1a2e6651 tempest-CreateVolumesFromSourceVolumeTest-1670988288 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-1725d18b-ab8b-4b12-ab2a-3d937b1c3579" returned: 0 in 0.916s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:48:06 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-0dadb44f-904a-4054-bfbe-a32a1a2e6651 tempest-CreateVolumesFromSourceVolumeTest-1670988288 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-1725d18b-ab8b-4b12-ab2a-3d937b1c3579 {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:48:06 devstack sudo[104382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-1725d18b-ab8b-4b12-ab2a-3d937b1c3579 Jun 17 04:48:06 devstack sudo[104382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:48:07 devstack sudo[104330]: pam_unix(sudo:session): session closed for user root Jun 17 04:48:07 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-ed465243-aa9e-4f9c-82e9-1dd09159333a tempest-CreateVolumesFromSnapshotTest-904120229 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-d2ac9a58-bdc3-4db4-a17a-4b55b1e95c79 1073741824" returned: 0 in 1.082s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:48:07 devstack sudo[104382]: pam_unix(sudo:session): session closed for user root Jun 17 04:48:07 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-0dadb44f-904a-4054-bfbe-a32a1a2e6651 tempest-CreateVolumesFromSourceVolumeTest-1670988288 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-1725d18b-ab8b-4b12-ab2a-3d937b1c3579" returned: 0 in 0.695s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:48:07 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-0dadb44f-904a-4054-bfbe-a32a1a2e6651 tempest-CreateVolumesFromSourceVolumeTest-1670988288 None] Lock "cinder-quobyte-1725d18b-ab8b-4b12-ab2a-3d937b1c3579" released by "delete_volume" :: held 1.677s {{(pid=92060) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 04:48:07 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-ed465243-aa9e-4f9c-82e9-1dd09159333a tempest-CreateVolumesFromSnapshotTest-904120229 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-d2ac9a58-bdc3-4db4-a17a-4b55b1e95c79 {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:48:07 devstack sudo[104401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-d2ac9a58-bdc3-4db4-a17a-4b55b1e95c79 Jun 17 04:48:07 devstack sudo[104401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:48:07 devstack cinder-volume[92060]: DEBUG cinder.quota [None req-0dadb44f-904a-4054-bfbe-a32a1a2e6651 tempest-CreateVolumesFromSourceVolumeTest-1670988288 None] Created reservations ['a75de28e-beea-4e81-b90b-460b527f7874', '1f3e099f-c233-4c56-ae59-b59e04d76316', '7e32a427-49df-420a-8aa7-ccd297028cbf', '9eb7fdce-3123-44d9-b9e9-92348cc3cd7a'] {{(pid=92060) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 17 04:48:07 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-0dadb44f-904a-4054-bfbe-a32a1a2e6651 tempest-CreateVolumesFromSourceVolumeTest-1670988288 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 04:48:07 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-0dadb44f-904a-4054-bfbe-a32a1a2e6651 tempest-CreateVolumesFromSourceVolumeTest-1670988288 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 04:48:07 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-0dadb44f-904a-4054-bfbe-a32a1a2e6651 tempest-CreateVolumesFromSourceVolumeTest-1670988288 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588': None} {{(pid=92060) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 17 04:48:07 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-0dadb44f-904a-4054-bfbe-a32a1a2e6651 tempest-CreateVolumesFromSourceVolumeTest-1670988288 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588'] {{(pid=92060) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 17 04:48:07 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-0dadb44f-904a-4054-bfbe-a32a1a2e6651 tempest-CreateVolumesFromSourceVolumeTest-1670988288 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 04:48:07 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-0dadb44f-904a-4054-bfbe-a32a1a2e6651 tempest-CreateVolumesFromSourceVolumeTest-1670988288 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:48:07 devstack sudo[104403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a Jun 17 04:48:07 devstack sudo[104403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:48:08 devstack sudo[104401]: pam_unix(sudo:session): session closed for user root Jun 17 04:48:08 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-ed465243-aa9e-4f9c-82e9-1dd09159333a tempest-CreateVolumesFromSnapshotTest-904120229 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-d2ac9a58-bdc3-4db4-a17a-4b55b1e95c79" returned: 0 in 0.704s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:48:08 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-ed465243-aa9e-4f9c-82e9-1dd09159333a tempest-CreateVolumesFromSnapshotTest-904120229 None] <== create_volume: return (1851ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588'} {{(pid=92060) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 17 04:48:08 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-ed465243-aa9e-4f9c-82e9-1dd09159333a tempest-CreateVolumesFromSnapshotTest-904120229 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.855s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 04:48:08 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-6e2ff343-d96c-42a7-bf0f-fe4d2562e44f tempest-CreateVolumesFromSnapshotTest-904120229 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.308s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 04:48:08 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-6e2ff343-d96c-42a7-bf0f-fe4d2562e44f tempest-CreateVolumesFromSnapshotTest-904120229 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-17T02:48:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-263244563',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9072c1a3-3b76-48b7-9145-d3ebddbcdc88,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='89814f039bd544088837aa3c1874f94c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T02:48:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T02:48:05Z,use_quota=True,user_id='92d84b8d76cf4646a45de55995ea1c91',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aad9ce24-93f9-41a6-baa1-5125964f96d1),volume_type_id=aad9ce24-93f9-41a6-baa1-5125964f96d1)}" {{(pid=92060) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 17 04:48:08 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.remotefs [None req-6e2ff343-d96c-42a7-bf0f-fe4d2562e44f tempest-CreateVolumesFromSnapshotTest-904120229 None] Creating volume 9072c1a3-3b76-48b7-9145-d3ebddbcdc88 {{(pid=92060) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 17 04:48:08 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-6e2ff343-d96c-42a7-bf0f-fe4d2562e44f tempest-CreateVolumesFromSnapshotTest-904120229 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 04:48:08 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-6e2ff343-d96c-42a7-bf0f-fe4d2562e44f tempest-CreateVolumesFromSnapshotTest-904120229 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 04:48:08 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-6e2ff343-d96c-42a7-bf0f-fe4d2562e44f tempest-CreateVolumesFromSnapshotTest-904120229 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588': None} {{(pid=92060) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 17 04:48:08 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-6e2ff343-d96c-42a7-bf0f-fe4d2562e44f tempest-CreateVolumesFromSnapshotTest-904120229 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588'] {{(pid=92060) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 17 04:48:08 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-6e2ff343-d96c-42a7-bf0f-fe4d2562e44f tempest-CreateVolumesFromSnapshotTest-904120229 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 04:48:08 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-6e2ff343-d96c-42a7-bf0f-fe4d2562e44f tempest-CreateVolumesFromSnapshotTest-904120229 None] Selected osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588 as target Quobyte volume. {{(pid=92060) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 17 04:48:08 devstack cinder-volume[92060]: INFO cinder.volume.drivers.remotefs [None req-6e2ff343-d96c-42a7-bf0f-fe4d2562e44f tempest-CreateVolumesFromSnapshotTest-904120229 None] casted to osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588 Jun 17 04:48:08 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-6e2ff343-d96c-42a7-bf0f-fe4d2562e44f tempest-CreateVolumesFromSnapshotTest-904120229 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-9072c1a3-3b76-48b7-9145-d3ebddbcdc88 1073741824 {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:48:08 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-ed465243-aa9e-4f9c-82e9-1dd09159333a tempest-CreateVolumesFromSnapshotTest-904120229 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (167f3ae2-e325-4da2-ad4e-deba99138f83) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d2ac9a58-bdc3-4db4-a17a-4b55b1e95c79', 'volume_size': 1}' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:48:08 devstack sudo[104409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-9072c1a3-3b76-48b7-9145-d3ebddbcdc88 1073741824 Jun 17 04:48:08 devstack sudo[104409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:48:08 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-ed465243-aa9e-4f9c-82e9-1dd09159333a tempest-CreateVolumesFromSnapshotTest-904120229 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (be3bf8ec-406c-47c1-8dd0-add65c005dcf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:48:08 devstack cinder-volume[92060]: INFO cinder.volume.flows.manager.create_volume [None req-ed465243-aa9e-4f9c-82e9-1dd09159333a tempest-CreateVolumesFromSnapshotTest-904120229 None] Volume volume-d2ac9a58-bdc3-4db4-a17a-4b55b1e95c79 (d2ac9a58-bdc3-4db4-a17a-4b55b1e95c79): created successfully Jun 17 04:48:08 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-ed465243-aa9e-4f9c-82e9-1dd09159333a tempest-CreateVolumesFromSnapshotTest-904120229 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (be3bf8ec-406c-47c1-8dd0-add65c005dcf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:48:08 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-ed465243-aa9e-4f9c-82e9-1dd09159333a tempest-CreateVolumesFromSnapshotTest-904120229 None] Flow 'volume_create_manager' (573998d5-f656-4d35-a130-0ea880817ce1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92060) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 17 04:48:08 devstack cinder-volume[92060]: INFO cinder.volume.manager [None req-ed465243-aa9e-4f9c-82e9-1dd09159333a tempest-CreateVolumesFromSnapshotTest-904120229 None] Created volume successfully. Jun 17 04:48:08 devstack sudo[104403]: pam_unix(sudo:session): session closed for user root Jun 17 04:48:08 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-0dadb44f-904a-4054-bfbe-a32a1a2e6651 tempest-CreateVolumesFromSourceVolumeTest-1670988288 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a" returned: 0 in 0.742s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:48:08 devstack cinder-volume[92060]: DEBUG cinder.manager [None req-0dadb44f-904a-4054-bfbe-a32a1a2e6651 tempest-CreateVolumesFromSourceVolumeTest-1670988288 None] Notifying Schedulers of capabilities ... {{(pid=92060) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 17 04:48:08 devstack cinder-volume[92060]: INFO cinder.volume.manager [None req-0dadb44f-904a-4054-bfbe-a32a1a2e6651 tempest-CreateVolumesFromSourceVolumeTest-1670988288 None] Deleted volume successfully. Jun 17 04:48:08 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-0dadb44f-904a-4054-bfbe-a32a1a2e6651 tempest-CreateVolumesFromSourceVolumeTest-1670988288 None] Lock "cinder-1725d18b-ab8b-4b12-ab2a-3d937b1c3579-delete_volume" released by "delete_volume" :: held 2.777s {{(pid=92060) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 04:48:09 devstack sudo[104409]: pam_unix(sudo:session): session closed for user root Jun 17 04:48:09 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-6e2ff343-d96c-42a7-bf0f-fe4d2562e44f tempest-CreateVolumesFromSnapshotTest-904120229 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-9072c1a3-3b76-48b7-9145-d3ebddbcdc88 1073741824" returned: 0 in 0.873s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:48:09 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-6e2ff343-d96c-42a7-bf0f-fe4d2562e44f tempest-CreateVolumesFromSnapshotTest-904120229 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-9072c1a3-3b76-48b7-9145-d3ebddbcdc88 {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:48:09 devstack sudo[104419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-9072c1a3-3b76-48b7-9145-d3ebddbcdc88 Jun 17 04:48:09 devstack sudo[104419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:48:09 devstack sudo[104419]: pam_unix(sudo:session): session closed for user root Jun 17 04:48:09 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-6e2ff343-d96c-42a7-bf0f-fe4d2562e44f tempest-CreateVolumesFromSnapshotTest-904120229 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-9072c1a3-3b76-48b7-9145-d3ebddbcdc88" returned: 0 in 0.601s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:48:09 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-6e2ff343-d96c-42a7-bf0f-fe4d2562e44f tempest-CreateVolumesFromSnapshotTest-904120229 None] <== create_volume: return (1534ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588'} {{(pid=92060) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 17 04:48:09 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-6e2ff343-d96c-42a7-bf0f-fe4d2562e44f tempest-CreateVolumesFromSnapshotTest-904120229 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.539s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 04:48:09 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-606e1a1d-722b-4ab5-a30e-8b09c2a58aa1 tempest-CreateVolumesFromSnapshotTest-904120229 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.248s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 04:48:09 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-606e1a1d-722b-4ab5-a30e-8b09c2a58aa1 tempest-CreateVolumesFromSnapshotTest-904120229 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-17T02:48:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-190387081',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aa34913e-37c2-43e9-afdb-9a698e12830b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='89814f039bd544088837aa3c1874f94c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T02:48:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T02:48:05Z,use_quota=True,user_id='92d84b8d76cf4646a45de55995ea1c91',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aad9ce24-93f9-41a6-baa1-5125964f96d1),volume_type_id=aad9ce24-93f9-41a6-baa1-5125964f96d1)}" {{(pid=92060) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 17 04:48:09 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.remotefs [None req-606e1a1d-722b-4ab5-a30e-8b09c2a58aa1 tempest-CreateVolumesFromSnapshotTest-904120229 None] Creating volume aa34913e-37c2-43e9-afdb-9a698e12830b {{(pid=92060) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 17 04:48:09 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-606e1a1d-722b-4ab5-a30e-8b09c2a58aa1 tempest-CreateVolumesFromSnapshotTest-904120229 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 04:48:09 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-606e1a1d-722b-4ab5-a30e-8b09c2a58aa1 tempest-CreateVolumesFromSnapshotTest-904120229 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 04:48:09 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-606e1a1d-722b-4ab5-a30e-8b09c2a58aa1 tempest-CreateVolumesFromSnapshotTest-904120229 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588': None} {{(pid=92060) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 17 04:48:09 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-606e1a1d-722b-4ab5-a30e-8b09c2a58aa1 tempest-CreateVolumesFromSnapshotTest-904120229 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588'] {{(pid=92060) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 17 04:48:09 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-606e1a1d-722b-4ab5-a30e-8b09c2a58aa1 tempest-CreateVolumesFromSnapshotTest-904120229 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 04:48:09 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-606e1a1d-722b-4ab5-a30e-8b09c2a58aa1 tempest-CreateVolumesFromSnapshotTest-904120229 None] Selected osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588 as target Quobyte volume. {{(pid=92060) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 17 04:48:09 devstack cinder-volume[92060]: INFO cinder.volume.drivers.remotefs [None req-606e1a1d-722b-4ab5-a30e-8b09c2a58aa1 tempest-CreateVolumesFromSnapshotTest-904120229 None] casted to osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588 Jun 17 04:48:09 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-606e1a1d-722b-4ab5-a30e-8b09c2a58aa1 tempest-CreateVolumesFromSnapshotTest-904120229 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-aa34913e-37c2-43e9-afdb-9a698e12830b 1073741824 {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:48:09 devstack sudo[104422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-aa34913e-37c2-43e9-afdb-9a698e12830b 1073741824 Jun 17 04:48:09 devstack sudo[104422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:48:09 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-6e2ff343-d96c-42a7-bf0f-fe4d2562e44f tempest-CreateVolumesFromSnapshotTest-904120229 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bbbe8486-619e-450b-b44b-1d2dc732e304) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9072c1a3-3b76-48b7-9145-d3ebddbcdc88', 'volume_size': 1}' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:48:09 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-6e2ff343-d96c-42a7-bf0f-fe4d2562e44f tempest-CreateVolumesFromSnapshotTest-904120229 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6e8ec648-c54e-4e46-8f68-3313308d0d29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:48:09 devstack cinder-volume[92060]: INFO cinder.volume.flows.manager.create_volume [None req-6e2ff343-d96c-42a7-bf0f-fe4d2562e44f tempest-CreateVolumesFromSnapshotTest-904120229 None] Volume volume-9072c1a3-3b76-48b7-9145-d3ebddbcdc88 (9072c1a3-3b76-48b7-9145-d3ebddbcdc88): created successfully Jun 17 04:48:09 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-6e2ff343-d96c-42a7-bf0f-fe4d2562e44f tempest-CreateVolumesFromSnapshotTest-904120229 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6e8ec648-c54e-4e46-8f68-3313308d0d29) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:48:09 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-6e2ff343-d96c-42a7-bf0f-fe4d2562e44f tempest-CreateVolumesFromSnapshotTest-904120229 None] Flow 'volume_create_manager' (c752cfc6-dba4-4c31-a383-e4efbe32df53) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92060) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 17 04:48:10 devstack cinder-volume[92060]: INFO cinder.volume.manager [None req-6e2ff343-d96c-42a7-bf0f-fe4d2562e44f tempest-CreateVolumesFromSnapshotTest-904120229 None] Created volume successfully. Jun 17 04:48:10 devstack sudo[104422]: pam_unix(sudo:session): session closed for user root Jun 17 04:48:10 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-606e1a1d-722b-4ab5-a30e-8b09c2a58aa1 tempest-CreateVolumesFromSnapshotTest-904120229 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-aa34913e-37c2-43e9-afdb-9a698e12830b 1073741824" returned: 0 in 0.825s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:48:10 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-606e1a1d-722b-4ab5-a30e-8b09c2a58aa1 tempest-CreateVolumesFromSnapshotTest-904120229 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-aa34913e-37c2-43e9-afdb-9a698e12830b {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:48:10 devstack sudo[104428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-aa34913e-37c2-43e9-afdb-9a698e12830b Jun 17 04:48:10 devstack sudo[104428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:48:10 devstack cinder-volume[92060]: DEBUG cinder.volume.flows.manager.create_volume [None req-0b98677c-e4cf-4f8f-8c0c-e19302e72661 tempest-VolumeDependencyTests-2043422105 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92060) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 17 04:48:10 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-0b98677c-e4cf-4f8f-8c0c-e19302e72661 tempest-VolumeDependencyTests-2043422105 None] Flow 'volume_create_manager' (f85ff31f-994e-4307-a1e0-fee32c196be9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 17 04:48:10 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-0b98677c-e4cf-4f8f-8c0c-e19302e72661 tempest-VolumeDependencyTests-2043422105 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c286563c-0c73-4881-b4da-cad4ae8cde97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:48:10 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-0b98677c-e4cf-4f8f-8c0c-e19302e72661 tempest-VolumeDependencyTests-2043422105 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c286563c-0c73-4881-b4da-cad4ae8cde97) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-17T02:48:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-417383580',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=651dbb0b-4e5a-4a05-b7e2-3fc19a2103d7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dc34ab073a8a4a9ba05015904da5bee3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T02:48:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T02:48:11Z,use_quota=True,user_id='5b984786c08a4f09bdcc94b6d57bf406',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aad9ce24-93f9-41a6-baa1-5125964f96d1),volume_type_id=aad9ce24-93f9-41a6-baa1-5125964f96d1)' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:48:10 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-0b98677c-e4cf-4f8f-8c0c-e19302e72661 tempest-VolumeDependencyTests-2043422105 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6fd95809-99d6-4e14-a675-c7c5619b8ecb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:48:10 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-0b98677c-e4cf-4f8f-8c0c-e19302e72661 tempest-VolumeDependencyTests-2043422105 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6fd95809-99d6-4e14-a675-c7c5619b8ecb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:48:10 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-0b98677c-e4cf-4f8f-8c0c-e19302e72661 tempest-VolumeDependencyTests-2043422105 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2894440b-55d8-4781-a029-7bdbb29b2fa6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:48:10 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-0b98677c-e4cf-4f8f-8c0c-e19302e72661 tempest-VolumeDependencyTests-2043422105 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2894440b-55d8-4781-a029-7bdbb29b2fa6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '651dbb0b-4e5a-4a05-b7e2-3fc19a2103d7', 'volume_name': 'volume-651dbb0b-4e5a-4a05-b7e2-3fc19a2103d7', 'volume_size': 1}' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:48:10 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-0b98677c-e4cf-4f8f-8c0c-e19302e72661 tempest-VolumeDependencyTests-2043422105 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8c478b43-207e-43fb-a374-d7560bb034f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:48:10 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-0b98677c-e4cf-4f8f-8c0c-e19302e72661 tempest-VolumeDependencyTests-2043422105 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8c478b43-207e-43fb-a374-d7560bb034f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:48:10 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-0b98677c-e4cf-4f8f-8c0c-e19302e72661 tempest-VolumeDependencyTests-2043422105 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0fd1ec56-788f-4f5b-824d-f03d6518e3ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:48:10 devstack cinder-volume[92060]: INFO cinder.volume.flows.manager.create_volume [None req-0b98677c-e4cf-4f8f-8c0c-e19302e72661 tempest-VolumeDependencyTests-2043422105 None] Volume 651dbb0b-4e5a-4a05-b7e2-3fc19a2103d7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-651dbb0b-4e5a-4a05-b7e2-3fc19a2103d7', 'volume_size': 1} Jun 17 04:48:10 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-0b98677c-e4cf-4f8f-8c0c-e19302e72661 tempest-VolumeDependencyTests-2043422105 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 04:48:11 devstack sudo[104428]: pam_unix(sudo:session): session closed for user root Jun 17 04:48:11 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-606e1a1d-722b-4ab5-a30e-8b09c2a58aa1 tempest-CreateVolumesFromSnapshotTest-904120229 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-aa34913e-37c2-43e9-afdb-9a698e12830b" returned: 0 in 0.594s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:48:11 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-606e1a1d-722b-4ab5-a30e-8b09c2a58aa1 tempest-CreateVolumesFromSnapshotTest-904120229 None] <== create_volume: return (1466ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588'} {{(pid=92060) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 17 04:48:11 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-606e1a1d-722b-4ab5-a30e-8b09c2a58aa1 tempest-CreateVolumesFromSnapshotTest-904120229 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.468s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 04:48:11 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-ca44abe1-3122-4e9f-b934-aa045d1a72ad tempest-AttachVolumeNegativeTest-991296233 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.503s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 04:48:11 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-ca44abe1-3122-4e9f-b934-aa045d1a72ad tempest-AttachVolumeNegativeTest-991296233 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-17T02:48:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-2114435129',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f3bc4daf-94fb-4638-b601-1f86d479d4de,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9d0a579338d541c79ff65be0490f47b0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T02:48:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T02:48:05Z,use_quota=True,user_id='994750bc5563495ca183a77999e0ce87',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aad9ce24-93f9-41a6-baa1-5125964f96d1),volume_type_id=aad9ce24-93f9-41a6-baa1-5125964f96d1)}" {{(pid=92060) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 17 04:48:11 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.remotefs [None req-ca44abe1-3122-4e9f-b934-aa045d1a72ad tempest-AttachVolumeNegativeTest-991296233 None] Creating volume f3bc4daf-94fb-4638-b601-1f86d479d4de {{(pid=92060) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 17 04:48:11 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-ca44abe1-3122-4e9f-b934-aa045d1a72ad tempest-AttachVolumeNegativeTest-991296233 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 04:48:11 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-ca44abe1-3122-4e9f-b934-aa045d1a72ad tempest-AttachVolumeNegativeTest-991296233 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 04:48:11 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-ca44abe1-3122-4e9f-b934-aa045d1a72ad tempest-AttachVolumeNegativeTest-991296233 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588': None} {{(pid=92060) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 17 04:48:11 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-ca44abe1-3122-4e9f-b934-aa045d1a72ad tempest-AttachVolumeNegativeTest-991296233 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588'] {{(pid=92060) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 17 04:48:11 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-ca44abe1-3122-4e9f-b934-aa045d1a72ad tempest-AttachVolumeNegativeTest-991296233 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 04:48:11 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-ca44abe1-3122-4e9f-b934-aa045d1a72ad tempest-AttachVolumeNegativeTest-991296233 None] Selected osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588 as target Quobyte volume. {{(pid=92060) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 17 04:48:11 devstack cinder-volume[92060]: INFO cinder.volume.drivers.remotefs [None req-ca44abe1-3122-4e9f-b934-aa045d1a72ad tempest-AttachVolumeNegativeTest-991296233 None] casted to osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588 Jun 17 04:48:11 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-ca44abe1-3122-4e9f-b934-aa045d1a72ad tempest-AttachVolumeNegativeTest-991296233 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-f3bc4daf-94fb-4638-b601-1f86d479d4de 1073741824 {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:48:11 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-606e1a1d-722b-4ab5-a30e-8b09c2a58aa1 tempest-CreateVolumesFromSnapshotTest-904120229 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8b8a3b37-6184-4ffd-8fd7-0c405602bd2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-aa34913e-37c2-43e9-afdb-9a698e12830b', 'volume_size': 1}' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:48:11 devstack sudo[104432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-f3bc4daf-94fb-4638-b601-1f86d479d4de 1073741824 Jun 17 04:48:11 devstack sudo[104432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:48:11 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-606e1a1d-722b-4ab5-a30e-8b09c2a58aa1 tempest-CreateVolumesFromSnapshotTest-904120229 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (acb20fdc-8843-4531-9786-687e6ac72c85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:48:11 devstack cinder-volume[92060]: INFO cinder.volume.flows.manager.create_volume [None req-606e1a1d-722b-4ab5-a30e-8b09c2a58aa1 tempest-CreateVolumesFromSnapshotTest-904120229 None] Volume volume-aa34913e-37c2-43e9-afdb-9a698e12830b (aa34913e-37c2-43e9-afdb-9a698e12830b): created successfully Jun 17 04:48:11 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-606e1a1d-722b-4ab5-a30e-8b09c2a58aa1 tempest-CreateVolumesFromSnapshotTest-904120229 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (acb20fdc-8843-4531-9786-687e6ac72c85) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:48:11 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-606e1a1d-722b-4ab5-a30e-8b09c2a58aa1 tempest-CreateVolumesFromSnapshotTest-904120229 None] Flow 'volume_create_manager' (b9088a6b-3163-433a-aee3-42d959310757) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92060) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 17 04:48:11 devstack cinder-volume[92060]: INFO cinder.volume.manager [None req-606e1a1d-722b-4ab5-a30e-8b09c2a58aa1 tempest-CreateVolumesFromSnapshotTest-904120229 None] Created volume successfully. Jun 17 04:48:12 devstack sudo[104432]: pam_unix(sudo:session): session closed for user root Jun 17 04:48:12 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-ca44abe1-3122-4e9f-b934-aa045d1a72ad tempest-AttachVolumeNegativeTest-991296233 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-f3bc4daf-94fb-4638-b601-1f86d479d4de 1073741824" returned: 0 in 0.752s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:48:12 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-ca44abe1-3122-4e9f-b934-aa045d1a72ad tempest-AttachVolumeNegativeTest-991296233 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-f3bc4daf-94fb-4638-b601-1f86d479d4de {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:48:12 devstack sudo[104437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-f3bc4daf-94fb-4638-b601-1f86d479d4de Jun 17 04:48:12 devstack sudo[104437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:48:12 devstack sudo[104437]: pam_unix(sudo:session): session closed for user root Jun 17 04:48:12 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-ca44abe1-3122-4e9f-b934-aa045d1a72ad tempest-AttachVolumeNegativeTest-991296233 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-f3bc4daf-94fb-4638-b601-1f86d479d4de" returned: 0 in 0.598s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:48:12 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-ca44abe1-3122-4e9f-b934-aa045d1a72ad tempest-AttachVolumeNegativeTest-991296233 None] <== create_volume: return (1384ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588'} {{(pid=92060) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 17 04:48:12 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-ca44abe1-3122-4e9f-b934-aa045d1a72ad tempest-AttachVolumeNegativeTest-991296233 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.386s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 04:48:12 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-d937dcaa-8e7b-461f-9c24-a77b8b455f7a tempest-CreateVolumesFromSnapshotTest-904120229 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.495s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 04:48:12 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-d937dcaa-8e7b-461f-9c24-a77b8b455f7a tempest-CreateVolumesFromSnapshotTest-904120229 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-17T02:48:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1135472637',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=543f148e-4d95-428d-abfb-8fb5b53935db,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='89814f039bd544088837aa3c1874f94c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T02:48:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T02:48:06Z,use_quota=True,user_id='92d84b8d76cf4646a45de55995ea1c91',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aad9ce24-93f9-41a6-baa1-5125964f96d1),volume_type_id=aad9ce24-93f9-41a6-baa1-5125964f96d1)}" {{(pid=92060) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 17 04:48:12 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.remotefs [None req-d937dcaa-8e7b-461f-9c24-a77b8b455f7a tempest-CreateVolumesFromSnapshotTest-904120229 None] Creating volume 543f148e-4d95-428d-abfb-8fb5b53935db {{(pid=92060) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 17 04:48:12 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-d937dcaa-8e7b-461f-9c24-a77b8b455f7a tempest-CreateVolumesFromSnapshotTest-904120229 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 04:48:12 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-d937dcaa-8e7b-461f-9c24-a77b8b455f7a tempest-CreateVolumesFromSnapshotTest-904120229 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 04:48:12 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-d937dcaa-8e7b-461f-9c24-a77b8b455f7a tempest-CreateVolumesFromSnapshotTest-904120229 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588': None} {{(pid=92060) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 17 04:48:12 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-d937dcaa-8e7b-461f-9c24-a77b8b455f7a tempest-CreateVolumesFromSnapshotTest-904120229 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588'] {{(pid=92060) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 17 04:48:12 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-d937dcaa-8e7b-461f-9c24-a77b8b455f7a tempest-CreateVolumesFromSnapshotTest-904120229 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 04:48:12 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-d937dcaa-8e7b-461f-9c24-a77b8b455f7a tempest-CreateVolumesFromSnapshotTest-904120229 None] Selected osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588 as target Quobyte volume. {{(pid=92060) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 17 04:48:12 devstack cinder-volume[92060]: INFO cinder.volume.drivers.remotefs [None req-d937dcaa-8e7b-461f-9c24-a77b8b455f7a tempest-CreateVolumesFromSnapshotTest-904120229 None] casted to osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588 Jun 17 04:48:12 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-d937dcaa-8e7b-461f-9c24-a77b8b455f7a tempest-CreateVolumesFromSnapshotTest-904120229 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-543f148e-4d95-428d-abfb-8fb5b53935db 1073741824 {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:48:12 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-ca44abe1-3122-4e9f-b934-aa045d1a72ad tempest-AttachVolumeNegativeTest-991296233 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (173df87c-9d3d-4749-a936-7f89695636d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f3bc4daf-94fb-4638-b601-1f86d479d4de', 'volume_size': 1}' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:48:12 devstack sudo[104440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-543f148e-4d95-428d-abfb-8fb5b53935db 1073741824 Jun 17 04:48:12 devstack sudo[104440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:48:12 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-ca44abe1-3122-4e9f-b934-aa045d1a72ad tempest-AttachVolumeNegativeTest-991296233 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1843e70f-f76b-4609-8070-debc9dca482a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:48:12 devstack cinder-volume[92060]: INFO cinder.volume.flows.manager.create_volume [None req-ca44abe1-3122-4e9f-b934-aa045d1a72ad tempest-AttachVolumeNegativeTest-991296233 None] Volume volume-f3bc4daf-94fb-4638-b601-1f86d479d4de (f3bc4daf-94fb-4638-b601-1f86d479d4de): created successfully Jun 17 04:48:12 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-ca44abe1-3122-4e9f-b934-aa045d1a72ad tempest-AttachVolumeNegativeTest-991296233 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1843e70f-f76b-4609-8070-debc9dca482a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:48:12 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-ca44abe1-3122-4e9f-b934-aa045d1a72ad tempest-AttachVolumeNegativeTest-991296233 None] Flow 'volume_create_manager' (5cc65d5c-5a25-439a-a154-84770eb67e78) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92060) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 17 04:48:12 devstack cinder-volume[92060]: INFO cinder.volume.manager [None req-ca44abe1-3122-4e9f-b934-aa045d1a72ad tempest-AttachVolumeNegativeTest-991296233 None] Created volume successfully. Jun 17 04:48:13 devstack sudo[104440]: pam_unix(sudo:session): session closed for user root Jun 17 04:48:13 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-d937dcaa-8e7b-461f-9c24-a77b8b455f7a tempest-CreateVolumesFromSnapshotTest-904120229 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-543f148e-4d95-428d-abfb-8fb5b53935db 1073741824" returned: 0 in 0.776s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:48:13 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-d937dcaa-8e7b-461f-9c24-a77b8b455f7a tempest-CreateVolumesFromSnapshotTest-904120229 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-543f148e-4d95-428d-abfb-8fb5b53935db {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:48:13 devstack sudo[104446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-543f148e-4d95-428d-abfb-8fb5b53935db Jun 17 04:48:13 devstack sudo[104446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:48:14 devstack sudo[104446]: pam_unix(sudo:session): session closed for user root Jun 17 04:48:14 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-d937dcaa-8e7b-461f-9c24-a77b8b455f7a tempest-CreateVolumesFromSnapshotTest-904120229 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-543f148e-4d95-428d-abfb-8fb5b53935db" returned: 0 in 0.605s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:48:14 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-d937dcaa-8e7b-461f-9c24-a77b8b455f7a tempest-CreateVolumesFromSnapshotTest-904120229 None] <== create_volume: return (1419ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588'} {{(pid=92060) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 17 04:48:14 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-d937dcaa-8e7b-461f-9c24-a77b8b455f7a tempest-CreateVolumesFromSnapshotTest-904120229 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.422s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 04:48:14 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-0b98677c-e4cf-4f8f-8c0c-e19302e72661 tempest-VolumeDependencyTests-2043422105 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.244s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 04:48:14 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-0b98677c-e4cf-4f8f-8c0c-e19302e72661 tempest-VolumeDependencyTests-2043422105 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-17T02:48:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-417383580',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=651dbb0b-4e5a-4a05-b7e2-3fc19a2103d7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dc34ab073a8a4a9ba05015904da5bee3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T02:48:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T02:48:11Z,use_quota=True,user_id='5b984786c08a4f09bdcc94b6d57bf406',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aad9ce24-93f9-41a6-baa1-5125964f96d1),volume_type_id=aad9ce24-93f9-41a6-baa1-5125964f96d1)}" {{(pid=92060) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 17 04:48:14 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.remotefs [None req-0b98677c-e4cf-4f8f-8c0c-e19302e72661 tempest-VolumeDependencyTests-2043422105 None] Creating volume 651dbb0b-4e5a-4a05-b7e2-3fc19a2103d7 {{(pid=92060) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 17 04:48:14 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-0b98677c-e4cf-4f8f-8c0c-e19302e72661 tempest-VolumeDependencyTests-2043422105 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 04:48:14 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-0b98677c-e4cf-4f8f-8c0c-e19302e72661 tempest-VolumeDependencyTests-2043422105 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 04:48:14 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-0b98677c-e4cf-4f8f-8c0c-e19302e72661 tempest-VolumeDependencyTests-2043422105 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588': None} {{(pid=92060) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 17 04:48:14 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-0b98677c-e4cf-4f8f-8c0c-e19302e72661 tempest-VolumeDependencyTests-2043422105 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588'] {{(pid=92060) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 17 04:48:14 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-0b98677c-e4cf-4f8f-8c0c-e19302e72661 tempest-VolumeDependencyTests-2043422105 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 04:48:14 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-0b98677c-e4cf-4f8f-8c0c-e19302e72661 tempest-VolumeDependencyTests-2043422105 None] Selected osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588 as target Quobyte volume. {{(pid=92060) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 17 04:48:14 devstack cinder-volume[92060]: INFO cinder.volume.drivers.remotefs [None req-0b98677c-e4cf-4f8f-8c0c-e19302e72661 tempest-VolumeDependencyTests-2043422105 None] casted to osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588 Jun 17 04:48:14 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-0b98677c-e4cf-4f8f-8c0c-e19302e72661 tempest-VolumeDependencyTests-2043422105 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-651dbb0b-4e5a-4a05-b7e2-3fc19a2103d7 1073741824 {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:48:14 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-d937dcaa-8e7b-461f-9c24-a77b8b455f7a tempest-CreateVolumesFromSnapshotTest-904120229 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (161ded02-46da-450a-a5f7-9a6cdcd164ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-543f148e-4d95-428d-abfb-8fb5b53935db', 'volume_size': 1}' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:48:14 devstack sudo[104449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-651dbb0b-4e5a-4a05-b7e2-3fc19a2103d7 1073741824 Jun 17 04:48:14 devstack sudo[104449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:48:14 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-d937dcaa-8e7b-461f-9c24-a77b8b455f7a tempest-CreateVolumesFromSnapshotTest-904120229 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fc3a9aa9-803b-41eb-a86e-6f5932fbf3dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:48:14 devstack cinder-volume[92060]: INFO cinder.volume.flows.manager.create_volume [None req-d937dcaa-8e7b-461f-9c24-a77b8b455f7a tempest-CreateVolumesFromSnapshotTest-904120229 None] Volume volume-543f148e-4d95-428d-abfb-8fb5b53935db (543f148e-4d95-428d-abfb-8fb5b53935db): created successfully Jun 17 04:48:14 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-d937dcaa-8e7b-461f-9c24-a77b8b455f7a tempest-CreateVolumesFromSnapshotTest-904120229 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fc3a9aa9-803b-41eb-a86e-6f5932fbf3dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:48:14 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-d937dcaa-8e7b-461f-9c24-a77b8b455f7a tempest-CreateVolumesFromSnapshotTest-904120229 None] Flow 'volume_create_manager' (546e099a-0fab-43d1-9e82-0288c47e87f8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92060) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 17 04:48:14 devstack cinder-volume[92060]: INFO cinder.volume.manager [None req-d937dcaa-8e7b-461f-9c24-a77b8b455f7a tempest-CreateVolumesFromSnapshotTest-904120229 None] Created volume successfully. Jun 17 04:48:14 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-e21261f0-3d46-460b-95be-3f4657d53792 tempest-CreateVolumesFromSnapshotTest-904120229 None] Acquiring lock "cinder-543f148e-4d95-428d-abfb-8fb5b53935db-delete_volume" by "delete_volume" {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 04:48:15 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-e21261f0-3d46-460b-95be-3f4657d53792 tempest-CreateVolumesFromSnapshotTest-904120229 None] Lock "cinder-543f148e-4d95-428d-abfb-8fb5b53935db-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 04:48:15 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-e21261f0-3d46-460b-95be-3f4657d53792 tempest-CreateVolumesFromSnapshotTest-904120229 None] Acquiring lock "cinder-quobyte-543f148e-4d95-428d-abfb-8fb5b53935db" by "delete_volume" {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 04:48:15 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-e21261f0-3d46-460b-95be-3f4657d53792 tempest-CreateVolumesFromSnapshotTest-904120229 None] Lock "cinder-quobyte-543f148e-4d95-428d-abfb-8fb5b53935db" acquired by "delete_volume" :: waited 0.017s {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 04:48:15 devstack cinder-volume[92060]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3388d4d-7ed5-4397-86b3-369291572409]: (4, 'qcow2') {{(pid=93130) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 04:48:15 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-e21261f0-3d46-460b-95be-3f4657d53792 tempest-CreateVolumesFromSnapshotTest-904120229 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-543f148e-4d95-428d-abfb-8fb5b53935db {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:48:15 devstack sudo[104449]: pam_unix(sudo:session): session closed for user root Jun 17 04:48:15 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-0b98677c-e4cf-4f8f-8c0c-e19302e72661 tempest-VolumeDependencyTests-2043422105 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-651dbb0b-4e5a-4a05-b7e2-3fc19a2103d7 1073741824" returned: 0 in 0.964s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:48:15 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-0b98677c-e4cf-4f8f-8c0c-e19302e72661 tempest-VolumeDependencyTests-2043422105 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-651dbb0b-4e5a-4a05-b7e2-3fc19a2103d7 {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:48:15 devstack sudo[104456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-651dbb0b-4e5a-4a05-b7e2-3fc19a2103d7 Jun 17 04:48:15 devstack sudo[104456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:48:15 devstack sudo[104455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-543f148e-4d95-428d-abfb-8fb5b53935db Jun 17 04:48:15 devstack sudo[104455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:48:15 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-e21261f0-3d46-460b-95be-3f4657d53792 tempest-CreateVolumesFromSnapshotTest-904120229 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-543f148e-4d95-428d-abfb-8fb5b53935db" returned: 0 in 0.770s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:48:15 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-e21261f0-3d46-460b-95be-3f4657d53792 tempest-CreateVolumesFromSnapshotTest-904120229 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-543f148e-4d95-428d-abfb-8fb5b53935db {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:48:15 devstack sudo[104455]: pam_unix(sudo:session): session closed for user root Jun 17 04:48:15 devstack sudo[104463]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-543f148e-4d95-428d-abfb-8fb5b53935db Jun 17 04:48:15 devstack sudo[104463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:48:15 devstack sudo[104456]: pam_unix(sudo:session): session closed for user root Jun 17 04:48:15 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-0b98677c-e4cf-4f8f-8c0c-e19302e72661 tempest-VolumeDependencyTests-2043422105 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-651dbb0b-4e5a-4a05-b7e2-3fc19a2103d7" returned: 0 in 0.719s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:48:15 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-0b98677c-e4cf-4f8f-8c0c-e19302e72661 tempest-VolumeDependencyTests-2043422105 None] <== create_volume: return (1735ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588'} {{(pid=92060) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 17 04:48:15 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-0b98677c-e4cf-4f8f-8c0c-e19302e72661 tempest-VolumeDependencyTests-2043422105 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.738s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 04:48:15 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-0b98677c-e4cf-4f8f-8c0c-e19302e72661 tempest-VolumeDependencyTests-2043422105 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0fd1ec56-788f-4f5b-824d-f03d6518e3ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-651dbb0b-4e5a-4a05-b7e2-3fc19a2103d7', 'volume_size': 1}' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:48:15 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-0b98677c-e4cf-4f8f-8c0c-e19302e72661 tempest-VolumeDependencyTests-2043422105 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bef568ed-59f5-4aa1-a8b0-cd66fcf07c12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:48:15 devstack cinder-volume[92060]: INFO cinder.volume.flows.manager.create_volume [None req-0b98677c-e4cf-4f8f-8c0c-e19302e72661 tempest-VolumeDependencyTests-2043422105 None] Volume volume-651dbb0b-4e5a-4a05-b7e2-3fc19a2103d7 (651dbb0b-4e5a-4a05-b7e2-3fc19a2103d7): created successfully Jun 17 04:48:16 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-0b98677c-e4cf-4f8f-8c0c-e19302e72661 tempest-VolumeDependencyTests-2043422105 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bef568ed-59f5-4aa1-a8b0-cd66fcf07c12) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:48:16 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-0b98677c-e4cf-4f8f-8c0c-e19302e72661 tempest-VolumeDependencyTests-2043422105 None] Flow 'volume_create_manager' (f85ff31f-994e-4307-a1e0-fee32c196be9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92060) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 17 04:48:16 devstack cinder-volume[92060]: INFO cinder.volume.manager [None req-0b98677c-e4cf-4f8f-8c0c-e19302e72661 tempest-VolumeDependencyTests-2043422105 None] Created volume successfully. Jun 17 04:48:16 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [req-be3d39cf-6367-4a1a-a1e5-efb7265672f7 req-a7df8b0a-33d2-4924-988f-998898f823ff tempest-AttachVolumeNegativeTest-991296233 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 04:48:16 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [req-be3d39cf-6367-4a1a-a1e5-efb7265672f7 req-a7df8b0a-33d2-4924-988f-998898f823ff tempest-AttachVolumeNegativeTest-991296233 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 04:48:16 devstack cinder-volume[92060]: DEBUG oslo.privsep.daemon [-] privsep: reply[2755670b-ea06-40b0-9a1a-7d1bf776aef2]: (4, 'qcow2') {{(pid=93130) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 04:48:16 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [req-be3d39cf-6367-4a1a-a1e5-efb7265672f7 req-a7df8b0a-33d2-4924-988f-998898f823ff tempest-AttachVolumeNegativeTest-991296233 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-f3bc4daf-94fb-4638-b601-1f86d479d4de {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:48:16 devstack sudo[104473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-f3bc4daf-94fb-4638-b601-1f86d479d4de Jun 17 04:48:16 devstack sudo[104473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:48:16 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-f8c4ff31-993d-473b-a9d0-1b09164e2828 tempest-VolumeDependencyTests-2043422105 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 04:48:16 devstack sudo[104463]: pam_unix(sudo:session): session closed for user root Jun 17 04:48:16 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-e21261f0-3d46-460b-95be-3f4657d53792 tempest-CreateVolumesFromSnapshotTest-904120229 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-543f148e-4d95-428d-abfb-8fb5b53935db" returned: 0 in 0.656s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:48:16 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-e21261f0-3d46-460b-95be-3f4657d53792 tempest-CreateVolumesFromSnapshotTest-904120229 None] Lock "cinder-quobyte-543f148e-4d95-428d-abfb-8fb5b53935db" released by "delete_volume" :: held 1.479s {{(pid=92060) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 04:48:16 devstack cinder-volume[92060]: DEBUG cinder.quota [None req-e21261f0-3d46-460b-95be-3f4657d53792 tempest-CreateVolumesFromSnapshotTest-904120229 None] Created reservations ['2ac80945-1cc3-4f48-a8f5-cce248a2dcd3', '1ff0744f-2b28-4a5a-a8bc-9ed30761f001', 'c9678983-bb19-4782-beac-d68e132b13a1', 'e774a41a-c601-498f-9967-1fa63cd87ca6'] {{(pid=92060) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 17 04:48:16 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-e21261f0-3d46-460b-95be-3f4657d53792 tempest-CreateVolumesFromSnapshotTest-904120229 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 04:48:16 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-e21261f0-3d46-460b-95be-3f4657d53792 tempest-CreateVolumesFromSnapshotTest-904120229 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 04:48:16 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-e21261f0-3d46-460b-95be-3f4657d53792 tempest-CreateVolumesFromSnapshotTest-904120229 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588': None} {{(pid=92060) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 17 04:48:16 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-e21261f0-3d46-460b-95be-3f4657d53792 tempest-CreateVolumesFromSnapshotTest-904120229 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588'] {{(pid=92060) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 17 04:48:16 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-e21261f0-3d46-460b-95be-3f4657d53792 tempest-CreateVolumesFromSnapshotTest-904120229 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 04:48:16 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-e21261f0-3d46-460b-95be-3f4657d53792 tempest-CreateVolumesFromSnapshotTest-904120229 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:48:16 devstack sudo[104476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a Jun 17 04:48:16 devstack sudo[104476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:48:17 devstack sudo[104473]: pam_unix(sudo:session): session closed for user root Jun 17 04:48:17 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [req-be3d39cf-6367-4a1a-a1e5-efb7265672f7 req-a7df8b0a-33d2-4924-988f-998898f823ff tempest-AttachVolumeNegativeTest-991296233 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-f3bc4daf-94fb-4638-b601-1f86d479d4de" returned: 0 in 0.857s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:48:17 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [req-be3d39cf-6367-4a1a-a1e5-efb7265672f7 req-a7df8b0a-33d2-4924-988f-998898f823ff tempest-AttachVolumeNegativeTest-991296233 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.883s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 04:48:17 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-f8c4ff31-993d-473b-a9d0-1b09164e2828 tempest-VolumeDependencyTests-2043422105 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.581s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 04:48:17 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.remotefs [None req-f8c4ff31-993d-473b-a9d0-1b09164e2828 tempest-VolumeDependencyTests-2043422105 None] Creating offline snapshot 3d117106-07d7-4c98-bc8b-94b24b6d29e5 of volume 651dbb0b-4e5a-4a05-b7e2-3fc19a2103d7 {{(pid=92060) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 17 04:48:17 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [req-be3d39cf-6367-4a1a-a1e5-efb7265672f7 req-a7df8b0a-33d2-4924-988f-998898f823ff tempest-AttachVolumeNegativeTest-991296233 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588', 'name': 'volume-f3bc4daf-94fb-4638-b601-1f86d479d4de', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '986e929f-2681-40c6-8614-f9835702fe08', 'enforce_multipath': True} {{(pid=92060) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 17 04:48:17 devstack cinder-volume[92060]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e62a1e3-45f4-4cd7-80a0-797e159f44df]: (4, 'qcow2') {{(pid=93130) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 04:48:17 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-f8c4ff31-993d-473b-a9d0-1b09164e2828 tempest-VolumeDependencyTests-2043422105 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-651dbb0b-4e5a-4a05-b7e2-3fc19a2103d7 {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:48:17 devstack cinder-volume[92060]: INFO cinder.volume.manager [req-be3d39cf-6367-4a1a-a1e5-efb7265672f7 req-a7df8b0a-33d2-4924-988f-998898f823ff tempest-AttachVolumeNegativeTest-991296233 None] attachment_update completed successfully. Jun 17 04:48:17 devstack sudo[104481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-651dbb0b-4e5a-4a05-b7e2-3fc19a2103d7 Jun 17 04:48:17 devstack sudo[104481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:48:17 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-ae4fed96-9947-43bc-86af-bf925719ac5b tempest-CreateVolumesFromSnapshotTest-904120229 None] Acquiring lock "cinder-aa34913e-37c2-43e9-afdb-9a698e12830b-delete_volume" by "delete_volume" {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 04:48:17 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-ae4fed96-9947-43bc-86af-bf925719ac5b tempest-CreateVolumesFromSnapshotTest-904120229 None] Lock "cinder-aa34913e-37c2-43e9-afdb-9a698e12830b-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 04:48:17 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-ae4fed96-9947-43bc-86af-bf925719ac5b tempest-CreateVolumesFromSnapshotTest-904120229 None] Acquiring lock "cinder-quobyte-aa34913e-37c2-43e9-afdb-9a698e12830b" by "delete_volume" {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 04:48:17 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-ae4fed96-9947-43bc-86af-bf925719ac5b tempest-CreateVolumesFromSnapshotTest-904120229 None] Lock "cinder-quobyte-aa34913e-37c2-43e9-afdb-9a698e12830b" acquired by "delete_volume" :: waited 0.024s {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 04:48:17 devstack cinder-volume[92060]: DEBUG oslo.privsep.daemon [-] privsep: reply[427aef29-c8ea-4b39-98a3-ac814377de28]: (4, 'qcow2') {{(pid=93130) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 04:48:17 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-ae4fed96-9947-43bc-86af-bf925719ac5b tempest-CreateVolumesFromSnapshotTest-904120229 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-aa34913e-37c2-43e9-afdb-9a698e12830b {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:48:17 devstack sudo[104476]: pam_unix(sudo:session): session closed for user root Jun 17 04:48:17 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-e21261f0-3d46-460b-95be-3f4657d53792 tempest-CreateVolumesFromSnapshotTest-904120229 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a" returned: 0 in 0.783s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:48:17 devstack cinder-volume[92060]: DEBUG cinder.manager [None req-e21261f0-3d46-460b-95be-3f4657d53792 tempest-CreateVolumesFromSnapshotTest-904120229 None] Notifying Schedulers of capabilities ... {{(pid=92060) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 17 04:48:17 devstack cinder-volume[92060]: INFO cinder.volume.manager [None req-e21261f0-3d46-460b-95be-3f4657d53792 tempest-CreateVolumesFromSnapshotTest-904120229 None] Deleted volume successfully. Jun 17 04:48:17 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-e21261f0-3d46-460b-95be-3f4657d53792 tempest-CreateVolumesFromSnapshotTest-904120229 None] Lock "cinder-543f148e-4d95-428d-abfb-8fb5b53935db-delete_volume" released by "delete_volume" :: held 2.539s {{(pid=92060) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 04:48:17 devstack sudo[104484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-aa34913e-37c2-43e9-afdb-9a698e12830b Jun 17 04:48:17 devstack sudo[104484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:48:17 devstack sudo[104481]: pam_unix(sudo:session): session closed for user root Jun 17 04:48:17 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-f8c4ff31-993d-473b-a9d0-1b09164e2828 tempest-VolumeDependencyTests-2043422105 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-651dbb0b-4e5a-4a05-b7e2-3fc19a2103d7" returned: 0 in 0.829s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:48:17 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-f8c4ff31-993d-473b-a9d0-1b09164e2828 tempest-VolumeDependencyTests-2043422105 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-651dbb0b-4e5a-4a05-b7e2-3fc19a2103d7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-651dbb0b-4e5a-4a05-b7e2-3fc19a2103d7.3d117106-07d7-4c98-bc8b-94b24b6d29e5 1G {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:48:17 devstack sudo[104489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-651dbb0b-4e5a-4a05-b7e2-3fc19a2103d7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-651dbb0b-4e5a-4a05-b7e2-3fc19a2103d7.3d117106-07d7-4c98-bc8b-94b24b6d29e5 1G Jun 17 04:48:17 devstack sudo[104489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:48:18 devstack sudo[104484]: pam_unix(sudo:session): session closed for user root Jun 17 04:48:18 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-ae4fed96-9947-43bc-86af-bf925719ac5b tempest-CreateVolumesFromSnapshotTest-904120229 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-aa34913e-37c2-43e9-afdb-9a698e12830b" returned: 0 in 0.741s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:48:18 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-ae4fed96-9947-43bc-86af-bf925719ac5b tempest-CreateVolumesFromSnapshotTest-904120229 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-aa34913e-37c2-43e9-afdb-9a698e12830b {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:48:18 devstack sudo[104494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-aa34913e-37c2-43e9-afdb-9a698e12830b Jun 17 04:48:18 devstack sudo[104494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:48:18 devstack sudo[104489]: pam_unix(sudo:session): session closed for user root Jun 17 04:48:18 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-f8c4ff31-993d-473b-a9d0-1b09164e2828 tempest-VolumeDependencyTests-2043422105 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-651dbb0b-4e5a-4a05-b7e2-3fc19a2103d7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-651dbb0b-4e5a-4a05-b7e2-3fc19a2103d7.3d117106-07d7-4c98-bc8b-94b24b6d29e5 1G" returned: 0 in 0.772s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:48:18 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-f8c4ff31-993d-473b-a9d0-1b09164e2828 tempest-VolumeDependencyTests-2043422105 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-651dbb0b-4e5a-4a05-b7e2-3fc19a2103d7 -F qcow2 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-651dbb0b-4e5a-4a05-b7e2-3fc19a2103d7.3d117106-07d7-4c98-bc8b-94b24b6d29e5 {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:48:18 devstack sudo[104501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-651dbb0b-4e5a-4a05-b7e2-3fc19a2103d7 -F qcow2 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-651dbb0b-4e5a-4a05-b7e2-3fc19a2103d7.3d117106-07d7-4c98-bc8b-94b24b6d29e5 Jun 17 04:48:18 devstack sudo[104501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:48:18 devstack sudo[104494]: pam_unix(sudo:session): session closed for user root Jun 17 04:48:18 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-ae4fed96-9947-43bc-86af-bf925719ac5b tempest-CreateVolumesFromSnapshotTest-904120229 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-aa34913e-37c2-43e9-afdb-9a698e12830b" returned: 0 in 0.666s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:48:18 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-ae4fed96-9947-43bc-86af-bf925719ac5b tempest-CreateVolumesFromSnapshotTest-904120229 None] Lock "cinder-quobyte-aa34913e-37c2-43e9-afdb-9a698e12830b" released by "delete_volume" :: held 1.474s {{(pid=92060) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 04:48:18 devstack cinder-volume[92060]: DEBUG cinder.quota [None req-ae4fed96-9947-43bc-86af-bf925719ac5b tempest-CreateVolumesFromSnapshotTest-904120229 None] Created reservations ['f2c428ef-645e-495d-8d68-076edfb633ca', '40f4b344-657e-4560-a182-0d6a8ebfd2a0', '090a8ad9-9289-462e-a73b-de20b8648d58', '6ffd4689-9e80-4545-a91e-bc5f392f294a'] {{(pid=92060) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 17 04:48:18 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-ae4fed96-9947-43bc-86af-bf925719ac5b tempest-CreateVolumesFromSnapshotTest-904120229 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 04:48:18 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-ae4fed96-9947-43bc-86af-bf925719ac5b tempest-CreateVolumesFromSnapshotTest-904120229 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 04:48:18 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-ae4fed96-9947-43bc-86af-bf925719ac5b tempest-CreateVolumesFromSnapshotTest-904120229 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588': None} {{(pid=92060) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 17 04:48:18 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-ae4fed96-9947-43bc-86af-bf925719ac5b tempest-CreateVolumesFromSnapshotTest-904120229 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588'] {{(pid=92060) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 17 04:48:18 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-ae4fed96-9947-43bc-86af-bf925719ac5b tempest-CreateVolumesFromSnapshotTest-904120229 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 04:48:18 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-ae4fed96-9947-43bc-86af-bf925719ac5b tempest-CreateVolumesFromSnapshotTest-904120229 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:48:19 devstack sudo[104505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a Jun 17 04:48:19 devstack sudo[104505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:48:19 devstack sudo[104501]: pam_unix(sudo:session): session closed for user root Jun 17 04:48:19 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-f8c4ff31-993d-473b-a9d0-1b09164e2828 tempest-VolumeDependencyTests-2043422105 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-651dbb0b-4e5a-4a05-b7e2-3fc19a2103d7 -F qcow2 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-651dbb0b-4e5a-4a05-b7e2-3fc19a2103d7.3d117106-07d7-4c98-bc8b-94b24b6d29e5" returned: 0 in 0.656s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:48:19 devstack cinder-volume[92060]: WARNING cinder.volume.drivers.remotefs [None req-f8c4ff31-993d-473b-a9d0-1b09164e2828 tempest-VolumeDependencyTests-2043422105 None] /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-651dbb0b-4e5a-4a05-b7e2-3fc19a2103d7.3d117106-07d7-4c98-bc8b-94b24b6d29e5 is being set with open permissions: ugo+rw Jun 17 04:48:19 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-f8c4ff31-993d-473b-a9d0-1b09164e2828 tempest-VolumeDependencyTests-2043422105 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-651dbb0b-4e5a-4a05-b7e2-3fc19a2103d7.3d117106-07d7-4c98-bc8b-94b24b6d29e5 {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:48:19 devstack sudo[104510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-651dbb0b-4e5a-4a05-b7e2-3fc19a2103d7.3d117106-07d7-4c98-bc8b-94b24b6d29e5 Jun 17 04:48:19 devstack sudo[104510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:48:19 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-99a97d64-50d3-4346-b2e3-0482b9efb3f3 tempest-CreateVolumesFromSnapshotTest-904120229 None] Acquiring lock "cinder-9072c1a3-3b76-48b7-9145-d3ebddbcdc88-delete_volume" by "delete_volume" {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 04:48:19 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-99a97d64-50d3-4346-b2e3-0482b9efb3f3 tempest-CreateVolumesFromSnapshotTest-904120229 None] Lock "cinder-9072c1a3-3b76-48b7-9145-d3ebddbcdc88-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 04:48:19 devstack sudo[104505]: pam_unix(sudo:session): session closed for user root Jun 17 04:48:19 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-ae4fed96-9947-43bc-86af-bf925719ac5b tempest-CreateVolumesFromSnapshotTest-904120229 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a" returned: 0 in 0.674s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:48:19 devstack cinder-volume[92060]: DEBUG cinder.manager [None req-ae4fed96-9947-43bc-86af-bf925719ac5b tempest-CreateVolumesFromSnapshotTest-904120229 None] Notifying Schedulers of capabilities ... {{(pid=92060) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 17 04:48:19 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-99a97d64-50d3-4346-b2e3-0482b9efb3f3 tempest-CreateVolumesFromSnapshotTest-904120229 None] Acquiring lock "cinder-quobyte-9072c1a3-3b76-48b7-9145-d3ebddbcdc88" by "delete_volume" {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 04:48:19 devstack cinder-volume[92060]: INFO cinder.volume.manager [None req-ae4fed96-9947-43bc-86af-bf925719ac5b tempest-CreateVolumesFromSnapshotTest-904120229 None] Deleted volume successfully. Jun 17 04:48:19 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-99a97d64-50d3-4346-b2e3-0482b9efb3f3 tempest-CreateVolumesFromSnapshotTest-904120229 None] Lock "cinder-quobyte-9072c1a3-3b76-48b7-9145-d3ebddbcdc88" acquired by "delete_volume" :: waited 0.023s {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 04:48:19 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-ae4fed96-9947-43bc-86af-bf925719ac5b tempest-CreateVolumesFromSnapshotTest-904120229 None] Lock "cinder-aa34913e-37c2-43e9-afdb-9a698e12830b-delete_volume" released by "delete_volume" :: held 2.383s {{(pid=92060) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 04:48:19 devstack cinder-volume[92060]: DEBUG oslo.privsep.daemon [-] privsep: reply[be06d5b7-f190-4a59-a814-ad6b892b92e8]: (4, 'qcow2') {{(pid=93130) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 04:48:19 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-99a97d64-50d3-4346-b2e3-0482b9efb3f3 tempest-CreateVolumesFromSnapshotTest-904120229 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-9072c1a3-3b76-48b7-9145-d3ebddbcdc88 {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:48:19 devstack sudo[104513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-9072c1a3-3b76-48b7-9145-d3ebddbcdc88 Jun 17 04:48:19 devstack sudo[104513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:48:20 devstack sudo[104510]: pam_unix(sudo:session): session closed for user root Jun 17 04:48:20 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-f8c4ff31-993d-473b-a9d0-1b09164e2828 tempest-VolumeDependencyTests-2043422105 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-651dbb0b-4e5a-4a05-b7e2-3fc19a2103d7.3d117106-07d7-4c98-bc8b-94b24b6d29e5" returned: 0 in 0.647s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:48:20 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-f8c4ff31-993d-473b-a9d0-1b09164e2828 tempest-VolumeDependencyTests-2043422105 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-651dbb0b-4e5a-4a05-b7e2-3fc19a2103d7.info {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:48:20 devstack sudo[104516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-651dbb0b-4e5a-4a05-b7e2-3fc19a2103d7.info Jun 17 04:48:20 devstack sudo[104516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:48:20 devstack sudo[104513]: pam_unix(sudo:session): session closed for user root Jun 17 04:48:20 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-99a97d64-50d3-4346-b2e3-0482b9efb3f3 tempest-CreateVolumesFromSnapshotTest-904120229 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-9072c1a3-3b76-48b7-9145-d3ebddbcdc88" returned: 0 in 0.776s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:48:20 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-99a97d64-50d3-4346-b2e3-0482b9efb3f3 tempest-CreateVolumesFromSnapshotTest-904120229 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-9072c1a3-3b76-48b7-9145-d3ebddbcdc88 {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:48:20 devstack sudo[104535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-9072c1a3-3b76-48b7-9145-d3ebddbcdc88 Jun 17 04:48:20 devstack sudo[104535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:48:20 devstack sudo[104516]: pam_unix(sudo:session): session closed for user root Jun 17 04:48:20 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-f8c4ff31-993d-473b-a9d0-1b09164e2828 tempest-VolumeDependencyTests-2043422105 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-651dbb0b-4e5a-4a05-b7e2-3fc19a2103d7.info" returned: 0 in 0.629s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:48:20 devstack cinder-volume[92060]: WARNING cinder.volume.drivers.remotefs [None req-f8c4ff31-993d-473b-a9d0-1b09164e2828 tempest-VolumeDependencyTests-2043422105 None] /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-651dbb0b-4e5a-4a05-b7e2-3fc19a2103d7.info is being set with open permissions: ugo+rw Jun 17 04:48:20 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-f8c4ff31-993d-473b-a9d0-1b09164e2828 tempest-VolumeDependencyTests-2043422105 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-651dbb0b-4e5a-4a05-b7e2-3fc19a2103d7.info {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:48:20 devstack sudo[104558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-651dbb0b-4e5a-4a05-b7e2-3fc19a2103d7.info Jun 17 04:48:20 devstack sudo[104558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:48:21 devstack sudo[104535]: pam_unix(sudo:session): session closed for user root Jun 17 04:48:21 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-99a97d64-50d3-4346-b2e3-0482b9efb3f3 tempest-CreateVolumesFromSnapshotTest-904120229 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-9072c1a3-3b76-48b7-9145-d3ebddbcdc88" returned: 0 in 0.661s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:48:21 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-99a97d64-50d3-4346-b2e3-0482b9efb3f3 tempest-CreateVolumesFromSnapshotTest-904120229 None] Lock "cinder-quobyte-9072c1a3-3b76-48b7-9145-d3ebddbcdc88" released by "delete_volume" :: held 1.483s {{(pid=92060) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 04:48:21 devstack cinder-volume[92060]: DEBUG cinder.quota [None req-99a97d64-50d3-4346-b2e3-0482b9efb3f3 tempest-CreateVolumesFromSnapshotTest-904120229 None] Created reservations ['fd4d1d21-241e-405d-aa1a-4df1cde24005', '093b7eac-d744-4869-baf7-0179db80ae94', 'af6aa5d8-840a-4ab4-9a22-79d48b6ea24d', 'fd167da1-46cf-4c60-9e0b-92c8a765a149'] {{(pid=92060) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 17 04:48:21 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-99a97d64-50d3-4346-b2e3-0482b9efb3f3 tempest-CreateVolumesFromSnapshotTest-904120229 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 04:48:21 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-99a97d64-50d3-4346-b2e3-0482b9efb3f3 tempest-CreateVolumesFromSnapshotTest-904120229 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 04:48:21 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-99a97d64-50d3-4346-b2e3-0482b9efb3f3 tempest-CreateVolumesFromSnapshotTest-904120229 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588': None} {{(pid=92060) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 17 04:48:21 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-99a97d64-50d3-4346-b2e3-0482b9efb3f3 tempest-CreateVolumesFromSnapshotTest-904120229 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588'] {{(pid=92060) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 17 04:48:21 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-99a97d64-50d3-4346-b2e3-0482b9efb3f3 tempest-CreateVolumesFromSnapshotTest-904120229 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 04:48:21 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-99a97d64-50d3-4346-b2e3-0482b9efb3f3 tempest-CreateVolumesFromSnapshotTest-904120229 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:48:21 devstack sudo[104558]: pam_unix(sudo:session): session closed for user root Jun 17 04:48:21 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-f8c4ff31-993d-473b-a9d0-1b09164e2828 tempest-VolumeDependencyTests-2043422105 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-651dbb0b-4e5a-4a05-b7e2-3fc19a2103d7.info" returned: 0 in 0.634s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:48:21 devstack sudo[104565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a Jun 17 04:48:21 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-f8c4ff31-993d-473b-a9d0-1b09164e2828 tempest-VolumeDependencyTests-2043422105 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.281s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 04:48:21 devstack sudo[104565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:48:21 devstack cinder-volume[92060]: INFO cinder.volume.manager [None req-f8c4ff31-993d-473b-a9d0-1b09164e2828 tempest-VolumeDependencyTests-2043422105 None] Create snapshot completed successfully Jun 17 04:48:21 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-f4f2f955-77bc-4e56-be55-15c604aadf39 tempest-CreateVolumesFromSnapshotTest-904120229 None] Acquiring lock "cinder-d2ac9a58-bdc3-4db4-a17a-4b55b1e95c79-delete_volume" by "delete_volume" {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 04:48:21 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-f4f2f955-77bc-4e56-be55-15c604aadf39 tempest-CreateVolumesFromSnapshotTest-904120229 None] Lock "cinder-d2ac9a58-bdc3-4db4-a17a-4b55b1e95c79-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 04:48:21 devstack sudo[104565]: pam_unix(sudo:session): session closed for user root Jun 17 04:48:21 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-f4f2f955-77bc-4e56-be55-15c604aadf39 tempest-CreateVolumesFromSnapshotTest-904120229 None] Acquiring lock "cinder-quobyte-d2ac9a58-bdc3-4db4-a17a-4b55b1e95c79" by "delete_volume" {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 04:48:21 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-99a97d64-50d3-4346-b2e3-0482b9efb3f3 tempest-CreateVolumesFromSnapshotTest-904120229 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a" returned: 0 in 0.642s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:48:21 devstack cinder-volume[92060]: DEBUG cinder.manager [None req-99a97d64-50d3-4346-b2e3-0482b9efb3f3 tempest-CreateVolumesFromSnapshotTest-904120229 None] Notifying Schedulers of capabilities ... {{(pid=92060) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 17 04:48:21 devstack cinder-volume[92060]: INFO cinder.volume.manager [None req-99a97d64-50d3-4346-b2e3-0482b9efb3f3 tempest-CreateVolumesFromSnapshotTest-904120229 None] Deleted volume successfully. Jun 17 04:48:21 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-f4f2f955-77bc-4e56-be55-15c604aadf39 tempest-CreateVolumesFromSnapshotTest-904120229 None] Lock "cinder-quobyte-d2ac9a58-bdc3-4db4-a17a-4b55b1e95c79" acquired by "delete_volume" :: waited 0.022s {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 04:48:22 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-99a97d64-50d3-4346-b2e3-0482b9efb3f3 tempest-CreateVolumesFromSnapshotTest-904120229 None] Lock "cinder-9072c1a3-3b76-48b7-9145-d3ebddbcdc88-delete_volume" released by "delete_volume" :: held 2.378s {{(pid=92060) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 04:48:22 devstack cinder-volume[92060]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c1f1bfd-1e9b-4ed6-aabd-89314fa45a85]: (4, 'qcow2') {{(pid=93130) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 04:48:22 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-f4f2f955-77bc-4e56-be55-15c604aadf39 tempest-CreateVolumesFromSnapshotTest-904120229 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-d2ac9a58-bdc3-4db4-a17a-4b55b1e95c79 {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:48:22 devstack sudo[104570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-d2ac9a58-bdc3-4db4-a17a-4b55b1e95c79 Jun 17 04:48:22 devstack sudo[104570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:48:22 devstack cinder-volume[92060]: DEBUG cinder.volume.flows.manager.create_volume [None req-b4724b56-1df7-4454-b063-0b087d627bf0 tempest-VolumeDependencyTests-2043422105 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92060) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 17 04:48:22 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-b4724b56-1df7-4454-b063-0b087d627bf0 tempest-VolumeDependencyTests-2043422105 None] Flow 'volume_create_manager' (66f293e4-66e8-436b-923f-53765f84769d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 17 04:48:22 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-b4724b56-1df7-4454-b063-0b087d627bf0 tempest-VolumeDependencyTests-2043422105 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (217a0244-6db2-4c32-bc73-3723d908bc4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:48:22 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-b4724b56-1df7-4454-b063-0b087d627bf0 tempest-VolumeDependencyTests-2043422105 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (217a0244-6db2-4c32-bc73-3723d908bc4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-17T02:48:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1911062914',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0aa2d749-7810-49c3-a7fc-9da86ea9e9c4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dc34ab073a8a4a9ba05015904da5bee3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T02:48:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=3d117106-07d7-4c98-bc8b-94b24b6d29e5,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T02:48:22Z,use_quota=True,user_id='5b984786c08a4f09bdcc94b6d57bf406',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aad9ce24-93f9-41a6-baa1-5125964f96d1),volume_type_id=aad9ce24-93f9-41a6-baa1-5125964f96d1)' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:48:22 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-b4724b56-1df7-4454-b063-0b087d627bf0 tempest-VolumeDependencyTests-2043422105 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (21e19aef-9c24-42d4-a067-b2506a520469) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:48:22 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-b4724b56-1df7-4454-b063-0b087d627bf0 tempest-VolumeDependencyTests-2043422105 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (21e19aef-9c24-42d4-a067-b2506a520469) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:48:22 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-b4724b56-1df7-4454-b063-0b087d627bf0 tempest-VolumeDependencyTests-2043422105 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (886e6007-75c4-420c-8d91-e57ca328ea56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:48:22 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-b4724b56-1df7-4454-b063-0b087d627bf0 tempest-VolumeDependencyTests-2043422105 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (886e6007-75c4-420c-8d91-e57ca328ea56) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '0aa2d749-7810-49c3-a7fc-9da86ea9e9c4', 'volume_name': 'volume-0aa2d749-7810-49c3-a7fc-9da86ea9e9c4', 'volume_size': 1, 'snapshot_id': '3d117106-07d7-4c98-bc8b-94b24b6d29e5'}' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:48:22 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-b4724b56-1df7-4454-b063-0b087d627bf0 tempest-VolumeDependencyTests-2043422105 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bf3a432c-6a50-4590-858f-8fd66bf4560e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:48:22 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-b4724b56-1df7-4454-b063-0b087d627bf0 tempest-VolumeDependencyTests-2043422105 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bf3a432c-6a50-4590-858f-8fd66bf4560e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:48:22 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-b4724b56-1df7-4454-b063-0b087d627bf0 tempest-VolumeDependencyTests-2043422105 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (afeaad93-cb46-431d-9886-004a229bddf6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:48:22 devstack cinder-volume[92060]: INFO cinder.volume.flows.manager.create_volume [None req-b4724b56-1df7-4454-b063-0b087d627bf0 tempest-VolumeDependencyTests-2043422105 None] Volume 0aa2d749-7810-49c3-a7fc-9da86ea9e9c4: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-0aa2d749-7810-49c3-a7fc-9da86ea9e9c4', 'volume_size': 1, 'snapshot_id': '3d117106-07d7-4c98-bc8b-94b24b6d29e5'} Jun 17 04:48:22 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-b4724b56-1df7-4454-b063-0b087d627bf0 tempest-VolumeDependencyTests-2043422105 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 04:48:22 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-b4724b56-1df7-4454-b063-0b087d627bf0 tempest-VolumeDependencyTests-2043422105 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 04:48:22 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-b4724b56-1df7-4454-b063-0b087d627bf0 tempest-VolumeDependencyTests-2043422105 None] Acquiring lock "cinder-quobyte-3d117106-07d7-4c98-bc8b-94b24b6d29e5-0aa2d749-7810-49c3-a7fc-9da86ea9e9c4" by "_create_volume_from_snapshot" {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 04:48:22 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-b4724b56-1df7-4454-b063-0b087d627bf0 tempest-VolumeDependencyTests-2043422105 None] Lock "cinder-quobyte-3d117106-07d7-4c98-bc8b-94b24b6d29e5-0aa2d749-7810-49c3-a7fc-9da86ea9e9c4" acquired by "_create_volume_from_snapshot" :: waited 0.019s {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 04:48:22 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-b4724b56-1df7-4454-b063-0b087d627bf0 tempest-VolumeDependencyTests-2043422105 None] Creating volume 0aa2d749-7810-49c3-a7fc-9da86ea9e9c4 from snapshot 3d117106-07d7-4c98-bc8b-94b24b6d29e5 {{(pid=92060) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jun 17 04:48:22 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-b4724b56-1df7-4454-b063-0b087d627bf0 tempest-VolumeDependencyTests-2043422105 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 04:48:22 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-b4724b56-1df7-4454-b063-0b087d627bf0 tempest-VolumeDependencyTests-2043422105 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 04:48:22 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-b4724b56-1df7-4454-b063-0b087d627bf0 tempest-VolumeDependencyTests-2043422105 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588': None} {{(pid=92060) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 17 04:48:22 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-b4724b56-1df7-4454-b063-0b087d627bf0 tempest-VolumeDependencyTests-2043422105 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588'] {{(pid=92060) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 17 04:48:22 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-b4724b56-1df7-4454-b063-0b087d627bf0 tempest-VolumeDependencyTests-2043422105 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 04:48:22 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-b4724b56-1df7-4454-b063-0b087d627bf0 tempest-VolumeDependencyTests-2043422105 None] Selected osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588 as target Quobyte volume. {{(pid=92060) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 17 04:48:22 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-b4724b56-1df7-4454-b063-0b087d627bf0 tempest-VolumeDependencyTests-2043422105 None] Acquiring lock "cinder-quobyte-0aa2d749-7810-49c3-a7fc-9da86ea9e9c4" by "_copy_volume_from_snapshot" {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 04:48:22 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-b4724b56-1df7-4454-b063-0b087d627bf0 tempest-VolumeDependencyTests-2043422105 None] Lock "cinder-quobyte-0aa2d749-7810-49c3-a7fc-9da86ea9e9c4" acquired by "_copy_volume_from_snapshot" :: waited 0.020s {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 04:48:22 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-b4724b56-1df7-4454-b063-0b087d627bf0 tempest-VolumeDependencyTests-2043422105 None] snapshot: 3d117106-07d7-4c98-bc8b-94b24b6d29e5, volume: 0aa2d749-7810-49c3-a7fc-9da86ea9e9c4, {{(pid=92060) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jun 17 04:48:22 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-b4724b56-1df7-4454-b063-0b087d627bf0 tempest-VolumeDependencyTests-2043422105 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 04:48:22 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-b4724b56-1df7-4454-b063-0b087d627bf0 tempest-VolumeDependencyTests-2043422105 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 04:48:22 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-b4724b56-1df7-4454-b063-0b087d627bf0 tempest-VolumeDependencyTests-2043422105 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588': None} {{(pid=92060) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 17 04:48:22 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-b4724b56-1df7-4454-b063-0b087d627bf0 tempest-VolumeDependencyTests-2043422105 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588'] {{(pid=92060) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 17 04:48:22 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-b4724b56-1df7-4454-b063-0b087d627bf0 tempest-VolumeDependencyTests-2043422105 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 04:48:22 devstack cinder-volume[92060]: DEBUG oslo.privsep.daemon [-] privsep: reply[aeba129c-60da-4cab-880a-6f3b56f4eedb]: (4, 'qcow2') {{(pid=93130) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 04:48:22 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-b4724b56-1df7-4454-b063-0b087d627bf0 tempest-VolumeDependencyTests-2043422105 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-651dbb0b-4e5a-4a05-b7e2-3fc19a2103d7.3d117106-07d7-4c98-bc8b-94b24b6d29e5 {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:48:22 devstack sudo[104576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-651dbb0b-4e5a-4a05-b7e2-3fc19a2103d7.3d117106-07d7-4c98-bc8b-94b24b6d29e5 Jun 17 04:48:22 devstack sudo[104576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:48:22 devstack sudo[104570]: pam_unix(sudo:session): session closed for user root Jun 17 04:48:22 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-f4f2f955-77bc-4e56-be55-15c604aadf39 tempest-CreateVolumesFromSnapshotTest-904120229 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-d2ac9a58-bdc3-4db4-a17a-4b55b1e95c79" returned: 0 in 0.923s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:48:22 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-f4f2f955-77bc-4e56-be55-15c604aadf39 tempest-CreateVolumesFromSnapshotTest-904120229 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-d2ac9a58-bdc3-4db4-a17a-4b55b1e95c79 {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:48:22 devstack sudo[104581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-d2ac9a58-bdc3-4db4-a17a-4b55b1e95c79 Jun 17 04:48:22 devstack sudo[104581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:48:23 devstack sudo[104576]: pam_unix(sudo:session): session closed for user root Jun 17 04:48:23 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-b4724b56-1df7-4454-b063-0b087d627bf0 tempest-VolumeDependencyTests-2043422105 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-651dbb0b-4e5a-4a05-b7e2-3fc19a2103d7.3d117106-07d7-4c98-bc8b-94b24b6d29e5" returned: 0 in 0.754s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:48:23 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.remotefs [None req-b4724b56-1df7-4454-b063-0b087d627bf0 tempest-VolumeDependencyTests-2043422105 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-651dbb0b-4e5a-4a05-b7e2-3fc19a2103d7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=92060) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 17 04:48:23 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-b4724b56-1df7-4454-b063-0b087d627bf0 tempest-VolumeDependencyTests-2043422105 None] will copy from snapshot at /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-651dbb0b-4e5a-4a05-b7e2-3fc19a2103d7 {{(pid=92060) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jun 17 04:48:23 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-b4724b56-1df7-4454-b063-0b087d627bf0 tempest-VolumeDependencyTests-2043422105 None] Creating direct copy from snapshot {{(pid=92060) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jun 17 04:48:23 devstack cinder-volume[92060]: DEBUG oslo.privsep.daemon [-] privsep: reply[28bd69ce-2e7d-40e2-ba39-6eb5cb6495a2]: (4, 'qcow2') {{(pid=93130) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 04:48:23 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-b4724b56-1df7-4454-b063-0b087d627bf0 tempest-VolumeDependencyTests-2043422105 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-651dbb0b-4e5a-4a05-b7e2-3fc19a2103d7 {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:48:23 devstack sudo[104586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-651dbb0b-4e5a-4a05-b7e2-3fc19a2103d7 Jun 17 04:48:23 devstack sudo[104586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:48:23 devstack sudo[104581]: pam_unix(sudo:session): session closed for user root Jun 17 04:48:23 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-f4f2f955-77bc-4e56-be55-15c604aadf39 tempest-CreateVolumesFromSnapshotTest-904120229 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-d2ac9a58-bdc3-4db4-a17a-4b55b1e95c79" returned: 0 in 0.617s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:48:23 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-f4f2f955-77bc-4e56-be55-15c604aadf39 tempest-CreateVolumesFromSnapshotTest-904120229 None] Lock "cinder-quobyte-d2ac9a58-bdc3-4db4-a17a-4b55b1e95c79" released by "delete_volume" :: held 1.602s {{(pid=92060) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 04:48:23 devstack cinder-volume[92060]: DEBUG cinder.quota [None req-f4f2f955-77bc-4e56-be55-15c604aadf39 tempest-CreateVolumesFromSnapshotTest-904120229 None] Created reservations ['76a27085-245d-45eb-8de4-9380baaba160', '6258287d-6807-48c7-b2a7-f5b251787687', '9e123759-1926-429c-ad21-648d47143fc7', '52f2f276-3346-46f2-80fe-71911663522f'] {{(pid=92060) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 17 04:48:23 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-f4f2f955-77bc-4e56-be55-15c604aadf39 tempest-CreateVolumesFromSnapshotTest-904120229 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 04:48:23 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-f4f2f955-77bc-4e56-be55-15c604aadf39 tempest-CreateVolumesFromSnapshotTest-904120229 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 04:48:23 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-f4f2f955-77bc-4e56-be55-15c604aadf39 tempest-CreateVolumesFromSnapshotTest-904120229 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588': None} {{(pid=92060) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 17 04:48:23 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-f4f2f955-77bc-4e56-be55-15c604aadf39 tempest-CreateVolumesFromSnapshotTest-904120229 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588'] {{(pid=92060) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 17 04:48:23 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-f4f2f955-77bc-4e56-be55-15c604aadf39 tempest-CreateVolumesFromSnapshotTest-904120229 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 04:48:23 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-f4f2f955-77bc-4e56-be55-15c604aadf39 tempest-CreateVolumesFromSnapshotTest-904120229 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:48:23 devstack sudo[104589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a Jun 17 04:48:23 devstack sudo[104589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:48:24 devstack sudo[104586]: pam_unix(sudo:session): session closed for user root Jun 17 04:48:24 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-b4724b56-1df7-4454-b063-0b087d627bf0 tempest-VolumeDependencyTests-2043422105 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-651dbb0b-4e5a-4a05-b7e2-3fc19a2103d7" returned: 0 in 0.779s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:48:24 devstack cinder-volume[92060]: DEBUG cinder.utils [None req-b4724b56-1df7-4454-b063-0b087d627bf0 tempest-VolumeDependencyTests-2043422105 None] Path /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-0aa2d749-7810-49c3-a7fc-9da86ea9e9c4 not found in is_blk_device check {{(pid=92060) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jun 17 04:48:24 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-b4724b56-1df7-4454-b063-0b087d627bf0 tempest-VolumeDependencyTests-2043422105 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-651dbb0b-4e5a-4a05-b7e2-3fc19a2103d7 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-0aa2d749-7810-49c3-a7fc-9da86ea9e9c4 {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:48:24 devstack sudo[104596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-651dbb0b-4e5a-4a05-b7e2-3fc19a2103d7 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-0aa2d749-7810-49c3-a7fc-9da86ea9e9c4 Jun 17 04:48:24 devstack sudo[104596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:48:24 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-23e70686-38a5-491e-be11-3fef4ffc1d4f tempest-CreateVolumesFromSnapshotTest-904120229 None] Acquiring lock "cinder-8b32166a-6c1c-4d7a-9752-c8c6e58fc97f-delete_volume" by "delete_volume" {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 04:48:24 devstack cinder-volume[92060]: INFO cinder.volume.manager [req-27622a5a-dfe3-49dc-9d56-f71706d0be90 req-261a2bd1-291f-4911-99a0-8590aa1b8990 tempest-AttachVolumeNegativeTest-991296233 None] Terminate volume connection completed successfully. Jun 17 04:48:24 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [req-27622a5a-dfe3-49dc-9d56-f71706d0be90 req-261a2bd1-291f-4911-99a0-8590aa1b8990 tempest-AttachVolumeNegativeTest-991296233 None] Deleting attachment 986e929f-2681-40c6-8614-f9835702fe08. {{(pid=92060) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 17 04:48:24 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-23e70686-38a5-491e-be11-3fef4ffc1d4f tempest-CreateVolumesFromSnapshotTest-904120229 None] Lock "cinder-8b32166a-6c1c-4d7a-9752-c8c6e58fc97f-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 04:48:24 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-23e70686-38a5-491e-be11-3fef4ffc1d4f tempest-CreateVolumesFromSnapshotTest-904120229 None] Acquiring lock "cinder-quobyte-8b32166a-6c1c-4d7a-9752-c8c6e58fc97f" by "delete_volume" {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 04:48:24 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-23e70686-38a5-491e-be11-3fef4ffc1d4f tempest-CreateVolumesFromSnapshotTest-904120229 None] Lock "cinder-quobyte-8b32166a-6c1c-4d7a-9752-c8c6e58fc97f" acquired by "delete_volume" :: waited 0.021s {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 04:48:24 devstack cinder-volume[92060]: DEBUG oslo.privsep.daemon [-] privsep: reply[795225d5-1bd5-4f4d-96ad-d4c9207a955e]: (4, 'qcow2') {{(pid=93130) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 04:48:24 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-23e70686-38a5-491e-be11-3fef4ffc1d4f tempest-CreateVolumesFromSnapshotTest-904120229 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-8b32166a-6c1c-4d7a-9752-c8c6e58fc97f {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:48:24 devstack sudo[104589]: pam_unix(sudo:session): session closed for user root Jun 17 04:48:24 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-f4f2f955-77bc-4e56-be55-15c604aadf39 tempest-CreateVolumesFromSnapshotTest-904120229 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a" returned: 0 in 0.688s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:48:24 devstack cinder-volume[92060]: DEBUG cinder.manager [None req-f4f2f955-77bc-4e56-be55-15c604aadf39 tempest-CreateVolumesFromSnapshotTest-904120229 None] Notifying Schedulers of capabilities ... {{(pid=92060) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 17 04:48:24 devstack cinder-volume[92060]: INFO cinder.volume.manager [None req-f4f2f955-77bc-4e56-be55-15c604aadf39 tempest-CreateVolumesFromSnapshotTest-904120229 None] Deleted volume successfully. Jun 17 04:48:24 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-f4f2f955-77bc-4e56-be55-15c604aadf39 tempest-CreateVolumesFromSnapshotTest-904120229 None] Lock "cinder-d2ac9a58-bdc3-4db4-a17a-4b55b1e95c79-delete_volume" released by "delete_volume" :: held 2.526s {{(pid=92060) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 04:48:24 devstack sudo[104599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-8b32166a-6c1c-4d7a-9752-c8c6e58fc97f Jun 17 04:48:24 devstack sudo[104599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:48:25 devstack sudo[104599]: pam_unix(sudo:session): session closed for user root Jun 17 04:48:25 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-23e70686-38a5-491e-be11-3fef4ffc1d4f tempest-CreateVolumesFromSnapshotTest-904120229 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-8b32166a-6c1c-4d7a-9752-c8c6e58fc97f" returned: 0 in 0.982s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:48:25 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-23e70686-38a5-491e-be11-3fef4ffc1d4f tempest-CreateVolumesFromSnapshotTest-904120229 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-8b32166a-6c1c-4d7a-9752-c8c6e58fc97f {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:48:25 devstack sudo[104614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-8b32166a-6c1c-4d7a-9752-c8c6e58fc97f Jun 17 04:48:25 devstack sudo[104614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:48:25 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [req-68f7f764-d277-4d3a-8e70-61e93292400a req-9de8b723-da7e-4ad1-97d7-b56278b9c1a2 tempest-TestInstancesWithCinderVolumes-729947751 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 04:48:27 devstack sudo[104614]: pam_unix(sudo:session): session closed for user root Jun 17 04:48:27 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-23e70686-38a5-491e-be11-3fef4ffc1d4f tempest-CreateVolumesFromSnapshotTest-904120229 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-8b32166a-6c1c-4d7a-9752-c8c6e58fc97f" returned: 0 in 1.697s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:48:27 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-23e70686-38a5-491e-be11-3fef4ffc1d4f tempest-CreateVolumesFromSnapshotTest-904120229 None] Lock "cinder-quobyte-8b32166a-6c1c-4d7a-9752-c8c6e58fc97f" released by "delete_volume" :: held 2.773s {{(pid=92060) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 04:48:27 devstack cinder-volume[92060]: DEBUG cinder.quota [None req-23e70686-38a5-491e-be11-3fef4ffc1d4f tempest-CreateVolumesFromSnapshotTest-904120229 None] Created reservations ['ed8eac8b-edcf-4ad3-958a-aefc69548cf4', '3f2e10bc-9c88-40e8-a122-330d0761390b', '1f812f16-42dc-49cb-a199-5765931aa49a', '204a0100-b0ee-428f-9c1e-3495720e5376'] {{(pid=92060) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 17 04:48:27 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-23e70686-38a5-491e-be11-3fef4ffc1d4f tempest-CreateVolumesFromSnapshotTest-904120229 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 04:48:27 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-23e70686-38a5-491e-be11-3fef4ffc1d4f tempest-CreateVolumesFromSnapshotTest-904120229 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 04:48:27 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-23e70686-38a5-491e-be11-3fef4ffc1d4f tempest-CreateVolumesFromSnapshotTest-904120229 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588': None} {{(pid=92060) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 17 04:48:27 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-23e70686-38a5-491e-be11-3fef4ffc1d4f tempest-CreateVolumesFromSnapshotTest-904120229 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588'] {{(pid=92060) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 17 04:48:27 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-23e70686-38a5-491e-be11-3fef4ffc1d4f tempest-CreateVolumesFromSnapshotTest-904120229 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.038s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 04:48:27 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-23e70686-38a5-491e-be11-3fef4ffc1d4f tempest-CreateVolumesFromSnapshotTest-904120229 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:48:27 devstack sudo[104625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a Jun 17 04:48:27 devstack sudo[104625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:48:27 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-6f1cd6ec-9170-46f0-a2c6-3b6ebe368ed2 tempest-CreateVolumesFromSnapshotTest-904120229 None] Acquiring lock "cinder-f6f90d56-9018-49ed-8ee6-3ea2d9a85d62-delete_snapshot" by "delete_snapshot" {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 04:48:27 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-6f1cd6ec-9170-46f0-a2c6-3b6ebe368ed2 tempest-CreateVolumesFromSnapshotTest-904120229 None] Lock "cinder-f6f90d56-9018-49ed-8ee6-3ea2d9a85d62-delete_snapshot" acquired by "delete_snapshot" :: waited 0.083s {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 04:48:27 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-6f1cd6ec-9170-46f0-a2c6-3b6ebe368ed2 tempest-CreateVolumesFromSnapshotTest-904120229 None] Acquiring lock "cinder-quobyte-92658ecb-9bb8-4dfe-96a3-6923fa844c3e" by "delete_snapshot" {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 04:48:28 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-6f1cd6ec-9170-46f0-a2c6-3b6ebe368ed2 tempest-CreateVolumesFromSnapshotTest-904120229 None] Lock "cinder-quobyte-92658ecb-9bb8-4dfe-96a3-6923fa844c3e" acquired by "delete_snapshot" :: waited 0.115s {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 04:48:28 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-6f1cd6ec-9170-46f0-a2c6-3b6ebe368ed2 tempest-CreateVolumesFromSnapshotTest-904120229 None] Acquiring lock "cinder-quobyte-f6f90d56-9018-49ed-8ee6-3ea2d9a85d62" by "_delete_snapshot" {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 04:48:28 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-6f1cd6ec-9170-46f0-a2c6-3b6ebe368ed2 tempest-CreateVolumesFromSnapshotTest-904120229 None] Lock "cinder-quobyte-f6f90d56-9018-49ed-8ee6-3ea2d9a85d62" acquired by "_delete_snapshot" :: waited 0.038s {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 04:48:28 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.remotefs [None req-6f1cd6ec-9170-46f0-a2c6-3b6ebe368ed2 tempest-CreateVolumesFromSnapshotTest-904120229 None] Deleting offline snapshot f6f90d56-9018-49ed-8ee6-3ea2d9a85d62 of volume 92658ecb-9bb8-4dfe-96a3-6923fa844c3e {{(pid=92060) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 17 04:48:28 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.remotefs [None req-6f1cd6ec-9170-46f0-a2c6-3b6ebe368ed2 tempest-CreateVolumesFromSnapshotTest-904120229 None] snapshot_file for this snap is: volume-92658ecb-9bb8-4dfe-96a3-6923fa844c3e.f6f90d56-9018-49ed-8ee6-3ea2d9a85d62 {{(pid=92060) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 17 04:48:28 devstack cinder-volume[92060]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cbda45b-cef4-4c0b-ba3d-862cdf3dc754]: (4, 'qcow2') {{(pid=93130) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 04:48:28 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-6f1cd6ec-9170-46f0-a2c6-3b6ebe368ed2 tempest-CreateVolumesFromSnapshotTest-904120229 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-92658ecb-9bb8-4dfe-96a3-6923fa844c3e.f6f90d56-9018-49ed-8ee6-3ea2d9a85d62 {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:48:28 devstack sudo[104661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-92658ecb-9bb8-4dfe-96a3-6923fa844c3e.f6f90d56-9018-49ed-8ee6-3ea2d9a85d62 Jun 17 04:48:28 devstack sudo[104661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:48:30 devstack sudo[104625]: pam_unix(sudo:session): session closed for user root Jun 17 04:48:30 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-23e70686-38a5-491e-be11-3fef4ffc1d4f tempest-CreateVolumesFromSnapshotTest-904120229 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a" returned: 0 in 2.499s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:48:30 devstack cinder-volume[92060]: DEBUG cinder.manager [None req-23e70686-38a5-491e-be11-3fef4ffc1d4f tempest-CreateVolumesFromSnapshotTest-904120229 None] Notifying Schedulers of capabilities ... {{(pid=92060) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 17 04:48:30 devstack cinder-volume[92060]: INFO cinder.volume.manager [None req-23e70686-38a5-491e-be11-3fef4ffc1d4f tempest-CreateVolumesFromSnapshotTest-904120229 None] Deleted volume successfully. Jun 17 04:48:30 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-23e70686-38a5-491e-be11-3fef4ffc1d4f tempest-CreateVolumesFromSnapshotTest-904120229 None] Lock "cinder-8b32166a-6c1c-4d7a-9752-c8c6e58fc97f-delete_volume" released by "delete_volume" :: held 5.942s {{(pid=92060) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 04:48:30 devstack sudo[104661]: pam_unix(sudo:session): session closed for user root Jun 17 04:48:30 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-6f1cd6ec-9170-46f0-a2c6-3b6ebe368ed2 tempest-CreateVolumesFromSnapshotTest-904120229 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-92658ecb-9bb8-4dfe-96a3-6923fa844c3e.f6f90d56-9018-49ed-8ee6-3ea2d9a85d62" returned: 0 in 2.230s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:48:30 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.remotefs [None req-6f1cd6ec-9170-46f0-a2c6-3b6ebe368ed2 tempest-CreateVolumesFromSnapshotTest-904120229 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-92658ecb-9bb8-4dfe-96a3-6923fa844c3e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=92060) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 17 04:48:30 devstack cinder-volume[92060]: DEBUG oslo.privsep.daemon [-] privsep: reply[77830592-9973-4f07-8680-ad786675b3a8]: (4, 'qcow2') {{(pid=93130) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 04:48:30 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-6f1cd6ec-9170-46f0-a2c6-3b6ebe368ed2 tempest-CreateVolumesFromSnapshotTest-904120229 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-92658ecb-9bb8-4dfe-96a3-6923fa844c3e {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:48:30 devstack sudo[104596]: pam_unix(sudo:session): session closed for user root Jun 17 04:48:30 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-b4724b56-1df7-4454-b063-0b087d627bf0 tempest-VolumeDependencyTests-2043422105 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-651dbb0b-4e5a-4a05-b7e2-3fc19a2103d7 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-0aa2d749-7810-49c3-a7fc-9da86ea9e9c4" returned: 0 in 6.500s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:48:30 devstack cinder-volume[92060]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a08c86f-6bef-45e7-bf25-b7b45c49c8fd]: (4, 'qcow2') {{(pid=93130) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 04:48:30 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-b4724b56-1df7-4454-b063-0b087d627bf0 tempest-VolumeDependencyTests-2043422105 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-651dbb0b-4e5a-4a05-b7e2-3fc19a2103d7 {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:48:30 devstack sudo[104671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-92658ecb-9bb8-4dfe-96a3-6923fa844c3e Jun 17 04:48:30 devstack sudo[104671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:48:30 devstack sudo[104672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-651dbb0b-4e5a-4a05-b7e2-3fc19a2103d7 Jun 17 04:48:30 devstack sudo[104672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:48:31 devstack sudo[104671]: pam_unix(sudo:session): session closed for user root Jun 17 04:48:31 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-6f1cd6ec-9170-46f0-a2c6-3b6ebe368ed2 tempest-CreateVolumesFromSnapshotTest-904120229 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-92658ecb-9bb8-4dfe-96a3-6923fa844c3e" returned: 0 in 0.822s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:48:31 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-6f1cd6ec-9170-46f0-a2c6-3b6ebe368ed2 tempest-CreateVolumesFromSnapshotTest-904120229 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-92658ecb-9bb8-4dfe-96a3-6923fa844c3e.f6f90d56-9018-49ed-8ee6-3ea2d9a85d62 {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:48:31 devstack sudo[104683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-92658ecb-9bb8-4dfe-96a3-6923fa844c3e.f6f90d56-9018-49ed-8ee6-3ea2d9a85d62 Jun 17 04:48:31 devstack sudo[104683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:48:31 devstack sudo[104672]: pam_unix(sudo:session): session closed for user root Jun 17 04:48:31 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-b4724b56-1df7-4454-b063-0b087d627bf0 tempest-VolumeDependencyTests-2043422105 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-651dbb0b-4e5a-4a05-b7e2-3fc19a2103d7" returned: 0 in 0.976s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:48:31 devstack cinder-volume[92060]: DEBUG cinder.image.image_utils [None req-b4724b56-1df7-4454-b063-0b087d627bf0 tempest-VolumeDependencyTests-2043422105 None] Image conversion details: src /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-651dbb0b-4e5a-4a05-b7e2-3fc19a2103d7, size 1024.00 MB, duration 6.50 sec, destination /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-0aa2d749-7810-49c3-a7fc-9da86ea9e9c4 {{(pid=92060) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 17 04:48:31 devstack cinder-volume[92060]: INFO cinder.image.image_utils [None req-b4724b56-1df7-4454-b063-0b087d627bf0 tempest-VolumeDependencyTests-2043422105 None] Converted 1024.00 MB image at 157.51 MB/s Jun 17 04:48:31 devstack cinder-volume[92060]: WARNING cinder.volume.drivers.remotefs [None req-b4724b56-1df7-4454-b063-0b087d627bf0 tempest-VolumeDependencyTests-2043422105 None] /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-0aa2d749-7810-49c3-a7fc-9da86ea9e9c4 is being set with open permissions: ugo+rw Jun 17 04:48:31 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-b4724b56-1df7-4454-b063-0b087d627bf0 tempest-VolumeDependencyTests-2043422105 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-0aa2d749-7810-49c3-a7fc-9da86ea9e9c4 {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:48:31 devstack sudo[104686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-0aa2d749-7810-49c3-a7fc-9da86ea9e9c4 Jun 17 04:48:31 devstack sudo[104686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:48:32 devstack sudo[104683]: pam_unix(sudo:session): session closed for user root Jun 17 04:48:32 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-6f1cd6ec-9170-46f0-a2c6-3b6ebe368ed2 tempest-CreateVolumesFromSnapshotTest-904120229 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-92658ecb-9bb8-4dfe-96a3-6923fa844c3e.f6f90d56-9018-49ed-8ee6-3ea2d9a85d62" returned: 0 in 0.695s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:48:32 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-6f1cd6ec-9170-46f0-a2c6-3b6ebe368ed2 tempest-CreateVolumesFromSnapshotTest-904120229 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-92658ecb-9bb8-4dfe-96a3-6923fa844c3e.f6f90d56-9018-49ed-8ee6-3ea2d9a85d62 {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:48:32 devstack sudo[104691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-92658ecb-9bb8-4dfe-96a3-6923fa844c3e.f6f90d56-9018-49ed-8ee6-3ea2d9a85d62 Jun 17 04:48:32 devstack sudo[104691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:48:32 devstack sudo[104686]: pam_unix(sudo:session): session closed for user root Jun 17 04:48:32 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-b4724b56-1df7-4454-b063-0b087d627bf0 tempest-VolumeDependencyTests-2043422105 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-0aa2d749-7810-49c3-a7fc-9da86ea9e9c4" returned: 0 in 0.611s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:48:32 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-b4724b56-1df7-4454-b063-0b087d627bf0 tempest-VolumeDependencyTests-2043422105 None] Lock "cinder-quobyte-0aa2d749-7810-49c3-a7fc-9da86ea9e9c4" released by "_copy_volume_from_snapshot" :: held 9.725s {{(pid=92060) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 04:48:32 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-b4724b56-1df7-4454-b063-0b087d627bf0 tempest-VolumeDependencyTests-2043422105 None] Lock "cinder-quobyte-3d117106-07d7-4c98-bc8b-94b24b6d29e5-0aa2d749-7810-49c3-a7fc-9da86ea9e9c4" released by "_create_volume_from_snapshot" :: held 9.765s {{(pid=92060) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 04:48:32 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-b4724b56-1df7-4454-b063-0b087d627bf0 tempest-VolumeDependencyTests-2043422105 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.787s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 04:48:32 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [req-68f7f764-d277-4d3a-8e70-61e93292400a req-9de8b723-da7e-4ad1-97d7-b56278b9c1a2 tempest-TestInstancesWithCinderVolumes-729947751 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 6.251s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 04:48:32 devstack cinder-volume[92060]: DEBUG oslo.privsep.daemon [-] privsep: reply[5aac2ff9-e0c2-4bdd-8be6-82a221c05c82]: (4, 'qcow2') {{(pid=93130) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 04:48:32 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [req-68f7f764-d277-4d3a-8e70-61e93292400a req-9de8b723-da7e-4ad1-97d7-b56278b9c1a2 tempest-TestInstancesWithCinderVolumes-729947751 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-1bdbda56-f74d-4574-a81c-741cf74d19a9 {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:48:32 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-b4724b56-1df7-4454-b063-0b087d627bf0 tempest-VolumeDependencyTests-2043422105 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (afeaad93-cb46-431d-9886-004a229bddf6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0aa2d749-7810-49c3-a7fc-9da86ea9e9c4', 'volume_size': 1, 'snapshot_id': '3d117106-07d7-4c98-bc8b-94b24b6d29e5'}' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:48:32 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-b4724b56-1df7-4454-b063-0b087d627bf0 tempest-VolumeDependencyTests-2043422105 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6e416f0c-d2aa-433a-9b37-1386e4022486) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:48:32 devstack cinder-volume[92060]: INFO cinder.volume.flows.manager.create_volume [None req-b4724b56-1df7-4454-b063-0b087d627bf0 tempest-VolumeDependencyTests-2043422105 None] Volume volume-0aa2d749-7810-49c3-a7fc-9da86ea9e9c4 (0aa2d749-7810-49c3-a7fc-9da86ea9e9c4): created successfully Jun 17 04:48:32 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-b4724b56-1df7-4454-b063-0b087d627bf0 tempest-VolumeDependencyTests-2043422105 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6e416f0c-d2aa-433a-9b37-1386e4022486) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:48:32 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-b4724b56-1df7-4454-b063-0b087d627bf0 tempest-VolumeDependencyTests-2043422105 None] Flow 'volume_create_manager' (66f293e4-66e8-436b-923f-53765f84769d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92060) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 17 04:48:32 devstack cinder-volume[92060]: INFO cinder.volume.manager [None req-b4724b56-1df7-4454-b063-0b087d627bf0 tempest-VolumeDependencyTests-2043422105 None] Created volume successfully. Jun 17 04:48:32 devstack sudo[104695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-1bdbda56-f74d-4574-a81c-741cf74d19a9 Jun 17 04:48:32 devstack sudo[104695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:48:32 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-43b7fa60-440a-4936-98a1-1c85e58e2d9a tempest-VolumeDependencyTests-2043422105 None] Acquiring lock "cinder-3d117106-07d7-4c98-bc8b-94b24b6d29e5-delete_snapshot" by "delete_snapshot" {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 04:48:32 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-43b7fa60-440a-4936-98a1-1c85e58e2d9a tempest-VolumeDependencyTests-2043422105 None] Lock "cinder-3d117106-07d7-4c98-bc8b-94b24b6d29e5-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 04:48:32 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-43b7fa60-440a-4936-98a1-1c85e58e2d9a tempest-VolumeDependencyTests-2043422105 None] Acquiring lock "cinder-quobyte-651dbb0b-4e5a-4a05-b7e2-3fc19a2103d7" by "delete_snapshot" {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 04:48:32 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-43b7fa60-440a-4936-98a1-1c85e58e2d9a tempest-VolumeDependencyTests-2043422105 None] Lock "cinder-quobyte-651dbb0b-4e5a-4a05-b7e2-3fc19a2103d7" acquired by "delete_snapshot" :: waited 0.015s {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 04:48:32 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-43b7fa60-440a-4936-98a1-1c85e58e2d9a tempest-VolumeDependencyTests-2043422105 None] Acquiring lock "cinder-quobyte-3d117106-07d7-4c98-bc8b-94b24b6d29e5" by "_delete_snapshot" {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 04:48:32 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-43b7fa60-440a-4936-98a1-1c85e58e2d9a tempest-VolumeDependencyTests-2043422105 None] Lock "cinder-quobyte-3d117106-07d7-4c98-bc8b-94b24b6d29e5" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 04:48:32 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.remotefs [None req-43b7fa60-440a-4936-98a1-1c85e58e2d9a tempest-VolumeDependencyTests-2043422105 None] Deleting offline snapshot 3d117106-07d7-4c98-bc8b-94b24b6d29e5 of volume 651dbb0b-4e5a-4a05-b7e2-3fc19a2103d7 {{(pid=92060) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 17 04:48:32 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.remotefs [None req-43b7fa60-440a-4936-98a1-1c85e58e2d9a tempest-VolumeDependencyTests-2043422105 None] snapshot_file for this snap is: volume-651dbb0b-4e5a-4a05-b7e2-3fc19a2103d7.3d117106-07d7-4c98-bc8b-94b24b6d29e5 {{(pid=92060) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 17 04:48:32 devstack cinder-volume[92060]: DEBUG oslo.privsep.daemon [-] privsep: reply[908dee15-1f95-45e5-9d3a-411fda547b95]: (4, 'qcow2') {{(pid=93130) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 04:48:32 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-43b7fa60-440a-4936-98a1-1c85e58e2d9a tempest-VolumeDependencyTests-2043422105 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-651dbb0b-4e5a-4a05-b7e2-3fc19a2103d7.3d117106-07d7-4c98-bc8b-94b24b6d29e5 {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:48:32 devstack sudo[104691]: pam_unix(sudo:session): session closed for user root Jun 17 04:48:32 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-6f1cd6ec-9170-46f0-a2c6-3b6ebe368ed2 tempest-CreateVolumesFromSnapshotTest-904120229 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-92658ecb-9bb8-4dfe-96a3-6923fa844c3e.f6f90d56-9018-49ed-8ee6-3ea2d9a85d62" returned: 0 in 0.661s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:48:32 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-6f1cd6ec-9170-46f0-a2c6-3b6ebe368ed2 tempest-CreateVolumesFromSnapshotTest-904120229 None] Lock "cinder-quobyte-f6f90d56-9018-49ed-8ee6-3ea2d9a85d62" released by "_delete_snapshot" :: held 4.663s {{(pid=92060) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 04:48:32 devstack sudo[104698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-651dbb0b-4e5a-4a05-b7e2-3fc19a2103d7.3d117106-07d7-4c98-bc8b-94b24b6d29e5 Jun 17 04:48:32 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-6f1cd6ec-9170-46f0-a2c6-3b6ebe368ed2 tempest-CreateVolumesFromSnapshotTest-904120229 None] Lock "cinder-quobyte-92658ecb-9bb8-4dfe-96a3-6923fa844c3e" released by "delete_snapshot" :: held 4.716s {{(pid=92060) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 04:48:32 devstack sudo[104698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:48:32 devstack cinder-volume[92060]: DEBUG cinder.quota [None req-6f1cd6ec-9170-46f0-a2c6-3b6ebe368ed2 tempest-CreateVolumesFromSnapshotTest-904120229 None] Created reservations ['1ac55330-346f-4b8f-9cf1-9d00fef76926', '389dd86c-8a72-4048-9175-3c6cacba2601', '7162083e-1cf5-4f7a-97b0-31afde6ebf02', '75e052d2-635d-458d-897e-0145f9c08741'] {{(pid=92060) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 17 04:48:32 devstack cinder-volume[92060]: INFO cinder.volume.manager [None req-6f1cd6ec-9170-46f0-a2c6-3b6ebe368ed2 tempest-CreateVolumesFromSnapshotTest-904120229 None] Delete snapshot completed successfully. Jun 17 04:48:32 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-6f1cd6ec-9170-46f0-a2c6-3b6ebe368ed2 tempest-CreateVolumesFromSnapshotTest-904120229 None] Lock "cinder-f6f90d56-9018-49ed-8ee6-3ea2d9a85d62-delete_snapshot" released by "delete_snapshot" :: held 4.993s {{(pid=92060) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 04:48:33 devstack sudo[104695]: pam_unix(sudo:session): session closed for user root Jun 17 04:48:33 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [req-68f7f764-d277-4d3a-8e70-61e93292400a req-9de8b723-da7e-4ad1-97d7-b56278b9c1a2 tempest-TestInstancesWithCinderVolumes-729947751 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-1bdbda56-f74d-4574-a81c-741cf74d19a9" returned: 0 in 0.780s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:48:33 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [req-68f7f764-d277-4d3a-8e70-61e93292400a req-9de8b723-da7e-4ad1-97d7-b56278b9c1a2 tempest-TestInstancesWithCinderVolumes-729947751 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.816s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 04:48:33 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [req-68f7f764-d277-4d3a-8e70-61e93292400a req-9de8b723-da7e-4ad1-97d7-b56278b9c1a2 tempest-TestInstancesWithCinderVolumes-729947751 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588', 'name': 'volume-1bdbda56-f74d-4574-a81c-741cf74d19a9', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '3d8f994f-e839-4501-955a-250d0cce2a63', 'enforce_multipath': True} {{(pid=92060) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 17 04:48:33 devstack cinder-volume[92060]: INFO cinder.volume.manager [req-68f7f764-d277-4d3a-8e70-61e93292400a req-9de8b723-da7e-4ad1-97d7-b56278b9c1a2 tempest-TestInstancesWithCinderVolumes-729947751 None] attachment_update completed successfully. Jun 17 04:48:33 devstack sudo[104698]: pam_unix(sudo:session): session closed for user root Jun 17 04:48:33 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-43b7fa60-440a-4936-98a1-1c85e58e2d9a tempest-VolumeDependencyTests-2043422105 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-651dbb0b-4e5a-4a05-b7e2-3fc19a2103d7.3d117106-07d7-4c98-bc8b-94b24b6d29e5" returned: 0 in 0.726s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:48:33 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.remotefs [None req-43b7fa60-440a-4936-98a1-1c85e58e2d9a tempest-VolumeDependencyTests-2043422105 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-651dbb0b-4e5a-4a05-b7e2-3fc19a2103d7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=92060) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 17 04:48:33 devstack cinder-volume[92060]: DEBUG oslo.privsep.daemon [-] privsep: reply[d29244b0-29ed-4d64-b3b4-611fb0b598a2]: (4, 'qcow2') {{(pid=93130) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 04:48:33 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-43b7fa60-440a-4936-98a1-1c85e58e2d9a tempest-VolumeDependencyTests-2043422105 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-651dbb0b-4e5a-4a05-b7e2-3fc19a2103d7 {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:48:33 devstack sudo[104706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-651dbb0b-4e5a-4a05-b7e2-3fc19a2103d7 Jun 17 04:48:33 devstack sudo[104706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:48:33 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-c1db6e09-0217-4492-b0e6-092638450fe1 tempest-CreateVolumesFromSnapshotTest-904120229 None] Acquiring lock "cinder-92658ecb-9bb8-4dfe-96a3-6923fa844c3e-delete_volume" by "delete_volume" {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 04:48:33 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-c1db6e09-0217-4492-b0e6-092638450fe1 tempest-CreateVolumesFromSnapshotTest-904120229 None] Lock "cinder-92658ecb-9bb8-4dfe-96a3-6923fa844c3e-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 04:48:33 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-c1db6e09-0217-4492-b0e6-092638450fe1 tempest-CreateVolumesFromSnapshotTest-904120229 None] Acquiring lock "cinder-quobyte-92658ecb-9bb8-4dfe-96a3-6923fa844c3e" by "delete_volume" {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 04:48:33 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-c1db6e09-0217-4492-b0e6-092638450fe1 tempest-CreateVolumesFromSnapshotTest-904120229 None] Lock "cinder-quobyte-92658ecb-9bb8-4dfe-96a3-6923fa844c3e" acquired by "delete_volume" :: waited 0.019s {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 04:48:33 devstack cinder-volume[92060]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c34054f-f4f8-4809-9e2f-6711af85959d]: (4, 'qcow2') {{(pid=93130) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 04:48:33 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-c1db6e09-0217-4492-b0e6-092638450fe1 tempest-CreateVolumesFromSnapshotTest-904120229 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-92658ecb-9bb8-4dfe-96a3-6923fa844c3e {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:48:33 devstack sudo[104708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-92658ecb-9bb8-4dfe-96a3-6923fa844c3e Jun 17 04:48:33 devstack sudo[104708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:48:34 devstack sudo[104706]: pam_unix(sudo:session): session closed for user root Jun 17 04:48:34 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-43b7fa60-440a-4936-98a1-1c85e58e2d9a tempest-VolumeDependencyTests-2043422105 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-651dbb0b-4e5a-4a05-b7e2-3fc19a2103d7" returned: 0 in 0.821s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:48:34 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-43b7fa60-440a-4936-98a1-1c85e58e2d9a tempest-VolumeDependencyTests-2043422105 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-651dbb0b-4e5a-4a05-b7e2-3fc19a2103d7.3d117106-07d7-4c98-bc8b-94b24b6d29e5 {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:48:34 devstack sudo[104716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-651dbb0b-4e5a-4a05-b7e2-3fc19a2103d7.3d117106-07d7-4c98-bc8b-94b24b6d29e5 Jun 17 04:48:34 devstack sudo[104716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:48:34 devstack sudo[104708]: pam_unix(sudo:session): session closed for user root Jun 17 04:48:34 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-c1db6e09-0217-4492-b0e6-092638450fe1 tempest-CreateVolumesFromSnapshotTest-904120229 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-92658ecb-9bb8-4dfe-96a3-6923fa844c3e" returned: 0 in 0.762s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:48:34 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-c1db6e09-0217-4492-b0e6-092638450fe1 tempest-CreateVolumesFromSnapshotTest-904120229 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-92658ecb-9bb8-4dfe-96a3-6923fa844c3e {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:48:34 devstack sudo[104721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-92658ecb-9bb8-4dfe-96a3-6923fa844c3e Jun 17 04:48:34 devstack sudo[104721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:48:34 devstack sudo[104716]: pam_unix(sudo:session): session closed for user root Jun 17 04:48:34 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-43b7fa60-440a-4936-98a1-1c85e58e2d9a tempest-VolumeDependencyTests-2043422105 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-651dbb0b-4e5a-4a05-b7e2-3fc19a2103d7.3d117106-07d7-4c98-bc8b-94b24b6d29e5" returned: 0 in 0.716s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:48:34 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-43b7fa60-440a-4936-98a1-1c85e58e2d9a tempest-VolumeDependencyTests-2043422105 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-651dbb0b-4e5a-4a05-b7e2-3fc19a2103d7.3d117106-07d7-4c98-bc8b-94b24b6d29e5 {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:48:35 devstack sudo[104726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-651dbb0b-4e5a-4a05-b7e2-3fc19a2103d7.3d117106-07d7-4c98-bc8b-94b24b6d29e5 Jun 17 04:48:35 devstack sudo[104726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:48:35 devstack sudo[104721]: pam_unix(sudo:session): session closed for user root Jun 17 04:48:35 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-c1db6e09-0217-4492-b0e6-092638450fe1 tempest-CreateVolumesFromSnapshotTest-904120229 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-92658ecb-9bb8-4dfe-96a3-6923fa844c3e" returned: 0 in 0.604s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:48:35 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-c1db6e09-0217-4492-b0e6-092638450fe1 tempest-CreateVolumesFromSnapshotTest-904120229 None] Lock "cinder-quobyte-92658ecb-9bb8-4dfe-96a3-6923fa844c3e" released by "delete_volume" :: held 1.436s {{(pid=92060) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 04:48:35 devstack cinder-volume[92060]: DEBUG cinder.quota [None req-c1db6e09-0217-4492-b0e6-092638450fe1 tempest-CreateVolumesFromSnapshotTest-904120229 None] Created reservations ['0749052f-557c-4bce-a18b-b7950096d378', 'ea7580d8-d63c-485e-af7f-67072ba2d4db', '8a01f5c0-4bee-4d8f-85d4-d9bb82835e5c', '97d178a8-70a3-460e-a9d2-975d7fd2ac4a'] {{(pid=92060) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 17 04:48:35 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-c1db6e09-0217-4492-b0e6-092638450fe1 tempest-CreateVolumesFromSnapshotTest-904120229 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 04:48:35 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-c1db6e09-0217-4492-b0e6-092638450fe1 tempest-CreateVolumesFromSnapshotTest-904120229 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 04:48:35 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-c1db6e09-0217-4492-b0e6-092638450fe1 tempest-CreateVolumesFromSnapshotTest-904120229 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588': None} {{(pid=92060) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 17 04:48:35 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-c1db6e09-0217-4492-b0e6-092638450fe1 tempest-CreateVolumesFromSnapshotTest-904120229 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588'] {{(pid=92060) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 17 04:48:35 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-c1db6e09-0217-4492-b0e6-092638450fe1 tempest-CreateVolumesFromSnapshotTest-904120229 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 04:48:35 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-c1db6e09-0217-4492-b0e6-092638450fe1 tempest-CreateVolumesFromSnapshotTest-904120229 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:48:35 devstack sudo[104729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a Jun 17 04:48:35 devstack sudo[104729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:48:35 devstack sudo[104726]: pam_unix(sudo:session): session closed for user root Jun 17 04:48:35 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-43b7fa60-440a-4936-98a1-1c85e58e2d9a tempest-VolumeDependencyTests-2043422105 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-651dbb0b-4e5a-4a05-b7e2-3fc19a2103d7.3d117106-07d7-4c98-bc8b-94b24b6d29e5" returned: 0 in 0.602s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:48:35 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-43b7fa60-440a-4936-98a1-1c85e58e2d9a tempest-VolumeDependencyTests-2043422105 None] Lock "cinder-quobyte-3d117106-07d7-4c98-bc8b-94b24b6d29e5" released by "_delete_snapshot" :: held 2.978s {{(pid=92060) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 04:48:35 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-43b7fa60-440a-4936-98a1-1c85e58e2d9a tempest-VolumeDependencyTests-2043422105 None] Lock "cinder-quobyte-651dbb0b-4e5a-4a05-b7e2-3fc19a2103d7" released by "delete_snapshot" :: held 3.003s {{(pid=92060) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 04:48:35 devstack cinder-volume[92060]: DEBUG cinder.quota [None req-43b7fa60-440a-4936-98a1-1c85e58e2d9a tempest-VolumeDependencyTests-2043422105 None] Created reservations ['d08bf3da-99a3-4a1a-b518-75bd1fdcc2d6', 'ab4aca4d-b899-4032-831b-f00b4aedd323', 'f492cc4f-7dc6-4364-af52-900b4d67297c', '0bf885ed-87d8-4320-8ad8-fce21e304807'] {{(pid=92060) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 17 04:48:35 devstack cinder-volume[92060]: INFO cinder.volume.manager [None req-43b7fa60-440a-4936-98a1-1c85e58e2d9a tempest-VolumeDependencyTests-2043422105 None] Delete snapshot completed successfully. Jun 17 04:48:35 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-43b7fa60-440a-4936-98a1-1c85e58e2d9a tempest-VolumeDependencyTests-2043422105 None] Lock "cinder-3d117106-07d7-4c98-bc8b-94b24b6d29e5-delete_snapshot" released by "delete_snapshot" :: held 3.236s {{(pid=92060) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 04:48:35 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-c7d0df75-3f98-42c4-a8b0-a76c654620f2 tempest-VolumeDependencyTests-2043422105 None] Acquiring lock "cinder-651dbb0b-4e5a-4a05-b7e2-3fc19a2103d7-delete_volume" by "delete_volume" {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 04:48:35 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-c7d0df75-3f98-42c4-a8b0-a76c654620f2 tempest-VolumeDependencyTests-2043422105 None] Lock "cinder-651dbb0b-4e5a-4a05-b7e2-3fc19a2103d7-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 04:48:35 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-c7d0df75-3f98-42c4-a8b0-a76c654620f2 tempest-VolumeDependencyTests-2043422105 None] Acquiring lock "cinder-quobyte-651dbb0b-4e5a-4a05-b7e2-3fc19a2103d7" by "delete_volume" {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 04:48:36 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-c7d0df75-3f98-42c4-a8b0-a76c654620f2 tempest-VolumeDependencyTests-2043422105 None] Lock "cinder-quobyte-651dbb0b-4e5a-4a05-b7e2-3fc19a2103d7" acquired by "delete_volume" :: waited 0.039s {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 04:48:36 devstack sudo[104729]: pam_unix(sudo:session): session closed for user root Jun 17 04:48:36 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-c1db6e09-0217-4492-b0e6-092638450fe1 tempest-CreateVolumesFromSnapshotTest-904120229 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a" returned: 0 in 0.731s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:48:36 devstack cinder-volume[92060]: DEBUG cinder.manager [None req-c1db6e09-0217-4492-b0e6-092638450fe1 tempest-CreateVolumesFromSnapshotTest-904120229 None] Notifying Schedulers of capabilities ... {{(pid=92060) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 17 04:48:36 devstack cinder-volume[92060]: INFO cinder.volume.manager [None req-c1db6e09-0217-4492-b0e6-092638450fe1 tempest-CreateVolumesFromSnapshotTest-904120229 None] Deleted volume successfully. Jun 17 04:48:36 devstack cinder-volume[92060]: DEBUG oslo.privsep.daemon [-] privsep: reply[561d1afb-359e-484a-90a2-eef15003dcf2]: (4, 'qcow2') {{(pid=93130) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 04:48:36 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-c7d0df75-3f98-42c4-a8b0-a76c654620f2 tempest-VolumeDependencyTests-2043422105 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-651dbb0b-4e5a-4a05-b7e2-3fc19a2103d7 {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:48:36 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-c1db6e09-0217-4492-b0e6-092638450fe1 tempest-CreateVolumesFromSnapshotTest-904120229 None] Lock "cinder-92658ecb-9bb8-4dfe-96a3-6923fa844c3e-delete_volume" released by "delete_volume" :: held 2.428s {{(pid=92060) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 04:48:36 devstack sudo[104733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-651dbb0b-4e5a-4a05-b7e2-3fc19a2103d7 Jun 17 04:48:36 devstack sudo[104733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:48:36 devstack sudo[104733]: pam_unix(sudo:session): session closed for user root Jun 17 04:48:36 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-c7d0df75-3f98-42c4-a8b0-a76c654620f2 tempest-VolumeDependencyTests-2043422105 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-651dbb0b-4e5a-4a05-b7e2-3fc19a2103d7" returned: 0 in 0.890s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:48:36 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-c7d0df75-3f98-42c4-a8b0-a76c654620f2 tempest-VolumeDependencyTests-2043422105 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-651dbb0b-4e5a-4a05-b7e2-3fc19a2103d7 {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:48:36 devstack sudo[104738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-651dbb0b-4e5a-4a05-b7e2-3fc19a2103d7 Jun 17 04:48:36 devstack sudo[104738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:48:37 devstack sudo[104738]: pam_unix(sudo:session): session closed for user root Jun 17 04:48:37 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-c7d0df75-3f98-42c4-a8b0-a76c654620f2 tempest-VolumeDependencyTests-2043422105 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-651dbb0b-4e5a-4a05-b7e2-3fc19a2103d7" returned: 0 in 0.735s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:48:37 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-c7d0df75-3f98-42c4-a8b0-a76c654620f2 tempest-VolumeDependencyTests-2043422105 None] Lock "cinder-quobyte-651dbb0b-4e5a-4a05-b7e2-3fc19a2103d7" released by "delete_volume" :: held 1.703s {{(pid=92060) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 04:48:37 devstack cinder-volume[92060]: DEBUG cinder.quota [None req-c7d0df75-3f98-42c4-a8b0-a76c654620f2 tempest-VolumeDependencyTests-2043422105 None] Created reservations ['a6a39a3d-3754-4f9f-bb79-d3b7085aa777', 'e71a4466-2465-4f54-a30f-8de073a8544e', 'b1c8d53d-3988-4e5b-9175-75073fa14a42', '9769d7eb-9a28-4b23-bb15-f60fff15b20a'] {{(pid=92060) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 17 04:48:37 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-c7d0df75-3f98-42c4-a8b0-a76c654620f2 tempest-VolumeDependencyTests-2043422105 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 04:48:37 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-c7d0df75-3f98-42c4-a8b0-a76c654620f2 tempest-VolumeDependencyTests-2043422105 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 04:48:37 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-c7d0df75-3f98-42c4-a8b0-a76c654620f2 tempest-VolumeDependencyTests-2043422105 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588': None} {{(pid=92060) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 17 04:48:37 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-c7d0df75-3f98-42c4-a8b0-a76c654620f2 tempest-VolumeDependencyTests-2043422105 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588'] {{(pid=92060) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 17 04:48:37 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-c7d0df75-3f98-42c4-a8b0-a76c654620f2 tempest-VolumeDependencyTests-2043422105 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 04:48:37 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-c7d0df75-3f98-42c4-a8b0-a76c654620f2 tempest-VolumeDependencyTests-2043422105 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:48:37 devstack sudo[104745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a Jun 17 04:48:37 devstack sudo[104745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:48:38 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-2533561d-72b2-411b-aa8f-20df7e041509 tempest-VolumeDependencyTests-2043422105 None] Acquiring lock "cinder-0aa2d749-7810-49c3-a7fc-9da86ea9e9c4-delete_volume" by "delete_volume" {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 04:48:38 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-2533561d-72b2-411b-aa8f-20df7e041509 tempest-VolumeDependencyTests-2043422105 None] Lock "cinder-0aa2d749-7810-49c3-a7fc-9da86ea9e9c4-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 04:48:38 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-2533561d-72b2-411b-aa8f-20df7e041509 tempest-VolumeDependencyTests-2043422105 None] Acquiring lock "cinder-quobyte-0aa2d749-7810-49c3-a7fc-9da86ea9e9c4" by "delete_volume" {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 04:48:38 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-2533561d-72b2-411b-aa8f-20df7e041509 tempest-VolumeDependencyTests-2043422105 None] Lock "cinder-quobyte-0aa2d749-7810-49c3-a7fc-9da86ea9e9c4" acquired by "delete_volume" :: waited 0.019s {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 04:48:38 devstack cinder-volume[92060]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2412ae4-51a4-4cbd-832e-fd3f8ec6d9a5]: (4, 'qcow2') {{(pid=93130) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 04:48:38 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-2533561d-72b2-411b-aa8f-20df7e041509 tempest-VolumeDependencyTests-2043422105 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-0aa2d749-7810-49c3-a7fc-9da86ea9e9c4 {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:48:38 devstack sudo[104749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-0aa2d749-7810-49c3-a7fc-9da86ea9e9c4 Jun 17 04:48:38 devstack sudo[104749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:48:38 devstack sudo[104745]: pam_unix(sudo:session): session closed for user root Jun 17 04:48:38 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-c7d0df75-3f98-42c4-a8b0-a76c654620f2 tempest-VolumeDependencyTests-2043422105 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a" returned: 0 in 0.823s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:48:38 devstack cinder-volume[92060]: DEBUG cinder.manager [None req-c7d0df75-3f98-42c4-a8b0-a76c654620f2 tempest-VolumeDependencyTests-2043422105 None] Notifying Schedulers of capabilities ... {{(pid=92060) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 17 04:48:38 devstack cinder-volume[92060]: INFO cinder.volume.manager [None req-c7d0df75-3f98-42c4-a8b0-a76c654620f2 tempest-VolumeDependencyTests-2043422105 None] Deleted volume successfully. Jun 17 04:48:38 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-c7d0df75-3f98-42c4-a8b0-a76c654620f2 tempest-VolumeDependencyTests-2043422105 None] Lock "cinder-651dbb0b-4e5a-4a05-b7e2-3fc19a2103d7-delete_volume" released by "delete_volume" :: held 2.803s {{(pid=92060) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 04:48:39 devstack sudo[104749]: pam_unix(sudo:session): session closed for user root Jun 17 04:48:39 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-2533561d-72b2-411b-aa8f-20df7e041509 tempest-VolumeDependencyTests-2043422105 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-0aa2d749-7810-49c3-a7fc-9da86ea9e9c4" returned: 0 in 0.824s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:48:39 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-2533561d-72b2-411b-aa8f-20df7e041509 tempest-VolumeDependencyTests-2043422105 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-0aa2d749-7810-49c3-a7fc-9da86ea9e9c4 {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:48:39 devstack sudo[104755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-0aa2d749-7810-49c3-a7fc-9da86ea9e9c4 Jun 17 04:48:39 devstack sudo[104755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:48:39 devstack cinder-volume[92060]: DEBUG cinder.volume.flows.manager.create_volume [None req-8fdb6359-bd4d-4c56-9710-40c142b42e99 tempest-CinderUnicodeTest-54061701 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92060) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 17 04:48:39 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-8fdb6359-bd4d-4c56-9710-40c142b42e99 tempest-CinderUnicodeTest-54061701 None] Flow 'volume_create_manager' (91818bc1-3943-4e5e-ba48-f6861263d92e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 17 04:48:39 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-8fdb6359-bd4d-4c56-9710-40c142b42e99 tempest-CinderUnicodeTest-54061701 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0c78ec2d-4154-40fd-be75-4d49a3123d7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:48:39 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-8fdb6359-bd4d-4c56-9710-40c142b42e99 tempest-CinderUnicodeTest-54061701 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0c78ec2d-4154-40fd-be75-4d49a3123d7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-17T02:48:39Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=02266bff-0ef4-4da3-b86b-36da8322f723,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8b574ed3657642ca919181d3faeb9408',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T02:48:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T02:48:40Z,use_quota=True,user_id='25373a57a8c94784a423d207d73e3616',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aad9ce24-93f9-41a6-baa1-5125964f96d1),volume_type_id=aad9ce24-93f9-41a6-baa1-5125964f96d1)' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:48:39 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-8fdb6359-bd4d-4c56-9710-40c142b42e99 tempest-CinderUnicodeTest-54061701 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b9ce2bf3-8dcb-4546-b7cb-be6027e08b7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:48:39 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-8fdb6359-bd4d-4c56-9710-40c142b42e99 tempest-CinderUnicodeTest-54061701 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b9ce2bf3-8dcb-4546-b7cb-be6027e08b7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:48:39 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-8fdb6359-bd4d-4c56-9710-40c142b42e99 tempest-CinderUnicodeTest-54061701 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (98d0e696-11fc-4117-b9fa-b0779ea5a90a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:48:39 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-8fdb6359-bd4d-4c56-9710-40c142b42e99 tempest-CinderUnicodeTest-54061701 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (98d0e696-11fc-4117-b9fa-b0779ea5a90a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '02266bff-0ef4-4da3-b86b-36da8322f723', 'volume_name': 'volume-02266bff-0ef4-4da3-b86b-36da8322f723', 'volume_size': 1}' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:48:39 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-8fdb6359-bd4d-4c56-9710-40c142b42e99 tempest-CinderUnicodeTest-54061701 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (19f16e4a-c299-43e7-a707-725c16165af7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:48:39 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-8fdb6359-bd4d-4c56-9710-40c142b42e99 tempest-CinderUnicodeTest-54061701 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (19f16e4a-c299-43e7-a707-725c16165af7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:48:39 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-8fdb6359-bd4d-4c56-9710-40c142b42e99 tempest-CinderUnicodeTest-54061701 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ab5a8982-bcb3-422d-9c96-256f8c75ae36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:48:39 devstack cinder-volume[92060]: INFO cinder.volume.flows.manager.create_volume [None req-8fdb6359-bd4d-4c56-9710-40c142b42e99 tempest-CinderUnicodeTest-54061701 None] Volume 02266bff-0ef4-4da3-b86b-36da8322f723: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-02266bff-0ef4-4da3-b86b-36da8322f723', 'volume_size': 1} Jun 17 04:48:39 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-8fdb6359-bd4d-4c56-9710-40c142b42e99 tempest-CinderUnicodeTest-54061701 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 04:48:39 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-8fdb6359-bd4d-4c56-9710-40c142b42e99 tempest-CinderUnicodeTest-54061701 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 04:48:39 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-8fdb6359-bd4d-4c56-9710-40c142b42e99 tempest-CinderUnicodeTest-54061701 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-17T02:48:39Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=02266bff-0ef4-4da3-b86b-36da8322f723,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8b574ed3657642ca919181d3faeb9408',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T02:48:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T02:48:40Z,use_quota=True,user_id='25373a57a8c94784a423d207d73e3616',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aad9ce24-93f9-41a6-baa1-5125964f96d1),volume_type_id=aad9ce24-93f9-41a6-baa1-5125964f96d1)}" {{(pid=92060) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 17 04:48:39 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.remotefs [None req-8fdb6359-bd4d-4c56-9710-40c142b42e99 tempest-CinderUnicodeTest-54061701 None] Creating volume 02266bff-0ef4-4da3-b86b-36da8322f723 {{(pid=92060) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 17 04:48:39 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-8fdb6359-bd4d-4c56-9710-40c142b42e99 tempest-CinderUnicodeTest-54061701 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 04:48:39 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-8fdb6359-bd4d-4c56-9710-40c142b42e99 tempest-CinderUnicodeTest-54061701 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 04:48:39 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-8fdb6359-bd4d-4c56-9710-40c142b42e99 tempest-CinderUnicodeTest-54061701 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588': None} {{(pid=92060) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 17 04:48:39 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-8fdb6359-bd4d-4c56-9710-40c142b42e99 tempest-CinderUnicodeTest-54061701 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588'] {{(pid=92060) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 17 04:48:39 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-8fdb6359-bd4d-4c56-9710-40c142b42e99 tempest-CinderUnicodeTest-54061701 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 04:48:39 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-8fdb6359-bd4d-4c56-9710-40c142b42e99 tempest-CinderUnicodeTest-54061701 None] Selected osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588 as target Quobyte volume. {{(pid=92060) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 17 04:48:39 devstack cinder-volume[92060]: INFO cinder.volume.drivers.remotefs [None req-8fdb6359-bd4d-4c56-9710-40c142b42e99 tempest-CinderUnicodeTest-54061701 None] casted to osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588 Jun 17 04:48:39 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-8fdb6359-bd4d-4c56-9710-40c142b42e99 tempest-CinderUnicodeTest-54061701 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-02266bff-0ef4-4da3-b86b-36da8322f723 1073741824 {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:48:39 devstack sudo[104757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-02266bff-0ef4-4da3-b86b-36da8322f723 1073741824 Jun 17 04:48:39 devstack sudo[104757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:48:39 devstack sudo[104755]: pam_unix(sudo:session): session closed for user root Jun 17 04:48:39 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-2533561d-72b2-411b-aa8f-20df7e041509 tempest-VolumeDependencyTests-2043422105 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-0aa2d749-7810-49c3-a7fc-9da86ea9e9c4" returned: 0 in 0.626s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:48:39 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-2533561d-72b2-411b-aa8f-20df7e041509 tempest-VolumeDependencyTests-2043422105 None] Lock "cinder-quobyte-0aa2d749-7810-49c3-a7fc-9da86ea9e9c4" released by "delete_volume" :: held 1.525s {{(pid=92060) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 04:48:39 devstack cinder-volume[92060]: DEBUG cinder.quota [None req-2533561d-72b2-411b-aa8f-20df7e041509 tempest-VolumeDependencyTests-2043422105 None] Created reservations ['a0ce97e8-60e6-4c03-9909-5a899e1bdb48', '67301abe-7f4a-4139-b11c-62bf972cbf7b', 'f18bff08-585a-437e-9125-0fa80f2784bf', 'b8a86a8f-483a-4a0a-9250-8c4f0cdbb469'] {{(pid=92060) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 17 04:48:40 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-2533561d-72b2-411b-aa8f-20df7e041509 tempest-VolumeDependencyTests-2043422105 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 04:48:40 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-2533561d-72b2-411b-aa8f-20df7e041509 tempest-VolumeDependencyTests-2043422105 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 04:48:40 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-2533561d-72b2-411b-aa8f-20df7e041509 tempest-VolumeDependencyTests-2043422105 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588': None} {{(pid=92060) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 17 04:48:40 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-2533561d-72b2-411b-aa8f-20df7e041509 tempest-VolumeDependencyTests-2043422105 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588'] {{(pid=92060) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 17 04:48:40 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-2533561d-72b2-411b-aa8f-20df7e041509 tempest-VolumeDependencyTests-2043422105 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 04:48:40 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-2533561d-72b2-411b-aa8f-20df7e041509 tempest-VolumeDependencyTests-2043422105 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:48:40 devstack sudo[104760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a Jun 17 04:48:40 devstack sudo[104760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:48:40 devstack sudo[104757]: pam_unix(sudo:session): session closed for user root Jun 17 04:48:40 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-8fdb6359-bd4d-4c56-9710-40c142b42e99 tempest-CinderUnicodeTest-54061701 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-02266bff-0ef4-4da3-b86b-36da8322f723 1073741824" returned: 0 in 0.952s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:48:40 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-8fdb6359-bd4d-4c56-9710-40c142b42e99 tempest-CinderUnicodeTest-54061701 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-02266bff-0ef4-4da3-b86b-36da8322f723 {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:48:40 devstack sudo[104768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-02266bff-0ef4-4da3-b86b-36da8322f723 Jun 17 04:48:40 devstack sudo[104768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:48:40 devstack sudo[104760]: pam_unix(sudo:session): session closed for user root Jun 17 04:48:40 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-2533561d-72b2-411b-aa8f-20df7e041509 tempest-VolumeDependencyTests-2043422105 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a" returned: 0 in 0.774s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:48:40 devstack cinder-volume[92060]: DEBUG cinder.manager [None req-2533561d-72b2-411b-aa8f-20df7e041509 tempest-VolumeDependencyTests-2043422105 None] Notifying Schedulers of capabilities ... {{(pid=92060) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 17 04:48:40 devstack cinder-volume[92060]: INFO cinder.volume.manager [None req-2533561d-72b2-411b-aa8f-20df7e041509 tempest-VolumeDependencyTests-2043422105 None] Deleted volume successfully. Jun 17 04:48:40 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-2533561d-72b2-411b-aa8f-20df7e041509 tempest-VolumeDependencyTests-2043422105 None] Lock "cinder-0aa2d749-7810-49c3-a7fc-9da86ea9e9c4-delete_volume" released by "delete_volume" :: held 2.561s {{(pid=92060) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 04:48:41 devstack sudo[104768]: pam_unix(sudo:session): session closed for user root Jun 17 04:48:41 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-8fdb6359-bd4d-4c56-9710-40c142b42e99 tempest-CinderUnicodeTest-54061701 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-02266bff-0ef4-4da3-b86b-36da8322f723" returned: 0 in 0.669s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:48:41 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-8fdb6359-bd4d-4c56-9710-40c142b42e99 tempest-CinderUnicodeTest-54061701 None] <== create_volume: return (1683ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588'} {{(pid=92060) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 17 04:48:41 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-8fdb6359-bd4d-4c56-9710-40c142b42e99 tempest-CinderUnicodeTest-54061701 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.687s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 04:48:41 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-8fdb6359-bd4d-4c56-9710-40c142b42e99 tempest-CinderUnicodeTest-54061701 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ab5a8982-bcb3-422d-9c96-256f8c75ae36) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-02266bff-0ef4-4da3-b86b-36da8322f723', 'volume_size': 1}' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:48:41 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-8fdb6359-bd4d-4c56-9710-40c142b42e99 tempest-CinderUnicodeTest-54061701 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ce4377e0-6024-494e-9f4a-85ec4a3454ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:48:41 devstack cinder-volume[92060]: INFO cinder.volume.flows.manager.create_volume [None req-8fdb6359-bd4d-4c56-9710-40c142b42e99 tempest-CinderUnicodeTest-54061701 None] Volume volume-02266bff-0ef4-4da3-b86b-36da8322f723 (02266bff-0ef4-4da3-b86b-36da8322f723): created successfully Jun 17 04:48:41 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-8fdb6359-bd4d-4c56-9710-40c142b42e99 tempest-CinderUnicodeTest-54061701 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ce4377e0-6024-494e-9f4a-85ec4a3454ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:48:41 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-8fdb6359-bd4d-4c56-9710-40c142b42e99 tempest-CinderUnicodeTest-54061701 None] Flow 'volume_create_manager' (91818bc1-3943-4e5e-ba48-f6861263d92e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92060) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 17 04:48:41 devstack cinder-volume[92060]: INFO cinder.volume.manager [None req-8fdb6359-bd4d-4c56-9710-40c142b42e99 tempest-CinderUnicodeTest-54061701 None] Created volume successfully. Jun 17 04:48:41 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [req-afd2ef7d-6986-46ff-aed2-268584b60972 req-4a56e3eb-dee8-4afd-9018-51fdbb049fe4 tempest-TestInstancesWithCinderVolumes-729947751 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 04:48:41 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [req-afd2ef7d-6986-46ff-aed2-268584b60972 req-4a56e3eb-dee8-4afd-9018-51fdbb049fe4 tempest-TestInstancesWithCinderVolumes-729947751 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 04:48:41 devstack cinder-volume[92060]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c98fa23-a4b5-4a8c-9797-2d96c7e0a3b6]: (4, 'qcow2') {{(pid=93130) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 04:48:41 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [req-afd2ef7d-6986-46ff-aed2-268584b60972 req-4a56e3eb-dee8-4afd-9018-51fdbb049fe4 tempest-TestInstancesWithCinderVolumes-729947751 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-7ad20cd3-2204-4cad-8706-e9d0e0ae3442 {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:48:41 devstack sudo[104780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-7ad20cd3-2204-4cad-8706-e9d0e0ae3442 Jun 17 04:48:41 devstack sudo[104780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:48:42 devstack sudo[104780]: pam_unix(sudo:session): session closed for user root Jun 17 04:48:42 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [req-afd2ef7d-6986-46ff-aed2-268584b60972 req-4a56e3eb-dee8-4afd-9018-51fdbb049fe4 tempest-TestInstancesWithCinderVolumes-729947751 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-7ad20cd3-2204-4cad-8706-e9d0e0ae3442" returned: 0 in 0.819s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:48:42 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [req-afd2ef7d-6986-46ff-aed2-268584b60972 req-4a56e3eb-dee8-4afd-9018-51fdbb049fe4 tempest-TestInstancesWithCinderVolumes-729947751 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.858s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 04:48:42 devstack cinder-volume[92060]: DEBUG dbcounter [-] [92060] Writing DB stats cinder:SELECT=138,cinder:UPDATE=167,cinder:INSERT=40,cinder:DELETE=18 {{(pid=92060) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 17 04:48:42 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [req-afd2ef7d-6986-46ff-aed2-268584b60972 req-4a56e3eb-dee8-4afd-9018-51fdbb049fe4 tempest-TestInstancesWithCinderVolumes-729947751 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588', 'name': 'volume-7ad20cd3-2204-4cad-8706-e9d0e0ae3442', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'd8c52236-20a7-4987-bd22-f36e97434b91', 'enforce_multipath': True} {{(pid=92060) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 17 04:48:42 devstack cinder-volume[92060]: DEBUG cinder.volume.flows.manager.create_volume [None req-97b789de-0301-4d05-8370-3d8f7d4c17d3 tempest-CinderUnicodeTest-54061701 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92060) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 17 04:48:42 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-97b789de-0301-4d05-8370-3d8f7d4c17d3 tempest-CinderUnicodeTest-54061701 None] Flow 'volume_create_manager' (625550a5-e1c3-4768-9c99-196ccc46f83b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 17 04:48:42 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-97b789de-0301-4d05-8370-3d8f7d4c17d3 tempest-CinderUnicodeTest-54061701 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (91311384-5865-462d-a6f5-7eb5c45b2fa9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:48:42 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-97b789de-0301-4d05-8370-3d8f7d4c17d3 tempest-CinderUnicodeTest-54061701 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (91311384-5865-462d-a6f5-7eb5c45b2fa9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-17T02:48:42Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1045961543',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4cdb7d3f-6690-4383-b1ba-f635b7d2a1d8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8b574ed3657642ca919181d3faeb9408',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T02:48:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T02:48:42Z,use_quota=True,user_id='25373a57a8c94784a423d207d73e3616',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aad9ce24-93f9-41a6-baa1-5125964f96d1),volume_type_id=aad9ce24-93f9-41a6-baa1-5125964f96d1)' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:48:42 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-97b789de-0301-4d05-8370-3d8f7d4c17d3 tempest-CinderUnicodeTest-54061701 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dc1bbfc5-0c24-42ed-8283-07adadadd4cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:48:42 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-97b789de-0301-4d05-8370-3d8f7d4c17d3 tempest-CinderUnicodeTest-54061701 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dc1bbfc5-0c24-42ed-8283-07adadadd4cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:48:42 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-97b789de-0301-4d05-8370-3d8f7d4c17d3 tempest-CinderUnicodeTest-54061701 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2a713cb0-4ef4-420a-8844-5a3e752ddc37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:48:42 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-97b789de-0301-4d05-8370-3d8f7d4c17d3 tempest-CinderUnicodeTest-54061701 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2a713cb0-4ef4-420a-8844-5a3e752ddc37) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4cdb7d3f-6690-4383-b1ba-f635b7d2a1d8', 'volume_name': 'volume-4cdb7d3f-6690-4383-b1ba-f635b7d2a1d8', 'volume_size': 1}' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:48:42 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-97b789de-0301-4d05-8370-3d8f7d4c17d3 tempest-CinderUnicodeTest-54061701 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (efbd7da6-3fd2-4e56-b5a9-07e201cc2b5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:48:42 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-97b789de-0301-4d05-8370-3d8f7d4c17d3 tempest-CinderUnicodeTest-54061701 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (efbd7da6-3fd2-4e56-b5a9-07e201cc2b5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:48:42 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-97b789de-0301-4d05-8370-3d8f7d4c17d3 tempest-CinderUnicodeTest-54061701 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0f33a2f1-78b3-4028-8cb0-27fb0f36fbcf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:48:42 devstack cinder-volume[92060]: INFO cinder.volume.flows.manager.create_volume [None req-97b789de-0301-4d05-8370-3d8f7d4c17d3 tempest-CinderUnicodeTest-54061701 None] Volume 4cdb7d3f-6690-4383-b1ba-f635b7d2a1d8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4cdb7d3f-6690-4383-b1ba-f635b7d2a1d8', 'volume_size': 1} Jun 17 04:48:42 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-97b789de-0301-4d05-8370-3d8f7d4c17d3 tempest-CinderUnicodeTest-54061701 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 04:48:42 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-97b789de-0301-4d05-8370-3d8f7d4c17d3 tempest-CinderUnicodeTest-54061701 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 04:48:42 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-97b789de-0301-4d05-8370-3d8f7d4c17d3 tempest-CinderUnicodeTest-54061701 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-17T02:48:42Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1045961543',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4cdb7d3f-6690-4383-b1ba-f635b7d2a1d8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8b574ed3657642ca919181d3faeb9408',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T02:48:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T02:48:42Z,use_quota=True,user_id='25373a57a8c94784a423d207d73e3616',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aad9ce24-93f9-41a6-baa1-5125964f96d1),volume_type_id=aad9ce24-93f9-41a6-baa1-5125964f96d1)}" {{(pid=92060) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 17 04:48:42 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.remotefs [None req-97b789de-0301-4d05-8370-3d8f7d4c17d3 tempest-CinderUnicodeTest-54061701 None] Creating volume 4cdb7d3f-6690-4383-b1ba-f635b7d2a1d8 {{(pid=92060) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 17 04:48:42 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-97b789de-0301-4d05-8370-3d8f7d4c17d3 tempest-CinderUnicodeTest-54061701 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 04:48:42 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-97b789de-0301-4d05-8370-3d8f7d4c17d3 tempest-CinderUnicodeTest-54061701 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 04:48:42 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-97b789de-0301-4d05-8370-3d8f7d4c17d3 tempest-CinderUnicodeTest-54061701 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588': None} {{(pid=92060) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 17 04:48:42 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-97b789de-0301-4d05-8370-3d8f7d4c17d3 tempest-CinderUnicodeTest-54061701 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588'] {{(pid=92060) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 17 04:48:42 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-97b789de-0301-4d05-8370-3d8f7d4c17d3 tempest-CinderUnicodeTest-54061701 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 04:48:42 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-97b789de-0301-4d05-8370-3d8f7d4c17d3 tempest-CinderUnicodeTest-54061701 None] Selected osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588 as target Quobyte volume. {{(pid=92060) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 17 04:48:42 devstack cinder-volume[92060]: INFO cinder.volume.drivers.remotefs [None req-97b789de-0301-4d05-8370-3d8f7d4c17d3 tempest-CinderUnicodeTest-54061701 None] casted to osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588 Jun 17 04:48:42 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-97b789de-0301-4d05-8370-3d8f7d4c17d3 tempest-CinderUnicodeTest-54061701 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-4cdb7d3f-6690-4383-b1ba-f635b7d2a1d8 1073741824 {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:48:42 devstack sudo[104785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-4cdb7d3f-6690-4383-b1ba-f635b7d2a1d8 1073741824 Jun 17 04:48:42 devstack sudo[104785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:48:42 devstack cinder-volume[92060]: INFO cinder.volume.manager [req-afd2ef7d-6986-46ff-aed2-268584b60972 req-4a56e3eb-dee8-4afd-9018-51fdbb049fe4 tempest-TestInstancesWithCinderVolumes-729947751 None] attachment_update completed successfully. Jun 17 04:48:43 devstack sudo[104785]: pam_unix(sudo:session): session closed for user root Jun 17 04:48:43 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-97b789de-0301-4d05-8370-3d8f7d4c17d3 tempest-CinderUnicodeTest-54061701 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-4cdb7d3f-6690-4383-b1ba-f635b7d2a1d8 1073741824" returned: 0 in 0.867s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:48:43 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-97b789de-0301-4d05-8370-3d8f7d4c17d3 tempest-CinderUnicodeTest-54061701 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-4cdb7d3f-6690-4383-b1ba-f635b7d2a1d8 {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:48:43 devstack sudo[104791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-4cdb7d3f-6690-4383-b1ba-f635b7d2a1d8 Jun 17 04:48:43 devstack sudo[104791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:48:44 devstack sudo[104791]: pam_unix(sudo:session): session closed for user root Jun 17 04:48:44 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-97b789de-0301-4d05-8370-3d8f7d4c17d3 tempest-CinderUnicodeTest-54061701 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-4cdb7d3f-6690-4383-b1ba-f635b7d2a1d8" returned: 0 in 0.694s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:48:44 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-97b789de-0301-4d05-8370-3d8f7d4c17d3 tempest-CinderUnicodeTest-54061701 None] <== create_volume: return (1605ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588'} {{(pid=92060) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 17 04:48:44 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-97b789de-0301-4d05-8370-3d8f7d4c17d3 tempest-CinderUnicodeTest-54061701 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.609s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 04:48:44 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-97b789de-0301-4d05-8370-3d8f7d4c17d3 tempest-CinderUnicodeTest-54061701 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0f33a2f1-78b3-4028-8cb0-27fb0f36fbcf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4cdb7d3f-6690-4383-b1ba-f635b7d2a1d8', 'volume_size': 1}' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:48:44 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-97b789de-0301-4d05-8370-3d8f7d4c17d3 tempest-CinderUnicodeTest-54061701 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e62b7c9e-922f-4e5c-9fa5-f24df81923df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:48:44 devstack cinder-volume[92060]: DEBUG dbcounter [-] [92060] Writing DB stats cinder:UPDATE=181,cinder:INSERT=42,cinder:SELECT=135,cinder:DELETE=11 {{(pid=92060) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 17 04:48:44 devstack cinder-volume[92060]: INFO cinder.volume.flows.manager.create_volume [None req-97b789de-0301-4d05-8370-3d8f7d4c17d3 tempest-CinderUnicodeTest-54061701 None] Volume volume-4cdb7d3f-6690-4383-b1ba-f635b7d2a1d8 (4cdb7d3f-6690-4383-b1ba-f635b7d2a1d8): created successfully Jun 17 04:48:44 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-97b789de-0301-4d05-8370-3d8f7d4c17d3 tempest-CinderUnicodeTest-54061701 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e62b7c9e-922f-4e5c-9fa5-f24df81923df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:48:44 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-97b789de-0301-4d05-8370-3d8f7d4c17d3 tempest-CinderUnicodeTest-54061701 None] Flow 'volume_create_manager' (625550a5-e1c3-4768-9c99-196ccc46f83b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92060) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 17 04:48:44 devstack cinder-volume[92060]: INFO cinder.volume.manager [None req-97b789de-0301-4d05-8370-3d8f7d4c17d3 tempest-CinderUnicodeTest-54061701 None] Created volume successfully. Jun 17 04:48:44 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-7d8c5fd5-f481-4494-aa70-ac39c1614254 tempest-CinderUnicodeTest-54061701 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 04:48:44 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-7d8c5fd5-f481-4494-aa70-ac39c1614254 tempest-CinderUnicodeTest-54061701 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 04:48:44 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.remotefs [None req-7d8c5fd5-f481-4494-aa70-ac39c1614254 tempest-CinderUnicodeTest-54061701 None] Creating offline snapshot 18eec727-8b07-4b88-9f0f-7ff646cfd696 of volume 4cdb7d3f-6690-4383-b1ba-f635b7d2a1d8 {{(pid=92060) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 17 04:48:44 devstack cinder-volume[92060]: DEBUG oslo.privsep.daemon [-] privsep: reply[243668a0-179b-47e5-9e42-54c36ca92c8e]: (4, 'qcow2') {{(pid=93130) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 04:48:44 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-7d8c5fd5-f481-4494-aa70-ac39c1614254 tempest-CinderUnicodeTest-54061701 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-4cdb7d3f-6690-4383-b1ba-f635b7d2a1d8 {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:48:44 devstack cinder-volume[92060]: DEBUG oslo_service.periodic_task [None req-60d279ad-ad8c-4d36-a4b8-f593e74fb922 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=92060) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 17 04:48:44 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-60d279ad-ad8c-4d36-a4b8-f593e74fb922 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 04:48:44 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-60d279ad-ad8c-4d36-a4b8-f593e74fb922 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 04:48:44 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-60d279ad-ad8c-4d36-a4b8-f593e74fb922 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588': None} {{(pid=92060) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 17 04:48:44 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-60d279ad-ad8c-4d36-a4b8-f593e74fb922 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588'] {{(pid=92060) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 17 04:48:44 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-60d279ad-ad8c-4d36-a4b8-f593e74fb922 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 04:48:44 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-60d279ad-ad8c-4d36-a4b8-f593e74fb922 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:48:45 devstack sudo[104797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a Jun 17 04:48:45 devstack sudo[104797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:48:45 devstack sudo[104796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-4cdb7d3f-6690-4383-b1ba-f635b7d2a1d8 Jun 17 04:48:45 devstack sudo[104796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:48:45 devstack sudo[104797]: pam_unix(sudo:session): session closed for user root Jun 17 04:48:45 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-60d279ad-ad8c-4d36-a4b8-f593e74fb922 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a" returned: 0 in 0.770s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:48:45 devstack cinder-volume[92060]: DEBUG cinder.manager [None req-60d279ad-ad8c-4d36-a4b8-f593e74fb922 None None] Notifying Schedulers of capabilities ... {{(pid=92060) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 17 04:48:45 devstack cinder-volume[92060]: DEBUG oslo_service.periodic_task [None req-60d279ad-ad8c-4d36-a4b8-f593e74fb922 None None] Running periodic task VolumeManager._thread_info {{(pid=92060) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 17 04:48:45 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-60d279ad-ad8c-4d36-a4b8-f593e74fb922 None None] thread count: 28 {{(pid=92060) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 17 04:48:45 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-60d279ad-ad8c-4d36-a4b8-f593e74fb922 None None] thread info: [<_MainThread(MainThread, started 130061806440576)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=92060) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 17 04:48:45 devstack sudo[104796]: pam_unix(sudo:session): session closed for user root Jun 17 04:48:45 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-7d8c5fd5-f481-4494-aa70-ac39c1614254 tempest-CinderUnicodeTest-54061701 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-4cdb7d3f-6690-4383-b1ba-f635b7d2a1d8" returned: 0 in 0.997s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:48:45 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-7d8c5fd5-f481-4494-aa70-ac39c1614254 tempest-CinderUnicodeTest-54061701 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-4cdb7d3f-6690-4383-b1ba-f635b7d2a1d8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-4cdb7d3f-6690-4383-b1ba-f635b7d2a1d8.18eec727-8b07-4b88-9f0f-7ff646cfd696 1G {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:48:45 devstack sudo[104804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-4cdb7d3f-6690-4383-b1ba-f635b7d2a1d8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-4cdb7d3f-6690-4383-b1ba-f635b7d2a1d8.18eec727-8b07-4b88-9f0f-7ff646cfd696 1G Jun 17 04:48:45 devstack sudo[104804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:48:46 devstack sudo[104804]: pam_unix(sudo:session): session closed for user root Jun 17 04:48:46 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-7d8c5fd5-f481-4494-aa70-ac39c1614254 tempest-CinderUnicodeTest-54061701 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-4cdb7d3f-6690-4383-b1ba-f635b7d2a1d8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-4cdb7d3f-6690-4383-b1ba-f635b7d2a1d8.18eec727-8b07-4b88-9f0f-7ff646cfd696 1G" returned: 0 in 0.995s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:48:46 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-7d8c5fd5-f481-4494-aa70-ac39c1614254 tempest-CinderUnicodeTest-54061701 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4cdb7d3f-6690-4383-b1ba-f635b7d2a1d8 -F qcow2 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-4cdb7d3f-6690-4383-b1ba-f635b7d2a1d8.18eec727-8b07-4b88-9f0f-7ff646cfd696 {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:48:46 devstack sudo[104817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4cdb7d3f-6690-4383-b1ba-f635b7d2a1d8 -F qcow2 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-4cdb7d3f-6690-4383-b1ba-f635b7d2a1d8.18eec727-8b07-4b88-9f0f-7ff646cfd696 Jun 17 04:48:46 devstack sudo[104817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:48:47 devstack sudo[104817]: pam_unix(sudo:session): session closed for user root Jun 17 04:48:47 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-7d8c5fd5-f481-4494-aa70-ac39c1614254 tempest-CinderUnicodeTest-54061701 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4cdb7d3f-6690-4383-b1ba-f635b7d2a1d8 -F qcow2 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-4cdb7d3f-6690-4383-b1ba-f635b7d2a1d8.18eec727-8b07-4b88-9f0f-7ff646cfd696" returned: 0 in 0.996s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:48:47 devstack cinder-volume[92060]: WARNING cinder.volume.drivers.remotefs [None req-7d8c5fd5-f481-4494-aa70-ac39c1614254 tempest-CinderUnicodeTest-54061701 None] /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-4cdb7d3f-6690-4383-b1ba-f635b7d2a1d8.18eec727-8b07-4b88-9f0f-7ff646cfd696 is being set with open permissions: ugo+rw Jun 17 04:48:47 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-7d8c5fd5-f481-4494-aa70-ac39c1614254 tempest-CinderUnicodeTest-54061701 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-4cdb7d3f-6690-4383-b1ba-f635b7d2a1d8.18eec727-8b07-4b88-9f0f-7ff646cfd696 {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:48:47 devstack sudo[104840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-4cdb7d3f-6690-4383-b1ba-f635b7d2a1d8.18eec727-8b07-4b88-9f0f-7ff646cfd696 Jun 17 04:48:47 devstack sudo[104840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:48:48 devstack sudo[104840]: pam_unix(sudo:session): session closed for user root Jun 17 04:48:48 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-7d8c5fd5-f481-4494-aa70-ac39c1614254 tempest-CinderUnicodeTest-54061701 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-4cdb7d3f-6690-4383-b1ba-f635b7d2a1d8.18eec727-8b07-4b88-9f0f-7ff646cfd696" returned: 0 in 0.651s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:48:48 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-7d8c5fd5-f481-4494-aa70-ac39c1614254 tempest-CinderUnicodeTest-54061701 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-4cdb7d3f-6690-4383-b1ba-f635b7d2a1d8.info {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:48:48 devstack sudo[104843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-4cdb7d3f-6690-4383-b1ba-f635b7d2a1d8.info Jun 17 04:48:48 devstack sudo[104843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:48:49 devstack sudo[104843]: pam_unix(sudo:session): session closed for user root Jun 17 04:48:49 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-7d8c5fd5-f481-4494-aa70-ac39c1614254 tempest-CinderUnicodeTest-54061701 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-4cdb7d3f-6690-4383-b1ba-f635b7d2a1d8.info" returned: 0 in 0.699s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:48:49 devstack cinder-volume[92060]: WARNING cinder.volume.drivers.remotefs [None req-7d8c5fd5-f481-4494-aa70-ac39c1614254 tempest-CinderUnicodeTest-54061701 None] /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-4cdb7d3f-6690-4383-b1ba-f635b7d2a1d8.info is being set with open permissions: ugo+rw Jun 17 04:48:49 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-7d8c5fd5-f481-4494-aa70-ac39c1614254 tempest-CinderUnicodeTest-54061701 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-4cdb7d3f-6690-4383-b1ba-f635b7d2a1d8.info {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:48:49 devstack sudo[104848]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-4cdb7d3f-6690-4383-b1ba-f635b7d2a1d8.info Jun 17 04:48:49 devstack sudo[104848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:48:50 devstack sudo[104848]: pam_unix(sudo:session): session closed for user root Jun 17 04:48:50 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-7d8c5fd5-f481-4494-aa70-ac39c1614254 tempest-CinderUnicodeTest-54061701 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-4cdb7d3f-6690-4383-b1ba-f635b7d2a1d8.info" returned: 0 in 0.905s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:48:50 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-7d8c5fd5-f481-4494-aa70-ac39c1614254 tempest-CinderUnicodeTest-54061701 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.356s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 04:48:50 devstack cinder-volume[92060]: INFO cinder.volume.manager [None req-7d8c5fd5-f481-4494-aa70-ac39c1614254 tempest-CinderUnicodeTest-54061701 None] Create snapshot completed successfully Jun 17 04:48:51 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-7cc84f3c-0730-4ffe-969e-af18d605001e tempest-CinderUnicodeTest-54061701 None] Acquiring lock "cinder-18eec727-8b07-4b88-9f0f-7ff646cfd696-delete_snapshot" by "delete_snapshot" {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 04:48:51 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-7cc84f3c-0730-4ffe-969e-af18d605001e tempest-CinderUnicodeTest-54061701 None] Lock "cinder-18eec727-8b07-4b88-9f0f-7ff646cfd696-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 04:48:51 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-7cc84f3c-0730-4ffe-969e-af18d605001e tempest-CinderUnicodeTest-54061701 None] Acquiring lock "cinder-quobyte-4cdb7d3f-6690-4383-b1ba-f635b7d2a1d8" by "delete_snapshot" {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 04:48:51 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-7cc84f3c-0730-4ffe-969e-af18d605001e tempest-CinderUnicodeTest-54061701 None] Lock "cinder-quobyte-4cdb7d3f-6690-4383-b1ba-f635b7d2a1d8" acquired by "delete_snapshot" :: waited 0.026s {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 04:48:51 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-7cc84f3c-0730-4ffe-969e-af18d605001e tempest-CinderUnicodeTest-54061701 None] Acquiring lock "cinder-quobyte-18eec727-8b07-4b88-9f0f-7ff646cfd696" by "_delete_snapshot" {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 04:48:51 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-7cc84f3c-0730-4ffe-969e-af18d605001e tempest-CinderUnicodeTest-54061701 None] Lock "cinder-quobyte-18eec727-8b07-4b88-9f0f-7ff646cfd696" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 04:48:51 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.remotefs [None req-7cc84f3c-0730-4ffe-969e-af18d605001e tempest-CinderUnicodeTest-54061701 None] Deleting offline snapshot 18eec727-8b07-4b88-9f0f-7ff646cfd696 of volume 4cdb7d3f-6690-4383-b1ba-f635b7d2a1d8 {{(pid=92060) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 17 04:48:51 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.remotefs [None req-7cc84f3c-0730-4ffe-969e-af18d605001e tempest-CinderUnicodeTest-54061701 None] snapshot_file for this snap is: volume-4cdb7d3f-6690-4383-b1ba-f635b7d2a1d8.18eec727-8b07-4b88-9f0f-7ff646cfd696 {{(pid=92060) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 17 04:48:51 devstack cinder-volume[92060]: DEBUG oslo.privsep.daemon [-] privsep: reply[60312801-a1d8-445e-a17c-725b2b1ec7b2]: (4, 'qcow2') {{(pid=93130) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 04:48:51 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-7cc84f3c-0730-4ffe-969e-af18d605001e tempest-CinderUnicodeTest-54061701 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-4cdb7d3f-6690-4383-b1ba-f635b7d2a1d8.18eec727-8b07-4b88-9f0f-7ff646cfd696 {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:48:51 devstack sudo[104873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-4cdb7d3f-6690-4383-b1ba-f635b7d2a1d8.18eec727-8b07-4b88-9f0f-7ff646cfd696 Jun 17 04:48:51 devstack sudo[104873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:48:52 devstack cinder-volume[92060]: INFO cinder.volume.manager [req-e1e30317-d023-4417-bf97-bd26daeb4aab req-c0a94004-158b-4411-a310-3296e4001d3e tempest-TestInstancesWithCinderVolumes-729947751 None] Terminate volume connection completed successfully. Jun 17 04:48:52 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [req-e1e30317-d023-4417-bf97-bd26daeb4aab req-c0a94004-158b-4411-a310-3296e4001d3e tempest-TestInstancesWithCinderVolumes-729947751 None] Deleting attachment 3d8f994f-e839-4501-955a-250d0cce2a63. {{(pid=92060) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 17 04:48:52 devstack sudo[104873]: pam_unix(sudo:session): session closed for user root Jun 17 04:48:52 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-7cc84f3c-0730-4ffe-969e-af18d605001e tempest-CinderUnicodeTest-54061701 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-4cdb7d3f-6690-4383-b1ba-f635b7d2a1d8.18eec727-8b07-4b88-9f0f-7ff646cfd696" returned: 0 in 0.971s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:48:52 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.remotefs [None req-7cc84f3c-0730-4ffe-969e-af18d605001e tempest-CinderUnicodeTest-54061701 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4cdb7d3f-6690-4383-b1ba-f635b7d2a1d8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=92060) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 17 04:48:52 devstack cinder-volume[92060]: DEBUG oslo.privsep.daemon [-] privsep: reply[1662bad7-fe56-4f16-8a62-a283571cf367]: (4, 'qcow2') {{(pid=93130) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 04:48:52 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-7cc84f3c-0730-4ffe-969e-af18d605001e tempest-CinderUnicodeTest-54061701 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-4cdb7d3f-6690-4383-b1ba-f635b7d2a1d8 {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:48:52 devstack sudo[104884]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-4cdb7d3f-6690-4383-b1ba-f635b7d2a1d8 Jun 17 04:48:52 devstack sudo[104884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:48:53 devstack sudo[104884]: pam_unix(sudo:session): session closed for user root Jun 17 04:48:53 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-7cc84f3c-0730-4ffe-969e-af18d605001e tempest-CinderUnicodeTest-54061701 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-4cdb7d3f-6690-4383-b1ba-f635b7d2a1d8" returned: 0 in 0.970s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:48:53 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-7cc84f3c-0730-4ffe-969e-af18d605001e tempest-CinderUnicodeTest-54061701 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-4cdb7d3f-6690-4383-b1ba-f635b7d2a1d8.18eec727-8b07-4b88-9f0f-7ff646cfd696 {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:48:53 devstack sudo[104934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-4cdb7d3f-6690-4383-b1ba-f635b7d2a1d8.18eec727-8b07-4b88-9f0f-7ff646cfd696 Jun 17 04:48:53 devstack sudo[104934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:48:54 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-fff1a1bb-b608-4255-8c7f-6340bc49fed1 tempest-TestInstancesWithCinderVolumes-729947751 None] Acquiring lock "cinder-1bdbda56-f74d-4574-a81c-741cf74d19a9-delete_volume" by "delete_volume" {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 04:48:54 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-fff1a1bb-b608-4255-8c7f-6340bc49fed1 tempest-TestInstancesWithCinderVolumes-729947751 None] Lock "cinder-1bdbda56-f74d-4574-a81c-741cf74d19a9-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 04:48:54 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-fff1a1bb-b608-4255-8c7f-6340bc49fed1 tempest-TestInstancesWithCinderVolumes-729947751 None] Acquiring lock "cinder-quobyte-1bdbda56-f74d-4574-a81c-741cf74d19a9" by "delete_volume" {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 04:48:54 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-fff1a1bb-b608-4255-8c7f-6340bc49fed1 tempest-TestInstancesWithCinderVolumes-729947751 None] Lock "cinder-quobyte-1bdbda56-f74d-4574-a81c-741cf74d19a9" acquired by "delete_volume" :: waited 0.039s {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 04:48:54 devstack cinder-volume[92060]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3aec2df-de2d-496e-ade5-4917467ebd01]: (4, 'qcow2') {{(pid=93130) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 04:48:54 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-fff1a1bb-b608-4255-8c7f-6340bc49fed1 tempest-TestInstancesWithCinderVolumes-729947751 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-1bdbda56-f74d-4574-a81c-741cf74d19a9 {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:48:54 devstack sudo[104934]: pam_unix(sudo:session): session closed for user root Jun 17 04:48:54 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-7cc84f3c-0730-4ffe-969e-af18d605001e tempest-CinderUnicodeTest-54061701 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-4cdb7d3f-6690-4383-b1ba-f635b7d2a1d8.18eec727-8b07-4b88-9f0f-7ff646cfd696" returned: 0 in 1.224s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:48:54 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-7cc84f3c-0730-4ffe-969e-af18d605001e tempest-CinderUnicodeTest-54061701 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-4cdb7d3f-6690-4383-b1ba-f635b7d2a1d8.18eec727-8b07-4b88-9f0f-7ff646cfd696 {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:48:54 devstack sudo[104960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-4cdb7d3f-6690-4383-b1ba-f635b7d2a1d8.18eec727-8b07-4b88-9f0f-7ff646cfd696 Jun 17 04:48:54 devstack sudo[104960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:48:54 devstack sudo[104959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-1bdbda56-f74d-4574-a81c-741cf74d19a9 Jun 17 04:48:54 devstack sudo[104959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:48:55 devstack sudo[104959]: pam_unix(sudo:session): session closed for user root Jun 17 04:48:55 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-fff1a1bb-b608-4255-8c7f-6340bc49fed1 tempest-TestInstancesWithCinderVolumes-729947751 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-1bdbda56-f74d-4574-a81c-741cf74d19a9" returned: 0 in 1.106s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:48:55 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-fff1a1bb-b608-4255-8c7f-6340bc49fed1 tempest-TestInstancesWithCinderVolumes-729947751 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-1bdbda56-f74d-4574-a81c-741cf74d19a9 {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:48:55 devstack sudo[104960]: pam_unix(sudo:session): session closed for user root Jun 17 04:48:55 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-7cc84f3c-0730-4ffe-969e-af18d605001e tempest-CinderUnicodeTest-54061701 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-4cdb7d3f-6690-4383-b1ba-f635b7d2a1d8.18eec727-8b07-4b88-9f0f-7ff646cfd696" returned: 0 in 0.956s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:48:55 devstack sudo[104968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-1bdbda56-f74d-4574-a81c-741cf74d19a9 Jun 17 04:48:55 devstack sudo[104968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:48:55 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-7cc84f3c-0730-4ffe-969e-af18d605001e tempest-CinderUnicodeTest-54061701 None] Lock "cinder-quobyte-18eec727-8b07-4b88-9f0f-7ff646cfd696" released by "_delete_snapshot" :: held 4.264s {{(pid=92060) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 04:48:55 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-7cc84f3c-0730-4ffe-969e-af18d605001e tempest-CinderUnicodeTest-54061701 None] Lock "cinder-quobyte-4cdb7d3f-6690-4383-b1ba-f635b7d2a1d8" released by "delete_snapshot" :: held 4.299s {{(pid=92060) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 04:48:55 devstack cinder-volume[92060]: DEBUG cinder.quota [None req-7cc84f3c-0730-4ffe-969e-af18d605001e tempest-CinderUnicodeTest-54061701 None] Created reservations ['4d7348cb-cf06-4a75-8010-5672f2e9a0af', '3e867859-2ebe-49e9-b268-3be78360930d', '1bdc7823-99af-43f2-a13f-27d3348b7718', 'c624d455-873a-48f7-9494-9215d966093e'] {{(pid=92060) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 17 04:48:55 devstack cinder-volume[92060]: INFO cinder.volume.manager [None req-7cc84f3c-0730-4ffe-969e-af18d605001e tempest-CinderUnicodeTest-54061701 None] Delete snapshot completed successfully. Jun 17 04:48:55 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-7cc84f3c-0730-4ffe-969e-af18d605001e tempest-CinderUnicodeTest-54061701 None] Lock "cinder-18eec727-8b07-4b88-9f0f-7ff646cfd696-delete_snapshot" released by "delete_snapshot" :: held 4.531s {{(pid=92060) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 04:48:56 devstack sudo[104968]: pam_unix(sudo:session): session closed for user root Jun 17 04:48:56 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-fff1a1bb-b608-4255-8c7f-6340bc49fed1 tempest-TestInstancesWithCinderVolumes-729947751 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-1bdbda56-f74d-4574-a81c-741cf74d19a9" returned: 0 in 0.755s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:48:56 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-fff1a1bb-b608-4255-8c7f-6340bc49fed1 tempest-TestInstancesWithCinderVolumes-729947751 None] Lock "cinder-quobyte-1bdbda56-f74d-4574-a81c-741cf74d19a9" released by "delete_volume" :: held 1.921s {{(pid=92060) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 04:48:56 devstack cinder-volume[92060]: WARNING cinder.quota [None req-fff1a1bb-b608-4255-8c7f-6340bc49fed1 tempest-TestInstancesWithCinderVolumes-729947751 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-202414536-130703524 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-202414536-130703524, it is now deprecated. Please use the default quota class for default quota. Jun 17 04:48:56 devstack cinder-volume[92060]: WARNING cinder.quota [None req-fff1a1bb-b608-4255-8c7f-6340bc49fed1 tempest-TestInstancesWithCinderVolumes-729947751 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-202414536-130703524 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-202414536-130703524, it is now deprecated. Please use the default quota class for default quota. Jun 17 04:48:56 devstack cinder-volume[92060]: DEBUG cinder.quota [None req-fff1a1bb-b608-4255-8c7f-6340bc49fed1 tempest-TestInstancesWithCinderVolumes-729947751 None] Created reservations ['2c262d1b-2fb8-481e-a72e-7030f90bc301', '2fef312a-fb57-45e8-ab72-057d2547b55d', '36b5cc05-711e-4821-ac7a-b0dfc4e18fc5', 'acb349ff-a152-4bd2-88e5-4c5a253577d9'] {{(pid=92060) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 17 04:48:56 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-fff1a1bb-b608-4255-8c7f-6340bc49fed1 tempest-TestInstancesWithCinderVolumes-729947751 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 04:48:56 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-fff1a1bb-b608-4255-8c7f-6340bc49fed1 tempest-TestInstancesWithCinderVolumes-729947751 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 04:48:56 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-fff1a1bb-b608-4255-8c7f-6340bc49fed1 tempest-TestInstancesWithCinderVolumes-729947751 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588': None} {{(pid=92060) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 17 04:48:56 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-fff1a1bb-b608-4255-8c7f-6340bc49fed1 tempest-TestInstancesWithCinderVolumes-729947751 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588'] {{(pid=92060) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 17 04:48:56 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-fff1a1bb-b608-4255-8c7f-6340bc49fed1 tempest-TestInstancesWithCinderVolumes-729947751 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 04:48:56 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-fff1a1bb-b608-4255-8c7f-6340bc49fed1 tempest-TestInstancesWithCinderVolumes-729947751 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:48:56 devstack sudo[104971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a Jun 17 04:48:56 devstack sudo[104971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:48:56 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-b0674893-ebfe-495e-99c4-22393c7ccd40 tempest-CinderUnicodeTest-54061701 None] Acquiring lock "cinder-4cdb7d3f-6690-4383-b1ba-f635b7d2a1d8-delete_volume" by "delete_volume" {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 04:48:56 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-b0674893-ebfe-495e-99c4-22393c7ccd40 tempest-CinderUnicodeTest-54061701 None] Lock "cinder-4cdb7d3f-6690-4383-b1ba-f635b7d2a1d8-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 04:48:56 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-b0674893-ebfe-495e-99c4-22393c7ccd40 tempest-CinderUnicodeTest-54061701 None] Acquiring lock "cinder-quobyte-4cdb7d3f-6690-4383-b1ba-f635b7d2a1d8" by "delete_volume" {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 04:48:56 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-b0674893-ebfe-495e-99c4-22393c7ccd40 tempest-CinderUnicodeTest-54061701 None] Lock "cinder-quobyte-4cdb7d3f-6690-4383-b1ba-f635b7d2a1d8" acquired by "delete_volume" :: waited 0.031s {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 04:48:56 devstack cinder-volume[92060]: DEBUG oslo.privsep.daemon [-] privsep: reply[9da00af6-0b0a-424f-b982-bec9b9b8d896]: (4, 'qcow2') {{(pid=93130) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 04:48:56 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-b0674893-ebfe-495e-99c4-22393c7ccd40 tempest-CinderUnicodeTest-54061701 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-4cdb7d3f-6690-4383-b1ba-f635b7d2a1d8 {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:48:57 devstack sudo[104975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-4cdb7d3f-6690-4383-b1ba-f635b7d2a1d8 Jun 17 04:48:57 devstack sudo[104975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:48:57 devstack sudo[104971]: pam_unix(sudo:session): session closed for user root Jun 17 04:48:57 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-fff1a1bb-b608-4255-8c7f-6340bc49fed1 tempest-TestInstancesWithCinderVolumes-729947751 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a" returned: 0 in 0.713s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:48:57 devstack cinder-volume[92060]: DEBUG cinder.manager [None req-fff1a1bb-b608-4255-8c7f-6340bc49fed1 tempest-TestInstancesWithCinderVolumes-729947751 None] Notifying Schedulers of capabilities ... {{(pid=92060) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 17 04:48:57 devstack cinder-volume[92060]: INFO cinder.volume.manager [None req-fff1a1bb-b608-4255-8c7f-6340bc49fed1 tempest-TestInstancesWithCinderVolumes-729947751 None] Deleted volume successfully. Jun 17 04:48:57 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-fff1a1bb-b608-4255-8c7f-6340bc49fed1 tempest-TestInstancesWithCinderVolumes-729947751 None] Lock "cinder-1bdbda56-f74d-4574-a81c-741cf74d19a9-delete_volume" released by "delete_volume" :: held 2.990s {{(pid=92060) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 04:48:57 devstack sudo[104975]: pam_unix(sudo:session): session closed for user root Jun 17 04:48:57 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-b0674893-ebfe-495e-99c4-22393c7ccd40 tempest-CinderUnicodeTest-54061701 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-4cdb7d3f-6690-4383-b1ba-f635b7d2a1d8" returned: 0 in 0.936s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:48:57 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-b0674893-ebfe-495e-99c4-22393c7ccd40 tempest-CinderUnicodeTest-54061701 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-4cdb7d3f-6690-4383-b1ba-f635b7d2a1d8 {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:48:57 devstack sudo[104998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-4cdb7d3f-6690-4383-b1ba-f635b7d2a1d8 Jun 17 04:48:57 devstack sudo[104998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:48:58 devstack sudo[104998]: pam_unix(sudo:session): session closed for user root Jun 17 04:48:58 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-b0674893-ebfe-495e-99c4-22393c7ccd40 tempest-CinderUnicodeTest-54061701 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-4cdb7d3f-6690-4383-b1ba-f635b7d2a1d8" returned: 0 in 0.640s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:48:58 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-b0674893-ebfe-495e-99c4-22393c7ccd40 tempest-CinderUnicodeTest-54061701 None] Lock "cinder-quobyte-4cdb7d3f-6690-4383-b1ba-f635b7d2a1d8" released by "delete_volume" :: held 1.717s {{(pid=92060) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 04:48:58 devstack cinder-volume[92060]: DEBUG cinder.quota [None req-b0674893-ebfe-495e-99c4-22393c7ccd40 tempest-CinderUnicodeTest-54061701 None] Created reservations ['c90e19db-1919-405b-9691-48d99a41a07a', '11e8ee3e-917b-4fb6-a5fa-912878c631a3', 'ad9316bd-99ce-4eac-b968-b91e51716323', '2e5de8c5-4c12-4db8-9127-d69b2f7bd30c'] {{(pid=92060) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 17 04:48:58 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-b0674893-ebfe-495e-99c4-22393c7ccd40 tempest-CinderUnicodeTest-54061701 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 04:48:58 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-b0674893-ebfe-495e-99c4-22393c7ccd40 tempest-CinderUnicodeTest-54061701 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 04:48:58 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-b0674893-ebfe-495e-99c4-22393c7ccd40 tempest-CinderUnicodeTest-54061701 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588': None} {{(pid=92060) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 17 04:48:58 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-b0674893-ebfe-495e-99c4-22393c7ccd40 tempest-CinderUnicodeTest-54061701 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588'] {{(pid=92060) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 17 04:48:58 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-b0674893-ebfe-495e-99c4-22393c7ccd40 tempest-CinderUnicodeTest-54061701 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 04:48:58 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-b0674893-ebfe-495e-99c4-22393c7ccd40 tempest-CinderUnicodeTest-54061701 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:48:58 devstack sudo[105003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a Jun 17 04:48:58 devstack sudo[105003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:48:58 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-745dc9fb-71a7-4519-bba3-4fa12ce26ea9 tempest-CinderUnicodeTest-54061701 None] Acquiring lock "cinder-02266bff-0ef4-4da3-b86b-36da8322f723-delete_volume" by "delete_volume" {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 04:48:58 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-745dc9fb-71a7-4519-bba3-4fa12ce26ea9 tempest-CinderUnicodeTest-54061701 None] Lock "cinder-02266bff-0ef4-4da3-b86b-36da8322f723-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 04:48:59 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-745dc9fb-71a7-4519-bba3-4fa12ce26ea9 tempest-CinderUnicodeTest-54061701 None] Acquiring lock "cinder-quobyte-02266bff-0ef4-4da3-b86b-36da8322f723" by "delete_volume" {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 04:48:59 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-745dc9fb-71a7-4519-bba3-4fa12ce26ea9 tempest-CinderUnicodeTest-54061701 None] Lock "cinder-quobyte-02266bff-0ef4-4da3-b86b-36da8322f723" acquired by "delete_volume" :: waited 0.027s {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 04:48:59 devstack cinder-volume[92060]: DEBUG oslo.privsep.daemon [-] privsep: reply[edbb90fa-2854-4045-949f-f3661bd975c7]: (4, 'qcow2') {{(pid=93130) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 04:48:59 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-745dc9fb-71a7-4519-bba3-4fa12ce26ea9 tempest-CinderUnicodeTest-54061701 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-02266bff-0ef4-4da3-b86b-36da8322f723 {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:48:59 devstack sudo[105005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-02266bff-0ef4-4da3-b86b-36da8322f723 Jun 17 04:48:59 devstack sudo[105005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:48:59 devstack sudo[105003]: pam_unix(sudo:session): session closed for user root Jun 17 04:48:59 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-b0674893-ebfe-495e-99c4-22393c7ccd40 tempest-CinderUnicodeTest-54061701 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a" returned: 0 in 0.754s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:48:59 devstack cinder-volume[92060]: DEBUG cinder.manager [None req-b0674893-ebfe-495e-99c4-22393c7ccd40 tempest-CinderUnicodeTest-54061701 None] Notifying Schedulers of capabilities ... {{(pid=92060) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 17 04:48:59 devstack cinder-volume[92060]: INFO cinder.volume.manager [None req-b0674893-ebfe-495e-99c4-22393c7ccd40 tempest-CinderUnicodeTest-54061701 None] Deleted volume successfully. Jun 17 04:48:59 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-b0674893-ebfe-495e-99c4-22393c7ccd40 tempest-CinderUnicodeTest-54061701 None] Lock "cinder-4cdb7d3f-6690-4383-b1ba-f635b7d2a1d8-delete_volume" released by "delete_volume" :: held 2.775s {{(pid=92060) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 04:48:59 devstack cinder-volume[92060]: INFO cinder.volume.manager [req-a13c686f-fe8f-4477-bda9-e3ad36ca30b8 req-33d7acb0-79c4-4045-b5b2-82beb686438f tempest-TestInstancesWithCinderVolumes-729947751 None] Terminate volume connection completed successfully. Jun 17 04:48:59 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [req-a13c686f-fe8f-4477-bda9-e3ad36ca30b8 req-33d7acb0-79c4-4045-b5b2-82beb686438f tempest-TestInstancesWithCinderVolumes-729947751 None] Deleting attachment d8c52236-20a7-4987-bd22-f36e97434b91. {{(pid=92060) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 17 04:48:59 devstack sudo[105005]: pam_unix(sudo:session): session closed for user root Jun 17 04:49:00 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-745dc9fb-71a7-4519-bba3-4fa12ce26ea9 tempest-CinderUnicodeTest-54061701 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-02266bff-0ef4-4da3-b86b-36da8322f723" returned: 0 in 0.872s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:49:00 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-745dc9fb-71a7-4519-bba3-4fa12ce26ea9 tempest-CinderUnicodeTest-54061701 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-02266bff-0ef4-4da3-b86b-36da8322f723 {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:49:00 devstack sudo[105013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-02266bff-0ef4-4da3-b86b-36da8322f723 Jun 17 04:49:00 devstack sudo[105013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:49:00 devstack sudo[105013]: pam_unix(sudo:session): session closed for user root Jun 17 04:49:00 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-745dc9fb-71a7-4519-bba3-4fa12ce26ea9 tempest-CinderUnicodeTest-54061701 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-02266bff-0ef4-4da3-b86b-36da8322f723" returned: 0 in 0.755s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:49:00 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-745dc9fb-71a7-4519-bba3-4fa12ce26ea9 tempest-CinderUnicodeTest-54061701 None] Lock "cinder-quobyte-02266bff-0ef4-4da3-b86b-36da8322f723" released by "delete_volume" :: held 1.684s {{(pid=92060) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 04:49:00 devstack cinder-volume[92060]: DEBUG cinder.quota [None req-745dc9fb-71a7-4519-bba3-4fa12ce26ea9 tempest-CinderUnicodeTest-54061701 None] Created reservations ['087cb811-e6c5-4536-a486-e554ab0eee69', '516643ea-84a4-467d-9546-52b26b94ab6b', '6cd4ab86-f797-4add-842c-54e3642ef27f', '6bbb8241-ef2f-48c6-95c1-159556e84297'] {{(pid=92060) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 17 04:49:00 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-745dc9fb-71a7-4519-bba3-4fa12ce26ea9 tempest-CinderUnicodeTest-54061701 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 04:49:00 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-745dc9fb-71a7-4519-bba3-4fa12ce26ea9 tempest-CinderUnicodeTest-54061701 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 04:49:00 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-745dc9fb-71a7-4519-bba3-4fa12ce26ea9 tempest-CinderUnicodeTest-54061701 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588': None} {{(pid=92060) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 17 04:49:00 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-745dc9fb-71a7-4519-bba3-4fa12ce26ea9 tempest-CinderUnicodeTest-54061701 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588'] {{(pid=92060) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 17 04:49:00 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-745dc9fb-71a7-4519-bba3-4fa12ce26ea9 tempest-CinderUnicodeTest-54061701 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 04:49:00 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-745dc9fb-71a7-4519-bba3-4fa12ce26ea9 tempest-CinderUnicodeTest-54061701 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:49:01 devstack sudo[105019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a Jun 17 04:49:01 devstack sudo[105019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:49:02 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-94e9f012-7b19-4598-b986-435ce8b6600f tempest-TestInstancesWithCinderVolumes-729947751 None] Acquiring lock "cinder-7ad20cd3-2204-4cad-8706-e9d0e0ae3442-delete_volume" by "delete_volume" {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 04:49:02 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-94e9f012-7b19-4598-b986-435ce8b6600f tempest-TestInstancesWithCinderVolumes-729947751 None] Lock "cinder-7ad20cd3-2204-4cad-8706-e9d0e0ae3442-delete_volume" acquired by "delete_volume" :: waited 0.071s {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 04:49:02 devstack sudo[105019]: pam_unix(sudo:session): session closed for user root Jun 17 04:49:02 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-745dc9fb-71a7-4519-bba3-4fa12ce26ea9 tempest-CinderUnicodeTest-54061701 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a" returned: 0 in 1.236s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:49:02 devstack cinder-volume[92060]: DEBUG cinder.manager [None req-745dc9fb-71a7-4519-bba3-4fa12ce26ea9 tempest-CinderUnicodeTest-54061701 None] Notifying Schedulers of capabilities ... {{(pid=92060) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 17 04:49:02 devstack cinder-volume[92060]: INFO cinder.volume.manager [None req-745dc9fb-71a7-4519-bba3-4fa12ce26ea9 tempest-CinderUnicodeTest-54061701 None] Deleted volume successfully. Jun 17 04:49:02 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-94e9f012-7b19-4598-b986-435ce8b6600f tempest-TestInstancesWithCinderVolumes-729947751 None] Acquiring lock "cinder-quobyte-7ad20cd3-2204-4cad-8706-e9d0e0ae3442" by "delete_volume" {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 04:49:02 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-745dc9fb-71a7-4519-bba3-4fa12ce26ea9 tempest-CinderUnicodeTest-54061701 None] Lock "cinder-02266bff-0ef4-4da3-b86b-36da8322f723-delete_volume" released by "delete_volume" :: held 3.393s {{(pid=92060) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 04:49:02 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-94e9f012-7b19-4598-b986-435ce8b6600f tempest-TestInstancesWithCinderVolumes-729947751 None] Lock "cinder-quobyte-7ad20cd3-2204-4cad-8706-e9d0e0ae3442" acquired by "delete_volume" :: waited 0.058s {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 04:49:02 devstack cinder-volume[92060]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c33efd9-9fe9-43a2-93e6-8473da01a1ea]: (4, 'qcow2') {{(pid=93130) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 04:49:02 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-94e9f012-7b19-4598-b986-435ce8b6600f tempest-TestInstancesWithCinderVolumes-729947751 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-7ad20cd3-2204-4cad-8706-e9d0e0ae3442 {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:49:02 devstack sudo[105023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-7ad20cd3-2204-4cad-8706-e9d0e0ae3442 Jun 17 04:49:02 devstack sudo[105023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:49:03 devstack sudo[105023]: pam_unix(sudo:session): session closed for user root Jun 17 04:49:03 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-94e9f012-7b19-4598-b986-435ce8b6600f tempest-TestInstancesWithCinderVolumes-729947751 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-7ad20cd3-2204-4cad-8706-e9d0e0ae3442" returned: 0 in 0.968s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:49:03 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-94e9f012-7b19-4598-b986-435ce8b6600f tempest-TestInstancesWithCinderVolumes-729947751 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-7ad20cd3-2204-4cad-8706-e9d0e0ae3442 {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:49:03 devstack sudo[105028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-7ad20cd3-2204-4cad-8706-e9d0e0ae3442 Jun 17 04:49:03 devstack sudo[105028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:49:04 devstack sudo[105028]: pam_unix(sudo:session): session closed for user root Jun 17 04:49:04 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-94e9f012-7b19-4598-b986-435ce8b6600f tempest-TestInstancesWithCinderVolumes-729947751 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-7ad20cd3-2204-4cad-8706-e9d0e0ae3442" returned: 0 in 0.872s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:49:04 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-94e9f012-7b19-4598-b986-435ce8b6600f tempest-TestInstancesWithCinderVolumes-729947751 None] Lock "cinder-quobyte-7ad20cd3-2204-4cad-8706-e9d0e0ae3442" released by "delete_volume" :: held 1.939s {{(pid=92060) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 04:49:04 devstack cinder-volume[92060]: WARNING cinder.quota [None req-94e9f012-7b19-4598-b986-435ce8b6600f tempest-TestInstancesWithCinderVolumes-729947751 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-555190491-2004869605 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-555190491-2004869605, it is now deprecated. Please use the default quota class for default quota. Jun 17 04:49:04 devstack cinder-volume[92060]: WARNING cinder.quota [None req-94e9f012-7b19-4598-b986-435ce8b6600f tempest-TestInstancesWithCinderVolumes-729947751 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-555190491-2004869605 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-555190491-2004869605, it is now deprecated. Please use the default quota class for default quota. Jun 17 04:49:04 devstack cinder-volume[92060]: DEBUG cinder.quota [None req-94e9f012-7b19-4598-b986-435ce8b6600f tempest-TestInstancesWithCinderVolumes-729947751 None] Created reservations ['d807c551-897a-4bc6-9f8e-b8210bdf2114', '3abdf643-9a3c-4533-b30d-a303388897aa', '05443282-4210-41b2-b561-6dd2cb2a0f64', 'f029541f-91ec-4a93-8ea2-ba714d5198e3'] {{(pid=92060) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 17 04:49:04 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-94e9f012-7b19-4598-b986-435ce8b6600f tempest-TestInstancesWithCinderVolumes-729947751 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 04:49:04 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-94e9f012-7b19-4598-b986-435ce8b6600f tempest-TestInstancesWithCinderVolumes-729947751 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 04:49:04 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-94e9f012-7b19-4598-b986-435ce8b6600f tempest-TestInstancesWithCinderVolumes-729947751 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588': None} {{(pid=92060) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 17 04:49:04 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-94e9f012-7b19-4598-b986-435ce8b6600f tempest-TestInstancesWithCinderVolumes-729947751 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588'] {{(pid=92060) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 17 04:49:04 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-94e9f012-7b19-4598-b986-435ce8b6600f tempest-TestInstancesWithCinderVolumes-729947751 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 04:49:04 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-94e9f012-7b19-4598-b986-435ce8b6600f tempest-TestInstancesWithCinderVolumes-729947751 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:49:04 devstack sudo[105031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a Jun 17 04:49:04 devstack sudo[105031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:49:05 devstack sudo[105031]: pam_unix(sudo:session): session closed for user root Jun 17 04:49:05 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-94e9f012-7b19-4598-b986-435ce8b6600f tempest-TestInstancesWithCinderVolumes-729947751 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a" returned: 0 in 0.731s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:49:05 devstack cinder-volume[92060]: DEBUG cinder.manager [None req-94e9f012-7b19-4598-b986-435ce8b6600f tempest-TestInstancesWithCinderVolumes-729947751 None] Notifying Schedulers of capabilities ... {{(pid=92060) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 17 04:49:05 devstack cinder-volume[92060]: INFO cinder.volume.manager [None req-94e9f012-7b19-4598-b986-435ce8b6600f tempest-TestInstancesWithCinderVolumes-729947751 None] Deleted volume successfully. Jun 17 04:49:05 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-94e9f012-7b19-4598-b986-435ce8b6600f tempest-TestInstancesWithCinderVolumes-729947751 None] Lock "cinder-7ad20cd3-2204-4cad-8706-e9d0e0ae3442-delete_volume" released by "delete_volume" :: held 3.277s {{(pid=92060) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 04:49:10 devstack cinder-volume[92060]: DEBUG cinder.volume.flows.manager.create_volume [None req-a9acaffa-4c3d-46c2-b215-1a69be70ba7a tempest-SnapshotDependencyTests-1015838131 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92060) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 17 04:49:10 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-a9acaffa-4c3d-46c2-b215-1a69be70ba7a tempest-SnapshotDependencyTests-1015838131 None] Flow 'volume_create_manager' (4cfee421-741e-4cd6-b8d3-9a2c408f7202) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 17 04:49:10 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-a9acaffa-4c3d-46c2-b215-1a69be70ba7a tempest-SnapshotDependencyTests-1015838131 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bc720ba8-1e96-4b72-8765-23834ae7ab57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:49:10 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-a9acaffa-4c3d-46c2-b215-1a69be70ba7a tempest-SnapshotDependencyTests-1015838131 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bc720ba8-1e96-4b72-8765-23834ae7ab57) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-17T02:49:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1853414468',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b58f6a4a-6daf-4229-b8d8-3042ae708c7d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d82ccf847fad42cdb6938812bddc33ca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T02:49:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T02:49:10Z,use_quota=True,user_id='2d13570973334c239ade3691dec34a8d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aad9ce24-93f9-41a6-baa1-5125964f96d1),volume_type_id=aad9ce24-93f9-41a6-baa1-5125964f96d1)' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:49:10 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-a9acaffa-4c3d-46c2-b215-1a69be70ba7a tempest-SnapshotDependencyTests-1015838131 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (77192280-16ae-4e0d-bd28-f3b99da193e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:49:10 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-a9acaffa-4c3d-46c2-b215-1a69be70ba7a tempest-SnapshotDependencyTests-1015838131 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (77192280-16ae-4e0d-bd28-f3b99da193e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:49:10 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-a9acaffa-4c3d-46c2-b215-1a69be70ba7a tempest-SnapshotDependencyTests-1015838131 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cdecaeee-9796-4282-86b0-6663630066b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:49:10 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-a9acaffa-4c3d-46c2-b215-1a69be70ba7a tempest-SnapshotDependencyTests-1015838131 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cdecaeee-9796-4282-86b0-6663630066b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b58f6a4a-6daf-4229-b8d8-3042ae708c7d', 'volume_name': 'volume-b58f6a4a-6daf-4229-b8d8-3042ae708c7d', 'volume_size': 1}' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:49:10 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-a9acaffa-4c3d-46c2-b215-1a69be70ba7a tempest-SnapshotDependencyTests-1015838131 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e60c4d3e-35a9-4af8-87c8-2ed736f9a4cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:49:10 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-a9acaffa-4c3d-46c2-b215-1a69be70ba7a tempest-SnapshotDependencyTests-1015838131 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e60c4d3e-35a9-4af8-87c8-2ed736f9a4cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:49:10 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-a9acaffa-4c3d-46c2-b215-1a69be70ba7a tempest-SnapshotDependencyTests-1015838131 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (112af5f9-a907-4b6c-81ef-0b2b5e18ea25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:49:10 devstack cinder-volume[92060]: INFO cinder.volume.flows.manager.create_volume [None req-a9acaffa-4c3d-46c2-b215-1a69be70ba7a tempest-SnapshotDependencyTests-1015838131 None] Volume b58f6a4a-6daf-4229-b8d8-3042ae708c7d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b58f6a4a-6daf-4229-b8d8-3042ae708c7d', 'volume_size': 1} Jun 17 04:49:10 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-a9acaffa-4c3d-46c2-b215-1a69be70ba7a tempest-SnapshotDependencyTests-1015838131 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 04:49:10 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-a9acaffa-4c3d-46c2-b215-1a69be70ba7a tempest-SnapshotDependencyTests-1015838131 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 04:49:10 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-a9acaffa-4c3d-46c2-b215-1a69be70ba7a tempest-SnapshotDependencyTests-1015838131 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-17T02:49:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1853414468',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b58f6a4a-6daf-4229-b8d8-3042ae708c7d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d82ccf847fad42cdb6938812bddc33ca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T02:49:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T02:49:10Z,use_quota=True,user_id='2d13570973334c239ade3691dec34a8d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aad9ce24-93f9-41a6-baa1-5125964f96d1),volume_type_id=aad9ce24-93f9-41a6-baa1-5125964f96d1)}" {{(pid=92060) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 17 04:49:10 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.remotefs [None req-a9acaffa-4c3d-46c2-b215-1a69be70ba7a tempest-SnapshotDependencyTests-1015838131 None] Creating volume b58f6a4a-6daf-4229-b8d8-3042ae708c7d {{(pid=92060) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 17 04:49:10 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-a9acaffa-4c3d-46c2-b215-1a69be70ba7a tempest-SnapshotDependencyTests-1015838131 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 04:49:10 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-a9acaffa-4c3d-46c2-b215-1a69be70ba7a tempest-SnapshotDependencyTests-1015838131 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 04:49:10 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-a9acaffa-4c3d-46c2-b215-1a69be70ba7a tempest-SnapshotDependencyTests-1015838131 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588': None} {{(pid=92060) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 17 04:49:10 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-a9acaffa-4c3d-46c2-b215-1a69be70ba7a tempest-SnapshotDependencyTests-1015838131 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588'] {{(pid=92060) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 17 04:49:10 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-a9acaffa-4c3d-46c2-b215-1a69be70ba7a tempest-SnapshotDependencyTests-1015838131 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 04:49:10 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-a9acaffa-4c3d-46c2-b215-1a69be70ba7a tempest-SnapshotDependencyTests-1015838131 None] Selected osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588 as target Quobyte volume. {{(pid=92060) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 17 04:49:10 devstack cinder-volume[92060]: INFO cinder.volume.drivers.remotefs [None req-a9acaffa-4c3d-46c2-b215-1a69be70ba7a tempest-SnapshotDependencyTests-1015838131 None] casted to osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588 Jun 17 04:49:10 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-a9acaffa-4c3d-46c2-b215-1a69be70ba7a tempest-SnapshotDependencyTests-1015838131 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-b58f6a4a-6daf-4229-b8d8-3042ae708c7d 1073741824 {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:49:10 devstack sudo[105081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-b58f6a4a-6daf-4229-b8d8-3042ae708c7d 1073741824 Jun 17 04:49:10 devstack sudo[105081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:49:11 devstack sudo[105081]: pam_unix(sudo:session): session closed for user root Jun 17 04:49:11 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-a9acaffa-4c3d-46c2-b215-1a69be70ba7a tempest-SnapshotDependencyTests-1015838131 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-b58f6a4a-6daf-4229-b8d8-3042ae708c7d 1073741824" returned: 0 in 1.114s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:49:11 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-a9acaffa-4c3d-46c2-b215-1a69be70ba7a tempest-SnapshotDependencyTests-1015838131 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-b58f6a4a-6daf-4229-b8d8-3042ae708c7d {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:49:11 devstack sudo[105089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-b58f6a4a-6daf-4229-b8d8-3042ae708c7d Jun 17 04:49:11 devstack sudo[105089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:49:11 devstack cinder-volume[92060]: INFO cinder.volume.manager [req-358ecb1e-d7be-41e0-b251-0d04fc375096 req-d3c913e0-3ec4-4acf-b9a1-0c4023a49204 tempest-TestInstancesWithCinderVolumes-729947751 None] Terminate volume connection completed successfully. Jun 17 04:49:11 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [req-358ecb1e-d7be-41e0-b251-0d04fc375096 req-d3c913e0-3ec4-4acf-b9a1-0c4023a49204 tempest-TestInstancesWithCinderVolumes-729947751 None] Deleting attachment 77b6fd2b-3523-45f6-ac80-a3b5aee9b041. {{(pid=92060) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 17 04:49:12 devstack sudo[105089]: pam_unix(sudo:session): session closed for user root Jun 17 04:49:12 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-a9acaffa-4c3d-46c2-b215-1a69be70ba7a tempest-SnapshotDependencyTests-1015838131 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-b58f6a4a-6daf-4229-b8d8-3042ae708c7d" returned: 0 in 0.630s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:49:12 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-a9acaffa-4c3d-46c2-b215-1a69be70ba7a tempest-SnapshotDependencyTests-1015838131 None] <== create_volume: return (1811ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588'} {{(pid=92060) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 17 04:49:12 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-a9acaffa-4c3d-46c2-b215-1a69be70ba7a tempest-SnapshotDependencyTests-1015838131 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.814s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 04:49:12 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-a9acaffa-4c3d-46c2-b215-1a69be70ba7a tempest-SnapshotDependencyTests-1015838131 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (112af5f9-a907-4b6c-81ef-0b2b5e18ea25) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b58f6a4a-6daf-4229-b8d8-3042ae708c7d', 'volume_size': 1}' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:49:12 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-a9acaffa-4c3d-46c2-b215-1a69be70ba7a tempest-SnapshotDependencyTests-1015838131 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dcf171ca-fe84-438e-a8a7-6a525cf1f877) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:49:12 devstack cinder-volume[92060]: INFO cinder.volume.flows.manager.create_volume [None req-a9acaffa-4c3d-46c2-b215-1a69be70ba7a tempest-SnapshotDependencyTests-1015838131 None] Volume volume-b58f6a4a-6daf-4229-b8d8-3042ae708c7d (b58f6a4a-6daf-4229-b8d8-3042ae708c7d): created successfully Jun 17 04:49:12 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-a9acaffa-4c3d-46c2-b215-1a69be70ba7a tempest-SnapshotDependencyTests-1015838131 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dcf171ca-fe84-438e-a8a7-6a525cf1f877) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:49:12 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-a9acaffa-4c3d-46c2-b215-1a69be70ba7a tempest-SnapshotDependencyTests-1015838131 None] Flow 'volume_create_manager' (4cfee421-741e-4cd6-b8d3-9a2c408f7202) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92060) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 17 04:49:12 devstack cinder-volume[92060]: INFO cinder.volume.manager [None req-a9acaffa-4c3d-46c2-b215-1a69be70ba7a tempest-SnapshotDependencyTests-1015838131 None] Created volume successfully. Jun 17 04:49:13 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-448f0673-1459-43d1-8522-555fc9d626ba tempest-SnapshotDependencyTests-1015838131 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 04:49:13 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-448f0673-1459-43d1-8522-555fc9d626ba tempest-SnapshotDependencyTests-1015838131 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 04:49:13 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.remotefs [None req-448f0673-1459-43d1-8522-555fc9d626ba tempest-SnapshotDependencyTests-1015838131 None] Creating offline snapshot d837d477-0ae3-4769-bea2-c65f74a28191 of volume b58f6a4a-6daf-4229-b8d8-3042ae708c7d {{(pid=92060) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 17 04:49:13 devstack cinder-volume[92060]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f5dce5a-ed3b-473a-b6cf-9c2dce88d327]: (4, 'qcow2') {{(pid=93130) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 04:49:13 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-448f0673-1459-43d1-8522-555fc9d626ba tempest-SnapshotDependencyTests-1015838131 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-b58f6a4a-6daf-4229-b8d8-3042ae708c7d {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:49:13 devstack sudo[105111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-b58f6a4a-6daf-4229-b8d8-3042ae708c7d Jun 17 04:49:13 devstack sudo[105111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:49:14 devstack sudo[105111]: pam_unix(sudo:session): session closed for user root Jun 17 04:49:14 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-448f0673-1459-43d1-8522-555fc9d626ba tempest-SnapshotDependencyTests-1015838131 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-b58f6a4a-6daf-4229-b8d8-3042ae708c7d" returned: 0 in 0.708s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:49:14 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-448f0673-1459-43d1-8522-555fc9d626ba tempest-SnapshotDependencyTests-1015838131 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-b58f6a4a-6daf-4229-b8d8-3042ae708c7d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-b58f6a4a-6daf-4229-b8d8-3042ae708c7d.d837d477-0ae3-4769-bea2-c65f74a28191 1G {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:49:14 devstack sudo[105117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-b58f6a4a-6daf-4229-b8d8-3042ae708c7d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-b58f6a4a-6daf-4229-b8d8-3042ae708c7d.d837d477-0ae3-4769-bea2-c65f74a28191 1G Jun 17 04:49:14 devstack sudo[105117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:49:14 devstack sudo[105117]: pam_unix(sudo:session): session closed for user root Jun 17 04:49:14 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-448f0673-1459-43d1-8522-555fc9d626ba tempest-SnapshotDependencyTests-1015838131 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-b58f6a4a-6daf-4229-b8d8-3042ae708c7d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-b58f6a4a-6daf-4229-b8d8-3042ae708c7d.d837d477-0ae3-4769-bea2-c65f74a28191 1G" returned: 0 in 0.723s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:49:14 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-448f0673-1459-43d1-8522-555fc9d626ba tempest-SnapshotDependencyTests-1015838131 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b58f6a4a-6daf-4229-b8d8-3042ae708c7d -F qcow2 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-b58f6a4a-6daf-4229-b8d8-3042ae708c7d.d837d477-0ae3-4769-bea2-c65f74a28191 {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:49:14 devstack sudo[105122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b58f6a4a-6daf-4229-b8d8-3042ae708c7d -F qcow2 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-b58f6a4a-6daf-4229-b8d8-3042ae708c7d.d837d477-0ae3-4769-bea2-c65f74a28191 Jun 17 04:49:14 devstack sudo[105122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:49:15 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-c1a73776-8d0e-42c0-a619-4432027d1f10 tempest-TestInstancesWithCinderVolumes-729947751 None] Acquiring lock "cinder-7dc2c78d-7e4c-4e39-b276-4c1e36d07215-delete_volume" by "delete_volume" {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 04:49:15 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-c1a73776-8d0e-42c0-a619-4432027d1f10 tempest-TestInstancesWithCinderVolumes-729947751 None] Lock "cinder-7dc2c78d-7e4c-4e39-b276-4c1e36d07215-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 04:49:15 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-c1a73776-8d0e-42c0-a619-4432027d1f10 tempest-TestInstancesWithCinderVolumes-729947751 None] Acquiring lock "cinder-quobyte-7dc2c78d-7e4c-4e39-b276-4c1e36d07215" by "delete_volume" {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 04:49:15 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-c1a73776-8d0e-42c0-a619-4432027d1f10 tempest-TestInstancesWithCinderVolumes-729947751 None] Lock "cinder-quobyte-7dc2c78d-7e4c-4e39-b276-4c1e36d07215" acquired by "delete_volume" :: waited 0.034s {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 04:49:15 devstack cinder-volume[92060]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1e521c8-aa1a-4ad2-9ad7-64312b5614b5]: (4, 'raw') {{(pid=93130) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 04:49:15 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-c1a73776-8d0e-42c0-a619-4432027d1f10 tempest-TestInstancesWithCinderVolumes-729947751 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-7dc2c78d-7e4c-4e39-b276-4c1e36d07215 {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:49:15 devstack sudo[105127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-7dc2c78d-7e4c-4e39-b276-4c1e36d07215 Jun 17 04:49:15 devstack sudo[105127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:49:15 devstack sudo[105122]: pam_unix(sudo:session): session closed for user root Jun 17 04:49:15 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-448f0673-1459-43d1-8522-555fc9d626ba tempest-SnapshotDependencyTests-1015838131 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b58f6a4a-6daf-4229-b8d8-3042ae708c7d -F qcow2 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-b58f6a4a-6daf-4229-b8d8-3042ae708c7d.d837d477-0ae3-4769-bea2-c65f74a28191" returned: 0 in 0.741s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:49:15 devstack cinder-volume[92060]: WARNING cinder.volume.drivers.remotefs [None req-448f0673-1459-43d1-8522-555fc9d626ba tempest-SnapshotDependencyTests-1015838131 None] /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-b58f6a4a-6daf-4229-b8d8-3042ae708c7d.d837d477-0ae3-4769-bea2-c65f74a28191 is being set with open permissions: ugo+rw Jun 17 04:49:15 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-448f0673-1459-43d1-8522-555fc9d626ba tempest-SnapshotDependencyTests-1015838131 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-b58f6a4a-6daf-4229-b8d8-3042ae708c7d.d837d477-0ae3-4769-bea2-c65f74a28191 {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:49:15 devstack sudo[105130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-b58f6a4a-6daf-4229-b8d8-3042ae708c7d.d837d477-0ae3-4769-bea2-c65f74a28191 Jun 17 04:49:15 devstack sudo[105130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:49:16 devstack sudo[105127]: pam_unix(sudo:session): session closed for user root Jun 17 04:49:16 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-c1a73776-8d0e-42c0-a619-4432027d1f10 tempest-TestInstancesWithCinderVolumes-729947751 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-7dc2c78d-7e4c-4e39-b276-4c1e36d07215" returned: 0 in 0.696s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:49:16 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-c1a73776-8d0e-42c0-a619-4432027d1f10 tempest-TestInstancesWithCinderVolumes-729947751 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-7dc2c78d-7e4c-4e39-b276-4c1e36d07215 {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:49:16 devstack sudo[105130]: pam_unix(sudo:session): session closed for user root Jun 17 04:49:16 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-448f0673-1459-43d1-8522-555fc9d626ba tempest-SnapshotDependencyTests-1015838131 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-b58f6a4a-6daf-4229-b8d8-3042ae708c7d.d837d477-0ae3-4769-bea2-c65f74a28191" returned: 0 in 0.595s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:49:16 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-448f0673-1459-43d1-8522-555fc9d626ba tempest-SnapshotDependencyTests-1015838131 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-b58f6a4a-6daf-4229-b8d8-3042ae708c7d.info {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:49:16 devstack sudo[105136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-b58f6a4a-6daf-4229-b8d8-3042ae708c7d.info Jun 17 04:49:16 devstack sudo[105136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:49:16 devstack sudo[105135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-7dc2c78d-7e4c-4e39-b276-4c1e36d07215 Jun 17 04:49:16 devstack sudo[105135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:49:16 devstack sudo[105136]: pam_unix(sudo:session): session closed for user root Jun 17 04:49:16 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-448f0673-1459-43d1-8522-555fc9d626ba tempest-SnapshotDependencyTests-1015838131 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-b58f6a4a-6daf-4229-b8d8-3042ae708c7d.info" returned: 0 in 0.582s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:49:16 devstack cinder-volume[92060]: WARNING cinder.volume.drivers.remotefs [None req-448f0673-1459-43d1-8522-555fc9d626ba tempest-SnapshotDependencyTests-1015838131 None] /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-b58f6a4a-6daf-4229-b8d8-3042ae708c7d.info is being set with open permissions: ugo+rw Jun 17 04:49:16 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-448f0673-1459-43d1-8522-555fc9d626ba tempest-SnapshotDependencyTests-1015838131 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-b58f6a4a-6daf-4229-b8d8-3042ae708c7d.info {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:49:16 devstack sudo[105143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-b58f6a4a-6daf-4229-b8d8-3042ae708c7d.info Jun 17 04:49:16 devstack sudo[105143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:49:16 devstack sudo[105135]: pam_unix(sudo:session): session closed for user root Jun 17 04:49:16 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-c1a73776-8d0e-42c0-a619-4432027d1f10 tempest-TestInstancesWithCinderVolumes-729947751 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-7dc2c78d-7e4c-4e39-b276-4c1e36d07215" returned: 1 in 0.705s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:49:16 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-c1a73776-8d0e-42c0-a619-4432027d1f10 tempest-TestInstancesWithCinderVolumes-729947751 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-7dc2c78d-7e4c-4e39-b276-4c1e36d07215' failed. Not Retrying. {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 17 04:49:16 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-c1a73776-8d0e-42c0-a619-4432027d1f10 tempest-TestInstancesWithCinderVolumes-729947751 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-7dc2c78d-7e4c-4e39-b276-4c1e36d07215 {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:49:17 devstack sudo[105145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-7dc2c78d-7e4c-4e39-b276-4c1e36d07215 Jun 17 04:49:17 devstack sudo[105145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:49:17 devstack sudo[105143]: pam_unix(sudo:session): session closed for user root Jun 17 04:49:17 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-448f0673-1459-43d1-8522-555fc9d626ba tempest-SnapshotDependencyTests-1015838131 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-b58f6a4a-6daf-4229-b8d8-3042ae708c7d.info" returned: 0 in 0.598s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:49:17 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-448f0673-1459-43d1-8522-555fc9d626ba tempest-SnapshotDependencyTests-1015838131 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.031s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 04:49:17 devstack sudo[105145]: pam_unix(sudo:session): session closed for user root Jun 17 04:49:17 devstack cinder-volume[92060]: INFO cinder.volume.manager [None req-448f0673-1459-43d1-8522-555fc9d626ba tempest-SnapshotDependencyTests-1015838131 None] Create snapshot completed successfully Jun 17 04:49:17 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-c1a73776-8d0e-42c0-a619-4432027d1f10 tempest-TestInstancesWithCinderVolumes-729947751 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-7dc2c78d-7e4c-4e39-b276-4c1e36d07215" returned: 0 in 0.580s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:49:17 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-c1a73776-8d0e-42c0-a619-4432027d1f10 tempest-TestInstancesWithCinderVolumes-729947751 None] Lock "cinder-quobyte-7dc2c78d-7e4c-4e39-b276-4c1e36d07215" released by "delete_volume" :: held 2.081s {{(pid=92060) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 04:49:17 devstack cinder-volume[92060]: WARNING cinder.quota [None req-c1a73776-8d0e-42c0-a619-4432027d1f10 tempest-TestInstancesWithCinderVolumes-729947751 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1667239121-1579765131 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1667239121-1579765131, it is now deprecated. Please use the default quota class for default quota. Jun 17 04:49:17 devstack cinder-volume[92060]: WARNING cinder.quota [None req-c1a73776-8d0e-42c0-a619-4432027d1f10 tempest-TestInstancesWithCinderVolumes-729947751 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1667239121-1579765131 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1667239121-1579765131, it is now deprecated. Please use the default quota class for default quota. Jun 17 04:49:17 devstack cinder-volume[92060]: DEBUG cinder.quota [None req-c1a73776-8d0e-42c0-a619-4432027d1f10 tempest-TestInstancesWithCinderVolumes-729947751 None] Created reservations ['555bbc34-0735-4939-9068-e0ccfc8fc653', 'b4131dda-b69a-4d78-b04a-54a68e6ee84f', '356c8035-a395-4557-945c-397fa56fb571', '960ed818-0a60-4ab0-a961-4933ca1e5edb'] {{(pid=92060) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 17 04:49:17 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-c1a73776-8d0e-42c0-a619-4432027d1f10 tempest-TestInstancesWithCinderVolumes-729947751 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 04:49:17 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-c1a73776-8d0e-42c0-a619-4432027d1f10 tempest-TestInstancesWithCinderVolumes-729947751 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 04:49:17 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-c1a73776-8d0e-42c0-a619-4432027d1f10 tempest-TestInstancesWithCinderVolumes-729947751 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588': None} {{(pid=92060) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 17 04:49:17 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-c1a73776-8d0e-42c0-a619-4432027d1f10 tempest-TestInstancesWithCinderVolumes-729947751 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588'] {{(pid=92060) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 17 04:49:17 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-c1a73776-8d0e-42c0-a619-4432027d1f10 tempest-TestInstancesWithCinderVolumes-729947751 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 04:49:17 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-c1a73776-8d0e-42c0-a619-4432027d1f10 tempest-TestInstancesWithCinderVolumes-729947751 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:49:17 devstack sudo[105149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a Jun 17 04:49:17 devstack sudo[105149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:49:18 devstack cinder-volume[92060]: DEBUG cinder.volume.flows.manager.create_volume [None req-56974ab6-2aea-4aba-80b3-9bcb08d46cfb tempest-SnapshotDependencyTests-1015838131 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92060) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 17 04:49:18 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-56974ab6-2aea-4aba-80b3-9bcb08d46cfb tempest-SnapshotDependencyTests-1015838131 None] Flow 'volume_create_manager' (362247ee-5b7b-44f0-be26-8beb44e72fda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 17 04:49:18 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-56974ab6-2aea-4aba-80b3-9bcb08d46cfb tempest-SnapshotDependencyTests-1015838131 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4ea22423-dd81-4718-b26b-5c086506b69d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:49:18 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-56974ab6-2aea-4aba-80b3-9bcb08d46cfb tempest-SnapshotDependencyTests-1015838131 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4ea22423-dd81-4718-b26b-5c086506b69d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-17T02:49:18Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cd06cb5c-0e79-41dd-b069-f34d6fd20d83,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d82ccf847fad42cdb6938812bddc33ca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T02:49:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=d837d477-0ae3-4769-bea2-c65f74a28191,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T02:49:18Z,use_quota=True,user_id='2d13570973334c239ade3691dec34a8d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aad9ce24-93f9-41a6-baa1-5125964f96d1),volume_type_id=aad9ce24-93f9-41a6-baa1-5125964f96d1)' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:49:18 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-56974ab6-2aea-4aba-80b3-9bcb08d46cfb tempest-SnapshotDependencyTests-1015838131 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2528e9b3-1391-4572-8dd2-63721f58c160) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:49:18 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-56974ab6-2aea-4aba-80b3-9bcb08d46cfb tempest-SnapshotDependencyTests-1015838131 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2528e9b3-1391-4572-8dd2-63721f58c160) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:49:18 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-56974ab6-2aea-4aba-80b3-9bcb08d46cfb tempest-SnapshotDependencyTests-1015838131 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (25e658b3-9704-4fe1-bdec-fc5f5a2a26e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:49:18 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-56974ab6-2aea-4aba-80b3-9bcb08d46cfb tempest-SnapshotDependencyTests-1015838131 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (25e658b3-9704-4fe1-bdec-fc5f5a2a26e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'cd06cb5c-0e79-41dd-b069-f34d6fd20d83', 'volume_name': 'volume-cd06cb5c-0e79-41dd-b069-f34d6fd20d83', 'volume_size': 1, 'snapshot_id': 'd837d477-0ae3-4769-bea2-c65f74a28191'}' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:49:18 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-56974ab6-2aea-4aba-80b3-9bcb08d46cfb tempest-SnapshotDependencyTests-1015838131 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9c46fac0-2887-4546-907d-6e7caaee7679) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:49:18 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-56974ab6-2aea-4aba-80b3-9bcb08d46cfb tempest-SnapshotDependencyTests-1015838131 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9c46fac0-2887-4546-907d-6e7caaee7679) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:49:18 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-56974ab6-2aea-4aba-80b3-9bcb08d46cfb tempest-SnapshotDependencyTests-1015838131 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (44a1148a-655f-4df4-93c5-be3e10121021) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:49:18 devstack cinder-volume[92060]: INFO cinder.volume.flows.manager.create_volume [None req-56974ab6-2aea-4aba-80b3-9bcb08d46cfb tempest-SnapshotDependencyTests-1015838131 None] Volume cd06cb5c-0e79-41dd-b069-f34d6fd20d83: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-cd06cb5c-0e79-41dd-b069-f34d6fd20d83', 'volume_size': 1, 'snapshot_id': 'd837d477-0ae3-4769-bea2-c65f74a28191'} Jun 17 04:49:18 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-56974ab6-2aea-4aba-80b3-9bcb08d46cfb tempest-SnapshotDependencyTests-1015838131 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 04:49:18 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-56974ab6-2aea-4aba-80b3-9bcb08d46cfb tempest-SnapshotDependencyTests-1015838131 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 04:49:18 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-56974ab6-2aea-4aba-80b3-9bcb08d46cfb tempest-SnapshotDependencyTests-1015838131 None] Acquiring lock "cinder-quobyte-d837d477-0ae3-4769-bea2-c65f74a28191-cd06cb5c-0e79-41dd-b069-f34d6fd20d83" by "_create_volume_from_snapshot" {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 04:49:18 devstack sudo[105149]: pam_unix(sudo:session): session closed for user root Jun 17 04:49:18 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-c1a73776-8d0e-42c0-a619-4432027d1f10 tempest-TestInstancesWithCinderVolumes-729947751 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a" returned: 0 in 0.594s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:49:18 devstack cinder-volume[92060]: DEBUG cinder.manager [None req-c1a73776-8d0e-42c0-a619-4432027d1f10 tempest-TestInstancesWithCinderVolumes-729947751 None] Notifying Schedulers of capabilities ... {{(pid=92060) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 17 04:49:18 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-56974ab6-2aea-4aba-80b3-9bcb08d46cfb tempest-SnapshotDependencyTests-1015838131 None] Lock "cinder-quobyte-d837d477-0ae3-4769-bea2-c65f74a28191-cd06cb5c-0e79-41dd-b069-f34d6fd20d83" acquired by "_create_volume_from_snapshot" :: waited 0.020s {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 04:49:18 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-56974ab6-2aea-4aba-80b3-9bcb08d46cfb tempest-SnapshotDependencyTests-1015838131 None] Creating volume cd06cb5c-0e79-41dd-b069-f34d6fd20d83 from snapshot d837d477-0ae3-4769-bea2-c65f74a28191 {{(pid=92060) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jun 17 04:49:18 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-56974ab6-2aea-4aba-80b3-9bcb08d46cfb tempest-SnapshotDependencyTests-1015838131 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 04:49:18 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-56974ab6-2aea-4aba-80b3-9bcb08d46cfb tempest-SnapshotDependencyTests-1015838131 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 04:49:18 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-56974ab6-2aea-4aba-80b3-9bcb08d46cfb tempest-SnapshotDependencyTests-1015838131 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588': None} {{(pid=92060) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 17 04:49:18 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-56974ab6-2aea-4aba-80b3-9bcb08d46cfb tempest-SnapshotDependencyTests-1015838131 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588'] {{(pid=92060) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 17 04:49:18 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-56974ab6-2aea-4aba-80b3-9bcb08d46cfb tempest-SnapshotDependencyTests-1015838131 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 04:49:18 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-56974ab6-2aea-4aba-80b3-9bcb08d46cfb tempest-SnapshotDependencyTests-1015838131 None] Selected osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588 as target Quobyte volume. {{(pid=92060) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 17 04:49:18 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-56974ab6-2aea-4aba-80b3-9bcb08d46cfb tempest-SnapshotDependencyTests-1015838131 None] Acquiring lock "cinder-quobyte-cd06cb5c-0e79-41dd-b069-f34d6fd20d83" by "_copy_volume_from_snapshot" {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 04:49:18 devstack cinder-volume[92060]: INFO cinder.volume.manager [None req-c1a73776-8d0e-42c0-a619-4432027d1f10 tempest-TestInstancesWithCinderVolumes-729947751 None] Deleted volume successfully. Jun 17 04:49:18 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-56974ab6-2aea-4aba-80b3-9bcb08d46cfb tempest-SnapshotDependencyTests-1015838131 None] Lock "cinder-quobyte-cd06cb5c-0e79-41dd-b069-f34d6fd20d83" acquired by "_copy_volume_from_snapshot" :: waited 0.018s {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 04:49:18 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-56974ab6-2aea-4aba-80b3-9bcb08d46cfb tempest-SnapshotDependencyTests-1015838131 None] snapshot: d837d477-0ae3-4769-bea2-c65f74a28191, volume: cd06cb5c-0e79-41dd-b069-f34d6fd20d83, {{(pid=92060) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jun 17 04:49:18 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-c1a73776-8d0e-42c0-a619-4432027d1f10 tempest-TestInstancesWithCinderVolumes-729947751 None] Lock "cinder-7dc2c78d-7e4c-4e39-b276-4c1e36d07215-delete_volume" released by "delete_volume" :: held 2.925s {{(pid=92060) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 04:49:18 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-56974ab6-2aea-4aba-80b3-9bcb08d46cfb tempest-SnapshotDependencyTests-1015838131 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 04:49:18 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-56974ab6-2aea-4aba-80b3-9bcb08d46cfb tempest-SnapshotDependencyTests-1015838131 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 04:49:18 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-56974ab6-2aea-4aba-80b3-9bcb08d46cfb tempest-SnapshotDependencyTests-1015838131 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588': None} {{(pid=92060) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 17 04:49:18 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-56974ab6-2aea-4aba-80b3-9bcb08d46cfb tempest-SnapshotDependencyTests-1015838131 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588'] {{(pid=92060) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 17 04:49:18 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-56974ab6-2aea-4aba-80b3-9bcb08d46cfb tempest-SnapshotDependencyTests-1015838131 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 04:49:18 devstack cinder-volume[92060]: DEBUG oslo.privsep.daemon [-] privsep: reply[d41de32c-1f83-41fe-b7cc-37537fd4ab2e]: (4, 'qcow2') {{(pid=93130) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 04:49:18 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-56974ab6-2aea-4aba-80b3-9bcb08d46cfb tempest-SnapshotDependencyTests-1015838131 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-b58f6a4a-6daf-4229-b8d8-3042ae708c7d.d837d477-0ae3-4769-bea2-c65f74a28191 {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:49:18 devstack sudo[105152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-b58f6a4a-6daf-4229-b8d8-3042ae708c7d.d837d477-0ae3-4769-bea2-c65f74a28191 Jun 17 04:49:18 devstack sudo[105152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:49:19 devstack sudo[105152]: pam_unix(sudo:session): session closed for user root Jun 17 04:49:19 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-56974ab6-2aea-4aba-80b3-9bcb08d46cfb tempest-SnapshotDependencyTests-1015838131 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-b58f6a4a-6daf-4229-b8d8-3042ae708c7d.d837d477-0ae3-4769-bea2-c65f74a28191" returned: 0 in 0.718s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:49:19 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.remotefs [None req-56974ab6-2aea-4aba-80b3-9bcb08d46cfb tempest-SnapshotDependencyTests-1015838131 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b58f6a4a-6daf-4229-b8d8-3042ae708c7d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=92060) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 17 04:49:19 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-56974ab6-2aea-4aba-80b3-9bcb08d46cfb tempest-SnapshotDependencyTests-1015838131 None] will copy from snapshot at /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-b58f6a4a-6daf-4229-b8d8-3042ae708c7d {{(pid=92060) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jun 17 04:49:19 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-56974ab6-2aea-4aba-80b3-9bcb08d46cfb tempest-SnapshotDependencyTests-1015838131 None] Creating direct copy from snapshot {{(pid=92060) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jun 17 04:49:19 devstack cinder-volume[92060]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ff978a0-a507-4d72-bcd7-a986046c9807]: (4, 'qcow2') {{(pid=93130) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 04:49:19 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-56974ab6-2aea-4aba-80b3-9bcb08d46cfb tempest-SnapshotDependencyTests-1015838131 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-b58f6a4a-6daf-4229-b8d8-3042ae708c7d {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:49:19 devstack sudo[105159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-b58f6a4a-6daf-4229-b8d8-3042ae708c7d Jun 17 04:49:19 devstack sudo[105159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:49:19 devstack sudo[105159]: pam_unix(sudo:session): session closed for user root Jun 17 04:49:19 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-56974ab6-2aea-4aba-80b3-9bcb08d46cfb tempest-SnapshotDependencyTests-1015838131 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-b58f6a4a-6daf-4229-b8d8-3042ae708c7d" returned: 0 in 0.730s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:49:19 devstack cinder-volume[92060]: DEBUG cinder.utils [None req-56974ab6-2aea-4aba-80b3-9bcb08d46cfb tempest-SnapshotDependencyTests-1015838131 None] Path /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-cd06cb5c-0e79-41dd-b069-f34d6fd20d83 not found in is_blk_device check {{(pid=92060) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jun 17 04:49:19 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-56974ab6-2aea-4aba-80b3-9bcb08d46cfb tempest-SnapshotDependencyTests-1015838131 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-b58f6a4a-6daf-4229-b8d8-3042ae708c7d /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-cd06cb5c-0e79-41dd-b069-f34d6fd20d83 {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:49:19 devstack sudo[105164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-b58f6a4a-6daf-4229-b8d8-3042ae708c7d /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-cd06cb5c-0e79-41dd-b069-f34d6fd20d83 Jun 17 04:49:19 devstack sudo[105164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:49:25 devstack cinder-volume[92060]: DEBUG cinder.volume.flows.manager.create_volume [None req-5ab9f5e0-f846-4f94-bf41-5674263e64b9 tempest-AttachVolumeNegativeTest-991296233 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92060) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 17 04:49:25 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-5ab9f5e0-f846-4f94-bf41-5674263e64b9 tempest-AttachVolumeNegativeTest-991296233 None] Flow 'volume_create_manager' (a524d002-616a-41d8-9a10-489741c73b75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 17 04:49:25 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-5ab9f5e0-f846-4f94-bf41-5674263e64b9 tempest-AttachVolumeNegativeTest-991296233 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (38462b86-0f01-49c4-8036-0f472185c59e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:49:25 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-5ab9f5e0-f846-4f94-bf41-5674263e64b9 tempest-AttachVolumeNegativeTest-991296233 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (38462b86-0f01-49c4-8036-0f472185c59e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-17T02:49:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-2016739355',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4505949f-aa6c-48fd-b952-2d18b8088bbd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9d0a579338d541c79ff65be0490f47b0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T02:49:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T02:49:25Z,use_quota=True,user_id='994750bc5563495ca183a77999e0ce87',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aad9ce24-93f9-41a6-baa1-5125964f96d1),volume_type_id=aad9ce24-93f9-41a6-baa1-5125964f96d1)' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:49:25 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-5ab9f5e0-f846-4f94-bf41-5674263e64b9 tempest-AttachVolumeNegativeTest-991296233 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (52821fed-2347-4dd7-8a59-a9d71eef7114) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:49:25 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-5ab9f5e0-f846-4f94-bf41-5674263e64b9 tempest-AttachVolumeNegativeTest-991296233 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (52821fed-2347-4dd7-8a59-a9d71eef7114) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:49:25 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-5ab9f5e0-f846-4f94-bf41-5674263e64b9 tempest-AttachVolumeNegativeTest-991296233 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (03ab019c-dbac-4b76-8226-5b7c49d1bd3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:49:25 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-5ab9f5e0-f846-4f94-bf41-5674263e64b9 tempest-AttachVolumeNegativeTest-991296233 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (03ab019c-dbac-4b76-8226-5b7c49d1bd3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4505949f-aa6c-48fd-b952-2d18b8088bbd', 'volume_name': 'volume-4505949f-aa6c-48fd-b952-2d18b8088bbd', 'volume_size': 1}' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:49:25 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-5ab9f5e0-f846-4f94-bf41-5674263e64b9 tempest-AttachVolumeNegativeTest-991296233 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1e5da415-22a3-45fe-a6c8-10223095b608) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:49:25 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-5ab9f5e0-f846-4f94-bf41-5674263e64b9 tempest-AttachVolumeNegativeTest-991296233 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1e5da415-22a3-45fe-a6c8-10223095b608) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:49:25 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-5ab9f5e0-f846-4f94-bf41-5674263e64b9 tempest-AttachVolumeNegativeTest-991296233 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (459026f1-fa3c-439d-af00-bf3ae9a9eaa8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:49:25 devstack cinder-volume[92060]: INFO cinder.volume.flows.manager.create_volume [None req-5ab9f5e0-f846-4f94-bf41-5674263e64b9 tempest-AttachVolumeNegativeTest-991296233 None] Volume 4505949f-aa6c-48fd-b952-2d18b8088bbd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4505949f-aa6c-48fd-b952-2d18b8088bbd', 'volume_size': 1} Jun 17 04:49:25 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-5ab9f5e0-f846-4f94-bf41-5674263e64b9 tempest-AttachVolumeNegativeTest-991296233 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 04:49:26 devstack sudo[105164]: pam_unix(sudo:session): session closed for user root Jun 17 04:49:26 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-56974ab6-2aea-4aba-80b3-9bcb08d46cfb tempest-SnapshotDependencyTests-1015838131 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-b58f6a4a-6daf-4229-b8d8-3042ae708c7d /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-cd06cb5c-0e79-41dd-b069-f34d6fd20d83" returned: 0 in 6.177s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:49:26 devstack cinder-volume[92060]: DEBUG oslo.privsep.daemon [-] privsep: reply[6709506b-4025-4cd9-932a-37b133d95985]: (4, 'qcow2') {{(pid=93130) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 04:49:26 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-56974ab6-2aea-4aba-80b3-9bcb08d46cfb tempest-SnapshotDependencyTests-1015838131 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-b58f6a4a-6daf-4229-b8d8-3042ae708c7d {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:49:26 devstack sudo[105219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-b58f6a4a-6daf-4229-b8d8-3042ae708c7d Jun 17 04:49:26 devstack sudo[105219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:49:26 devstack sudo[105219]: pam_unix(sudo:session): session closed for user root Jun 17 04:49:26 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-56974ab6-2aea-4aba-80b3-9bcb08d46cfb tempest-SnapshotDependencyTests-1015838131 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-b58f6a4a-6daf-4229-b8d8-3042ae708c7d" returned: 0 in 0.896s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:49:26 devstack cinder-volume[92060]: DEBUG cinder.image.image_utils [None req-56974ab6-2aea-4aba-80b3-9bcb08d46cfb tempest-SnapshotDependencyTests-1015838131 None] Image conversion details: src /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-b58f6a4a-6daf-4229-b8d8-3042ae708c7d, size 1024.00 MB, duration 6.18 sec, destination /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-cd06cb5c-0e79-41dd-b069-f34d6fd20d83 {{(pid=92060) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 17 04:49:26 devstack cinder-volume[92060]: INFO cinder.image.image_utils [None req-56974ab6-2aea-4aba-80b3-9bcb08d46cfb tempest-SnapshotDependencyTests-1015838131 None] Converted 1024.00 MB image at 165.75 MB/s Jun 17 04:49:26 devstack cinder-volume[92060]: WARNING cinder.volume.drivers.remotefs [None req-56974ab6-2aea-4aba-80b3-9bcb08d46cfb tempest-SnapshotDependencyTests-1015838131 None] /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-cd06cb5c-0e79-41dd-b069-f34d6fd20d83 is being set with open permissions: ugo+rw Jun 17 04:49:26 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-56974ab6-2aea-4aba-80b3-9bcb08d46cfb tempest-SnapshotDependencyTests-1015838131 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-cd06cb5c-0e79-41dd-b069-f34d6fd20d83 {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:49:26 devstack sudo[105225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-cd06cb5c-0e79-41dd-b069-f34d6fd20d83 Jun 17 04:49:26 devstack sudo[105225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:49:27 devstack sudo[105225]: pam_unix(sudo:session): session closed for user root Jun 17 04:49:27 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-56974ab6-2aea-4aba-80b3-9bcb08d46cfb tempest-SnapshotDependencyTests-1015838131 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-cd06cb5c-0e79-41dd-b069-f34d6fd20d83" returned: 0 in 0.620s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:49:27 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-56974ab6-2aea-4aba-80b3-9bcb08d46cfb tempest-SnapshotDependencyTests-1015838131 None] Lock "cinder-quobyte-cd06cb5c-0e79-41dd-b069-f34d6fd20d83" released by "_copy_volume_from_snapshot" :: held 9.258s {{(pid=92060) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 04:49:27 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-56974ab6-2aea-4aba-80b3-9bcb08d46cfb tempest-SnapshotDependencyTests-1015838131 None] Lock "cinder-quobyte-d837d477-0ae3-4769-bea2-c65f74a28191-cd06cb5c-0e79-41dd-b069-f34d6fd20d83" released by "_create_volume_from_snapshot" :: held 9.291s {{(pid=92060) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 04:49:27 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-56974ab6-2aea-4aba-80b3-9bcb08d46cfb tempest-SnapshotDependencyTests-1015838131 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.312s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 04:49:27 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-5ab9f5e0-f846-4f94-bf41-5674263e64b9 tempest-AttachVolumeNegativeTest-991296233 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.812s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 04:49:27 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-5ab9f5e0-f846-4f94-bf41-5674263e64b9 tempest-AttachVolumeNegativeTest-991296233 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-17T02:49:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-2016739355',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4505949f-aa6c-48fd-b952-2d18b8088bbd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9d0a579338d541c79ff65be0490f47b0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T02:49:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T02:49:25Z,use_quota=True,user_id='994750bc5563495ca183a77999e0ce87',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aad9ce24-93f9-41a6-baa1-5125964f96d1),volume_type_id=aad9ce24-93f9-41a6-baa1-5125964f96d1)}" {{(pid=92060) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 17 04:49:27 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.remotefs [None req-5ab9f5e0-f846-4f94-bf41-5674263e64b9 tempest-AttachVolumeNegativeTest-991296233 None] Creating volume 4505949f-aa6c-48fd-b952-2d18b8088bbd {{(pid=92060) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 17 04:49:27 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-5ab9f5e0-f846-4f94-bf41-5674263e64b9 tempest-AttachVolumeNegativeTest-991296233 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 04:49:27 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-5ab9f5e0-f846-4f94-bf41-5674263e64b9 tempest-AttachVolumeNegativeTest-991296233 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 04:49:27 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-5ab9f5e0-f846-4f94-bf41-5674263e64b9 tempest-AttachVolumeNegativeTest-991296233 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588': None} {{(pid=92060) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 17 04:49:27 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-5ab9f5e0-f846-4f94-bf41-5674263e64b9 tempest-AttachVolumeNegativeTest-991296233 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588'] {{(pid=92060) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 17 04:49:27 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-5ab9f5e0-f846-4f94-bf41-5674263e64b9 tempest-AttachVolumeNegativeTest-991296233 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 04:49:27 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-5ab9f5e0-f846-4f94-bf41-5674263e64b9 tempest-AttachVolumeNegativeTest-991296233 None] Selected osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588 as target Quobyte volume. {{(pid=92060) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 17 04:49:27 devstack cinder-volume[92060]: INFO cinder.volume.drivers.remotefs [None req-5ab9f5e0-f846-4f94-bf41-5674263e64b9 tempest-AttachVolumeNegativeTest-991296233 None] casted to osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588 Jun 17 04:49:27 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-5ab9f5e0-f846-4f94-bf41-5674263e64b9 tempest-AttachVolumeNegativeTest-991296233 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-4505949f-aa6c-48fd-b952-2d18b8088bbd 1073741824 {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:49:27 devstack sudo[105229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-4505949f-aa6c-48fd-b952-2d18b8088bbd 1073741824 Jun 17 04:49:27 devstack sudo[105229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:49:27 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-56974ab6-2aea-4aba-80b3-9bcb08d46cfb tempest-SnapshotDependencyTests-1015838131 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (44a1148a-655f-4df4-93c5-be3e10121021) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cd06cb5c-0e79-41dd-b069-f34d6fd20d83', 'volume_size': 1, 'snapshot_id': 'd837d477-0ae3-4769-bea2-c65f74a28191'}' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:49:27 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-56974ab6-2aea-4aba-80b3-9bcb08d46cfb tempest-SnapshotDependencyTests-1015838131 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fa5916ab-c958-4c68-ac7f-f0b1e5a0b075) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:49:27 devstack cinder-volume[92060]: INFO cinder.volume.flows.manager.create_volume [None req-56974ab6-2aea-4aba-80b3-9bcb08d46cfb tempest-SnapshotDependencyTests-1015838131 None] Volume volume-cd06cb5c-0e79-41dd-b069-f34d6fd20d83 (cd06cb5c-0e79-41dd-b069-f34d6fd20d83): created successfully Jun 17 04:49:27 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-56974ab6-2aea-4aba-80b3-9bcb08d46cfb tempest-SnapshotDependencyTests-1015838131 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fa5916ab-c958-4c68-ac7f-f0b1e5a0b075) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:49:27 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-56974ab6-2aea-4aba-80b3-9bcb08d46cfb tempest-SnapshotDependencyTests-1015838131 None] Flow 'volume_create_manager' (362247ee-5b7b-44f0-be26-8beb44e72fda) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92060) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 17 04:49:27 devstack cinder-volume[92060]: INFO cinder.volume.manager [None req-56974ab6-2aea-4aba-80b3-9bcb08d46cfb tempest-SnapshotDependencyTests-1015838131 None] Created volume successfully. Jun 17 04:49:28 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-63a68c6c-3d93-4e1d-a1b5-df22835d8e76 tempest-SnapshotDependencyTests-1015838131 None] Acquiring lock "cinder-d837d477-0ae3-4769-bea2-c65f74a28191-delete_snapshot" by "delete_snapshot" {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 04:49:28 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-63a68c6c-3d93-4e1d-a1b5-df22835d8e76 tempest-SnapshotDependencyTests-1015838131 None] Lock "cinder-d837d477-0ae3-4769-bea2-c65f74a28191-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 04:49:28 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-63a68c6c-3d93-4e1d-a1b5-df22835d8e76 tempest-SnapshotDependencyTests-1015838131 None] Acquiring lock "cinder-quobyte-b58f6a4a-6daf-4229-b8d8-3042ae708c7d" by "delete_snapshot" {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 04:49:28 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-63a68c6c-3d93-4e1d-a1b5-df22835d8e76 tempest-SnapshotDependencyTests-1015838131 None] Lock "cinder-quobyte-b58f6a4a-6daf-4229-b8d8-3042ae708c7d" acquired by "delete_snapshot" :: waited 0.022s {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 04:49:28 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-63a68c6c-3d93-4e1d-a1b5-df22835d8e76 tempest-SnapshotDependencyTests-1015838131 None] Acquiring lock "cinder-quobyte-d837d477-0ae3-4769-bea2-c65f74a28191" by "_delete_snapshot" {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 04:49:28 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-63a68c6c-3d93-4e1d-a1b5-df22835d8e76 tempest-SnapshotDependencyTests-1015838131 None] Lock "cinder-quobyte-d837d477-0ae3-4769-bea2-c65f74a28191" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 04:49:28 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.remotefs [None req-63a68c6c-3d93-4e1d-a1b5-df22835d8e76 tempest-SnapshotDependencyTests-1015838131 None] Deleting offline snapshot d837d477-0ae3-4769-bea2-c65f74a28191 of volume b58f6a4a-6daf-4229-b8d8-3042ae708c7d {{(pid=92060) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 17 04:49:28 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.remotefs [None req-63a68c6c-3d93-4e1d-a1b5-df22835d8e76 tempest-SnapshotDependencyTests-1015838131 None] snapshot_file for this snap is: volume-b58f6a4a-6daf-4229-b8d8-3042ae708c7d.d837d477-0ae3-4769-bea2-c65f74a28191 {{(pid=92060) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 17 04:49:28 devstack cinder-volume[92060]: DEBUG oslo.privsep.daemon [-] privsep: reply[258d9e21-6cc5-4252-beff-3ee7a4109a45]: (4, 'qcow2') {{(pid=93130) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 04:49:28 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-63a68c6c-3d93-4e1d-a1b5-df22835d8e76 tempest-SnapshotDependencyTests-1015838131 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-b58f6a4a-6daf-4229-b8d8-3042ae708c7d.d837d477-0ae3-4769-bea2-c65f74a28191 {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:49:28 devstack sudo[105229]: pam_unix(sudo:session): session closed for user root Jun 17 04:49:28 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-5ab9f5e0-f846-4f94-bf41-5674263e64b9 tempest-AttachVolumeNegativeTest-991296233 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-4505949f-aa6c-48fd-b952-2d18b8088bbd 1073741824" returned: 0 in 0.881s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:49:28 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-5ab9f5e0-f846-4f94-bf41-5674263e64b9 tempest-AttachVolumeNegativeTest-991296233 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-4505949f-aa6c-48fd-b952-2d18b8088bbd {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:49:28 devstack sudo[105235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-b58f6a4a-6daf-4229-b8d8-3042ae708c7d.d837d477-0ae3-4769-bea2-c65f74a28191 Jun 17 04:49:28 devstack sudo[105235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:49:28 devstack sudo[105236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-4505949f-aa6c-48fd-b952-2d18b8088bbd Jun 17 04:49:28 devstack sudo[105236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:49:29 devstack sudo[105236]: pam_unix(sudo:session): session closed for user root Jun 17 04:49:29 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-5ab9f5e0-f846-4f94-bf41-5674263e64b9 tempest-AttachVolumeNegativeTest-991296233 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-4505949f-aa6c-48fd-b952-2d18b8088bbd" returned: 0 in 0.784s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:49:29 devstack sudo[105235]: pam_unix(sudo:session): session closed for user root Jun 17 04:49:29 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-5ab9f5e0-f846-4f94-bf41-5674263e64b9 tempest-AttachVolumeNegativeTest-991296233 None] <== create_volume: return (1719ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588'} {{(pid=92060) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 17 04:49:29 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-5ab9f5e0-f846-4f94-bf41-5674263e64b9 tempest-AttachVolumeNegativeTest-991296233 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.723s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 04:49:29 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-63a68c6c-3d93-4e1d-a1b5-df22835d8e76 tempest-SnapshotDependencyTests-1015838131 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-b58f6a4a-6daf-4229-b8d8-3042ae708c7d.d837d477-0ae3-4769-bea2-c65f74a28191" returned: 0 in 0.890s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:49:29 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.remotefs [None req-63a68c6c-3d93-4e1d-a1b5-df22835d8e76 tempest-SnapshotDependencyTests-1015838131 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b58f6a4a-6daf-4229-b8d8-3042ae708c7d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=92060) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 17 04:49:29 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-5ab9f5e0-f846-4f94-bf41-5674263e64b9 tempest-AttachVolumeNegativeTest-991296233 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (459026f1-fa3c-439d-af00-bf3ae9a9eaa8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4505949f-aa6c-48fd-b952-2d18b8088bbd', 'volume_size': 1}' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:49:29 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-5ab9f5e0-f846-4f94-bf41-5674263e64b9 tempest-AttachVolumeNegativeTest-991296233 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a82e572d-4d9e-4a84-ac26-2f48778eadc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:49:29 devstack cinder-volume[92060]: DEBUG oslo.privsep.daemon [-] privsep: reply[8096b39b-cc8e-4446-8a31-bddf06a57ed9]: (4, 'qcow2') {{(pid=93130) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 04:49:29 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-63a68c6c-3d93-4e1d-a1b5-df22835d8e76 tempest-SnapshotDependencyTests-1015838131 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-b58f6a4a-6daf-4229-b8d8-3042ae708c7d {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:49:29 devstack cinder-volume[92060]: INFO cinder.volume.flows.manager.create_volume [None req-5ab9f5e0-f846-4f94-bf41-5674263e64b9 tempest-AttachVolumeNegativeTest-991296233 None] Volume volume-4505949f-aa6c-48fd-b952-2d18b8088bbd (4505949f-aa6c-48fd-b952-2d18b8088bbd): created successfully Jun 17 04:49:29 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-5ab9f5e0-f846-4f94-bf41-5674263e64b9 tempest-AttachVolumeNegativeTest-991296233 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a82e572d-4d9e-4a84-ac26-2f48778eadc5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:49:29 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-5ab9f5e0-f846-4f94-bf41-5674263e64b9 tempest-AttachVolumeNegativeTest-991296233 None] Flow 'volume_create_manager' (a524d002-616a-41d8-9a10-489741c73b75) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92060) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 17 04:49:29 devstack cinder-volume[92060]: INFO cinder.volume.manager [None req-5ab9f5e0-f846-4f94-bf41-5674263e64b9 tempest-AttachVolumeNegativeTest-991296233 None] Created volume successfully. Jun 17 04:49:29 devstack sudo[105243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-b58f6a4a-6daf-4229-b8d8-3042ae708c7d Jun 17 04:49:29 devstack sudo[105243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:49:30 devstack sudo[105243]: pam_unix(sudo:session): session closed for user root Jun 17 04:49:30 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-63a68c6c-3d93-4e1d-a1b5-df22835d8e76 tempest-SnapshotDependencyTests-1015838131 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-b58f6a4a-6daf-4229-b8d8-3042ae708c7d" returned: 0 in 0.757s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:49:30 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-63a68c6c-3d93-4e1d-a1b5-df22835d8e76 tempest-SnapshotDependencyTests-1015838131 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-b58f6a4a-6daf-4229-b8d8-3042ae708c7d.d837d477-0ae3-4769-bea2-c65f74a28191 {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:49:30 devstack sudo[105249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-b58f6a4a-6daf-4229-b8d8-3042ae708c7d.d837d477-0ae3-4769-bea2-c65f74a28191 Jun 17 04:49:30 devstack sudo[105249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:49:30 devstack sudo[105249]: pam_unix(sudo:session): session closed for user root Jun 17 04:49:30 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-63a68c6c-3d93-4e1d-a1b5-df22835d8e76 tempest-SnapshotDependencyTests-1015838131 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-b58f6a4a-6daf-4229-b8d8-3042ae708c7d.d837d477-0ae3-4769-bea2-c65f74a28191" returned: 0 in 0.735s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:49:30 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-63a68c6c-3d93-4e1d-a1b5-df22835d8e76 tempest-SnapshotDependencyTests-1015838131 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-b58f6a4a-6daf-4229-b8d8-3042ae708c7d.d837d477-0ae3-4769-bea2-c65f74a28191 {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:49:30 devstack sudo[105254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-b58f6a4a-6daf-4229-b8d8-3042ae708c7d.d837d477-0ae3-4769-bea2-c65f74a28191 Jun 17 04:49:30 devstack sudo[105254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:49:31 devstack sudo[105254]: pam_unix(sudo:session): session closed for user root Jun 17 04:49:31 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-63a68c6c-3d93-4e1d-a1b5-df22835d8e76 tempest-SnapshotDependencyTests-1015838131 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-b58f6a4a-6daf-4229-b8d8-3042ae708c7d.d837d477-0ae3-4769-bea2-c65f74a28191" returned: 0 in 0.649s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:49:31 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-63a68c6c-3d93-4e1d-a1b5-df22835d8e76 tempest-SnapshotDependencyTests-1015838131 None] Lock "cinder-quobyte-d837d477-0ae3-4769-bea2-c65f74a28191" released by "_delete_snapshot" :: held 3.162s {{(pid=92060) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 04:49:31 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-63a68c6c-3d93-4e1d-a1b5-df22835d8e76 tempest-SnapshotDependencyTests-1015838131 None] Lock "cinder-quobyte-b58f6a4a-6daf-4229-b8d8-3042ae708c7d" released by "delete_snapshot" :: held 3.192s {{(pid=92060) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 04:49:31 devstack cinder-volume[92060]: DEBUG cinder.quota [None req-63a68c6c-3d93-4e1d-a1b5-df22835d8e76 tempest-SnapshotDependencyTests-1015838131 None] Created reservations ['29a068ae-ce88-4747-a3a9-2e65c52aa4f2', '5f890141-b3b9-484c-9d35-90c5bbd6da9c', 'cce733f6-62a3-458f-8590-14a2f3d66c6e', '20ea3390-fba1-4807-a512-3861176d16ee'] {{(pid=92060) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 17 04:49:31 devstack cinder-volume[92060]: INFO cinder.volume.manager [None req-63a68c6c-3d93-4e1d-a1b5-df22835d8e76 tempest-SnapshotDependencyTests-1015838131 None] Delete snapshot completed successfully. Jun 17 04:49:31 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-63a68c6c-3d93-4e1d-a1b5-df22835d8e76 tempest-SnapshotDependencyTests-1015838131 None] Lock "cinder-d837d477-0ae3-4769-bea2-c65f74a28191-delete_snapshot" released by "delete_snapshot" :: held 3.374s {{(pid=92060) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 04:49:32 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-7a380ce2-fbe3-4cb4-a9d9-6ca68d008b75 tempest-SnapshotDependencyTests-1015838131 None] Acquiring lock "cinder-b58f6a4a-6daf-4229-b8d8-3042ae708c7d-delete_volume" by "delete_volume" {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 04:49:32 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-7a380ce2-fbe3-4cb4-a9d9-6ca68d008b75 tempest-SnapshotDependencyTests-1015838131 None] Lock "cinder-b58f6a4a-6daf-4229-b8d8-3042ae708c7d-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 04:49:32 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-7a380ce2-fbe3-4cb4-a9d9-6ca68d008b75 tempest-SnapshotDependencyTests-1015838131 None] Acquiring lock "cinder-quobyte-b58f6a4a-6daf-4229-b8d8-3042ae708c7d" by "delete_volume" {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 04:49:32 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-7a380ce2-fbe3-4cb4-a9d9-6ca68d008b75 tempest-SnapshotDependencyTests-1015838131 None] Lock "cinder-quobyte-b58f6a4a-6daf-4229-b8d8-3042ae708c7d" acquired by "delete_volume" :: waited 0.022s {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 04:49:32 devstack cinder-volume[92060]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b46b681-f28e-46d3-bc67-1829415b5765]: (4, 'qcow2') {{(pid=93130) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 04:49:32 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-7a380ce2-fbe3-4cb4-a9d9-6ca68d008b75 tempest-SnapshotDependencyTests-1015838131 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-b58f6a4a-6daf-4229-b8d8-3042ae708c7d {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:49:32 devstack sudo[105258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-b58f6a4a-6daf-4229-b8d8-3042ae708c7d Jun 17 04:49:32 devstack sudo[105258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:49:33 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [req-32dac31b-68e9-498b-a03e-d010364de0f7 req-fed55427-62f7-47fe-a461-259ee9c8ac46 tempest-AttachVolumeNegativeTest-991296233 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 04:49:33 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [req-32dac31b-68e9-498b-a03e-d010364de0f7 req-fed55427-62f7-47fe-a461-259ee9c8ac46 tempest-AttachVolumeNegativeTest-991296233 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 04:49:33 devstack cinder-volume[92060]: DEBUG oslo.privsep.daemon [-] privsep: reply[04483ebb-a95a-43da-b548-170f86c0579a]: (4, 'qcow2') {{(pid=93130) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 04:49:33 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [req-32dac31b-68e9-498b-a03e-d010364de0f7 req-fed55427-62f7-47fe-a461-259ee9c8ac46 tempest-AttachVolumeNegativeTest-991296233 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-4505949f-aa6c-48fd-b952-2d18b8088bbd {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:49:33 devstack sudo[105268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-4505949f-aa6c-48fd-b952-2d18b8088bbd Jun 17 04:49:33 devstack sudo[105268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:49:33 devstack sudo[105258]: pam_unix(sudo:session): session closed for user root Jun 17 04:49:33 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-7a380ce2-fbe3-4cb4-a9d9-6ca68d008b75 tempest-SnapshotDependencyTests-1015838131 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-b58f6a4a-6daf-4229-b8d8-3042ae708c7d" returned: 0 in 0.789s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:49:33 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-7a380ce2-fbe3-4cb4-a9d9-6ca68d008b75 tempest-SnapshotDependencyTests-1015838131 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-b58f6a4a-6daf-4229-b8d8-3042ae708c7d {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:49:33 devstack sudo[105273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-b58f6a4a-6daf-4229-b8d8-3042ae708c7d Jun 17 04:49:33 devstack sudo[105273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:49:34 devstack sudo[105268]: pam_unix(sudo:session): session closed for user root Jun 17 04:49:34 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [req-32dac31b-68e9-498b-a03e-d010364de0f7 req-fed55427-62f7-47fe-a461-259ee9c8ac46 tempest-AttachVolumeNegativeTest-991296233 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-4505949f-aa6c-48fd-b952-2d18b8088bbd" returned: 0 in 0.831s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:49:34 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [req-32dac31b-68e9-498b-a03e-d010364de0f7 req-fed55427-62f7-47fe-a461-259ee9c8ac46 tempest-AttachVolumeNegativeTest-991296233 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.850s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 04:49:34 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [req-32dac31b-68e9-498b-a03e-d010364de0f7 req-fed55427-62f7-47fe-a461-259ee9c8ac46 tempest-AttachVolumeNegativeTest-991296233 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588', 'name': 'volume-4505949f-aa6c-48fd-b952-2d18b8088bbd', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'cdf95279-0b43-4a6e-bae9-6b46b83a5c29', 'enforce_multipath': True} {{(pid=92060) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 17 04:49:34 devstack cinder-volume[92060]: INFO cinder.volume.manager [req-32dac31b-68e9-498b-a03e-d010364de0f7 req-fed55427-62f7-47fe-a461-259ee9c8ac46 tempest-AttachVolumeNegativeTest-991296233 None] attachment_update completed successfully. Jun 17 04:49:34 devstack sudo[105273]: pam_unix(sudo:session): session closed for user root Jun 17 04:49:34 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-7a380ce2-fbe3-4cb4-a9d9-6ca68d008b75 tempest-SnapshotDependencyTests-1015838131 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-b58f6a4a-6daf-4229-b8d8-3042ae708c7d" returned: 0 in 0.713s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:49:34 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-7a380ce2-fbe3-4cb4-a9d9-6ca68d008b75 tempest-SnapshotDependencyTests-1015838131 None] Lock "cinder-quobyte-b58f6a4a-6daf-4229-b8d8-3042ae708c7d" released by "delete_volume" :: held 1.575s {{(pid=92060) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 04:49:34 devstack cinder-volume[92060]: DEBUG cinder.quota [None req-7a380ce2-fbe3-4cb4-a9d9-6ca68d008b75 tempest-SnapshotDependencyTests-1015838131 None] Created reservations ['a0792d92-52da-45dd-a737-df110aa350ef', '8ba29c3f-f3ee-4293-88d0-262e9c2fcb23', 'ed85d2b4-c887-4166-b282-d54a107506bd', '691c55a3-a408-4529-9381-d6f6876689df'] {{(pid=92060) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 17 04:49:34 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-7a380ce2-fbe3-4cb4-a9d9-6ca68d008b75 tempest-SnapshotDependencyTests-1015838131 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 04:49:34 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-7a380ce2-fbe3-4cb4-a9d9-6ca68d008b75 tempest-SnapshotDependencyTests-1015838131 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 04:49:34 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-7a380ce2-fbe3-4cb4-a9d9-6ca68d008b75 tempest-SnapshotDependencyTests-1015838131 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588': None} {{(pid=92060) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 17 04:49:34 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-7a380ce2-fbe3-4cb4-a9d9-6ca68d008b75 tempest-SnapshotDependencyTests-1015838131 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588'] {{(pid=92060) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 17 04:49:34 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-7a380ce2-fbe3-4cb4-a9d9-6ca68d008b75 tempest-SnapshotDependencyTests-1015838131 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 04:49:34 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-7a380ce2-fbe3-4cb4-a9d9-6ca68d008b75 tempest-SnapshotDependencyTests-1015838131 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:49:34 devstack sudo[105302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a Jun 17 04:49:34 devstack sudo[105302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:49:34 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-0d71e7fa-3594-475f-bfa0-4a84323b5d5e tempest-SnapshotDependencyTests-1015838131 None] Acquiring lock "cinder-cd06cb5c-0e79-41dd-b069-f34d6fd20d83-delete_volume" by "delete_volume" {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 04:49:34 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-0d71e7fa-3594-475f-bfa0-4a84323b5d5e tempest-SnapshotDependencyTests-1015838131 None] Lock "cinder-cd06cb5c-0e79-41dd-b069-f34d6fd20d83-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 04:49:35 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-0d71e7fa-3594-475f-bfa0-4a84323b5d5e tempest-SnapshotDependencyTests-1015838131 None] Acquiring lock "cinder-quobyte-cd06cb5c-0e79-41dd-b069-f34d6fd20d83" by "delete_volume" {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 04:49:35 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-0d71e7fa-3594-475f-bfa0-4a84323b5d5e tempest-SnapshotDependencyTests-1015838131 None] Lock "cinder-quobyte-cd06cb5c-0e79-41dd-b069-f34d6fd20d83" acquired by "delete_volume" :: waited 0.027s {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 04:49:35 devstack cinder-volume[92060]: DEBUG oslo.privsep.daemon [-] privsep: reply[06ecb755-871f-4bbe-8f37-57abbfe45c0f]: (4, 'qcow2') {{(pid=93130) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 04:49:35 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-0d71e7fa-3594-475f-bfa0-4a84323b5d5e tempest-SnapshotDependencyTests-1015838131 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-cd06cb5c-0e79-41dd-b069-f34d6fd20d83 {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:49:35 devstack sudo[105302]: pam_unix(sudo:session): session closed for user root Jun 17 04:49:35 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-7a380ce2-fbe3-4cb4-a9d9-6ca68d008b75 tempest-SnapshotDependencyTests-1015838131 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a" returned: 0 in 0.741s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:49:35 devstack cinder-volume[92060]: DEBUG cinder.manager [None req-7a380ce2-fbe3-4cb4-a9d9-6ca68d008b75 tempest-SnapshotDependencyTests-1015838131 None] Notifying Schedulers of capabilities ... {{(pid=92060) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 17 04:49:35 devstack cinder-volume[92060]: INFO cinder.volume.manager [None req-7a380ce2-fbe3-4cb4-a9d9-6ca68d008b75 tempest-SnapshotDependencyTests-1015838131 None] Deleted volume successfully. Jun 17 04:49:35 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-7a380ce2-fbe3-4cb4-a9d9-6ca68d008b75 tempest-SnapshotDependencyTests-1015838131 None] Lock "cinder-b58f6a4a-6daf-4229-b8d8-3042ae708c7d-delete_volume" released by "delete_volume" :: held 2.572s {{(pid=92060) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 04:49:35 devstack sudo[105523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-cd06cb5c-0e79-41dd-b069-f34d6fd20d83 Jun 17 04:49:35 devstack sudo[105523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:49:35 devstack sudo[105523]: pam_unix(sudo:session): session closed for user root Jun 17 04:49:35 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-0d71e7fa-3594-475f-bfa0-4a84323b5d5e tempest-SnapshotDependencyTests-1015838131 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-cd06cb5c-0e79-41dd-b069-f34d6fd20d83" returned: 0 in 0.881s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:49:35 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-0d71e7fa-3594-475f-bfa0-4a84323b5d5e tempest-SnapshotDependencyTests-1015838131 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-cd06cb5c-0e79-41dd-b069-f34d6fd20d83 {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:49:36 devstack sudo[105679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-cd06cb5c-0e79-41dd-b069-f34d6fd20d83 Jun 17 04:49:36 devstack sudo[105679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:49:36 devstack sudo[105679]: pam_unix(sudo:session): session closed for user root Jun 17 04:49:36 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-0d71e7fa-3594-475f-bfa0-4a84323b5d5e tempest-SnapshotDependencyTests-1015838131 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-cd06cb5c-0e79-41dd-b069-f34d6fd20d83" returned: 0 in 0.656s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:49:36 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-0d71e7fa-3594-475f-bfa0-4a84323b5d5e tempest-SnapshotDependencyTests-1015838131 None] Lock "cinder-quobyte-cd06cb5c-0e79-41dd-b069-f34d6fd20d83" released by "delete_volume" :: held 1.603s {{(pid=92060) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 04:49:36 devstack cinder-volume[92060]: DEBUG cinder.quota [None req-0d71e7fa-3594-475f-bfa0-4a84323b5d5e tempest-SnapshotDependencyTests-1015838131 None] Created reservations ['990a163e-7ac6-4ef8-9d5f-0b1c3425c401', '00a97dec-ac4f-4987-a1be-7943670ecf4b', '07e9b02f-68b9-4cb7-95bf-4ddde30deaed', '4390eb01-e7f1-4a3a-90d7-f610990d34a7'] {{(pid=92060) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 17 04:49:36 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-0d71e7fa-3594-475f-bfa0-4a84323b5d5e tempest-SnapshotDependencyTests-1015838131 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 04:49:36 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-0d71e7fa-3594-475f-bfa0-4a84323b5d5e tempest-SnapshotDependencyTests-1015838131 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 04:49:36 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-0d71e7fa-3594-475f-bfa0-4a84323b5d5e tempest-SnapshotDependencyTests-1015838131 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588': None} {{(pid=92060) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 17 04:49:36 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-0d71e7fa-3594-475f-bfa0-4a84323b5d5e tempest-SnapshotDependencyTests-1015838131 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588'] {{(pid=92060) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 17 04:49:36 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-0d71e7fa-3594-475f-bfa0-4a84323b5d5e tempest-SnapshotDependencyTests-1015838131 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 04:49:36 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-0d71e7fa-3594-475f-bfa0-4a84323b5d5e tempest-SnapshotDependencyTests-1015838131 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:49:36 devstack sudo[105683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a Jun 17 04:49:36 devstack sudo[105683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:49:37 devstack sudo[105683]: pam_unix(sudo:session): session closed for user root Jun 17 04:49:37 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-0d71e7fa-3594-475f-bfa0-4a84323b5d5e tempest-SnapshotDependencyTests-1015838131 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a" returned: 0 in 0.727s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:49:37 devstack cinder-volume[92060]: DEBUG cinder.manager [None req-0d71e7fa-3594-475f-bfa0-4a84323b5d5e tempest-SnapshotDependencyTests-1015838131 None] Notifying Schedulers of capabilities ... {{(pid=92060) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 17 04:49:37 devstack cinder-volume[92060]: INFO cinder.volume.manager [None req-0d71e7fa-3594-475f-bfa0-4a84323b5d5e tempest-SnapshotDependencyTests-1015838131 None] Deleted volume successfully. Jun 17 04:49:37 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-0d71e7fa-3594-475f-bfa0-4a84323b5d5e tempest-SnapshotDependencyTests-1015838131 None] Lock "cinder-cd06cb5c-0e79-41dd-b069-f34d6fd20d83-delete_volume" released by "delete_volume" :: held 2.623s {{(pid=92060) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 04:49:41 devstack cinder-volume[92060]: INFO cinder.volume.manager [req-cadbb718-56e6-4b40-8ead-117bf40303c0 req-6be1e6ef-d561-4859-a67d-6cf0db62e85b tempest-AttachVolumeNegativeTest-991296233 None] Terminate volume connection completed successfully. Jun 17 04:49:41 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [req-cadbb718-56e6-4b40-8ead-117bf40303c0 req-6be1e6ef-d561-4859-a67d-6cf0db62e85b tempest-AttachVolumeNegativeTest-991296233 None] Deleting attachment cdf95279-0b43-4a6e-bae9-6b46b83a5c29. {{(pid=92060) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 17 04:49:44 devstack cinder-volume[92060]: DEBUG oslo_service.periodic_task [None req-60d279ad-ad8c-4d36-a4b8-f593e74fb922 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=92060) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 17 04:49:44 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-60d279ad-ad8c-4d36-a4b8-f593e74fb922 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 04:49:44 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-60d279ad-ad8c-4d36-a4b8-f593e74fb922 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 04:49:44 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-60d279ad-ad8c-4d36-a4b8-f593e74fb922 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588': None} {{(pid=92060) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 17 04:49:44 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-60d279ad-ad8c-4d36-a4b8-f593e74fb922 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588'] {{(pid=92060) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 17 04:49:44 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-60d279ad-ad8c-4d36-a4b8-f593e74fb922 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 04:49:44 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-60d279ad-ad8c-4d36-a4b8-f593e74fb922 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:49:45 devstack sudo[105754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a Jun 17 04:49:45 devstack sudo[105754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:49:45 devstack sudo[105754]: pam_unix(sudo:session): session closed for user root Jun 17 04:49:45 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-60d279ad-ad8c-4d36-a4b8-f593e74fb922 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a" returned: 0 in 0.695s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:49:45 devstack cinder-volume[92060]: DEBUG cinder.manager [None req-60d279ad-ad8c-4d36-a4b8-f593e74fb922 None None] Notifying Schedulers of capabilities ... {{(pid=92060) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 17 04:49:45 devstack cinder-volume[92060]: DEBUG oslo_service.periodic_task [None req-60d279ad-ad8c-4d36-a4b8-f593e74fb922 None None] Running periodic task VolumeManager._thread_info {{(pid=92060) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 17 04:49:45 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-60d279ad-ad8c-4d36-a4b8-f593e74fb922 None None] thread count: 28 {{(pid=92060) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 17 04:49:45 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-60d279ad-ad8c-4d36-a4b8-f593e74fb922 None None] thread info: [<_MainThread(MainThread, started 130061806440576)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=92060) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 17 04:49:51 devstack cinder-volume[92060]: DEBUG dbcounter [-] [92060] Writing DB stats cinder:SELECT=64,cinder:DELETE=9,cinder:INSERT=20,cinder:UPDATE=82 {{(pid=92060) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 17 04:49:51 devstack cinder-volume[92060]: DEBUG dbcounter [-] [92060] Writing DB stats cinder:SELECT=78,cinder:UPDATE=81,cinder:DELETE=4,cinder:INSERT=20 {{(pid=92060) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 17 04:49:53 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-d39df3f3-53ac-4fce-a72e-fc86c9b9cc7f tempest-AttachVolumeNegativeTest-991296233 None] Acquiring lock "cinder-4505949f-aa6c-48fd-b952-2d18b8088bbd-delete_volume" by "delete_volume" {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 04:49:53 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-d39df3f3-53ac-4fce-a72e-fc86c9b9cc7f tempest-AttachVolumeNegativeTest-991296233 None] Lock "cinder-4505949f-aa6c-48fd-b952-2d18b8088bbd-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 04:49:53 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-d39df3f3-53ac-4fce-a72e-fc86c9b9cc7f tempest-AttachVolumeNegativeTest-991296233 None] Acquiring lock "cinder-quobyte-4505949f-aa6c-48fd-b952-2d18b8088bbd" by "delete_volume" {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 04:49:53 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-d39df3f3-53ac-4fce-a72e-fc86c9b9cc7f tempest-AttachVolumeNegativeTest-991296233 None] Lock "cinder-quobyte-4505949f-aa6c-48fd-b952-2d18b8088bbd" acquired by "delete_volume" :: waited 0.014s {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 04:49:53 devstack cinder-volume[92060]: DEBUG oslo.privsep.daemon [-] privsep: reply[68863235-5970-42bb-9539-d0d1a45cc8dc]: (4, 'qcow2') {{(pid=93130) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 04:49:53 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-d39df3f3-53ac-4fce-a72e-fc86c9b9cc7f tempest-AttachVolumeNegativeTest-991296233 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-4505949f-aa6c-48fd-b952-2d18b8088bbd {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:49:53 devstack sudo[105763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-4505949f-aa6c-48fd-b952-2d18b8088bbd Jun 17 04:49:53 devstack sudo[105763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:49:54 devstack sudo[105763]: pam_unix(sudo:session): session closed for user root Jun 17 04:49:54 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-d39df3f3-53ac-4fce-a72e-fc86c9b9cc7f tempest-AttachVolumeNegativeTest-991296233 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-4505949f-aa6c-48fd-b952-2d18b8088bbd" returned: 0 in 0.774s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:49:54 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-d39df3f3-53ac-4fce-a72e-fc86c9b9cc7f tempest-AttachVolumeNegativeTest-991296233 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-4505949f-aa6c-48fd-b952-2d18b8088bbd {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:49:54 devstack sudo[105768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-4505949f-aa6c-48fd-b952-2d18b8088bbd Jun 17 04:49:54 devstack sudo[105768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:49:54 devstack sudo[105768]: pam_unix(sudo:session): session closed for user root Jun 17 04:49:54 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-d39df3f3-53ac-4fce-a72e-fc86c9b9cc7f tempest-AttachVolumeNegativeTest-991296233 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-4505949f-aa6c-48fd-b952-2d18b8088bbd" returned: 0 in 0.640s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:49:54 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-d39df3f3-53ac-4fce-a72e-fc86c9b9cc7f tempest-AttachVolumeNegativeTest-991296233 None] Lock "cinder-quobyte-4505949f-aa6c-48fd-b952-2d18b8088bbd" released by "delete_volume" :: held 1.489s {{(pid=92060) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 04:49:54 devstack cinder-volume[92060]: DEBUG cinder.quota [None req-d39df3f3-53ac-4fce-a72e-fc86c9b9cc7f tempest-AttachVolumeNegativeTest-991296233 None] Created reservations ['c157a35f-7049-4bdc-892c-ec2033650722', '1e0d8be9-d047-4360-a38e-cfd5513a8115', 'ab3de563-2b3b-46be-9481-caa46fbb85d7', 'ea508469-4218-4fbd-9135-42bf62dc2bf3'] {{(pid=92060) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 17 04:49:54 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-d39df3f3-53ac-4fce-a72e-fc86c9b9cc7f tempest-AttachVolumeNegativeTest-991296233 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 04:49:54 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-d39df3f3-53ac-4fce-a72e-fc86c9b9cc7f tempest-AttachVolumeNegativeTest-991296233 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 04:49:54 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-d39df3f3-53ac-4fce-a72e-fc86c9b9cc7f tempest-AttachVolumeNegativeTest-991296233 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588': None} {{(pid=92060) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 17 04:49:54 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-d39df3f3-53ac-4fce-a72e-fc86c9b9cc7f tempest-AttachVolumeNegativeTest-991296233 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588'] {{(pid=92060) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 17 04:49:54 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-d39df3f3-53ac-4fce-a72e-fc86c9b9cc7f tempest-AttachVolumeNegativeTest-991296233 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 04:49:54 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-d39df3f3-53ac-4fce-a72e-fc86c9b9cc7f tempest-AttachVolumeNegativeTest-991296233 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:49:54 devstack sudo[105771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a Jun 17 04:49:54 devstack sudo[105771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:49:55 devstack sudo[105771]: pam_unix(sudo:session): session closed for user root Jun 17 04:49:55 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-d39df3f3-53ac-4fce-a72e-fc86c9b9cc7f tempest-AttachVolumeNegativeTest-991296233 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a" returned: 0 in 0.605s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:49:55 devstack cinder-volume[92060]: DEBUG cinder.manager [None req-d39df3f3-53ac-4fce-a72e-fc86c9b9cc7f tempest-AttachVolumeNegativeTest-991296233 None] Notifying Schedulers of capabilities ... {{(pid=92060) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 17 04:49:55 devstack cinder-volume[92060]: INFO cinder.volume.manager [None req-d39df3f3-53ac-4fce-a72e-fc86c9b9cc7f tempest-AttachVolumeNegativeTest-991296233 None] Deleted volume successfully. Jun 17 04:49:55 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-d39df3f3-53ac-4fce-a72e-fc86c9b9cc7f tempest-AttachVolumeNegativeTest-991296233 None] Lock "cinder-4505949f-aa6c-48fd-b952-2d18b8088bbd-delete_volume" released by "delete_volume" :: held 2.322s {{(pid=92060) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 04:49:55 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-911dc28b-eb9f-40e6-966c-7cd37d921e6a tempest-AttachVolumeNegativeTest-991296233 None] Acquiring lock "cinder-f3bc4daf-94fb-4638-b601-1f86d479d4de-delete_volume" by "delete_volume" {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 04:49:55 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-911dc28b-eb9f-40e6-966c-7cd37d921e6a tempest-AttachVolumeNegativeTest-991296233 None] Lock "cinder-f3bc4daf-94fb-4638-b601-1f86d479d4de-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 04:49:55 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-911dc28b-eb9f-40e6-966c-7cd37d921e6a tempest-AttachVolumeNegativeTest-991296233 None] Acquiring lock "cinder-quobyte-f3bc4daf-94fb-4638-b601-1f86d479d4de" by "delete_volume" {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 04:49:55 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-911dc28b-eb9f-40e6-966c-7cd37d921e6a tempest-AttachVolumeNegativeTest-991296233 None] Lock "cinder-quobyte-f3bc4daf-94fb-4638-b601-1f86d479d4de" acquired by "delete_volume" :: waited 0.015s {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 04:49:55 devstack cinder-volume[92060]: DEBUG oslo.privsep.daemon [-] privsep: reply[89c51228-8550-4993-abc1-827e5e54ab06]: (4, 'qcow2') {{(pid=93130) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 04:49:55 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-911dc28b-eb9f-40e6-966c-7cd37d921e6a tempest-AttachVolumeNegativeTest-991296233 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-f3bc4daf-94fb-4638-b601-1f86d479d4de {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:49:55 devstack sudo[105774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-f3bc4daf-94fb-4638-b601-1f86d479d4de Jun 17 04:49:55 devstack sudo[105774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:49:56 devstack sudo[105774]: pam_unix(sudo:session): session closed for user root Jun 17 04:49:56 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-911dc28b-eb9f-40e6-966c-7cd37d921e6a tempest-AttachVolumeNegativeTest-991296233 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-f3bc4daf-94fb-4638-b601-1f86d479d4de" returned: 0 in 0.742s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:49:56 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-911dc28b-eb9f-40e6-966c-7cd37d921e6a tempest-AttachVolumeNegativeTest-991296233 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-f3bc4daf-94fb-4638-b601-1f86d479d4de {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:49:56 devstack sudo[105779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-f3bc4daf-94fb-4638-b601-1f86d479d4de Jun 17 04:49:56 devstack sudo[105779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:49:57 devstack sudo[105779]: pam_unix(sudo:session): session closed for user root Jun 17 04:49:57 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-911dc28b-eb9f-40e6-966c-7cd37d921e6a tempest-AttachVolumeNegativeTest-991296233 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-f3bc4daf-94fb-4638-b601-1f86d479d4de" returned: 0 in 0.637s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:49:57 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-911dc28b-eb9f-40e6-966c-7cd37d921e6a tempest-AttachVolumeNegativeTest-991296233 None] Lock "cinder-quobyte-f3bc4daf-94fb-4638-b601-1f86d479d4de" released by "delete_volume" :: held 1.424s {{(pid=92060) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 04:49:57 devstack cinder-volume[92060]: DEBUG cinder.quota [None req-911dc28b-eb9f-40e6-966c-7cd37d921e6a tempest-AttachVolumeNegativeTest-991296233 None] Created reservations ['9d2463eb-8948-470c-a66c-984081e867c6', '2ff35cf3-68d7-4795-99f6-d546c79a3d66', '2d536238-f2ba-4408-a00a-d5d0f65c28f8', '137176f8-d077-433a-afb3-6559b3ab88a9'] {{(pid=92060) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 17 04:49:57 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-911dc28b-eb9f-40e6-966c-7cd37d921e6a tempest-AttachVolumeNegativeTest-991296233 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 04:49:57 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-911dc28b-eb9f-40e6-966c-7cd37d921e6a tempest-AttachVolumeNegativeTest-991296233 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 04:49:57 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-911dc28b-eb9f-40e6-966c-7cd37d921e6a tempest-AttachVolumeNegativeTest-991296233 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588': None} {{(pid=92060) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 17 04:49:57 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-911dc28b-eb9f-40e6-966c-7cd37d921e6a tempest-AttachVolumeNegativeTest-991296233 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588'] {{(pid=92060) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 17 04:49:57 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-911dc28b-eb9f-40e6-966c-7cd37d921e6a tempest-AttachVolumeNegativeTest-991296233 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 04:49:57 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-911dc28b-eb9f-40e6-966c-7cd37d921e6a tempest-AttachVolumeNegativeTest-991296233 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:49:57 devstack sudo[105782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a Jun 17 04:49:57 devstack sudo[105782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:49:57 devstack sudo[105782]: pam_unix(sudo:session): session closed for user root Jun 17 04:49:57 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-911dc28b-eb9f-40e6-966c-7cd37d921e6a tempest-AttachVolumeNegativeTest-991296233 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a" returned: 0 in 0.632s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:49:57 devstack cinder-volume[92060]: DEBUG cinder.manager [None req-911dc28b-eb9f-40e6-966c-7cd37d921e6a tempest-AttachVolumeNegativeTest-991296233 None] Notifying Schedulers of capabilities ... {{(pid=92060) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 17 04:49:57 devstack cinder-volume[92060]: INFO cinder.volume.manager [None req-911dc28b-eb9f-40e6-966c-7cd37d921e6a tempest-AttachVolumeNegativeTest-991296233 None] Deleted volume successfully. Jun 17 04:49:57 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-911dc28b-eb9f-40e6-966c-7cd37d921e6a tempest-AttachVolumeNegativeTest-991296233 None] Lock "cinder-f3bc4daf-94fb-4638-b601-1f86d479d4de-delete_volume" released by "delete_volume" :: held 2.306s {{(pid=92060) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 04:49:57 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-501f8af3-d071-4b32-96a5-84ca7f3c496b tempest-AttachVolumeNegativeTest-991296233 None] Acquiring lock "cinder-4b541ff9-3359-453a-99e0-e6cb6131f0c3-delete_volume" by "delete_volume" {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 04:49:58 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-501f8af3-d071-4b32-96a5-84ca7f3c496b tempest-AttachVolumeNegativeTest-991296233 None] Lock "cinder-4b541ff9-3359-453a-99e0-e6cb6131f0c3-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 04:49:58 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-501f8af3-d071-4b32-96a5-84ca7f3c496b tempest-AttachVolumeNegativeTest-991296233 None] Acquiring lock "cinder-quobyte-4b541ff9-3359-453a-99e0-e6cb6131f0c3" by "delete_volume" {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 04:49:58 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-501f8af3-d071-4b32-96a5-84ca7f3c496b tempest-AttachVolumeNegativeTest-991296233 None] Lock "cinder-quobyte-4b541ff9-3359-453a-99e0-e6cb6131f0c3" acquired by "delete_volume" :: waited 0.036s {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 04:49:58 devstack cinder-volume[92060]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c85dadd-b784-413d-a6a1-a2f8a5e10bd1]: (4, 'qcow2') {{(pid=93130) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 04:49:58 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-501f8af3-d071-4b32-96a5-84ca7f3c496b tempest-AttachVolumeNegativeTest-991296233 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-4b541ff9-3359-453a-99e0-e6cb6131f0c3 {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:49:58 devstack sudo[105786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-4b541ff9-3359-453a-99e0-e6cb6131f0c3 Jun 17 04:49:58 devstack sudo[105786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:49:58 devstack cinder-volume[92060]: DEBUG cinder.volume.flows.manager.create_volume [None req-94b2ae4d-8d1f-44c0-90df-e9bf38fc20d4 tempest-TestShelveInstance-2059068282 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92060) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 17 04:49:58 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-94b2ae4d-8d1f-44c0-90df-e9bf38fc20d4 tempest-TestShelveInstance-2059068282 None] Flow 'volume_create_manager' (abdd7022-a607-4aef-82c9-b3a141cde878) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 17 04:49:58 devstack sudo[105786]: pam_unix(sudo:session): session closed for user root Jun 17 04:49:58 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-94b2ae4d-8d1f-44c0-90df-e9bf38fc20d4 tempest-TestShelveInstance-2059068282 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c6604765-7ec3-4378-9591-41455c40c577) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:49:58 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-501f8af3-d071-4b32-96a5-84ca7f3c496b tempest-AttachVolumeNegativeTest-991296233 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-4b541ff9-3359-453a-99e0-e6cb6131f0c3" returned: 0 in 0.733s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:49:58 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-501f8af3-d071-4b32-96a5-84ca7f3c496b tempest-AttachVolumeNegativeTest-991296233 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-4b541ff9-3359-453a-99e0-e6cb6131f0c3 {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:49:58 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-94b2ae4d-8d1f-44c0-90df-e9bf38fc20d4 tempest-TestShelveInstance-2059068282 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c6604765-7ec3-4378-9591-41455c40c577) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-17T02:49:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-2039773532',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c22c4041-72e9-4e3e-99e3-e131db5f8013,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4ee815f7005b468998a971c13b93442f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T02:49:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T02:49:59Z,use_quota=True,user_id='89afeb4329c04c4587915a4b8794252d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aad9ce24-93f9-41a6-baa1-5125964f96d1),volume_type_id=aad9ce24-93f9-41a6-baa1-5125964f96d1)' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:49:58 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-94b2ae4d-8d1f-44c0-90df-e9bf38fc20d4 tempest-TestShelveInstance-2059068282 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4389584b-85cc-4fc1-953f-4ea657b47b48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:49:58 devstack sudo[105791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-4b541ff9-3359-453a-99e0-e6cb6131f0c3 Jun 17 04:49:58 devstack sudo[105791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:49:58 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-94b2ae4d-8d1f-44c0-90df-e9bf38fc20d4 tempest-TestShelveInstance-2059068282 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4389584b-85cc-4fc1-953f-4ea657b47b48) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:49:58 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-94b2ae4d-8d1f-44c0-90df-e9bf38fc20d4 tempest-TestShelveInstance-2059068282 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (101c5eb2-3540-414c-aa2f-99af8b701bb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:49:58 devstack cinder-volume[92060]: DEBUG cinder.image.glance [None req-94b2ae4d-8d1f-44c0-90df-e9bf38fc20d4 tempest-TestShelveInstance-2059068282 None] Creating Keystone auth plugin from conf {{(pid=92060) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jun 17 04:49:59 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-94b2ae4d-8d1f-44c0-90df-e9bf38fc20d4 tempest-TestShelveInstance-2059068282 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (101c5eb2-3540-414c-aa2f-99af8b701bb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'c22c4041-72e9-4e3e-99e3-e131db5f8013', 'volume_name': 'volume-c22c4041-72e9-4e3e-99e3-e131db5f8013', 'volume_size': 1, 'image_id': '5abcba5c-72fa-4ea5-881e-1f4f187259a5', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/5abcba5c-72fa-4ea5-881e-1f4f187259a5', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'ec7d18cca2734755a53ee22ace21508e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '5abcba5c-72fa-4ea5-881e-1f4f187259a5', 'created_at': datetime.datetime(2026, 6, 17, 2, 29, 47, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 17, 2, 29, 49, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/5abcba5c-72fa-4ea5-881e-1f4f187259a5/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:49:59 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-94b2ae4d-8d1f-44c0-90df-e9bf38fc20d4 tempest-TestShelveInstance-2059068282 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3d7c7731-88d2-447c-905a-4ff5972f05b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:49:59 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-94b2ae4d-8d1f-44c0-90df-e9bf38fc20d4 tempest-TestShelveInstance-2059068282 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3d7c7731-88d2-447c-905a-4ff5972f05b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:49:59 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-94b2ae4d-8d1f-44c0-90df-e9bf38fc20d4 tempest-TestShelveInstance-2059068282 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (318fffdb-3991-43af-90dd-74e168cb2d62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:49:59 devstack cinder-volume[92060]: INFO cinder.volume.flows.manager.create_volume [None req-94b2ae4d-8d1f-44c0-90df-e9bf38fc20d4 tempest-TestShelveInstance-2059068282 None] Volume c22c4041-72e9-4e3e-99e3-e131db5f8013: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-c22c4041-72e9-4e3e-99e3-e131db5f8013', 'volume_size': 1, 'image_id': '5abcba5c-72fa-4ea5-881e-1f4f187259a5', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/5abcba5c-72fa-4ea5-881e-1f4f187259a5', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'ec7d18cca2734755a53ee22ace21508e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '5abcba5c-72fa-4ea5-881e-1f4f187259a5', 'created_at': datetime.datetime(2026, 6, 17, 2, 29, 47, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 17, 2, 29, 49, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/5abcba5c-72fa-4ea5-881e-1f4f187259a5/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jun 17 04:49:59 devstack cinder-volume[92060]: DEBUG cinder.volume.flows.manager.create_volume [None req-94b2ae4d-8d1f-44c0-90df-e9bf38fc20d4 tempest-TestShelveInstance-2059068282 None] Trying to clone c22c4041-72e9-4e3e-99e3-e131db5f8013 from image 5abcba5c-72fa-4ea5-881e-1f4f187259a5 at location (None, [{'url': 'file:///opt/stack/data/glance/images/5abcba5c-72fa-4ea5-881e-1f4f187259a5', 'metadata': {}}]). {{(pid=92060) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jun 17 04:49:59 devstack sudo[105791]: pam_unix(sudo:session): session closed for user root Jun 17 04:49:59 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-501f8af3-d071-4b32-96a5-84ca7f3c496b tempest-AttachVolumeNegativeTest-991296233 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-4b541ff9-3359-453a-99e0-e6cb6131f0c3" returned: 0 in 0.604s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:49:59 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-501f8af3-d071-4b32-96a5-84ca7f3c496b tempest-AttachVolumeNegativeTest-991296233 None] Lock "cinder-quobyte-4b541ff9-3359-453a-99e0-e6cb6131f0c3" released by "delete_volume" :: held 1.413s {{(pid=92060) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 04:49:59 devstack cinder-volume[92060]: DEBUG cinder.image.image_utils [None req-94b2ae4d-8d1f-44c0-90df-e9bf38fc20d4 tempest-TestShelveInstance-2059068282 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_5abcba5c-72fa-4ea5-881e-1f4f187259a5_fl24zoh_devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=92060) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jun 17 04:49:59 devstack cinder-volume[92060]: INFO cinder.image.image_utils [None req-94b2ae4d-8d1f-44c0-90df-e9bf38fc20d4 tempest-TestShelveInstance-2059068282 None] Image download 20.69 MB at 20.69 MB/s Jun 17 04:49:59 devstack cinder-volume[92060]: DEBUG cinder.quota [None req-501f8af3-d071-4b32-96a5-84ca7f3c496b tempest-AttachVolumeNegativeTest-991296233 None] Created reservations ['73cd3695-f179-4608-812d-4119adc308ec', 'fd9b29bd-fdf4-405b-bd6b-2b1a6c70ffc2', '9b12134d-cdd8-4083-acf3-9ba2f69dcdf1', '17393809-9cce-488d-b7f3-b19bb9ed8fee'] {{(pid=92060) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 17 04:49:59 devstack cinder-volume[92060]: DEBUG oslo.privsep.daemon [-] privsep: reply[404966ab-59bc-4cab-90c5-938e94f84d75]: (4, 'qcow2') {{(pid=93130) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 04:49:59 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-94b2ae4d-8d1f-44c0-90df-e9bf38fc20d4 tempest-TestShelveInstance-2059068282 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5abcba5c-72fa-4ea5-881e-1f4f187259a5_fl24zoh_devstack@QuobyteHD {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:49:59 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-501f8af3-d071-4b32-96a5-84ca7f3c496b tempest-AttachVolumeNegativeTest-991296233 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 04:49:59 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-501f8af3-d071-4b32-96a5-84ca7f3c496b tempest-AttachVolumeNegativeTest-991296233 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 04:49:59 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-501f8af3-d071-4b32-96a5-84ca7f3c496b tempest-AttachVolumeNegativeTest-991296233 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588': None} {{(pid=92060) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 17 04:49:59 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-501f8af3-d071-4b32-96a5-84ca7f3c496b tempest-AttachVolumeNegativeTest-991296233 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588'] {{(pid=92060) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 17 04:49:59 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-501f8af3-d071-4b32-96a5-84ca7f3c496b tempest-AttachVolumeNegativeTest-991296233 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 04:49:59 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-501f8af3-d071-4b32-96a5-84ca7f3c496b tempest-AttachVolumeNegativeTest-991296233 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:49:59 devstack sudo[105796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a Jun 17 04:49:59 devstack sudo[105796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:49:59 devstack sudo[105795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5abcba5c-72fa-4ea5-881e-1f4f187259a5_fl24zoh_devstack@QuobyteHD Jun 17 04:49:59 devstack sudo[105795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:50:00 devstack sudo[105796]: pam_unix(sudo:session): session closed for user root Jun 17 04:50:00 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-501f8af3-d071-4b32-96a5-84ca7f3c496b tempest-AttachVolumeNegativeTest-991296233 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a" returned: 0 in 0.628s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:50:00 devstack cinder-volume[92060]: DEBUG cinder.manager [None req-501f8af3-d071-4b32-96a5-84ca7f3c496b tempest-AttachVolumeNegativeTest-991296233 None] Notifying Schedulers of capabilities ... {{(pid=92060) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 17 04:50:00 devstack cinder-volume[92060]: INFO cinder.volume.manager [None req-501f8af3-d071-4b32-96a5-84ca7f3c496b tempest-AttachVolumeNegativeTest-991296233 None] Deleted volume successfully. Jun 17 04:50:00 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-501f8af3-d071-4b32-96a5-84ca7f3c496b tempest-AttachVolumeNegativeTest-991296233 None] Lock "cinder-4b541ff9-3359-453a-99e0-e6cb6131f0c3-delete_volume" released by "delete_volume" :: held 2.434s {{(pid=92060) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 04:50:00 devstack sudo[105795]: pam_unix(sudo:session): session closed for user root Jun 17 04:50:00 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-94b2ae4d-8d1f-44c0-90df-e9bf38fc20d4 tempest-TestShelveInstance-2059068282 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5abcba5c-72fa-4ea5-881e-1f4f187259a5_fl24zoh_devstack@QuobyteHD" returned: 0 in 0.783s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:50:00 devstack cinder-volume[92060]: DEBUG cinder.image.image_utils [None req-94b2ae4d-8d1f-44c0-90df-e9bf38fc20d4 tempest-TestShelveInstance-2059068282 None] Temporary image 5abcba5c-72fa-4ea5-881e-1f4f187259a5 is fetched for user 89afeb4329c04c4587915a4b8794252d. {{(pid=92060) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jun 17 04:50:00 devstack cinder-volume[92060]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae6b9449-8c44-400f-b42f-1b827770bc89]: (4, 'qcow2') {{(pid=93130) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 04:50:00 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-94b2ae4d-8d1f-44c0-90df-e9bf38fc20d4 tempest-TestShelveInstance-2059068282 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5abcba5c-72fa-4ea5-881e-1f4f187259a5_fl24zoh_devstack@QuobyteHD {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:50:00 devstack sudo[105803]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5abcba5c-72fa-4ea5-881e-1f4f187259a5_fl24zoh_devstack@QuobyteHD Jun 17 04:50:00 devstack sudo[105803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:50:01 devstack sudo[105803]: pam_unix(sudo:session): session closed for user root Jun 17 04:50:01 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-94b2ae4d-8d1f-44c0-90df-e9bf38fc20d4 tempest-TestShelveInstance-2059068282 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5abcba5c-72fa-4ea5-881e-1f4f187259a5_fl24zoh_devstack@QuobyteHD" returned: 0 in 0.708s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:50:01 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-94b2ae4d-8d1f-44c0-90df-e9bf38fc20d4 tempest-TestShelveInstance-2059068282 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 04:50:01 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-94b2ae4d-8d1f-44c0-90df-e9bf38fc20d4 tempest-TestShelveInstance-2059068282 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.004s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 04:50:01 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-94b2ae4d-8d1f-44c0-90df-e9bf38fc20d4 tempest-TestShelveInstance-2059068282 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-17T02:49:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-2039773532',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c22c4041-72e9-4e3e-99e3-e131db5f8013,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4ee815f7005b468998a971c13b93442f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T02:49:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T02:49:59Z,use_quota=True,user_id='89afeb4329c04c4587915a4b8794252d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aad9ce24-93f9-41a6-baa1-5125964f96d1),volume_type_id=aad9ce24-93f9-41a6-baa1-5125964f96d1)}" {{(pid=92060) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 17 04:50:01 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.remotefs [None req-94b2ae4d-8d1f-44c0-90df-e9bf38fc20d4 tempest-TestShelveInstance-2059068282 None] Creating volume c22c4041-72e9-4e3e-99e3-e131db5f8013 {{(pid=92060) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 17 04:50:01 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-94b2ae4d-8d1f-44c0-90df-e9bf38fc20d4 tempest-TestShelveInstance-2059068282 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 04:50:01 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-94b2ae4d-8d1f-44c0-90df-e9bf38fc20d4 tempest-TestShelveInstance-2059068282 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 04:50:01 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-94b2ae4d-8d1f-44c0-90df-e9bf38fc20d4 tempest-TestShelveInstance-2059068282 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588': None} {{(pid=92060) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 17 04:50:01 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-94b2ae4d-8d1f-44c0-90df-e9bf38fc20d4 tempest-TestShelveInstance-2059068282 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588'] {{(pid=92060) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 17 04:50:01 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-94b2ae4d-8d1f-44c0-90df-e9bf38fc20d4 tempest-TestShelveInstance-2059068282 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 04:50:01 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-94b2ae4d-8d1f-44c0-90df-e9bf38fc20d4 tempest-TestShelveInstance-2059068282 None] Selected osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588 as target Quobyte volume. {{(pid=92060) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 17 04:50:01 devstack cinder-volume[92060]: INFO cinder.volume.drivers.remotefs [None req-94b2ae4d-8d1f-44c0-90df-e9bf38fc20d4 tempest-TestShelveInstance-2059068282 None] casted to osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588 Jun 17 04:50:01 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-94b2ae4d-8d1f-44c0-90df-e9bf38fc20d4 tempest-TestShelveInstance-2059068282 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-c22c4041-72e9-4e3e-99e3-e131db5f8013 1073741824 {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:50:01 devstack sudo[105809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-c22c4041-72e9-4e3e-99e3-e131db5f8013 1073741824 Jun 17 04:50:01 devstack sudo[105809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:50:02 devstack sudo[105809]: pam_unix(sudo:session): session closed for user root Jun 17 04:50:02 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-94b2ae4d-8d1f-44c0-90df-e9bf38fc20d4 tempest-TestShelveInstance-2059068282 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-c22c4041-72e9-4e3e-99e3-e131db5f8013 1073741824" returned: 0 in 0.824s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:50:02 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-94b2ae4d-8d1f-44c0-90df-e9bf38fc20d4 tempest-TestShelveInstance-2059068282 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-c22c4041-72e9-4e3e-99e3-e131db5f8013 {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:50:02 devstack sudo[105815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-c22c4041-72e9-4e3e-99e3-e131db5f8013 Jun 17 04:50:02 devstack sudo[105815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:50:02 devstack sudo[105815]: pam_unix(sudo:session): session closed for user root Jun 17 04:50:02 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-94b2ae4d-8d1f-44c0-90df-e9bf38fc20d4 tempest-TestShelveInstance-2059068282 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-c22c4041-72e9-4e3e-99e3-e131db5f8013" returned: 0 in 0.613s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:50:02 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-94b2ae4d-8d1f-44c0-90df-e9bf38fc20d4 tempest-TestShelveInstance-2059068282 None] <== create_volume: return (1483ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588'} {{(pid=92060) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 17 04:50:02 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-94b2ae4d-8d1f-44c0-90df-e9bf38fc20d4 tempest-TestShelveInstance-2059068282 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.490s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 04:50:02 devstack cinder-volume[92060]: DEBUG cinder.volume.volume_utils [None req-94b2ae4d-8d1f-44c0-90df-e9bf38fc20d4 tempest-TestShelveInstance-2059068282 None] Attempting download of 5abcba5c-72fa-4ea5-881e-1f4f187259a5 ((None, [{'url': 'file:///opt/stack/data/glance/images/5abcba5c-72fa-4ea5-881e-1f4f187259a5', 'metadata': {}}])) to volume c22c4041-72e9-4e3e-99e3-e131db5f8013. {{(pid=92060) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jun 17 04:50:02 devstack cinder-volume[92060]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b7d087f-36c5-451e-9bf0-2c3c512e9824]: (4, 'raw') {{(pid=93130) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 04:50:02 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-94b2ae4d-8d1f-44c0-90df-e9bf38fc20d4 tempest-TestShelveInstance-2059068282 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_5abcba5c-72fa-4ea5-881e-1f4f187259a5_1euvlcdx {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:50:02 devstack sudo[105818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_5abcba5c-72fa-4ea5-881e-1f4f187259a5_1euvlcdx Jun 17 04:50:02 devstack sudo[105818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:50:03 devstack sudo[105818]: pam_unix(sudo:session): session closed for user root Jun 17 04:50:03 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-94b2ae4d-8d1f-44c0-90df-e9bf38fc20d4 tempest-TestShelveInstance-2059068282 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_5abcba5c-72fa-4ea5-881e-1f4f187259a5_1euvlcdx" returned: 0 in 0.692s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:50:03 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-94b2ae4d-8d1f-44c0-90df-e9bf38fc20d4 tempest-TestShelveInstance-2059068282 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5abcba5c-72fa-4ea5-881e-1f4f187259a5_1euvlcdx {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:50:03 devstack sudo[105822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5abcba5c-72fa-4ea5-881e-1f4f187259a5_1euvlcdx Jun 17 04:50:03 devstack sudo[105822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:50:04 devstack sudo[105822]: pam_unix(sudo:session): session closed for user root Jun 17 04:50:04 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-94b2ae4d-8d1f-44c0-90df-e9bf38fc20d4 tempest-TestShelveInstance-2059068282 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5abcba5c-72fa-4ea5-881e-1f4f187259a5_1euvlcdx" returned: 1 in 0.794s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:50:04 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-94b2ae4d-8d1f-44c0-90df-e9bf38fc20d4 tempest-TestShelveInstance-2059068282 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5abcba5c-72fa-4ea5-881e-1f4f187259a5_1euvlcdx' failed. Not Retrying. {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 17 04:50:04 devstack cinder-volume[92060]: DEBUG oslo.privsep.daemon [-] privsep: reply[251f7605-1452-4646-ac43-ce7e25c7c7d5]: (4, 'qcow2') {{(pid=93130) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 04:50:04 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-94b2ae4d-8d1f-44c0-90df-e9bf38fc20d4 tempest-TestShelveInstance-2059068282 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5abcba5c-72fa-4ea5-881e-1f4f187259a5_fl24zoh_devstack@QuobyteHD {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:50:04 devstack sudo[105827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5abcba5c-72fa-4ea5-881e-1f4f187259a5_fl24zoh_devstack@QuobyteHD Jun 17 04:50:04 devstack sudo[105827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:50:05 devstack sudo[105827]: pam_unix(sudo:session): session closed for user root Jun 17 04:50:05 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-94b2ae4d-8d1f-44c0-90df-e9bf38fc20d4 tempest-TestShelveInstance-2059068282 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5abcba5c-72fa-4ea5-881e-1f4f187259a5_fl24zoh_devstack@QuobyteHD" returned: 0 in 0.697s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:50:05 devstack cinder-volume[92060]: DEBUG cinder.image.image_utils [None req-94b2ae4d-8d1f-44c0-90df-e9bf38fc20d4 tempest-TestShelveInstance-2059068282 None] 5abcba5c-72fa-4ea5-881e-1f4f187259a5 was qcow2, converting to raw {{(pid=92060) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jun 17 04:50:05 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-94b2ae4d-8d1f-44c0-90df-e9bf38fc20d4 tempest-TestShelveInstance-2059068282 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_5abcba5c-72fa-4ea5-881e-1f4f187259a5_fl24zoh_devstack@QuobyteHD /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-c22c4041-72e9-4e3e-99e3-e131db5f8013 {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:50:05 devstack sudo[105832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_5abcba5c-72fa-4ea5-881e-1f4f187259a5_fl24zoh_devstack@QuobyteHD /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-c22c4041-72e9-4e3e-99e3-e131db5f8013 Jun 17 04:50:05 devstack sudo[105832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:50:07 devstack sudo[105832]: pam_unix(sudo:session): session closed for user root Jun 17 04:50:07 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-94b2ae4d-8d1f-44c0-90df-e9bf38fc20d4 tempest-TestShelveInstance-2059068282 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_5abcba5c-72fa-4ea5-881e-1f4f187259a5_fl24zoh_devstack@QuobyteHD /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-c22c4041-72e9-4e3e-99e3-e131db5f8013" returned: 0 in 1.977s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:50:07 devstack cinder-volume[92060]: DEBUG cinder.image.image_utils [None req-94b2ae4d-8d1f-44c0-90df-e9bf38fc20d4 tempest-TestShelveInstance-2059068282 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_5abcba5c-72fa-4ea5-881e-1f4f187259a5_fl24zoh_devstack@QuobyteHD, size 112.00 MB, duration 1.98 sec, destination /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-c22c4041-72e9-4e3e-99e3-e131db5f8013 {{(pid=92060) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 17 04:50:07 devstack cinder-volume[92060]: INFO cinder.image.image_utils [None req-94b2ae4d-8d1f-44c0-90df-e9bf38fc20d4 tempest-TestShelveInstance-2059068282 None] Converted 112.00 MB image at 56.62 MB/s Jun 17 04:50:07 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-94b2ae4d-8d1f-44c0-90df-e9bf38fc20d4 tempest-TestShelveInstance-2059068282 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-c22c4041-72e9-4e3e-99e3-e131db5f8013 1G {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:50:07 devstack sudo[105848]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-c22c4041-72e9-4e3e-99e3-e131db5f8013 1G Jun 17 04:50:07 devstack sudo[105848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:50:07 devstack sudo[105848]: pam_unix(sudo:session): session closed for user root Jun 17 04:50:07 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-94b2ae4d-8d1f-44c0-90df-e9bf38fc20d4 tempest-TestShelveInstance-2059068282 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-c22c4041-72e9-4e3e-99e3-e131db5f8013 1G" returned: 0 in 0.687s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:50:07 devstack cinder-volume[92060]: DEBUG oslo.privsep.daemon [-] privsep: reply[e70edd54-d584-4ba0-8c50-4985c48487b2]: (4, 'raw') {{(pid=93130) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 04:50:07 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-94b2ae4d-8d1f-44c0-90df-e9bf38fc20d4 tempest-TestShelveInstance-2059068282 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-c22c4041-72e9-4e3e-99e3-e131db5f8013 {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:50:07 devstack sudo[105853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-c22c4041-72e9-4e3e-99e3-e131db5f8013 Jun 17 04:50:07 devstack sudo[105853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:50:08 devstack sudo[105853]: pam_unix(sudo:session): session closed for user root Jun 17 04:50:08 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-94b2ae4d-8d1f-44c0-90df-e9bf38fc20d4 tempest-TestShelveInstance-2059068282 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-c22c4041-72e9-4e3e-99e3-e131db5f8013" returned: 0 in 0.759s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:50:08 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-94b2ae4d-8d1f-44c0-90df-e9bf38fc20d4 tempest-TestShelveInstance-2059068282 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-c22c4041-72e9-4e3e-99e3-e131db5f8013 {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:50:08 devstack sudo[105857]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-c22c4041-72e9-4e3e-99e3-e131db5f8013 Jun 17 04:50:08 devstack sudo[105857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:50:09 devstack sudo[105857]: pam_unix(sudo:session): session closed for user root Jun 17 04:50:09 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-94b2ae4d-8d1f-44c0-90df-e9bf38fc20d4 tempest-TestShelveInstance-2059068282 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-c22c4041-72e9-4e3e-99e3-e131db5f8013" returned: 1 in 0.719s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:50:09 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-94b2ae4d-8d1f-44c0-90df-e9bf38fc20d4 tempest-TestShelveInstance-2059068282 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-c22c4041-72e9-4e3e-99e3-e131db5f8013' failed. Not Retrying. {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 17 04:50:09 devstack cinder-volume[92060]: DEBUG cinder.volume.volume_utils [None req-94b2ae4d-8d1f-44c0-90df-e9bf38fc20d4 tempest-TestShelveInstance-2059068282 None] Downloaded image 5abcba5c-72fa-4ea5-881e-1f4f187259a5 ((None, [{'url': 'file:///opt/stack/data/glance/images/5abcba5c-72fa-4ea5-881e-1f4f187259a5', 'metadata': {}}])) to volume c22c4041-72e9-4e3e-99e3-e131db5f8013 successfully. {{(pid=92060) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jun 17 04:50:09 devstack cinder-volume[92060]: DEBUG cinder.image.image_utils [None req-94b2ae4d-8d1f-44c0-90df-e9bf38fc20d4 tempest-TestShelveInstance-2059068282 None] Temporary image 5abcba5c-72fa-4ea5-881e-1f4f187259a5 for user 89afeb4329c04c4587915a4b8794252d is deleted. {{(pid=92060) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jun 17 04:50:09 devstack cinder-volume[92060]: DEBUG cinder.volume.volume_utils [None req-94b2ae4d-8d1f-44c0-90df-e9bf38fc20d4 tempest-TestShelveInstance-2059068282 None] Marking volume c22c4041-72e9-4e3e-99e3-e131db5f8013 as bootable. {{(pid=92060) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jun 17 04:50:09 devstack cinder-volume[92060]: DEBUG cinder.volume.flows.manager.create_volume [None req-94b2ae4d-8d1f-44c0-90df-e9bf38fc20d4 tempest-TestShelveInstance-2059068282 None] Copying metadata from image 5abcba5c-72fa-4ea5-881e-1f4f187259a5 to c22c4041-72e9-4e3e-99e3-e131db5f8013. {{(pid=92060) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jun 17 04:50:09 devstack cinder-volume[92060]: DEBUG cinder.volume.flows.manager.create_volume [None req-94b2ae4d-8d1f-44c0-90df-e9bf38fc20d4 tempest-TestShelveInstance-2059068282 None] Creating volume glance metadata for volume c22c4041-72e9-4e3e-99e3-e131db5f8013 backed by image 5abcba5c-72fa-4ea5-881e-1f4f187259a5 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '5abcba5c-72fa-4ea5-881e-1f4f187259a5', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=92060) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jun 17 04:50:09 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-94b2ae4d-8d1f-44c0-90df-e9bf38fc20d4 tempest-TestShelveInstance-2059068282 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (318fffdb-3991-43af-90dd-74e168cb2d62) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c22c4041-72e9-4e3e-99e3-e131db5f8013', 'volume_size': 1, 'image_id': '5abcba5c-72fa-4ea5-881e-1f4f187259a5', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/5abcba5c-72fa-4ea5-881e-1f4f187259a5', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'ec7d18cca2734755a53ee22ace21508e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '5abcba5c-72fa-4ea5-881e-1f4f187259a5', 'created_at': datetime.datetime(2026, 6, 17, 2, 29, 47, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 17, 2, 29, 49, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/5abcba5c-72fa-4ea5-881e-1f4f187259a5/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:50:09 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-94b2ae4d-8d1f-44c0-90df-e9bf38fc20d4 tempest-TestShelveInstance-2059068282 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a485b50f-e8fe-44cb-8fe0-d0f97d22629b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:50:09 devstack cinder-volume[92060]: INFO cinder.volume.flows.manager.create_volume [None req-94b2ae4d-8d1f-44c0-90df-e9bf38fc20d4 tempest-TestShelveInstance-2059068282 None] Volume volume-c22c4041-72e9-4e3e-99e3-e131db5f8013 (c22c4041-72e9-4e3e-99e3-e131db5f8013): created successfully Jun 17 04:50:09 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-94b2ae4d-8d1f-44c0-90df-e9bf38fc20d4 tempest-TestShelveInstance-2059068282 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a485b50f-e8fe-44cb-8fe0-d0f97d22629b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:50:09 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-94b2ae4d-8d1f-44c0-90df-e9bf38fc20d4 tempest-TestShelveInstance-2059068282 None] Flow 'volume_create_manager' (abdd7022-a607-4aef-82c9-b3a141cde878) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92060) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 17 04:50:09 devstack cinder-volume[92060]: INFO cinder.volume.manager [None req-94b2ae4d-8d1f-44c0-90df-e9bf38fc20d4 tempest-TestShelveInstance-2059068282 None] Created volume successfully. Jun 17 04:50:15 devstack cinder-volume[92060]: INFO cinder.volume.manager [None req-75cb1e76-9f7c-49f4-9a2f-0920c50a80d7 tempest-GroupsV320Test-496006543 None] Group tempest-GroupsV320Test-Group-431079208: creating Jun 17 04:50:15 devstack cinder-volume[92060]: INFO cinder.volume.manager [None req-75cb1e76-9f7c-49f4-9a2f-0920c50a80d7 tempest-GroupsV320Test-496006543 None] Group tempest-GroupsV320Test-Group-431079208: created successfully Jun 17 04:50:15 devstack cinder-volume[92060]: INFO cinder.volume.manager [None req-75cb1e76-9f7c-49f4-9a2f-0920c50a80d7 tempest-GroupsV320Test-496006543 None] Create group completed successfully. Jun 17 04:50:16 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [req-7e969676-ab80-4deb-b250-980a02b358c5 req-8425d6b3-9b55-450f-83a4-0051b7941885 tempest-TestShelveInstance-2059068282 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 04:50:16 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [req-7e969676-ab80-4deb-b250-980a02b358c5 req-8425d6b3-9b55-450f-83a4-0051b7941885 tempest-TestShelveInstance-2059068282 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 04:50:16 devstack cinder-volume[92060]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3fd868f-df91-4791-99d8-307a900b1f73]: (4, 'raw') {{(pid=93130) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 04:50:16 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [req-7e969676-ab80-4deb-b250-980a02b358c5 req-8425d6b3-9b55-450f-83a4-0051b7941885 tempest-TestShelveInstance-2059068282 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-c22c4041-72e9-4e3e-99e3-e131db5f8013 {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:50:17 devstack sudo[105882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-c22c4041-72e9-4e3e-99e3-e131db5f8013 Jun 17 04:50:17 devstack sudo[105882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:50:17 devstack cinder-volume[92060]: DEBUG cinder.quota [None req-40c60018-7a30-4318-8a4a-ce7ded454b95 tempest-GroupsV320Test-496006543 None] Created reservations ['586d929c-cdbb-46c6-92c6-fad045edea0f'] {{(pid=92060) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 17 04:50:17 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-40c60018-7a30-4318-8a4a-ce7ded454b95 tempest-GroupsV320Test-496006543 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 04:50:17 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-40c60018-7a30-4318-8a4a-ce7ded454b95 tempest-GroupsV320Test-496006543 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 04:50:17 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-40c60018-7a30-4318-8a4a-ce7ded454b95 tempest-GroupsV320Test-496006543 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588': None} {{(pid=92060) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 17 04:50:17 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-40c60018-7a30-4318-8a4a-ce7ded454b95 tempest-GroupsV320Test-496006543 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588'] {{(pid=92060) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 17 04:50:17 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-40c60018-7a30-4318-8a4a-ce7ded454b95 tempest-GroupsV320Test-496006543 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 04:50:17 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-40c60018-7a30-4318-8a4a-ce7ded454b95 tempest-GroupsV320Test-496006543 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:50:17 devstack sudo[105885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a Jun 17 04:50:17 devstack sudo[105885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:50:17 devstack sudo[105882]: pam_unix(sudo:session): session closed for user root Jun 17 04:50:17 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [req-7e969676-ab80-4deb-b250-980a02b358c5 req-8425d6b3-9b55-450f-83a4-0051b7941885 tempest-TestShelveInstance-2059068282 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-c22c4041-72e9-4e3e-99e3-e131db5f8013" returned: 0 in 0.732s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:50:17 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [req-7e969676-ab80-4deb-b250-980a02b358c5 req-8425d6b3-9b55-450f-83a4-0051b7941885 tempest-TestShelveInstance-2059068282 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-c22c4041-72e9-4e3e-99e3-e131db5f8013 {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:50:17 devstack sudo[105890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-c22c4041-72e9-4e3e-99e3-e131db5f8013 Jun 17 04:50:17 devstack sudo[105890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:50:17 devstack sudo[105885]: pam_unix(sudo:session): session closed for user root Jun 17 04:50:17 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-40c60018-7a30-4318-8a4a-ce7ded454b95 tempest-GroupsV320Test-496006543 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a" returned: 0 in 0.623s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:50:17 devstack cinder-volume[92060]: DEBUG cinder.manager [None req-40c60018-7a30-4318-8a4a-ce7ded454b95 tempest-GroupsV320Test-496006543 None] Notifying Schedulers of capabilities ... {{(pid=92060) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 17 04:50:17 devstack cinder-volume[92060]: INFO cinder.volume.manager [None req-40c60018-7a30-4318-8a4a-ce7ded454b95 tempest-GroupsV320Test-496006543 None] Delete group completed successfully. Jun 17 04:50:18 devstack sudo[105890]: pam_unix(sudo:session): session closed for user root Jun 17 04:50:18 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [req-7e969676-ab80-4deb-b250-980a02b358c5 req-8425d6b3-9b55-450f-83a4-0051b7941885 tempest-TestShelveInstance-2059068282 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-c22c4041-72e9-4e3e-99e3-e131db5f8013" returned: 1 in 0.747s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:50:18 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [req-7e969676-ab80-4deb-b250-980a02b358c5 req-8425d6b3-9b55-450f-83a4-0051b7941885 tempest-TestShelveInstance-2059068282 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-c22c4041-72e9-4e3e-99e3-e131db5f8013' failed. Not Retrying. {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 17 04:50:18 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [req-7e969676-ab80-4deb-b250-980a02b358c5 req-8425d6b3-9b55-450f-83a4-0051b7941885 tempest-TestShelveInstance-2059068282 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.529s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 04:50:18 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [req-7e969676-ab80-4deb-b250-980a02b358c5 req-8425d6b3-9b55-450f-83a4-0051b7941885 tempest-TestShelveInstance-2059068282 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588', 'name': 'volume-c22c4041-72e9-4e3e-99e3-e131db5f8013', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '5e474fc9-ea00-4bcd-a793-4276f90ff3c9', 'enforce_multipath': True} {{(pid=92060) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 17 04:50:18 devstack cinder-volume[92060]: INFO cinder.volume.manager [req-7e969676-ab80-4deb-b250-980a02b358c5 req-8425d6b3-9b55-450f-83a4-0051b7941885 tempest-TestShelveInstance-2059068282 None] attachment_update completed successfully. Jun 17 04:50:29 devstack cinder-volume[92060]: DEBUG cinder.volume.flows.manager.create_volume [None req-0e1e318f-0f60-44d6-a233-295ca82b8256 tempest-VolumesServicesTestJSON-1435341832 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92060) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 17 04:50:29 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-0e1e318f-0f60-44d6-a233-295ca82b8256 tempest-VolumesServicesTestJSON-1435341832 None] Flow 'volume_create_manager' (51f05e76-93bc-4284-ae3e-9ec79397dfb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 17 04:50:29 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-0e1e318f-0f60-44d6-a233-295ca82b8256 tempest-VolumesServicesTestJSON-1435341832 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ed5afc6e-9c5f-49e7-97ad-e8e5a12314fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:50:29 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-0e1e318f-0f60-44d6-a233-295ca82b8256 tempest-VolumesServicesTestJSON-1435341832 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ed5afc6e-9c5f-49e7-97ad-e8e5a12314fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-17T02:50:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-2005066807',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c736828a-209b-4daa-8406-c0938183587e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5df297fefe684dfa948e19a4159f513e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T02:50:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T02:50:30Z,use_quota=True,user_id='93160f054b35442bbfcf803a9a29fadc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aad9ce24-93f9-41a6-baa1-5125964f96d1),volume_type_id=aad9ce24-93f9-41a6-baa1-5125964f96d1)' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:50:29 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-0e1e318f-0f60-44d6-a233-295ca82b8256 tempest-VolumesServicesTestJSON-1435341832 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1c343d50-6826-4fe6-b32e-b6e72bf55491) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:50:29 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-0e1e318f-0f60-44d6-a233-295ca82b8256 tempest-VolumesServicesTestJSON-1435341832 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1c343d50-6826-4fe6-b32e-b6e72bf55491) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:50:29 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-0e1e318f-0f60-44d6-a233-295ca82b8256 tempest-VolumesServicesTestJSON-1435341832 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f2c305df-9e98-4161-a5c4-a6eada025595) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:50:29 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-0e1e318f-0f60-44d6-a233-295ca82b8256 tempest-VolumesServicesTestJSON-1435341832 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f2c305df-9e98-4161-a5c4-a6eada025595) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c736828a-209b-4daa-8406-c0938183587e', 'volume_name': 'volume-c736828a-209b-4daa-8406-c0938183587e', 'volume_size': 1}' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:50:29 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-0e1e318f-0f60-44d6-a233-295ca82b8256 tempest-VolumesServicesTestJSON-1435341832 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (73b352b2-bec8-4161-b2bd-f3fc6e6acd7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:50:29 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-0e1e318f-0f60-44d6-a233-295ca82b8256 tempest-VolumesServicesTestJSON-1435341832 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (73b352b2-bec8-4161-b2bd-f3fc6e6acd7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:50:29 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-0e1e318f-0f60-44d6-a233-295ca82b8256 tempest-VolumesServicesTestJSON-1435341832 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (674a5a2b-6bd5-432a-8cdb-5edc92400e96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:50:29 devstack cinder-volume[92060]: INFO cinder.volume.flows.manager.create_volume [None req-0e1e318f-0f60-44d6-a233-295ca82b8256 tempest-VolumesServicesTestJSON-1435341832 None] Volume c736828a-209b-4daa-8406-c0938183587e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c736828a-209b-4daa-8406-c0938183587e', 'volume_size': 1} Jun 17 04:50:29 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-0e1e318f-0f60-44d6-a233-295ca82b8256 tempest-VolumesServicesTestJSON-1435341832 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 04:50:29 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-0e1e318f-0f60-44d6-a233-295ca82b8256 tempest-VolumesServicesTestJSON-1435341832 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 04:50:29 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-0e1e318f-0f60-44d6-a233-295ca82b8256 tempest-VolumesServicesTestJSON-1435341832 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-17T02:50:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-2005066807',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c736828a-209b-4daa-8406-c0938183587e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5df297fefe684dfa948e19a4159f513e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T02:50:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T02:50:30Z,use_quota=True,user_id='93160f054b35442bbfcf803a9a29fadc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aad9ce24-93f9-41a6-baa1-5125964f96d1),volume_type_id=aad9ce24-93f9-41a6-baa1-5125964f96d1)}" {{(pid=92060) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 17 04:50:29 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.remotefs [None req-0e1e318f-0f60-44d6-a233-295ca82b8256 tempest-VolumesServicesTestJSON-1435341832 None] Creating volume c736828a-209b-4daa-8406-c0938183587e {{(pid=92060) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 17 04:50:29 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-0e1e318f-0f60-44d6-a233-295ca82b8256 tempest-VolumesServicesTestJSON-1435341832 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 04:50:29 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-0e1e318f-0f60-44d6-a233-295ca82b8256 tempest-VolumesServicesTestJSON-1435341832 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 04:50:29 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-0e1e318f-0f60-44d6-a233-295ca82b8256 tempest-VolumesServicesTestJSON-1435341832 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588': None} {{(pid=92060) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 17 04:50:29 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-0e1e318f-0f60-44d6-a233-295ca82b8256 tempest-VolumesServicesTestJSON-1435341832 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588'] {{(pid=92060) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 17 04:50:29 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-0e1e318f-0f60-44d6-a233-295ca82b8256 tempest-VolumesServicesTestJSON-1435341832 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 04:50:29 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-0e1e318f-0f60-44d6-a233-295ca82b8256 tempest-VolumesServicesTestJSON-1435341832 None] Selected osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588 as target Quobyte volume. {{(pid=92060) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 17 04:50:29 devstack cinder-volume[92060]: INFO cinder.volume.drivers.remotefs [None req-0e1e318f-0f60-44d6-a233-295ca82b8256 tempest-VolumesServicesTestJSON-1435341832 None] casted to osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588 Jun 17 04:50:29 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-0e1e318f-0f60-44d6-a233-295ca82b8256 tempest-VolumesServicesTestJSON-1435341832 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-c736828a-209b-4daa-8406-c0938183587e 1073741824 {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:50:29 devstack sudo[106379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-c736828a-209b-4daa-8406-c0938183587e 1073741824 Jun 17 04:50:29 devstack sudo[106379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:50:30 devstack sudo[106379]: pam_unix(sudo:session): session closed for user root Jun 17 04:50:30 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-0e1e318f-0f60-44d6-a233-295ca82b8256 tempest-VolumesServicesTestJSON-1435341832 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-c736828a-209b-4daa-8406-c0938183587e 1073741824" returned: 0 in 0.833s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:50:30 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-0e1e318f-0f60-44d6-a233-295ca82b8256 tempest-VolumesServicesTestJSON-1435341832 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-c736828a-209b-4daa-8406-c0938183587e {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:50:30 devstack sudo[106387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-c736828a-209b-4daa-8406-c0938183587e Jun 17 04:50:30 devstack sudo[106387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:50:31 devstack sudo[106387]: pam_unix(sudo:session): session closed for user root Jun 17 04:50:31 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-0e1e318f-0f60-44d6-a233-295ca82b8256 tempest-VolumesServicesTestJSON-1435341832 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-c736828a-209b-4daa-8406-c0938183587e" returned: 0 in 0.629s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:50:31 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-0e1e318f-0f60-44d6-a233-295ca82b8256 tempest-VolumesServicesTestJSON-1435341832 None] <== create_volume: return (1516ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588'} {{(pid=92060) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 17 04:50:31 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-0e1e318f-0f60-44d6-a233-295ca82b8256 tempest-VolumesServicesTestJSON-1435341832 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.521s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 04:50:31 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-0e1e318f-0f60-44d6-a233-295ca82b8256 tempest-VolumesServicesTestJSON-1435341832 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (674a5a2b-6bd5-432a-8cdb-5edc92400e96) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c736828a-209b-4daa-8406-c0938183587e', 'volume_size': 1}' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:50:31 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-0e1e318f-0f60-44d6-a233-295ca82b8256 tempest-VolumesServicesTestJSON-1435341832 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7da7f112-1e2a-437f-956d-6c6f3bf513fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:50:31 devstack cinder-volume[92060]: INFO cinder.volume.flows.manager.create_volume [None req-0e1e318f-0f60-44d6-a233-295ca82b8256 tempest-VolumesServicesTestJSON-1435341832 None] Volume volume-c736828a-209b-4daa-8406-c0938183587e (c736828a-209b-4daa-8406-c0938183587e): created successfully Jun 17 04:50:31 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-0e1e318f-0f60-44d6-a233-295ca82b8256 tempest-VolumesServicesTestJSON-1435341832 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7da7f112-1e2a-437f-956d-6c6f3bf513fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:50:31 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-0e1e318f-0f60-44d6-a233-295ca82b8256 tempest-VolumesServicesTestJSON-1435341832 None] Flow 'volume_create_manager' (51f05e76-93bc-4284-ae3e-9ec79397dfb3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92060) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 17 04:50:31 devstack cinder-volume[92060]: INFO cinder.volume.manager [None req-0e1e318f-0f60-44d6-a233-295ca82b8256 tempest-VolumesServicesTestJSON-1435341832 None] Created volume successfully. Jun 17 04:50:31 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-ae8d8b3a-fea6-456a-87eb-e4700a77461d tempest-VolumesServicesTestJSON-1435341832 None] Acquiring lock "cinder-c736828a-209b-4daa-8406-c0938183587e-delete_volume" by "delete_volume" {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 04:50:31 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-ae8d8b3a-fea6-456a-87eb-e4700a77461d tempest-VolumesServicesTestJSON-1435341832 None] Lock "cinder-c736828a-209b-4daa-8406-c0938183587e-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 04:50:31 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-ae8d8b3a-fea6-456a-87eb-e4700a77461d tempest-VolumesServicesTestJSON-1435341832 None] Acquiring lock "cinder-quobyte-c736828a-209b-4daa-8406-c0938183587e" by "delete_volume" {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 04:50:31 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-ae8d8b3a-fea6-456a-87eb-e4700a77461d tempest-VolumesServicesTestJSON-1435341832 None] Lock "cinder-quobyte-c736828a-209b-4daa-8406-c0938183587e" acquired by "delete_volume" :: waited 0.016s {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 04:50:31 devstack cinder-volume[92060]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d396de8-681f-4bb0-aed4-b688757928fc]: (4, 'qcow2') {{(pid=93130) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 04:50:31 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-ae8d8b3a-fea6-456a-87eb-e4700a77461d tempest-VolumesServicesTestJSON-1435341832 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-c736828a-209b-4daa-8406-c0938183587e {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:50:32 devstack sudo[106391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-c736828a-209b-4daa-8406-c0938183587e Jun 17 04:50:32 devstack sudo[106391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:50:32 devstack sudo[106391]: pam_unix(sudo:session): session closed for user root Jun 17 04:50:32 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-ae8d8b3a-fea6-456a-87eb-e4700a77461d tempest-VolumesServicesTestJSON-1435341832 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-c736828a-209b-4daa-8406-c0938183587e" returned: 0 in 0.730s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:50:32 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-ae8d8b3a-fea6-456a-87eb-e4700a77461d tempest-VolumesServicesTestJSON-1435341832 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-c736828a-209b-4daa-8406-c0938183587e {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:50:32 devstack sudo[106396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-c736828a-209b-4daa-8406-c0938183587e Jun 17 04:50:32 devstack sudo[106396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:50:33 devstack sudo[106396]: pam_unix(sudo:session): session closed for user root Jun 17 04:50:33 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-ae8d8b3a-fea6-456a-87eb-e4700a77461d tempest-VolumesServicesTestJSON-1435341832 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-c736828a-209b-4daa-8406-c0938183587e" returned: 0 in 0.596s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:50:33 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-ae8d8b3a-fea6-456a-87eb-e4700a77461d tempest-VolumesServicesTestJSON-1435341832 None] Lock "cinder-quobyte-c736828a-209b-4daa-8406-c0938183587e" released by "delete_volume" :: held 1.377s {{(pid=92060) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 04:50:33 devstack cinder-volume[92060]: DEBUG cinder.quota [None req-ae8d8b3a-fea6-456a-87eb-e4700a77461d tempest-VolumesServicesTestJSON-1435341832 None] Created reservations ['15a0d8d9-0ed8-4b2c-b2bc-da18e7aa793e', '6393a0e3-54e3-46aa-92b8-8877d7ad5273', 'bcb35734-f76c-4f1c-a000-9d6c7c5e3ef9', '2c5db95b-9e9c-46fa-b1bb-8a50e08526d4'] {{(pid=92060) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 17 04:50:33 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-ae8d8b3a-fea6-456a-87eb-e4700a77461d tempest-VolumesServicesTestJSON-1435341832 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 04:50:33 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-ae8d8b3a-fea6-456a-87eb-e4700a77461d tempest-VolumesServicesTestJSON-1435341832 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 04:50:33 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-ae8d8b3a-fea6-456a-87eb-e4700a77461d tempest-VolumesServicesTestJSON-1435341832 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588': None} {{(pid=92060) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 17 04:50:33 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-ae8d8b3a-fea6-456a-87eb-e4700a77461d tempest-VolumesServicesTestJSON-1435341832 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588'] {{(pid=92060) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 17 04:50:33 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-ae8d8b3a-fea6-456a-87eb-e4700a77461d tempest-VolumesServicesTestJSON-1435341832 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 04:50:33 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-ae8d8b3a-fea6-456a-87eb-e4700a77461d tempest-VolumesServicesTestJSON-1435341832 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:50:33 devstack sudo[106399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a Jun 17 04:50:33 devstack sudo[106399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:50:34 devstack sudo[106399]: pam_unix(sudo:session): session closed for user root Jun 17 04:50:34 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-ae8d8b3a-fea6-456a-87eb-e4700a77461d tempest-VolumesServicesTestJSON-1435341832 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a" returned: 0 in 0.598s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:50:34 devstack cinder-volume[92060]: DEBUG cinder.manager [None req-ae8d8b3a-fea6-456a-87eb-e4700a77461d tempest-VolumesServicesTestJSON-1435341832 None] Notifying Schedulers of capabilities ... {{(pid=92060) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 17 04:50:34 devstack cinder-volume[92060]: INFO cinder.volume.manager [None req-ae8d8b3a-fea6-456a-87eb-e4700a77461d tempest-VolumesServicesTestJSON-1435341832 None] Deleted volume successfully. Jun 17 04:50:34 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-ae8d8b3a-fea6-456a-87eb-e4700a77461d tempest-VolumesServicesTestJSON-1435341832 None] Lock "cinder-c736828a-209b-4daa-8406-c0938183587e-delete_volume" released by "delete_volume" :: held 2.197s {{(pid=92060) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 04:50:43 devstack cinder-volume[92060]: DEBUG dbcounter [-] [92060] Writing DB stats cinder:SELECT=47,cinder:INSERT=17,cinder:UPDATE=52,cinder:DELETE=1 {{(pid=92060) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 17 04:50:44 devstack cinder-volume[92060]: DEBUG dbcounter [-] [92060] Writing DB stats cinder:UPDATE=38,cinder:SELECT=41,cinder:INSERT=15,cinder:DELETE=5 {{(pid=92060) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 17 04:50:44 devstack cinder-volume[92060]: DEBUG oslo_service.periodic_task [None req-60d279ad-ad8c-4d36-a4b8-f593e74fb922 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=92060) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 17 04:50:44 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-60d279ad-ad8c-4d36-a4b8-f593e74fb922 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 04:50:44 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-60d279ad-ad8c-4d36-a4b8-f593e74fb922 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 04:50:44 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-60d279ad-ad8c-4d36-a4b8-f593e74fb922 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588': None} {{(pid=92060) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 17 04:50:44 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-60d279ad-ad8c-4d36-a4b8-f593e74fb922 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588'] {{(pid=92060) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 17 04:50:44 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-60d279ad-ad8c-4d36-a4b8-f593e74fb922 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 04:50:44 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-60d279ad-ad8c-4d36-a4b8-f593e74fb922 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:50:44 devstack sudo[106512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a Jun 17 04:50:44 devstack sudo[106512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:50:45 devstack sudo[106512]: pam_unix(sudo:session): session closed for user root Jun 17 04:50:45 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-60d279ad-ad8c-4d36-a4b8-f593e74fb922 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a" returned: 0 in 0.637s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:50:45 devstack cinder-volume[92060]: DEBUG cinder.manager [None req-60d279ad-ad8c-4d36-a4b8-f593e74fb922 None None] Notifying Schedulers of capabilities ... {{(pid=92060) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 17 04:50:45 devstack cinder-volume[92060]: DEBUG oslo_service.periodic_task [None req-60d279ad-ad8c-4d36-a4b8-f593e74fb922 None None] Running periodic task VolumeManager._thread_info {{(pid=92060) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 17 04:50:45 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-60d279ad-ad8c-4d36-a4b8-f593e74fb922 None None] thread count: 28 {{(pid=92060) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 17 04:50:45 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-60d279ad-ad8c-4d36-a4b8-f593e74fb922 None None] thread info: [<_MainThread(MainThread, started 130061806440576)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=92060) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 17 04:50:58 devstack cinder-volume[92060]: INFO cinder.volume.manager [req-2e8a9bde-6c8a-43a4-a318-3498eb956101 req-62aad00c-b01b-448c-9702-a0798fd9dd38 tempest-TestShelveInstance-2059068282 None] Terminate volume connection completed successfully. Jun 17 04:50:58 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [req-2e8a9bde-6c8a-43a4-a318-3498eb956101 req-62aad00c-b01b-448c-9702-a0798fd9dd38 tempest-TestShelveInstance-2059068282 None] Deleting attachment 5e474fc9-ea00-4bcd-a793-4276f90ff3c9. {{(pid=92060) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 17 04:51:02 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [req-3c0359ae-0e21-4692-8d63-8ec11c854983 req-b23cae7f-59f5-462b-8b0b-142543d893eb tempest-TestShelveInstance-2059068282 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 04:51:02 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [req-3c0359ae-0e21-4692-8d63-8ec11c854983 req-b23cae7f-59f5-462b-8b0b-142543d893eb tempest-TestShelveInstance-2059068282 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 04:51:02 devstack cinder-volume[92060]: DEBUG oslo.privsep.daemon [-] privsep: reply[62684a3a-daa4-433d-812b-7052d0f121ad]: (4, 'raw') {{(pid=93130) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 04:51:02 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [req-3c0359ae-0e21-4692-8d63-8ec11c854983 req-b23cae7f-59f5-462b-8b0b-142543d893eb tempest-TestShelveInstance-2059068282 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-c22c4041-72e9-4e3e-99e3-e131db5f8013 {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:51:03 devstack sudo[106576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-c22c4041-72e9-4e3e-99e3-e131db5f8013 Jun 17 04:51:03 devstack sudo[106576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:51:03 devstack sudo[106576]: pam_unix(sudo:session): session closed for user root Jun 17 04:51:03 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [req-3c0359ae-0e21-4692-8d63-8ec11c854983 req-b23cae7f-59f5-462b-8b0b-142543d893eb tempest-TestShelveInstance-2059068282 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-c22c4041-72e9-4e3e-99e3-e131db5f8013" returned: 0 in 0.753s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:51:03 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [req-3c0359ae-0e21-4692-8d63-8ec11c854983 req-b23cae7f-59f5-462b-8b0b-142543d893eb tempest-TestShelveInstance-2059068282 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-c22c4041-72e9-4e3e-99e3-e131db5f8013 {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:51:03 devstack sudo[106580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-c22c4041-72e9-4e3e-99e3-e131db5f8013 Jun 17 04:51:03 devstack sudo[106580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:51:04 devstack sudo[106580]: pam_unix(sudo:session): session closed for user root Jun 17 04:51:04 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [req-3c0359ae-0e21-4692-8d63-8ec11c854983 req-b23cae7f-59f5-462b-8b0b-142543d893eb tempest-TestShelveInstance-2059068282 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-c22c4041-72e9-4e3e-99e3-e131db5f8013" returned: 1 in 0.723s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:51:04 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [req-3c0359ae-0e21-4692-8d63-8ec11c854983 req-b23cae7f-59f5-462b-8b0b-142543d893eb tempest-TestShelveInstance-2059068282 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-c22c4041-72e9-4e3e-99e3-e131db5f8013' failed. Not Retrying. {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 17 04:51:04 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [req-3c0359ae-0e21-4692-8d63-8ec11c854983 req-b23cae7f-59f5-462b-8b0b-142543d893eb tempest-TestShelveInstance-2059068282 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.532s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 04:51:04 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [req-3c0359ae-0e21-4692-8d63-8ec11c854983 req-b23cae7f-59f5-462b-8b0b-142543d893eb tempest-TestShelveInstance-2059068282 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588', 'name': 'volume-c22c4041-72e9-4e3e-99e3-e131db5f8013', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '54442990-cabe-4dcd-b535-6dc43a817d6e', 'enforce_multipath': True} {{(pid=92060) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 17 04:51:04 devstack cinder-volume[92060]: INFO cinder.volume.manager [req-3c0359ae-0e21-4692-8d63-8ec11c854983 req-b23cae7f-59f5-462b-8b0b-142543d893eb tempest-TestShelveInstance-2059068282 None] attachment_update completed successfully. Jun 17 04:51:14 devstack cinder-volume[92060]: DEBUG dbcounter [-] [92060] Writing DB stats cinder:SELECT=5,cinder:UPDATE=2 {{(pid=92060) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 17 04:51:14 devstack cinder-volume[92060]: DEBUG dbcounter [-] [92060] Writing DB stats cinder:SELECT=8,cinder:UPDATE=1 {{(pid=92060) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 17 04:51:22 devstack cinder-volume[92060]: DEBUG cinder.volume.flows.manager.create_volume [None req-d1522529-f6ac-43af-9fc0-67a33511b98e tempest-VolumesActionsTest-580861366 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92060) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 17 04:51:22 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-d1522529-f6ac-43af-9fc0-67a33511b98e tempest-VolumesActionsTest-580861366 None] Flow 'volume_create_manager' (4155d27f-9d0c-43bb-8cec-ffa5ab0622fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 17 04:51:22 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-d1522529-f6ac-43af-9fc0-67a33511b98e tempest-VolumesActionsTest-580861366 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3c915096-4e1d-421c-998b-ec9347ba1ecc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:51:22 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-d1522529-f6ac-43af-9fc0-67a33511b98e tempest-VolumesActionsTest-580861366 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3c915096-4e1d-421c-998b-ec9347ba1ecc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-17T02:51:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-358900667',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fa0c2058-733e-466a-860f-c5fe68919228,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3d3f6191344d4204827365d8103433bb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T02:51:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T02:51:23Z,use_quota=True,user_id='17deb269ce2541159a6caa1cc972812e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aad9ce24-93f9-41a6-baa1-5125964f96d1),volume_type_id=aad9ce24-93f9-41a6-baa1-5125964f96d1)' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:51:22 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-d1522529-f6ac-43af-9fc0-67a33511b98e tempest-VolumesActionsTest-580861366 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (11b2e7f6-8b8c-49dc-b15b-cb71fe26b434) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:51:22 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-d1522529-f6ac-43af-9fc0-67a33511b98e tempest-VolumesActionsTest-580861366 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (11b2e7f6-8b8c-49dc-b15b-cb71fe26b434) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:51:22 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-d1522529-f6ac-43af-9fc0-67a33511b98e tempest-VolumesActionsTest-580861366 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (154ed982-af07-4a9d-b12f-6da12479af0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:51:22 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-d1522529-f6ac-43af-9fc0-67a33511b98e tempest-VolumesActionsTest-580861366 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (154ed982-af07-4a9d-b12f-6da12479af0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fa0c2058-733e-466a-860f-c5fe68919228', 'volume_name': 'volume-fa0c2058-733e-466a-860f-c5fe68919228', 'volume_size': 1}' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:51:23 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-d1522529-f6ac-43af-9fc0-67a33511b98e tempest-VolumesActionsTest-580861366 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (37340ba9-1405-4f21-9773-b6298610d876) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:51:23 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-d1522529-f6ac-43af-9fc0-67a33511b98e tempest-VolumesActionsTest-580861366 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (37340ba9-1405-4f21-9773-b6298610d876) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:51:23 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-d1522529-f6ac-43af-9fc0-67a33511b98e tempest-VolumesActionsTest-580861366 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (77b9470a-4f73-46e1-89ad-5bbda3f7fc6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:51:23 devstack cinder-volume[92060]: INFO cinder.volume.flows.manager.create_volume [None req-d1522529-f6ac-43af-9fc0-67a33511b98e tempest-VolumesActionsTest-580861366 None] Volume fa0c2058-733e-466a-860f-c5fe68919228: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fa0c2058-733e-466a-860f-c5fe68919228', 'volume_size': 1} Jun 17 04:51:23 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-d1522529-f6ac-43af-9fc0-67a33511b98e tempest-VolumesActionsTest-580861366 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 04:51:23 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-d1522529-f6ac-43af-9fc0-67a33511b98e tempest-VolumesActionsTest-580861366 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 04:51:23 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-d1522529-f6ac-43af-9fc0-67a33511b98e tempest-VolumesActionsTest-580861366 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-17T02:51:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-358900667',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fa0c2058-733e-466a-860f-c5fe68919228,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3d3f6191344d4204827365d8103433bb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T02:51:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T02:51:23Z,use_quota=True,user_id='17deb269ce2541159a6caa1cc972812e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aad9ce24-93f9-41a6-baa1-5125964f96d1),volume_type_id=aad9ce24-93f9-41a6-baa1-5125964f96d1)}" {{(pid=92060) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 17 04:51:23 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.remotefs [None req-d1522529-f6ac-43af-9fc0-67a33511b98e tempest-VolumesActionsTest-580861366 None] Creating volume fa0c2058-733e-466a-860f-c5fe68919228 {{(pid=92060) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 17 04:51:23 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-d1522529-f6ac-43af-9fc0-67a33511b98e tempest-VolumesActionsTest-580861366 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 04:51:23 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-d1522529-f6ac-43af-9fc0-67a33511b98e tempest-VolumesActionsTest-580861366 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 04:51:23 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-d1522529-f6ac-43af-9fc0-67a33511b98e tempest-VolumesActionsTest-580861366 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588': None} {{(pid=92060) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 17 04:51:23 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-d1522529-f6ac-43af-9fc0-67a33511b98e tempest-VolumesActionsTest-580861366 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588'] {{(pid=92060) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 17 04:51:23 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-d1522529-f6ac-43af-9fc0-67a33511b98e tempest-VolumesActionsTest-580861366 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 04:51:23 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-d1522529-f6ac-43af-9fc0-67a33511b98e tempest-VolumesActionsTest-580861366 None] Selected osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588 as target Quobyte volume. {{(pid=92060) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 17 04:51:23 devstack cinder-volume[92060]: INFO cinder.volume.drivers.remotefs [None req-d1522529-f6ac-43af-9fc0-67a33511b98e tempest-VolumesActionsTest-580861366 None] casted to osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588 Jun 17 04:51:23 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-d1522529-f6ac-43af-9fc0-67a33511b98e tempest-VolumesActionsTest-580861366 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-fa0c2058-733e-466a-860f-c5fe68919228 1073741824 {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:51:23 devstack sudo[107127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-fa0c2058-733e-466a-860f-c5fe68919228 1073741824 Jun 17 04:51:23 devstack sudo[107127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:51:23 devstack sudo[107127]: pam_unix(sudo:session): session closed for user root Jun 17 04:51:23 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-d1522529-f6ac-43af-9fc0-67a33511b98e tempest-VolumesActionsTest-580861366 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-fa0c2058-733e-466a-860f-c5fe68919228 1073741824" returned: 0 in 0.824s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:51:23 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-d1522529-f6ac-43af-9fc0-67a33511b98e tempest-VolumesActionsTest-580861366 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-fa0c2058-733e-466a-860f-c5fe68919228 {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:51:23 devstack sudo[107167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-fa0c2058-733e-466a-860f-c5fe68919228 Jun 17 04:51:23 devstack sudo[107167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:51:24 devstack sudo[107167]: pam_unix(sudo:session): session closed for user root Jun 17 04:51:24 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-d1522529-f6ac-43af-9fc0-67a33511b98e tempest-VolumesActionsTest-580861366 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-fa0c2058-733e-466a-860f-c5fe68919228" returned: 0 in 0.719s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:51:24 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-d1522529-f6ac-43af-9fc0-67a33511b98e tempest-VolumesActionsTest-580861366 None] <== create_volume: return (1612ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588'} {{(pid=92060) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 17 04:51:24 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-d1522529-f6ac-43af-9fc0-67a33511b98e tempest-VolumesActionsTest-580861366 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.617s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 04:51:24 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-d1522529-f6ac-43af-9fc0-67a33511b98e tempest-VolumesActionsTest-580861366 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (77b9470a-4f73-46e1-89ad-5bbda3f7fc6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fa0c2058-733e-466a-860f-c5fe68919228', 'volume_size': 1}' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:51:24 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-d1522529-f6ac-43af-9fc0-67a33511b98e tempest-VolumesActionsTest-580861366 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (32efbc08-d22e-4cf8-a0e6-8bea0faef896) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:51:24 devstack cinder-volume[92060]: INFO cinder.volume.flows.manager.create_volume [None req-d1522529-f6ac-43af-9fc0-67a33511b98e tempest-VolumesActionsTest-580861366 None] Volume volume-fa0c2058-733e-466a-860f-c5fe68919228 (fa0c2058-733e-466a-860f-c5fe68919228): created successfully Jun 17 04:51:24 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-d1522529-f6ac-43af-9fc0-67a33511b98e tempest-VolumesActionsTest-580861366 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (32efbc08-d22e-4cf8-a0e6-8bea0faef896) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:51:24 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-d1522529-f6ac-43af-9fc0-67a33511b98e tempest-VolumesActionsTest-580861366 None] Flow 'volume_create_manager' (4155d27f-9d0c-43bb-8cec-ffa5ab0622fc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92060) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 17 04:51:24 devstack cinder-volume[92060]: INFO cinder.volume.manager [None req-d1522529-f6ac-43af-9fc0-67a33511b98e tempest-VolumesActionsTest-580861366 None] Created volume successfully. Jun 17 04:51:25 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-616d46ba-c8b1-4602-ae07-4ad49de77f2e tempest-VolumesActionsTest-580861366 None] Acquiring lock "cinder-fa0c2058-733e-466a-860f-c5fe68919228" by "attach_volume" {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 04:51:25 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-616d46ba-c8b1-4602-ae07-4ad49de77f2e tempest-VolumesActionsTest-580861366 None] Lock "cinder-fa0c2058-733e-466a-860f-c5fe68919228" acquired by "attach_volume" :: waited 0.027s {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 04:51:25 devstack cinder-volume[92060]: INFO cinder.volume.manager [None req-616d46ba-c8b1-4602-ae07-4ad49de77f2e tempest-VolumesActionsTest-580861366 None] Attaching volume fa0c2058-733e-466a-860f-c5fe68919228 to instance 221f5da6-41f0-419b-85b3-8faf36f60da2 at mountpoint /dev/vdb on host None. Jun 17 04:51:25 devstack cinder-volume[92060]: INFO cinder.volume.manager [None req-616d46ba-c8b1-4602-ae07-4ad49de77f2e tempest-VolumesActionsTest-580861366 None] Attach volume completed successfully. Jun 17 04:51:25 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-616d46ba-c8b1-4602-ae07-4ad49de77f2e tempest-VolumesActionsTest-580861366 None] Lock "cinder-fa0c2058-733e-466a-860f-c5fe68919228" released by "attach_volume" :: held 0.115s {{(pid=92060) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 04:51:26 devstack cinder-volume[92060]: INFO cinder.volume.manager [None req-d65b01d2-4ad1-4a66-80c7-4838ff3f13e1 tempest-VolumesActionsTest-1357992424 None] Terminate volume connection completed successfully. Jun 17 04:51:26 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-d65b01d2-4ad1-4a66-80c7-4838ff3f13e1 tempest-VolumesActionsTest-1357992424 None] Acquiring lock "cinder-fa0c2058-733e-466a-860f-c5fe68919228-detach_volume" by "detach_volume" {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 04:51:26 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-d65b01d2-4ad1-4a66-80c7-4838ff3f13e1 tempest-VolumesActionsTest-1357992424 None] Lock "cinder-fa0c2058-733e-466a-860f-c5fe68919228-detach_volume" acquired by "detach_volume" :: waited 0.019s {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 04:51:26 devstack cinder-volume[92060]: INFO cinder.volume.manager [None req-d65b01d2-4ad1-4a66-80c7-4838ff3f13e1 tempest-VolumesActionsTest-1357992424 None] Detaching volume fa0c2058-733e-466a-860f-c5fe68919228 from instance 221f5da6-41f0-419b-85b3-8faf36f60da2. Jun 17 04:51:26 devstack cinder-volume[92060]: INFO cinder.volume.manager [None req-d65b01d2-4ad1-4a66-80c7-4838ff3f13e1 tempest-VolumesActionsTest-1357992424 None] Detach volume completed successfully. Jun 17 04:51:26 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-d65b01d2-4ad1-4a66-80c7-4838ff3f13e1 tempest-VolumesActionsTest-1357992424 None] Lock "cinder-fa0c2058-733e-466a-860f-c5fe68919228-detach_volume" released by "detach_volume" :: held 0.070s {{(pid=92060) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 04:51:27 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-a5ab5ef5-66e0-4624-8289-8b1046ac6b9e tempest-VolumesActionsTest-580861366 None] Acquiring lock "cinder-fa0c2058-733e-466a-860f-c5fe68919228-detach_volume" by "detach_volume" {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 04:51:27 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-a5ab5ef5-66e0-4624-8289-8b1046ac6b9e tempest-VolumesActionsTest-580861366 None] Lock "cinder-fa0c2058-733e-466a-860f-c5fe68919228-detach_volume" acquired by "detach_volume" :: waited 0.020s {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 04:51:27 devstack cinder-volume[92060]: INFO cinder.volume.manager [None req-a5ab5ef5-66e0-4624-8289-8b1046ac6b9e tempest-VolumesActionsTest-580861366 None] Volume detach called, but volume not attached. Jun 17 04:51:27 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-a5ab5ef5-66e0-4624-8289-8b1046ac6b9e tempest-VolumesActionsTest-580861366 None] Lock "cinder-fa0c2058-733e-466a-860f-c5fe68919228-detach_volume" released by "detach_volume" :: held 0.024s {{(pid=92060) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 04:51:28 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-df944444-c46d-4c71-978a-15851a4fd0bc tempest-VolumesActionsTest-580861366 None] Acquiring lock "cinder-fa0c2058-733e-466a-860f-c5fe68919228-delete_volume" by "delete_volume" {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 04:51:28 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-df944444-c46d-4c71-978a-15851a4fd0bc tempest-VolumesActionsTest-580861366 None] Lock "cinder-fa0c2058-733e-466a-860f-c5fe68919228-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 04:51:28 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-df944444-c46d-4c71-978a-15851a4fd0bc tempest-VolumesActionsTest-580861366 None] Acquiring lock "cinder-quobyte-fa0c2058-733e-466a-860f-c5fe68919228" by "delete_volume" {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 04:51:28 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-df944444-c46d-4c71-978a-15851a4fd0bc tempest-VolumesActionsTest-580861366 None] Lock "cinder-quobyte-fa0c2058-733e-466a-860f-c5fe68919228" acquired by "delete_volume" :: waited 0.023s {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 04:51:28 devstack cinder-volume[92060]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f967e24-261b-4640-9678-243dbadbc567]: (4, 'qcow2') {{(pid=93130) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 04:51:28 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-df944444-c46d-4c71-978a-15851a4fd0bc tempest-VolumesActionsTest-580861366 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-fa0c2058-733e-466a-860f-c5fe68919228 {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:51:28 devstack sudo[107172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-fa0c2058-733e-466a-860f-c5fe68919228 Jun 17 04:51:28 devstack sudo[107172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:51:28 devstack sudo[107172]: pam_unix(sudo:session): session closed for user root Jun 17 04:51:28 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-df944444-c46d-4c71-978a-15851a4fd0bc tempest-VolumesActionsTest-580861366 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-fa0c2058-733e-466a-860f-c5fe68919228" returned: 0 in 0.731s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:51:28 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-df944444-c46d-4c71-978a-15851a4fd0bc tempest-VolumesActionsTest-580861366 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-fa0c2058-733e-466a-860f-c5fe68919228 {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:51:28 devstack sudo[107177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-fa0c2058-733e-466a-860f-c5fe68919228 Jun 17 04:51:28 devstack sudo[107177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:51:29 devstack sudo[107177]: pam_unix(sudo:session): session closed for user root Jun 17 04:51:29 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-df944444-c46d-4c71-978a-15851a4fd0bc tempest-VolumesActionsTest-580861366 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-fa0c2058-733e-466a-860f-c5fe68919228" returned: 0 in 0.620s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:51:29 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-df944444-c46d-4c71-978a-15851a4fd0bc tempest-VolumesActionsTest-580861366 None] Lock "cinder-quobyte-fa0c2058-733e-466a-860f-c5fe68919228" released by "delete_volume" :: held 1.409s {{(pid=92060) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 04:51:29 devstack cinder-volume[92060]: DEBUG cinder.quota [None req-df944444-c46d-4c71-978a-15851a4fd0bc tempest-VolumesActionsTest-580861366 None] Created reservations ['3f3397a0-514a-48af-a0e2-7b0ae94bc225', '359cb374-49a0-4f76-8281-4bd84d808526', 'cbb1823a-ce1d-4c0d-8feb-3408519719d5', '41df35b3-e987-40aa-9d36-766edd40fbdd'] {{(pid=92060) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 17 04:51:29 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-df944444-c46d-4c71-978a-15851a4fd0bc tempest-VolumesActionsTest-580861366 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 04:51:29 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-df944444-c46d-4c71-978a-15851a4fd0bc tempest-VolumesActionsTest-580861366 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 04:51:29 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-df944444-c46d-4c71-978a-15851a4fd0bc tempest-VolumesActionsTest-580861366 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588': None} {{(pid=92060) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 17 04:51:29 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-df944444-c46d-4c71-978a-15851a4fd0bc tempest-VolumesActionsTest-580861366 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588'] {{(pid=92060) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 17 04:51:29 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-df944444-c46d-4c71-978a-15851a4fd0bc tempest-VolumesActionsTest-580861366 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 04:51:29 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-df944444-c46d-4c71-978a-15851a4fd0bc tempest-VolumesActionsTest-580861366 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:51:29 devstack sudo[107180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a Jun 17 04:51:29 devstack sudo[107180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:51:30 devstack sudo[107180]: pam_unix(sudo:session): session closed for user root Jun 17 04:51:30 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-df944444-c46d-4c71-978a-15851a4fd0bc tempest-VolumesActionsTest-580861366 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a" returned: 0 in 0.633s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:51:30 devstack cinder-volume[92060]: DEBUG cinder.manager [None req-df944444-c46d-4c71-978a-15851a4fd0bc tempest-VolumesActionsTest-580861366 None] Notifying Schedulers of capabilities ... {{(pid=92060) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 17 04:51:30 devstack cinder-volume[92060]: INFO cinder.volume.manager [None req-df944444-c46d-4c71-978a-15851a4fd0bc tempest-VolumesActionsTest-580861366 None] Deleted volume successfully. Jun 17 04:51:30 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-df944444-c46d-4c71-978a-15851a4fd0bc tempest-VolumesActionsTest-580861366 None] Lock "cinder-fa0c2058-733e-466a-860f-c5fe68919228-delete_volume" released by "delete_volume" :: held 2.278s {{(pid=92060) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 04:51:38 devstack cinder-volume[92060]: DEBUG cinder.volume.flows.manager.create_volume [None req-f5c99c7f-a8a5-499d-8fc2-f2680a73002e tempest-VolumesActionsTest-580861366 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92060) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 17 04:51:38 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-f5c99c7f-a8a5-499d-8fc2-f2680a73002e tempest-VolumesActionsTest-580861366 None] Flow 'volume_create_manager' (80036894-8a0a-4f41-bb8f-5794285ba33b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 17 04:51:38 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-f5c99c7f-a8a5-499d-8fc2-f2680a73002e tempest-VolumesActionsTest-580861366 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (661f0e03-a615-472c-b95e-9c0f7df27a98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:51:38 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-f5c99c7f-a8a5-499d-8fc2-f2680a73002e tempest-VolumesActionsTest-580861366 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (661f0e03-a615-472c-b95e-9c0f7df27a98) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-17T02:51:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1689408680',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3869c4df-6396-4c52-bc69-c9dd860b30ae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3d3f6191344d4204827365d8103433bb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T02:51:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T02:51:38Z,use_quota=True,user_id='17deb269ce2541159a6caa1cc972812e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aad9ce24-93f9-41a6-baa1-5125964f96d1),volume_type_id=aad9ce24-93f9-41a6-baa1-5125964f96d1)' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:51:38 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-f5c99c7f-a8a5-499d-8fc2-f2680a73002e tempest-VolumesActionsTest-580861366 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e87e88ac-4cce-424d-bcea-102d480aae54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:51:38 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-f5c99c7f-a8a5-499d-8fc2-f2680a73002e tempest-VolumesActionsTest-580861366 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e87e88ac-4cce-424d-bcea-102d480aae54) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:51:38 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-f5c99c7f-a8a5-499d-8fc2-f2680a73002e tempest-VolumesActionsTest-580861366 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fad98a88-982a-40d3-8234-53442aefaca8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:51:38 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-f5c99c7f-a8a5-499d-8fc2-f2680a73002e tempest-VolumesActionsTest-580861366 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fad98a88-982a-40d3-8234-53442aefaca8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3869c4df-6396-4c52-bc69-c9dd860b30ae', 'volume_name': 'volume-3869c4df-6396-4c52-bc69-c9dd860b30ae', 'volume_size': 1}' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:51:38 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-f5c99c7f-a8a5-499d-8fc2-f2680a73002e tempest-VolumesActionsTest-580861366 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8949b403-cede-407d-b7ad-b482a1cd1b0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:51:38 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-f5c99c7f-a8a5-499d-8fc2-f2680a73002e tempest-VolumesActionsTest-580861366 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8949b403-cede-407d-b7ad-b482a1cd1b0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:51:38 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-f5c99c7f-a8a5-499d-8fc2-f2680a73002e tempest-VolumesActionsTest-580861366 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2f8ced3e-6d62-401a-8a16-4cddba57c17c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:51:38 devstack cinder-volume[92060]: INFO cinder.volume.flows.manager.create_volume [None req-f5c99c7f-a8a5-499d-8fc2-f2680a73002e tempest-VolumesActionsTest-580861366 None] Volume 3869c4df-6396-4c52-bc69-c9dd860b30ae: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3869c4df-6396-4c52-bc69-c9dd860b30ae', 'volume_size': 1} Jun 17 04:51:38 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-f5c99c7f-a8a5-499d-8fc2-f2680a73002e tempest-VolumesActionsTest-580861366 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 04:51:38 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-f5c99c7f-a8a5-499d-8fc2-f2680a73002e tempest-VolumesActionsTest-580861366 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 04:51:38 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-f5c99c7f-a8a5-499d-8fc2-f2680a73002e tempest-VolumesActionsTest-580861366 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-17T02:51:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1689408680',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3869c4df-6396-4c52-bc69-c9dd860b30ae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3d3f6191344d4204827365d8103433bb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T02:51:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T02:51:38Z,use_quota=True,user_id='17deb269ce2541159a6caa1cc972812e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aad9ce24-93f9-41a6-baa1-5125964f96d1),volume_type_id=aad9ce24-93f9-41a6-baa1-5125964f96d1)}" {{(pid=92060) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 17 04:51:38 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.remotefs [None req-f5c99c7f-a8a5-499d-8fc2-f2680a73002e tempest-VolumesActionsTest-580861366 None] Creating volume 3869c4df-6396-4c52-bc69-c9dd860b30ae {{(pid=92060) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 17 04:51:38 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-f5c99c7f-a8a5-499d-8fc2-f2680a73002e tempest-VolumesActionsTest-580861366 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 04:51:38 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-f5c99c7f-a8a5-499d-8fc2-f2680a73002e tempest-VolumesActionsTest-580861366 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 04:51:38 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-f5c99c7f-a8a5-499d-8fc2-f2680a73002e tempest-VolumesActionsTest-580861366 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588': None} {{(pid=92060) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 17 04:51:38 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-f5c99c7f-a8a5-499d-8fc2-f2680a73002e tempest-VolumesActionsTest-580861366 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588'] {{(pid=92060) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 17 04:51:38 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-f5c99c7f-a8a5-499d-8fc2-f2680a73002e tempest-VolumesActionsTest-580861366 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 04:51:38 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-f5c99c7f-a8a5-499d-8fc2-f2680a73002e tempest-VolumesActionsTest-580861366 None] Selected osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588 as target Quobyte volume. {{(pid=92060) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 17 04:51:38 devstack cinder-volume[92060]: INFO cinder.volume.drivers.remotefs [None req-f5c99c7f-a8a5-499d-8fc2-f2680a73002e tempest-VolumesActionsTest-580861366 None] casted to osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588 Jun 17 04:51:38 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-f5c99c7f-a8a5-499d-8fc2-f2680a73002e tempest-VolumesActionsTest-580861366 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-3869c4df-6396-4c52-bc69-c9dd860b30ae 1073741824 {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:51:38 devstack sudo[107260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-3869c4df-6396-4c52-bc69-c9dd860b30ae 1073741824 Jun 17 04:51:38 devstack sudo[107260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:51:39 devstack sudo[107260]: pam_unix(sudo:session): session closed for user root Jun 17 04:51:39 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-f5c99c7f-a8a5-499d-8fc2-f2680a73002e tempest-VolumesActionsTest-580861366 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-3869c4df-6396-4c52-bc69-c9dd860b30ae 1073741824" returned: 0 in 0.788s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:51:39 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-f5c99c7f-a8a5-499d-8fc2-f2680a73002e tempest-VolumesActionsTest-580861366 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-3869c4df-6396-4c52-bc69-c9dd860b30ae {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:51:39 devstack sudo[107266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-3869c4df-6396-4c52-bc69-c9dd860b30ae Jun 17 04:51:39 devstack sudo[107266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:51:39 devstack sudo[107266]: pam_unix(sudo:session): session closed for user root Jun 17 04:51:39 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-f5c99c7f-a8a5-499d-8fc2-f2680a73002e tempest-VolumesActionsTest-580861366 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-3869c4df-6396-4c52-bc69-c9dd860b30ae" returned: 0 in 0.574s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:51:39 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-f5c99c7f-a8a5-499d-8fc2-f2680a73002e tempest-VolumesActionsTest-580861366 None] <== create_volume: return (1399ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588'} {{(pid=92060) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 17 04:51:39 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-f5c99c7f-a8a5-499d-8fc2-f2680a73002e tempest-VolumesActionsTest-580861366 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.402s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 04:51:39 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-f5c99c7f-a8a5-499d-8fc2-f2680a73002e tempest-VolumesActionsTest-580861366 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2f8ced3e-6d62-401a-8a16-4cddba57c17c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3869c4df-6396-4c52-bc69-c9dd860b30ae', 'volume_size': 1}' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:51:39 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-f5c99c7f-a8a5-499d-8fc2-f2680a73002e tempest-VolumesActionsTest-580861366 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (41d84f0c-1072-4ed1-a9d8-7554a763349a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:51:39 devstack cinder-volume[92060]: INFO cinder.volume.flows.manager.create_volume [None req-f5c99c7f-a8a5-499d-8fc2-f2680a73002e tempest-VolumesActionsTest-580861366 None] Volume volume-3869c4df-6396-4c52-bc69-c9dd860b30ae (3869c4df-6396-4c52-bc69-c9dd860b30ae): created successfully Jun 17 04:51:39 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-f5c99c7f-a8a5-499d-8fc2-f2680a73002e tempest-VolumesActionsTest-580861366 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (41d84f0c-1072-4ed1-a9d8-7554a763349a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:51:39 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-f5c99c7f-a8a5-499d-8fc2-f2680a73002e tempest-VolumesActionsTest-580861366 None] Flow 'volume_create_manager' (80036894-8a0a-4f41-bb8f-5794285ba33b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92060) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 17 04:51:39 devstack cinder-volume[92060]: INFO cinder.volume.manager [None req-f5c99c7f-a8a5-499d-8fc2-f2680a73002e tempest-VolumesActionsTest-580861366 None] Created volume successfully. Jun 17 04:51:40 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-43ca2a17-d3ce-41b0-9490-4556e4aeba9d tempest-VolumesActionsTest-1357992424 None] Acquiring lock "cinder-3869c4df-6396-4c52-bc69-c9dd860b30ae-delete_volume" by "delete_volume" {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 04:51:40 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-43ca2a17-d3ce-41b0-9490-4556e4aeba9d tempest-VolumesActionsTest-1357992424 None] Lock "cinder-3869c4df-6396-4c52-bc69-c9dd860b30ae-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 04:51:40 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-43ca2a17-d3ce-41b0-9490-4556e4aeba9d tempest-VolumesActionsTest-1357992424 None] Acquiring lock "cinder-quobyte-3869c4df-6396-4c52-bc69-c9dd860b30ae" by "delete_volume" {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 04:51:40 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-43ca2a17-d3ce-41b0-9490-4556e4aeba9d tempest-VolumesActionsTest-1357992424 None] Lock "cinder-quobyte-3869c4df-6396-4c52-bc69-c9dd860b30ae" acquired by "delete_volume" :: waited 0.016s {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 04:51:40 devstack cinder-volume[92060]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c707ce3-3bee-4f72-97ac-76800d0c4d12]: (4, 'qcow2') {{(pid=93130) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 04:51:40 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-43ca2a17-d3ce-41b0-9490-4556e4aeba9d tempest-VolumesActionsTest-1357992424 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-3869c4df-6396-4c52-bc69-c9dd860b30ae {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:51:40 devstack sudo[107269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-3869c4df-6396-4c52-bc69-c9dd860b30ae Jun 17 04:51:40 devstack sudo[107269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:51:41 devstack sudo[107269]: pam_unix(sudo:session): session closed for user root Jun 17 04:51:41 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-43ca2a17-d3ce-41b0-9490-4556e4aeba9d tempest-VolumesActionsTest-1357992424 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-3869c4df-6396-4c52-bc69-c9dd860b30ae" returned: 0 in 0.705s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:51:41 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-43ca2a17-d3ce-41b0-9490-4556e4aeba9d tempest-VolumesActionsTest-1357992424 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-3869c4df-6396-4c52-bc69-c9dd860b30ae {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:51:41 devstack sudo[107274]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-3869c4df-6396-4c52-bc69-c9dd860b30ae Jun 17 04:51:41 devstack sudo[107274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:51:41 devstack sudo[107274]: pam_unix(sudo:session): session closed for user root Jun 17 04:51:41 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-43ca2a17-d3ce-41b0-9490-4556e4aeba9d tempest-VolumesActionsTest-1357992424 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-3869c4df-6396-4c52-bc69-c9dd860b30ae" returned: 0 in 0.613s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:51:41 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-43ca2a17-d3ce-41b0-9490-4556e4aeba9d tempest-VolumesActionsTest-1357992424 None] Lock "cinder-quobyte-3869c4df-6396-4c52-bc69-c9dd860b30ae" released by "delete_volume" :: held 1.356s {{(pid=92060) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 04:51:41 devstack cinder-volume[92060]: DEBUG cinder.quota [None req-43ca2a17-d3ce-41b0-9490-4556e4aeba9d tempest-VolumesActionsTest-1357992424 None] Created reservations ['a65913f1-998f-487a-888c-a603a036a59a', '16df7fb7-3c2c-4f15-839f-f161bd72417c', 'c549f65a-b32e-44a8-a899-8ad2406a8a81', 'b3de586f-ee09-4122-b245-2739e4479d47'] {{(pid=92060) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 17 04:51:41 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-43ca2a17-d3ce-41b0-9490-4556e4aeba9d tempest-VolumesActionsTest-1357992424 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 04:51:41 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-43ca2a17-d3ce-41b0-9490-4556e4aeba9d tempest-VolumesActionsTest-1357992424 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 04:51:41 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-43ca2a17-d3ce-41b0-9490-4556e4aeba9d tempest-VolumesActionsTest-1357992424 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588': None} {{(pid=92060) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 17 04:51:41 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-43ca2a17-d3ce-41b0-9490-4556e4aeba9d tempest-VolumesActionsTest-1357992424 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588'] {{(pid=92060) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 17 04:51:41 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-43ca2a17-d3ce-41b0-9490-4556e4aeba9d tempest-VolumesActionsTest-1357992424 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 04:51:41 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-43ca2a17-d3ce-41b0-9490-4556e4aeba9d tempest-VolumesActionsTest-1357992424 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:51:41 devstack sudo[107278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a Jun 17 04:51:41 devstack sudo[107278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:51:42 devstack sudo[107278]: pam_unix(sudo:session): session closed for user root Jun 17 04:51:42 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-43ca2a17-d3ce-41b0-9490-4556e4aeba9d tempest-VolumesActionsTest-1357992424 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a" returned: 0 in 0.594s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:51:42 devstack cinder-volume[92060]: DEBUG cinder.manager [None req-43ca2a17-d3ce-41b0-9490-4556e4aeba9d tempest-VolumesActionsTest-1357992424 None] Notifying Schedulers of capabilities ... {{(pid=92060) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 17 04:51:42 devstack cinder-volume[92060]: INFO cinder.volume.manager [None req-43ca2a17-d3ce-41b0-9490-4556e4aeba9d tempest-VolumesActionsTest-1357992424 None] Deleted volume successfully. Jun 17 04:51:42 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-43ca2a17-d3ce-41b0-9490-4556e4aeba9d tempest-VolumesActionsTest-1357992424 None] Lock "cinder-3869c4df-6396-4c52-bc69-c9dd860b30ae-delete_volume" released by "delete_volume" :: held 2.131s {{(pid=92060) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 04:51:42 devstack cinder-volume[92060]: DEBUG cinder.volume.flows.manager.create_volume [None req-03c114e4-8614-45dc-b1d5-4ad54a4dffc8 tempest-VolumesActionsTest-580861366 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92060) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 17 04:51:42 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-03c114e4-8614-45dc-b1d5-4ad54a4dffc8 tempest-VolumesActionsTest-580861366 None] Flow 'volume_create_manager' (f65baeab-6f78-4c00-8c39-189862af4c84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 17 04:51:42 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-03c114e4-8614-45dc-b1d5-4ad54a4dffc8 tempest-VolumesActionsTest-580861366 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c57c9359-038d-458f-8425-eac1f07c9a90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:51:43 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-03c114e4-8614-45dc-b1d5-4ad54a4dffc8 tempest-VolumesActionsTest-580861366 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c57c9359-038d-458f-8425-eac1f07c9a90) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-17T02:51:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-2009913703',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1edd1f20-943d-4575-8a58-ee58c0c7e4b0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3d3f6191344d4204827365d8103433bb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T02:51:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T02:51:43Z,use_quota=True,user_id='17deb269ce2541159a6caa1cc972812e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aad9ce24-93f9-41a6-baa1-5125964f96d1),volume_type_id=aad9ce24-93f9-41a6-baa1-5125964f96d1)' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:51:43 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-03c114e4-8614-45dc-b1d5-4ad54a4dffc8 tempest-VolumesActionsTest-580861366 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (61f8b161-b5b4-4fc6-b889-a47412d9d782) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:51:43 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-03c114e4-8614-45dc-b1d5-4ad54a4dffc8 tempest-VolumesActionsTest-580861366 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (61f8b161-b5b4-4fc6-b889-a47412d9d782) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:51:43 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-03c114e4-8614-45dc-b1d5-4ad54a4dffc8 tempest-VolumesActionsTest-580861366 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (56a01f37-b8aa-458e-9f86-7678ef7e77e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:51:43 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-03c114e4-8614-45dc-b1d5-4ad54a4dffc8 tempest-VolumesActionsTest-580861366 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (56a01f37-b8aa-458e-9f86-7678ef7e77e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1edd1f20-943d-4575-8a58-ee58c0c7e4b0', 'volume_name': 'volume-1edd1f20-943d-4575-8a58-ee58c0c7e4b0', 'volume_size': 1}' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:51:43 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-03c114e4-8614-45dc-b1d5-4ad54a4dffc8 tempest-VolumesActionsTest-580861366 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (01babb17-3d79-44b4-b07a-db3078458d5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:51:43 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-03c114e4-8614-45dc-b1d5-4ad54a4dffc8 tempest-VolumesActionsTest-580861366 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (01babb17-3d79-44b4-b07a-db3078458d5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:51:43 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-03c114e4-8614-45dc-b1d5-4ad54a4dffc8 tempest-VolumesActionsTest-580861366 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (278283d6-1129-4a1a-88cc-4369abcd7072) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:51:43 devstack cinder-volume[92060]: INFO cinder.volume.flows.manager.create_volume [None req-03c114e4-8614-45dc-b1d5-4ad54a4dffc8 tempest-VolumesActionsTest-580861366 None] Volume 1edd1f20-943d-4575-8a58-ee58c0c7e4b0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1edd1f20-943d-4575-8a58-ee58c0c7e4b0', 'volume_size': 1} Jun 17 04:51:43 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-03c114e4-8614-45dc-b1d5-4ad54a4dffc8 tempest-VolumesActionsTest-580861366 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 04:51:43 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-03c114e4-8614-45dc-b1d5-4ad54a4dffc8 tempest-VolumesActionsTest-580861366 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 04:51:43 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-03c114e4-8614-45dc-b1d5-4ad54a4dffc8 tempest-VolumesActionsTest-580861366 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-17T02:51:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-2009913703',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1edd1f20-943d-4575-8a58-ee58c0c7e4b0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3d3f6191344d4204827365d8103433bb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T02:51:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T02:51:43Z,use_quota=True,user_id='17deb269ce2541159a6caa1cc972812e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aad9ce24-93f9-41a6-baa1-5125964f96d1),volume_type_id=aad9ce24-93f9-41a6-baa1-5125964f96d1)}" {{(pid=92060) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 17 04:51:43 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.remotefs [None req-03c114e4-8614-45dc-b1d5-4ad54a4dffc8 tempest-VolumesActionsTest-580861366 None] Creating volume 1edd1f20-943d-4575-8a58-ee58c0c7e4b0 {{(pid=92060) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 17 04:51:43 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-03c114e4-8614-45dc-b1d5-4ad54a4dffc8 tempest-VolumesActionsTest-580861366 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 04:51:43 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-03c114e4-8614-45dc-b1d5-4ad54a4dffc8 tempest-VolumesActionsTest-580861366 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 04:51:43 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-03c114e4-8614-45dc-b1d5-4ad54a4dffc8 tempest-VolumesActionsTest-580861366 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588': None} {{(pid=92060) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 17 04:51:43 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-03c114e4-8614-45dc-b1d5-4ad54a4dffc8 tempest-VolumesActionsTest-580861366 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588'] {{(pid=92060) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 17 04:51:43 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-03c114e4-8614-45dc-b1d5-4ad54a4dffc8 tempest-VolumesActionsTest-580861366 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 04:51:43 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-03c114e4-8614-45dc-b1d5-4ad54a4dffc8 tempest-VolumesActionsTest-580861366 None] Selected osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588 as target Quobyte volume. {{(pid=92060) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 17 04:51:43 devstack cinder-volume[92060]: INFO cinder.volume.drivers.remotefs [None req-03c114e4-8614-45dc-b1d5-4ad54a4dffc8 tempest-VolumesActionsTest-580861366 None] casted to osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588 Jun 17 04:51:43 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-03c114e4-8614-45dc-b1d5-4ad54a4dffc8 tempest-VolumesActionsTest-580861366 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-1edd1f20-943d-4575-8a58-ee58c0c7e4b0 1073741824 {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:51:43 devstack sudo[107281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-1edd1f20-943d-4575-8a58-ee58c0c7e4b0 1073741824 Jun 17 04:51:43 devstack sudo[107281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:51:43 devstack sudo[107281]: pam_unix(sudo:session): session closed for user root Jun 17 04:51:43 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-03c114e4-8614-45dc-b1d5-4ad54a4dffc8 tempest-VolumesActionsTest-580861366 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-1edd1f20-943d-4575-8a58-ee58c0c7e4b0 1073741824" returned: 0 in 0.751s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:51:43 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-03c114e4-8614-45dc-b1d5-4ad54a4dffc8 tempest-VolumesActionsTest-580861366 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-1edd1f20-943d-4575-8a58-ee58c0c7e4b0 {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:51:43 devstack sudo[107286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-1edd1f20-943d-4575-8a58-ee58c0c7e4b0 Jun 17 04:51:43 devstack sudo[107286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:51:44 devstack sudo[107286]: pam_unix(sudo:session): session closed for user root Jun 17 04:51:44 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-03c114e4-8614-45dc-b1d5-4ad54a4dffc8 tempest-VolumesActionsTest-580861366 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-1edd1f20-943d-4575-8a58-ee58c0c7e4b0" returned: 0 in 0.593s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:51:44 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-03c114e4-8614-45dc-b1d5-4ad54a4dffc8 tempest-VolumesActionsTest-580861366 None] <== create_volume: return (1387ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588'} {{(pid=92060) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 17 04:51:44 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-03c114e4-8614-45dc-b1d5-4ad54a4dffc8 tempest-VolumesActionsTest-580861366 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.390s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 04:51:44 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-03c114e4-8614-45dc-b1d5-4ad54a4dffc8 tempest-VolumesActionsTest-580861366 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (278283d6-1129-4a1a-88cc-4369abcd7072) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1edd1f20-943d-4575-8a58-ee58c0c7e4b0', 'volume_size': 1}' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:51:44 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-03c114e4-8614-45dc-b1d5-4ad54a4dffc8 tempest-VolumesActionsTest-580861366 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (54774f86-957d-4b50-9f2d-b35f43331c9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:51:44 devstack cinder-volume[92060]: INFO cinder.volume.flows.manager.create_volume [None req-03c114e4-8614-45dc-b1d5-4ad54a4dffc8 tempest-VolumesActionsTest-580861366 None] Volume volume-1edd1f20-943d-4575-8a58-ee58c0c7e4b0 (1edd1f20-943d-4575-8a58-ee58c0c7e4b0): created successfully Jun 17 04:51:44 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-03c114e4-8614-45dc-b1d5-4ad54a4dffc8 tempest-VolumesActionsTest-580861366 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (54774f86-957d-4b50-9f2d-b35f43331c9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:51:44 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-03c114e4-8614-45dc-b1d5-4ad54a4dffc8 tempest-VolumesActionsTest-580861366 None] Flow 'volume_create_manager' (f65baeab-6f78-4c00-8c39-189862af4c84) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92060) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 17 04:51:44 devstack cinder-volume[92060]: INFO cinder.volume.manager [None req-03c114e4-8614-45dc-b1d5-4ad54a4dffc8 tempest-VolumesActionsTest-580861366 None] Created volume successfully. Jun 17 04:51:44 devstack cinder-volume[92060]: DEBUG oslo_service.periodic_task [None req-60d279ad-ad8c-4d36-a4b8-f593e74fb922 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=92060) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 17 04:51:44 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-60d279ad-ad8c-4d36-a4b8-f593e74fb922 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 04:51:44 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-60d279ad-ad8c-4d36-a4b8-f593e74fb922 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 04:51:44 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-60d279ad-ad8c-4d36-a4b8-f593e74fb922 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588': None} {{(pid=92060) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 17 04:51:44 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-60d279ad-ad8c-4d36-a4b8-f593e74fb922 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588'] {{(pid=92060) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 17 04:51:44 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-60d279ad-ad8c-4d36-a4b8-f593e74fb922 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 04:51:44 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-60d279ad-ad8c-4d36-a4b8-f593e74fb922 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:51:44 devstack sudo[107289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a Jun 17 04:51:44 devstack sudo[107289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:51:45 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-1cbb419a-a9d0-425c-a13c-2328374aa4d6 tempest-VolumesActionsTest-1357992424 None] Acquiring lock "cinder-1edd1f20-943d-4575-8a58-ee58c0c7e4b0-delete_volume" by "delete_volume" {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 04:51:45 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-1cbb419a-a9d0-425c-a13c-2328374aa4d6 tempest-VolumesActionsTest-1357992424 None] Lock "cinder-1edd1f20-943d-4575-8a58-ee58c0c7e4b0-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 04:51:45 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-1cbb419a-a9d0-425c-a13c-2328374aa4d6 tempest-VolumesActionsTest-1357992424 None] Acquiring lock "cinder-quobyte-1edd1f20-943d-4575-8a58-ee58c0c7e4b0" by "delete_volume" {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 04:51:45 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-1cbb419a-a9d0-425c-a13c-2328374aa4d6 tempest-VolumesActionsTest-1357992424 None] Lock "cinder-quobyte-1edd1f20-943d-4575-8a58-ee58c0c7e4b0" acquired by "delete_volume" :: waited 0.015s {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 04:51:45 devstack cinder-volume[92060]: DEBUG oslo.privsep.daemon [-] privsep: reply[240f1ac2-7cf9-4246-8ae0-2a992d1644e7]: (4, 'qcow2') {{(pid=93130) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 04:51:45 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-1cbb419a-a9d0-425c-a13c-2328374aa4d6 tempest-VolumesActionsTest-1357992424 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-1edd1f20-943d-4575-8a58-ee58c0c7e4b0 {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:51:45 devstack sudo[107291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-1edd1f20-943d-4575-8a58-ee58c0c7e4b0 Jun 17 04:51:45 devstack sudo[107291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:51:45 devstack sudo[107289]: pam_unix(sudo:session): session closed for user root Jun 17 04:51:45 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-60d279ad-ad8c-4d36-a4b8-f593e74fb922 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a" returned: 0 in 0.639s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:51:45 devstack cinder-volume[92060]: DEBUG cinder.manager [None req-60d279ad-ad8c-4d36-a4b8-f593e74fb922 None None] Notifying Schedulers of capabilities ... {{(pid=92060) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 17 04:51:45 devstack cinder-volume[92060]: DEBUG oslo_service.periodic_task [None req-60d279ad-ad8c-4d36-a4b8-f593e74fb922 None None] Running periodic task VolumeManager._thread_info {{(pid=92060) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 17 04:51:45 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-60d279ad-ad8c-4d36-a4b8-f593e74fb922 None None] thread count: 28 {{(pid=92060) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 17 04:51:45 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-60d279ad-ad8c-4d36-a4b8-f593e74fb922 None None] thread info: [<_MainThread(MainThread, started 130061806440576)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=92060) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 17 04:51:46 devstack sudo[107291]: pam_unix(sudo:session): session closed for user root Jun 17 04:51:46 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-1cbb419a-a9d0-425c-a13c-2328374aa4d6 tempest-VolumesActionsTest-1357992424 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-1edd1f20-943d-4575-8a58-ee58c0c7e4b0" returned: 0 in 0.734s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:51:46 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-1cbb419a-a9d0-425c-a13c-2328374aa4d6 tempest-VolumesActionsTest-1357992424 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-1edd1f20-943d-4575-8a58-ee58c0c7e4b0 {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:51:46 devstack sudo[107297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-1edd1f20-943d-4575-8a58-ee58c0c7e4b0 Jun 17 04:51:46 devstack sudo[107297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:51:46 devstack sudo[107297]: pam_unix(sudo:session): session closed for user root Jun 17 04:51:46 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-1cbb419a-a9d0-425c-a13c-2328374aa4d6 tempest-VolumesActionsTest-1357992424 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-1edd1f20-943d-4575-8a58-ee58c0c7e4b0" returned: 0 in 0.605s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:51:46 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-1cbb419a-a9d0-425c-a13c-2328374aa4d6 tempest-VolumesActionsTest-1357992424 None] Lock "cinder-quobyte-1edd1f20-943d-4575-8a58-ee58c0c7e4b0" released by "delete_volume" :: held 1.384s {{(pid=92060) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 04:51:46 devstack cinder-volume[92060]: DEBUG cinder.quota [None req-1cbb419a-a9d0-425c-a13c-2328374aa4d6 tempest-VolumesActionsTest-1357992424 None] Created reservations ['62736240-f8c7-4e6d-ab89-fce3823069df', '8249596d-8ded-4307-b7c4-612fdbae3c04', '624a34a6-7b72-451a-8b9c-7c65d976cf03', 'cdd6688e-e86f-4c23-a348-bfd34c8859d4'] {{(pid=92060) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 17 04:51:46 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-1cbb419a-a9d0-425c-a13c-2328374aa4d6 tempest-VolumesActionsTest-1357992424 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 04:51:46 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-1cbb419a-a9d0-425c-a13c-2328374aa4d6 tempest-VolumesActionsTest-1357992424 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 04:51:46 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-1cbb419a-a9d0-425c-a13c-2328374aa4d6 tempest-VolumesActionsTest-1357992424 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588': None} {{(pid=92060) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 17 04:51:46 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-1cbb419a-a9d0-425c-a13c-2328374aa4d6 tempest-VolumesActionsTest-1357992424 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588'] {{(pid=92060) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 17 04:51:46 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-1cbb419a-a9d0-425c-a13c-2328374aa4d6 tempest-VolumesActionsTest-1357992424 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 04:51:46 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-1cbb419a-a9d0-425c-a13c-2328374aa4d6 tempest-VolumesActionsTest-1357992424 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:51:46 devstack sudo[107300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a Jun 17 04:51:46 devstack sudo[107300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:51:47 devstack sudo[107300]: pam_unix(sudo:session): session closed for user root Jun 17 04:51:47 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-1cbb419a-a9d0-425c-a13c-2328374aa4d6 tempest-VolumesActionsTest-1357992424 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a" returned: 0 in 0.593s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:51:47 devstack cinder-volume[92060]: DEBUG cinder.manager [None req-1cbb419a-a9d0-425c-a13c-2328374aa4d6 tempest-VolumesActionsTest-1357992424 None] Notifying Schedulers of capabilities ... {{(pid=92060) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 17 04:51:47 devstack cinder-volume[92060]: INFO cinder.volume.manager [None req-1cbb419a-a9d0-425c-a13c-2328374aa4d6 tempest-VolumesActionsTest-1357992424 None] Deleted volume successfully. Jun 17 04:51:47 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-1cbb419a-a9d0-425c-a13c-2328374aa4d6 tempest-VolumesActionsTest-1357992424 None] Lock "cinder-1edd1f20-943d-4575-8a58-ee58c0c7e4b0-delete_volume" released by "delete_volume" :: held 2.177s {{(pid=92060) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 04:51:47 devstack cinder-volume[92060]: DEBUG cinder.volume.flows.manager.create_volume [None req-017d1b10-411b-45f7-bb9e-d0ebb174f657 tempest-VolumesActionsTest-580861366 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92060) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 17 04:51:47 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-017d1b10-411b-45f7-bb9e-d0ebb174f657 tempest-VolumesActionsTest-580861366 None] Flow 'volume_create_manager' (024dfb0b-c356-4c21-bb7c-c49a2951a338) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 17 04:51:47 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-017d1b10-411b-45f7-bb9e-d0ebb174f657 tempest-VolumesActionsTest-580861366 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f091418b-8f0f-4d51-ac18-6f239c52b6c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:51:47 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-017d1b10-411b-45f7-bb9e-d0ebb174f657 tempest-VolumesActionsTest-580861366 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f091418b-8f0f-4d51-ac18-6f239c52b6c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-17T02:51:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1501421053',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f151ff2b-4af9-4548-8456-a465b5dd371c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3d3f6191344d4204827365d8103433bb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T02:51:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T02:51:48Z,use_quota=True,user_id='17deb269ce2541159a6caa1cc972812e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aad9ce24-93f9-41a6-baa1-5125964f96d1),volume_type_id=aad9ce24-93f9-41a6-baa1-5125964f96d1)' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:51:47 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-017d1b10-411b-45f7-bb9e-d0ebb174f657 tempest-VolumesActionsTest-580861366 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c00c1f90-d7c0-487b-b4f0-69dbd8100336) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:51:47 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-017d1b10-411b-45f7-bb9e-d0ebb174f657 tempest-VolumesActionsTest-580861366 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c00c1f90-d7c0-487b-b4f0-69dbd8100336) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:51:47 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-017d1b10-411b-45f7-bb9e-d0ebb174f657 tempest-VolumesActionsTest-580861366 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4edc5614-6bb2-48e5-9779-db2972123544) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:51:47 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-017d1b10-411b-45f7-bb9e-d0ebb174f657 tempest-VolumesActionsTest-580861366 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4edc5614-6bb2-48e5-9779-db2972123544) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f151ff2b-4af9-4548-8456-a465b5dd371c', 'volume_name': 'volume-f151ff2b-4af9-4548-8456-a465b5dd371c', 'volume_size': 1}' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:51:47 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-017d1b10-411b-45f7-bb9e-d0ebb174f657 tempest-VolumesActionsTest-580861366 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b3ee91ca-8689-4d6c-a3e8-ec04a5ee6872) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:51:47 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-017d1b10-411b-45f7-bb9e-d0ebb174f657 tempest-VolumesActionsTest-580861366 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b3ee91ca-8689-4d6c-a3e8-ec04a5ee6872) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:51:47 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-017d1b10-411b-45f7-bb9e-d0ebb174f657 tempest-VolumesActionsTest-580861366 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d8d3a8ce-3b37-49b1-920b-36ef35f10b21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:51:47 devstack cinder-volume[92060]: INFO cinder.volume.flows.manager.create_volume [None req-017d1b10-411b-45f7-bb9e-d0ebb174f657 tempest-VolumesActionsTest-580861366 None] Volume f151ff2b-4af9-4548-8456-a465b5dd371c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f151ff2b-4af9-4548-8456-a465b5dd371c', 'volume_size': 1} Jun 17 04:51:47 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-017d1b10-411b-45f7-bb9e-d0ebb174f657 tempest-VolumesActionsTest-580861366 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 04:51:47 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-017d1b10-411b-45f7-bb9e-d0ebb174f657 tempest-VolumesActionsTest-580861366 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 04:51:47 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-017d1b10-411b-45f7-bb9e-d0ebb174f657 tempest-VolumesActionsTest-580861366 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-17T02:51:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1501421053',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f151ff2b-4af9-4548-8456-a465b5dd371c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3d3f6191344d4204827365d8103433bb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T02:51:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T02:51:48Z,use_quota=True,user_id='17deb269ce2541159a6caa1cc972812e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aad9ce24-93f9-41a6-baa1-5125964f96d1),volume_type_id=aad9ce24-93f9-41a6-baa1-5125964f96d1)}" {{(pid=92060) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 17 04:51:47 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.remotefs [None req-017d1b10-411b-45f7-bb9e-d0ebb174f657 tempest-VolumesActionsTest-580861366 None] Creating volume f151ff2b-4af9-4548-8456-a465b5dd371c {{(pid=92060) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 17 04:51:47 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-017d1b10-411b-45f7-bb9e-d0ebb174f657 tempest-VolumesActionsTest-580861366 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 04:51:47 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-017d1b10-411b-45f7-bb9e-d0ebb174f657 tempest-VolumesActionsTest-580861366 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 04:51:47 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-017d1b10-411b-45f7-bb9e-d0ebb174f657 tempest-VolumesActionsTest-580861366 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588': None} {{(pid=92060) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 17 04:51:47 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-017d1b10-411b-45f7-bb9e-d0ebb174f657 tempest-VolumesActionsTest-580861366 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588'] {{(pid=92060) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 17 04:51:47 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-017d1b10-411b-45f7-bb9e-d0ebb174f657 tempest-VolumesActionsTest-580861366 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 04:51:47 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-017d1b10-411b-45f7-bb9e-d0ebb174f657 tempest-VolumesActionsTest-580861366 None] Selected osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588 as target Quobyte volume. {{(pid=92060) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 17 04:51:47 devstack cinder-volume[92060]: INFO cinder.volume.drivers.remotefs [None req-017d1b10-411b-45f7-bb9e-d0ebb174f657 tempest-VolumesActionsTest-580861366 None] casted to osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588 Jun 17 04:51:47 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-017d1b10-411b-45f7-bb9e-d0ebb174f657 tempest-VolumesActionsTest-580861366 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-f151ff2b-4af9-4548-8456-a465b5dd371c 1073741824 {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:51:47 devstack sudo[107303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-f151ff2b-4af9-4548-8456-a465b5dd371c 1073741824 Jun 17 04:51:47 devstack sudo[107303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:51:48 devstack sudo[107303]: pam_unix(sudo:session): session closed for user root Jun 17 04:51:48 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-017d1b10-411b-45f7-bb9e-d0ebb174f657 tempest-VolumesActionsTest-580861366 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-f151ff2b-4af9-4548-8456-a465b5dd371c 1073741824" returned: 0 in 0.767s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:51:48 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-017d1b10-411b-45f7-bb9e-d0ebb174f657 tempest-VolumesActionsTest-580861366 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-f151ff2b-4af9-4548-8456-a465b5dd371c {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:51:48 devstack sudo[107309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-f151ff2b-4af9-4548-8456-a465b5dd371c Jun 17 04:51:48 devstack sudo[107309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:51:49 devstack sudo[107309]: pam_unix(sudo:session): session closed for user root Jun 17 04:51:49 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-017d1b10-411b-45f7-bb9e-d0ebb174f657 tempest-VolumesActionsTest-580861366 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-f151ff2b-4af9-4548-8456-a465b5dd371c" returned: 0 in 0.586s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:51:49 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-017d1b10-411b-45f7-bb9e-d0ebb174f657 tempest-VolumesActionsTest-580861366 None] <== create_volume: return (1401ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588'} {{(pid=92060) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 17 04:51:49 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-017d1b10-411b-45f7-bb9e-d0ebb174f657 tempest-VolumesActionsTest-580861366 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.404s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 04:51:49 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-017d1b10-411b-45f7-bb9e-d0ebb174f657 tempest-VolumesActionsTest-580861366 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d8d3a8ce-3b37-49b1-920b-36ef35f10b21) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f151ff2b-4af9-4548-8456-a465b5dd371c', 'volume_size': 1}' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:51:49 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-017d1b10-411b-45f7-bb9e-d0ebb174f657 tempest-VolumesActionsTest-580861366 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c4d626ea-7aa4-4726-bd76-0d1661103f7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:51:49 devstack cinder-volume[92060]: INFO cinder.volume.flows.manager.create_volume [None req-017d1b10-411b-45f7-bb9e-d0ebb174f657 tempest-VolumesActionsTest-580861366 None] Volume volume-f151ff2b-4af9-4548-8456-a465b5dd371c (f151ff2b-4af9-4548-8456-a465b5dd371c): created successfully Jun 17 04:51:49 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-017d1b10-411b-45f7-bb9e-d0ebb174f657 tempest-VolumesActionsTest-580861366 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c4d626ea-7aa4-4726-bd76-0d1661103f7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:51:49 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-017d1b10-411b-45f7-bb9e-d0ebb174f657 tempest-VolumesActionsTest-580861366 None] Flow 'volume_create_manager' (024dfb0b-c356-4c21-bb7c-c49a2951a338) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92060) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 17 04:51:49 devstack cinder-volume[92060]: INFO cinder.volume.manager [None req-017d1b10-411b-45f7-bb9e-d0ebb174f657 tempest-VolumesActionsTest-580861366 None] Created volume successfully. Jun 17 04:51:50 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-79b83f1d-08fa-438f-9c92-b1040a3a6292 tempest-VolumesActionsTest-1357992424 None] Acquiring lock "cinder-f151ff2b-4af9-4548-8456-a465b5dd371c-delete_volume" by "delete_volume" {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 04:51:50 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-79b83f1d-08fa-438f-9c92-b1040a3a6292 tempest-VolumesActionsTest-1357992424 None] Lock "cinder-f151ff2b-4af9-4548-8456-a465b5dd371c-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 04:51:50 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-79b83f1d-08fa-438f-9c92-b1040a3a6292 tempest-VolumesActionsTest-1357992424 None] Acquiring lock "cinder-quobyte-f151ff2b-4af9-4548-8456-a465b5dd371c" by "delete_volume" {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 04:51:50 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-79b83f1d-08fa-438f-9c92-b1040a3a6292 tempest-VolumesActionsTest-1357992424 None] Lock "cinder-quobyte-f151ff2b-4af9-4548-8456-a465b5dd371c" acquired by "delete_volume" :: waited 0.013s {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 04:51:50 devstack cinder-volume[92060]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b7a452a-4dd9-4ba9-8e02-bd998de680be]: (4, 'qcow2') {{(pid=93130) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 04:51:50 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-79b83f1d-08fa-438f-9c92-b1040a3a6292 tempest-VolumesActionsTest-1357992424 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-f151ff2b-4af9-4548-8456-a465b5dd371c {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:51:50 devstack sudo[107313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-f151ff2b-4af9-4548-8456-a465b5dd371c Jun 17 04:51:50 devstack sudo[107313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:51:50 devstack sudo[107313]: pam_unix(sudo:session): session closed for user root Jun 17 04:51:50 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-79b83f1d-08fa-438f-9c92-b1040a3a6292 tempest-VolumesActionsTest-1357992424 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-f151ff2b-4af9-4548-8456-a465b5dd371c" returned: 0 in 0.729s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:51:50 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-79b83f1d-08fa-438f-9c92-b1040a3a6292 tempest-VolumesActionsTest-1357992424 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-f151ff2b-4af9-4548-8456-a465b5dd371c {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:51:50 devstack sudo[107318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-f151ff2b-4af9-4548-8456-a465b5dd371c Jun 17 04:51:50 devstack sudo[107318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:51:51 devstack sudo[107318]: pam_unix(sudo:session): session closed for user root Jun 17 04:51:51 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-79b83f1d-08fa-438f-9c92-b1040a3a6292 tempest-VolumesActionsTest-1357992424 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-f151ff2b-4af9-4548-8456-a465b5dd371c" returned: 0 in 0.585s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:51:51 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-79b83f1d-08fa-438f-9c92-b1040a3a6292 tempest-VolumesActionsTest-1357992424 None] Lock "cinder-quobyte-f151ff2b-4af9-4548-8456-a465b5dd371c" released by "delete_volume" :: held 1.357s {{(pid=92060) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 04:51:51 devstack cinder-volume[92060]: DEBUG cinder.quota [None req-79b83f1d-08fa-438f-9c92-b1040a3a6292 tempest-VolumesActionsTest-1357992424 None] Created reservations ['11cbe6ff-0e70-4d0f-9aef-428ae71f3ff3', '1d8f157f-4343-4e75-85b3-33ff86db2601', '5cdeea81-607f-48c7-8a37-43dba0921f22', '292b2a6e-ad97-4e70-82b5-cda46ab5f423'] {{(pid=92060) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 17 04:51:51 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-79b83f1d-08fa-438f-9c92-b1040a3a6292 tempest-VolumesActionsTest-1357992424 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 04:51:51 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-79b83f1d-08fa-438f-9c92-b1040a3a6292 tempest-VolumesActionsTest-1357992424 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 04:51:51 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-79b83f1d-08fa-438f-9c92-b1040a3a6292 tempest-VolumesActionsTest-1357992424 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588': None} {{(pid=92060) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 17 04:51:51 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-79b83f1d-08fa-438f-9c92-b1040a3a6292 tempest-VolumesActionsTest-1357992424 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588'] {{(pid=92060) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 17 04:51:51 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-79b83f1d-08fa-438f-9c92-b1040a3a6292 tempest-VolumesActionsTest-1357992424 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 04:51:51 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-79b83f1d-08fa-438f-9c92-b1040a3a6292 tempest-VolumesActionsTest-1357992424 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:51:51 devstack sudo[107322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a Jun 17 04:51:51 devstack sudo[107322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:51:52 devstack sudo[107322]: pam_unix(sudo:session): session closed for user root Jun 17 04:51:52 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-79b83f1d-08fa-438f-9c92-b1040a3a6292 tempest-VolumesActionsTest-1357992424 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a" returned: 0 in 0.583s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:51:52 devstack cinder-volume[92060]: DEBUG cinder.manager [None req-79b83f1d-08fa-438f-9c92-b1040a3a6292 tempest-VolumesActionsTest-1357992424 None] Notifying Schedulers of capabilities ... {{(pid=92060) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 17 04:51:52 devstack cinder-volume[92060]: INFO cinder.volume.manager [None req-79b83f1d-08fa-438f-9c92-b1040a3a6292 tempest-VolumesActionsTest-1357992424 None] Deleted volume successfully. Jun 17 04:51:52 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-79b83f1d-08fa-438f-9c92-b1040a3a6292 tempest-VolumesActionsTest-1357992424 None] Lock "cinder-f151ff2b-4af9-4548-8456-a465b5dd371c-delete_volume" released by "delete_volume" :: held 2.116s {{(pid=92060) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 04:51:52 devstack cinder-volume[92060]: DEBUG cinder.volume.flows.manager.create_volume [None req-82199982-1449-4f48-aa18-bc67d13d01bb tempest-VolumesActionsTest-580861366 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92060) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 17 04:51:52 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-82199982-1449-4f48-aa18-bc67d13d01bb tempest-VolumesActionsTest-580861366 None] Flow 'volume_create_manager' (b2424e3f-b1ea-4502-bc0f-bc20f02bdab0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 17 04:51:52 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-82199982-1449-4f48-aa18-bc67d13d01bb tempest-VolumesActionsTest-580861366 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0e97d967-c239-40de-a4a4-2963ceaead7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:51:52 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-82199982-1449-4f48-aa18-bc67d13d01bb tempest-VolumesActionsTest-580861366 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0e97d967-c239-40de-a4a4-2963ceaead7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-17T02:51:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1258562001',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=91aaae3d-741b-4e24-a297-3ac1b5d0cc74,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3d3f6191344d4204827365d8103433bb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T02:51:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T02:51:53Z,use_quota=True,user_id='17deb269ce2541159a6caa1cc972812e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aad9ce24-93f9-41a6-baa1-5125964f96d1),volume_type_id=aad9ce24-93f9-41a6-baa1-5125964f96d1)' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:51:52 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-82199982-1449-4f48-aa18-bc67d13d01bb tempest-VolumesActionsTest-580861366 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3ad457e7-08de-4a7f-b3f6-07d9b936c415) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:51:52 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-82199982-1449-4f48-aa18-bc67d13d01bb tempest-VolumesActionsTest-580861366 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3ad457e7-08de-4a7f-b3f6-07d9b936c415) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:51:52 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-82199982-1449-4f48-aa18-bc67d13d01bb tempest-VolumesActionsTest-580861366 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f02f93a7-dace-42dc-b0dd-eb28b7970519) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:51:52 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-82199982-1449-4f48-aa18-bc67d13d01bb tempest-VolumesActionsTest-580861366 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f02f93a7-dace-42dc-b0dd-eb28b7970519) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '91aaae3d-741b-4e24-a297-3ac1b5d0cc74', 'volume_name': 'volume-91aaae3d-741b-4e24-a297-3ac1b5d0cc74', 'volume_size': 1}' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:51:52 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-82199982-1449-4f48-aa18-bc67d13d01bb tempest-VolumesActionsTest-580861366 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7974f3bc-bfd9-46db-aad9-4de8b7a034e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:51:52 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-82199982-1449-4f48-aa18-bc67d13d01bb tempest-VolumesActionsTest-580861366 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7974f3bc-bfd9-46db-aad9-4de8b7a034e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:51:52 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-82199982-1449-4f48-aa18-bc67d13d01bb tempest-VolumesActionsTest-580861366 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (831c0776-ea04-4001-bf7c-a3ddd5f5425d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:51:52 devstack cinder-volume[92060]: INFO cinder.volume.flows.manager.create_volume [None req-82199982-1449-4f48-aa18-bc67d13d01bb tempest-VolumesActionsTest-580861366 None] Volume 91aaae3d-741b-4e24-a297-3ac1b5d0cc74: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-91aaae3d-741b-4e24-a297-3ac1b5d0cc74', 'volume_size': 1} Jun 17 04:51:52 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-82199982-1449-4f48-aa18-bc67d13d01bb tempest-VolumesActionsTest-580861366 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 04:51:52 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-82199982-1449-4f48-aa18-bc67d13d01bb tempest-VolumesActionsTest-580861366 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 04:51:52 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-82199982-1449-4f48-aa18-bc67d13d01bb tempest-VolumesActionsTest-580861366 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-17T02:51:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1258562001',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=91aaae3d-741b-4e24-a297-3ac1b5d0cc74,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3d3f6191344d4204827365d8103433bb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T02:51:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T02:51:53Z,use_quota=True,user_id='17deb269ce2541159a6caa1cc972812e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aad9ce24-93f9-41a6-baa1-5125964f96d1),volume_type_id=aad9ce24-93f9-41a6-baa1-5125964f96d1)}" {{(pid=92060) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 17 04:51:52 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.remotefs [None req-82199982-1449-4f48-aa18-bc67d13d01bb tempest-VolumesActionsTest-580861366 None] Creating volume 91aaae3d-741b-4e24-a297-3ac1b5d0cc74 {{(pid=92060) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 17 04:51:52 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-82199982-1449-4f48-aa18-bc67d13d01bb tempest-VolumesActionsTest-580861366 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 04:51:52 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-82199982-1449-4f48-aa18-bc67d13d01bb tempest-VolumesActionsTest-580861366 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 04:51:52 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-82199982-1449-4f48-aa18-bc67d13d01bb tempest-VolumesActionsTest-580861366 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588': None} {{(pid=92060) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 17 04:51:52 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-82199982-1449-4f48-aa18-bc67d13d01bb tempest-VolumesActionsTest-580861366 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588'] {{(pid=92060) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 17 04:51:52 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-82199982-1449-4f48-aa18-bc67d13d01bb tempest-VolumesActionsTest-580861366 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 04:51:52 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-82199982-1449-4f48-aa18-bc67d13d01bb tempest-VolumesActionsTest-580861366 None] Selected osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588 as target Quobyte volume. {{(pid=92060) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 17 04:51:52 devstack cinder-volume[92060]: INFO cinder.volume.drivers.remotefs [None req-82199982-1449-4f48-aa18-bc67d13d01bb tempest-VolumesActionsTest-580861366 None] casted to osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588 Jun 17 04:51:52 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-82199982-1449-4f48-aa18-bc67d13d01bb tempest-VolumesActionsTest-580861366 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-91aaae3d-741b-4e24-a297-3ac1b5d0cc74 1073741824 {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:51:52 devstack sudo[107325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-91aaae3d-741b-4e24-a297-3ac1b5d0cc74 1073741824 Jun 17 04:51:52 devstack sudo[107325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:51:53 devstack sudo[107325]: pam_unix(sudo:session): session closed for user root Jun 17 04:51:53 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-82199982-1449-4f48-aa18-bc67d13d01bb tempest-VolumesActionsTest-580861366 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-91aaae3d-741b-4e24-a297-3ac1b5d0cc74 1073741824" returned: 0 in 0.788s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:51:53 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-82199982-1449-4f48-aa18-bc67d13d01bb tempest-VolumesActionsTest-580861366 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-91aaae3d-741b-4e24-a297-3ac1b5d0cc74 {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:51:53 devstack sudo[107335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-91aaae3d-741b-4e24-a297-3ac1b5d0cc74 Jun 17 04:51:53 devstack sudo[107335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:51:54 devstack sudo[107335]: pam_unix(sudo:session): session closed for user root Jun 17 04:51:54 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-82199982-1449-4f48-aa18-bc67d13d01bb tempest-VolumesActionsTest-580861366 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-91aaae3d-741b-4e24-a297-3ac1b5d0cc74" returned: 0 in 0.679s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:51:54 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-82199982-1449-4f48-aa18-bc67d13d01bb tempest-VolumesActionsTest-580861366 None] <== create_volume: return (1525ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588'} {{(pid=92060) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 17 04:51:54 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-82199982-1449-4f48-aa18-bc67d13d01bb tempest-VolumesActionsTest-580861366 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.528s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 04:51:54 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-82199982-1449-4f48-aa18-bc67d13d01bb tempest-VolumesActionsTest-580861366 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (831c0776-ea04-4001-bf7c-a3ddd5f5425d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-91aaae3d-741b-4e24-a297-3ac1b5d0cc74', 'volume_size': 1}' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:51:54 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-82199982-1449-4f48-aa18-bc67d13d01bb tempest-VolumesActionsTest-580861366 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f28e6856-748b-4df2-92de-76fbbe88c77f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:51:54 devstack cinder-volume[92060]: INFO cinder.volume.flows.manager.create_volume [None req-82199982-1449-4f48-aa18-bc67d13d01bb tempest-VolumesActionsTest-580861366 None] Volume volume-91aaae3d-741b-4e24-a297-3ac1b5d0cc74 (91aaae3d-741b-4e24-a297-3ac1b5d0cc74): created successfully Jun 17 04:51:54 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-82199982-1449-4f48-aa18-bc67d13d01bb tempest-VolumesActionsTest-580861366 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f28e6856-748b-4df2-92de-76fbbe88c77f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:51:54 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-82199982-1449-4f48-aa18-bc67d13d01bb tempest-VolumesActionsTest-580861366 None] Flow 'volume_create_manager' (b2424e3f-b1ea-4502-bc0f-bc20f02bdab0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92060) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 17 04:51:54 devstack cinder-volume[92060]: INFO cinder.volume.manager [None req-82199982-1449-4f48-aa18-bc67d13d01bb tempest-VolumesActionsTest-580861366 None] Created volume successfully. Jun 17 04:51:54 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-a6ec7131-0b2b-41b5-87bf-6860927bfca6 tempest-VolumesActionsTest-1357992424 None] Acquiring lock "cinder-91aaae3d-741b-4e24-a297-3ac1b5d0cc74-delete_volume" by "delete_volume" {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 04:51:54 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-a6ec7131-0b2b-41b5-87bf-6860927bfca6 tempest-VolumesActionsTest-1357992424 None] Lock "cinder-91aaae3d-741b-4e24-a297-3ac1b5d0cc74-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 04:51:54 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-a6ec7131-0b2b-41b5-87bf-6860927bfca6 tempest-VolumesActionsTest-1357992424 None] Acquiring lock "cinder-quobyte-91aaae3d-741b-4e24-a297-3ac1b5d0cc74" by "delete_volume" {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 04:51:54 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-a6ec7131-0b2b-41b5-87bf-6860927bfca6 tempest-VolumesActionsTest-1357992424 None] Lock "cinder-quobyte-91aaae3d-741b-4e24-a297-3ac1b5d0cc74" acquired by "delete_volume" :: waited 0.014s {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 04:51:54 devstack cinder-volume[92060]: DEBUG oslo.privsep.daemon [-] privsep: reply[145c3b80-67a5-48b5-9e8c-f40421e098a8]: (4, 'qcow2') {{(pid=93130) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 04:51:54 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-a6ec7131-0b2b-41b5-87bf-6860927bfca6 tempest-VolumesActionsTest-1357992424 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-91aaae3d-741b-4e24-a297-3ac1b5d0cc74 {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:51:55 devstack sudo[107340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-91aaae3d-741b-4e24-a297-3ac1b5d0cc74 Jun 17 04:51:55 devstack sudo[107340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:51:55 devstack sudo[107340]: pam_unix(sudo:session): session closed for user root Jun 17 04:51:55 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-a6ec7131-0b2b-41b5-87bf-6860927bfca6 tempest-VolumesActionsTest-1357992424 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-91aaae3d-741b-4e24-a297-3ac1b5d0cc74" returned: 0 in 0.834s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:51:55 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-a6ec7131-0b2b-41b5-87bf-6860927bfca6 tempest-VolumesActionsTest-1357992424 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-91aaae3d-741b-4e24-a297-3ac1b5d0cc74 {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:51:55 devstack sudo[107388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-91aaae3d-741b-4e24-a297-3ac1b5d0cc74 Jun 17 04:51:55 devstack sudo[107388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:51:56 devstack sudo[107388]: pam_unix(sudo:session): session closed for user root Jun 17 04:51:56 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-a6ec7131-0b2b-41b5-87bf-6860927bfca6 tempest-VolumesActionsTest-1357992424 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-91aaae3d-741b-4e24-a297-3ac1b5d0cc74" returned: 0 in 0.604s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:51:56 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-a6ec7131-0b2b-41b5-87bf-6860927bfca6 tempest-VolumesActionsTest-1357992424 None] Lock "cinder-quobyte-91aaae3d-741b-4e24-a297-3ac1b5d0cc74" released by "delete_volume" :: held 1.474s {{(pid=92060) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 04:51:56 devstack cinder-volume[92060]: DEBUG cinder.quota [None req-a6ec7131-0b2b-41b5-87bf-6860927bfca6 tempest-VolumesActionsTest-1357992424 None] Created reservations ['6e0c1254-a298-4d84-8f99-cf3420d66389', 'b8b676be-6304-429d-8718-d8989e4cae4e', 'a13a8dba-255d-4f3d-a277-fb7814883983', '09a00f76-4e9a-4d99-8bd7-021fb744292c'] {{(pid=92060) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 17 04:51:56 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-a6ec7131-0b2b-41b5-87bf-6860927bfca6 tempest-VolumesActionsTest-1357992424 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 04:51:56 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-a6ec7131-0b2b-41b5-87bf-6860927bfca6 tempest-VolumesActionsTest-1357992424 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 04:51:56 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-a6ec7131-0b2b-41b5-87bf-6860927bfca6 tempest-VolumesActionsTest-1357992424 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588': None} {{(pid=92060) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 17 04:51:56 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-a6ec7131-0b2b-41b5-87bf-6860927bfca6 tempest-VolumesActionsTest-1357992424 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588'] {{(pid=92060) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 17 04:51:56 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-a6ec7131-0b2b-41b5-87bf-6860927bfca6 tempest-VolumesActionsTest-1357992424 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 04:51:56 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-a6ec7131-0b2b-41b5-87bf-6860927bfca6 tempest-VolumesActionsTest-1357992424 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:51:56 devstack sudo[107392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a Jun 17 04:51:56 devstack sudo[107392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:51:57 devstack sudo[107392]: pam_unix(sudo:session): session closed for user root Jun 17 04:51:57 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-a6ec7131-0b2b-41b5-87bf-6860927bfca6 tempest-VolumesActionsTest-1357992424 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a" returned: 0 in 0.573s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:51:57 devstack cinder-volume[92060]: DEBUG cinder.manager [None req-a6ec7131-0b2b-41b5-87bf-6860927bfca6 tempest-VolumesActionsTest-1357992424 None] Notifying Schedulers of capabilities ... {{(pid=92060) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 17 04:51:57 devstack cinder-volume[92060]: INFO cinder.volume.manager [None req-a6ec7131-0b2b-41b5-87bf-6860927bfca6 tempest-VolumesActionsTest-1357992424 None] Deleted volume successfully. Jun 17 04:51:57 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-a6ec7131-0b2b-41b5-87bf-6860927bfca6 tempest-VolumesActionsTest-1357992424 None] Lock "cinder-91aaae3d-741b-4e24-a297-3ac1b5d0cc74-delete_volume" released by "delete_volume" :: held 2.255s {{(pid=92060) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 04:51:57 devstack cinder-volume[92060]: DEBUG cinder.volume.flows.manager.create_volume [None req-2c9688bf-cd11-4585-ac22-c84eba53e715 tempest-VolumesActionsTest-580861366 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92060) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 17 04:51:57 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-2c9688bf-cd11-4585-ac22-c84eba53e715 tempest-VolumesActionsTest-580861366 None] Flow 'volume_create_manager' (5ef723aa-763c-4847-9dc1-738d3e25b2e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 17 04:51:57 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-2c9688bf-cd11-4585-ac22-c84eba53e715 tempest-VolumesActionsTest-580861366 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7f3631d7-dbbd-4fad-8cae-1e31feb2637e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:51:57 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-2c9688bf-cd11-4585-ac22-c84eba53e715 tempest-VolumesActionsTest-580861366 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7f3631d7-dbbd-4fad-8cae-1e31feb2637e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-17T02:51:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1061547250',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f5b11e91-87ee-42fa-825f-0cbee1477699,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3d3f6191344d4204827365d8103433bb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T02:51:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T02:51:58Z,use_quota=True,user_id='17deb269ce2541159a6caa1cc972812e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aad9ce24-93f9-41a6-baa1-5125964f96d1),volume_type_id=aad9ce24-93f9-41a6-baa1-5125964f96d1)' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:51:57 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-2c9688bf-cd11-4585-ac22-c84eba53e715 tempest-VolumesActionsTest-580861366 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ee2aea65-0287-4555-bf00-77a729275055) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:51:57 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-2c9688bf-cd11-4585-ac22-c84eba53e715 tempest-VolumesActionsTest-580861366 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ee2aea65-0287-4555-bf00-77a729275055) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:51:57 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-2c9688bf-cd11-4585-ac22-c84eba53e715 tempest-VolumesActionsTest-580861366 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6553cc14-55f8-42b5-875c-29cbb7d7734a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:51:57 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-2c9688bf-cd11-4585-ac22-c84eba53e715 tempest-VolumesActionsTest-580861366 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6553cc14-55f8-42b5-875c-29cbb7d7734a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f5b11e91-87ee-42fa-825f-0cbee1477699', 'volume_name': 'volume-f5b11e91-87ee-42fa-825f-0cbee1477699', 'volume_size': 1}' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:51:57 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-2c9688bf-cd11-4585-ac22-c84eba53e715 tempest-VolumesActionsTest-580861366 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (67feb4a5-d90d-4990-95e9-6d7ed253b42e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:51:57 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-2c9688bf-cd11-4585-ac22-c84eba53e715 tempest-VolumesActionsTest-580861366 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (67feb4a5-d90d-4990-95e9-6d7ed253b42e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:51:57 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-2c9688bf-cd11-4585-ac22-c84eba53e715 tempest-VolumesActionsTest-580861366 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (53e1dac0-ba23-4b1b-ac4a-a3f509a50d71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:51:57 devstack cinder-volume[92060]: INFO cinder.volume.flows.manager.create_volume [None req-2c9688bf-cd11-4585-ac22-c84eba53e715 tempest-VolumesActionsTest-580861366 None] Volume f5b11e91-87ee-42fa-825f-0cbee1477699: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f5b11e91-87ee-42fa-825f-0cbee1477699', 'volume_size': 1} Jun 17 04:51:57 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-2c9688bf-cd11-4585-ac22-c84eba53e715 tempest-VolumesActionsTest-580861366 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 04:51:57 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-2c9688bf-cd11-4585-ac22-c84eba53e715 tempest-VolumesActionsTest-580861366 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 04:51:57 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-2c9688bf-cd11-4585-ac22-c84eba53e715 tempest-VolumesActionsTest-580861366 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-17T02:51:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1061547250',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f5b11e91-87ee-42fa-825f-0cbee1477699,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3d3f6191344d4204827365d8103433bb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T02:51:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T02:51:58Z,use_quota=True,user_id='17deb269ce2541159a6caa1cc972812e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aad9ce24-93f9-41a6-baa1-5125964f96d1),volume_type_id=aad9ce24-93f9-41a6-baa1-5125964f96d1)}" {{(pid=92060) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 17 04:51:57 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.remotefs [None req-2c9688bf-cd11-4585-ac22-c84eba53e715 tempest-VolumesActionsTest-580861366 None] Creating volume f5b11e91-87ee-42fa-825f-0cbee1477699 {{(pid=92060) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 17 04:51:57 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-2c9688bf-cd11-4585-ac22-c84eba53e715 tempest-VolumesActionsTest-580861366 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 04:51:57 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-2c9688bf-cd11-4585-ac22-c84eba53e715 tempest-VolumesActionsTest-580861366 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 04:51:57 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-2c9688bf-cd11-4585-ac22-c84eba53e715 tempest-VolumesActionsTest-580861366 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588': None} {{(pid=92060) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 17 04:51:57 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-2c9688bf-cd11-4585-ac22-c84eba53e715 tempest-VolumesActionsTest-580861366 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588'] {{(pid=92060) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 17 04:51:57 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-2c9688bf-cd11-4585-ac22-c84eba53e715 tempest-VolumesActionsTest-580861366 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 04:51:57 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-2c9688bf-cd11-4585-ac22-c84eba53e715 tempest-VolumesActionsTest-580861366 None] Selected osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588 as target Quobyte volume. {{(pid=92060) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 17 04:51:57 devstack cinder-volume[92060]: INFO cinder.volume.drivers.remotefs [None req-2c9688bf-cd11-4585-ac22-c84eba53e715 tempest-VolumesActionsTest-580861366 None] casted to osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588 Jun 17 04:51:57 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-2c9688bf-cd11-4585-ac22-c84eba53e715 tempest-VolumesActionsTest-580861366 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-f5b11e91-87ee-42fa-825f-0cbee1477699 1073741824 {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:51:57 devstack sudo[107396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-f5b11e91-87ee-42fa-825f-0cbee1477699 1073741824 Jun 17 04:51:57 devstack sudo[107396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:51:58 devstack cinder-volume[92060]: INFO cinder.volume.manager [req-d86e273f-eea4-4385-a088-e9e7da097d31 req-a162f1f9-ed31-4d24-9589-f4d9cf8f2ace tempest-TestShelveInstance-2059068282 None] Terminate volume connection completed successfully. Jun 17 04:51:58 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [req-d86e273f-eea4-4385-a088-e9e7da097d31 req-a162f1f9-ed31-4d24-9589-f4d9cf8f2ace tempest-TestShelveInstance-2059068282 None] Deleting attachment 54442990-cabe-4dcd-b535-6dc43a817d6e. {{(pid=92060) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 17 04:51:58 devstack sudo[107396]: pam_unix(sudo:session): session closed for user root Jun 17 04:51:58 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-2c9688bf-cd11-4585-ac22-c84eba53e715 tempest-VolumesActionsTest-580861366 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-f5b11e91-87ee-42fa-825f-0cbee1477699 1073741824" returned: 0 in 0.772s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:51:58 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-2c9688bf-cd11-4585-ac22-c84eba53e715 tempest-VolumesActionsTest-580861366 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-f5b11e91-87ee-42fa-825f-0cbee1477699 {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:51:58 devstack sudo[107401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-f5b11e91-87ee-42fa-825f-0cbee1477699 Jun 17 04:51:58 devstack sudo[107401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:51:58 devstack cinder-volume[92060]: DEBUG cinder.coordination [req-d86e273f-eea4-4385-a088-e9e7da097d31 req-ba2258a3-8982-4e0b-a841-009f851b02ec tempest-TestShelveInstance-2059068282 None] Acquiring lock "cinder-c22c4041-72e9-4e3e-99e3-e131db5f8013-delete_volume" by "delete_volume" {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 04:51:58 devstack cinder-volume[92060]: DEBUG cinder.coordination [req-d86e273f-eea4-4385-a088-e9e7da097d31 req-ba2258a3-8982-4e0b-a841-009f851b02ec tempest-TestShelveInstance-2059068282 None] Lock "cinder-c22c4041-72e9-4e3e-99e3-e131db5f8013-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 04:51:58 devstack cinder-volume[92060]: DEBUG cinder.coordination [req-d86e273f-eea4-4385-a088-e9e7da097d31 req-ba2258a3-8982-4e0b-a841-009f851b02ec tempest-TestShelveInstance-2059068282 None] Acquiring lock "cinder-quobyte-c22c4041-72e9-4e3e-99e3-e131db5f8013" by "delete_volume" {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 04:51:58 devstack cinder-volume[92060]: DEBUG cinder.coordination [req-d86e273f-eea4-4385-a088-e9e7da097d31 req-ba2258a3-8982-4e0b-a841-009f851b02ec tempest-TestShelveInstance-2059068282 None] Lock "cinder-quobyte-c22c4041-72e9-4e3e-99e3-e131db5f8013" acquired by "delete_volume" :: waited 0.013s {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 04:51:58 devstack cinder-volume[92060]: DEBUG oslo.privsep.daemon [-] privsep: reply[34e96768-3ff3-4b48-98cd-1db00142390c]: (4, 'raw') {{(pid=93130) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 04:51:58 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [req-d86e273f-eea4-4385-a088-e9e7da097d31 req-ba2258a3-8982-4e0b-a841-009f851b02ec tempest-TestShelveInstance-2059068282 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-c22c4041-72e9-4e3e-99e3-e131db5f8013 {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:51:58 devstack sudo[107403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-c22c4041-72e9-4e3e-99e3-e131db5f8013 Jun 17 04:51:58 devstack sudo[107403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:51:59 devstack sudo[107401]: pam_unix(sudo:session): session closed for user root Jun 17 04:51:59 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-2c9688bf-cd11-4585-ac22-c84eba53e715 tempest-VolumesActionsTest-580861366 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-f5b11e91-87ee-42fa-825f-0cbee1477699" returned: 0 in 0.591s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:51:59 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-2c9688bf-cd11-4585-ac22-c84eba53e715 tempest-VolumesActionsTest-580861366 None] <== create_volume: return (1399ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588'} {{(pid=92060) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 17 04:51:59 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-2c9688bf-cd11-4585-ac22-c84eba53e715 tempest-VolumesActionsTest-580861366 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.403s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 04:51:59 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-2c9688bf-cd11-4585-ac22-c84eba53e715 tempest-VolumesActionsTest-580861366 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (53e1dac0-ba23-4b1b-ac4a-a3f509a50d71) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f5b11e91-87ee-42fa-825f-0cbee1477699', 'volume_size': 1}' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:51:59 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-2c9688bf-cd11-4585-ac22-c84eba53e715 tempest-VolumesActionsTest-580861366 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e604b8d9-1e18-4d28-a698-b3909bbeae65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:51:59 devstack cinder-volume[92060]: INFO cinder.volume.flows.manager.create_volume [None req-2c9688bf-cd11-4585-ac22-c84eba53e715 tempest-VolumesActionsTest-580861366 None] Volume volume-f5b11e91-87ee-42fa-825f-0cbee1477699 (f5b11e91-87ee-42fa-825f-0cbee1477699): created successfully Jun 17 04:51:59 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-2c9688bf-cd11-4585-ac22-c84eba53e715 tempest-VolumesActionsTest-580861366 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e604b8d9-1e18-4d28-a698-b3909bbeae65) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:51:59 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-2c9688bf-cd11-4585-ac22-c84eba53e715 tempest-VolumesActionsTest-580861366 None] Flow 'volume_create_manager' (5ef723aa-763c-4847-9dc1-738d3e25b2e6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92060) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 17 04:51:59 devstack cinder-volume[92060]: INFO cinder.volume.manager [None req-2c9688bf-cd11-4585-ac22-c84eba53e715 tempest-VolumesActionsTest-580861366 None] Created volume successfully. Jun 17 04:51:59 devstack sudo[107403]: pam_unix(sudo:session): session closed for user root Jun 17 04:51:59 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [req-d86e273f-eea4-4385-a088-e9e7da097d31 req-ba2258a3-8982-4e0b-a841-009f851b02ec tempest-TestShelveInstance-2059068282 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-c22c4041-72e9-4e3e-99e3-e131db5f8013" returned: 0 in 0.700s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:51:59 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [req-d86e273f-eea4-4385-a088-e9e7da097d31 req-ba2258a3-8982-4e0b-a841-009f851b02ec tempest-TestShelveInstance-2059068282 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-c22c4041-72e9-4e3e-99e3-e131db5f8013 {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:51:59 devstack sudo[107408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-c22c4041-72e9-4e3e-99e3-e131db5f8013 Jun 17 04:51:59 devstack sudo[107408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:52:00 devstack sudo[107408]: pam_unix(sudo:session): session closed for user root Jun 17 04:52:00 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [req-d86e273f-eea4-4385-a088-e9e7da097d31 req-ba2258a3-8982-4e0b-a841-009f851b02ec tempest-TestShelveInstance-2059068282 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-c22c4041-72e9-4e3e-99e3-e131db5f8013" returned: 1 in 0.673s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:52:00 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [req-d86e273f-eea4-4385-a088-e9e7da097d31 req-ba2258a3-8982-4e0b-a841-009f851b02ec tempest-TestShelveInstance-2059068282 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-c22c4041-72e9-4e3e-99e3-e131db5f8013' failed. Not Retrying. {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 17 04:52:00 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [req-d86e273f-eea4-4385-a088-e9e7da097d31 req-ba2258a3-8982-4e0b-a841-009f851b02ec tempest-TestShelveInstance-2059068282 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-c22c4041-72e9-4e3e-99e3-e131db5f8013 {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:52:00 devstack sudo[107413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-c22c4041-72e9-4e3e-99e3-e131db5f8013 Jun 17 04:52:00 devstack sudo[107413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:52:00 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-c49f3461-0e9a-4b14-9944-e003cc67e35a tempest-VolumesActionsTest-580861366 None] Acquiring lock "cinder-f5b11e91-87ee-42fa-825f-0cbee1477699-delete_volume" by "delete_volume" {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 04:52:00 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-c49f3461-0e9a-4b14-9944-e003cc67e35a tempest-VolumesActionsTest-580861366 None] Lock "cinder-f5b11e91-87ee-42fa-825f-0cbee1477699-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 04:52:00 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-c49f3461-0e9a-4b14-9944-e003cc67e35a tempest-VolumesActionsTest-580861366 None] Acquiring lock "cinder-quobyte-f5b11e91-87ee-42fa-825f-0cbee1477699" by "delete_volume" {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 04:52:00 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-c49f3461-0e9a-4b14-9944-e003cc67e35a tempest-VolumesActionsTest-580861366 None] Lock "cinder-quobyte-f5b11e91-87ee-42fa-825f-0cbee1477699" acquired by "delete_volume" :: waited 0.019s {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 04:52:00 devstack cinder-volume[92060]: DEBUG oslo.privsep.daemon [-] privsep: reply[0aa5a6ce-0be3-4ec8-a07d-cd2595d99527]: (4, 'qcow2') {{(pid=93130) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 04:52:00 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-c49f3461-0e9a-4b14-9944-e003cc67e35a tempest-VolumesActionsTest-580861366 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-f5b11e91-87ee-42fa-825f-0cbee1477699 {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:52:00 devstack sudo[107415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-f5b11e91-87ee-42fa-825f-0cbee1477699 Jun 17 04:52:00 devstack sudo[107415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:52:00 devstack sudo[107413]: pam_unix(sudo:session): session closed for user root Jun 17 04:52:00 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [req-d86e273f-eea4-4385-a088-e9e7da097d31 req-ba2258a3-8982-4e0b-a841-009f851b02ec tempest-TestShelveInstance-2059068282 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-c22c4041-72e9-4e3e-99e3-e131db5f8013" returned: 0 in 0.642s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:52:00 devstack cinder-volume[92060]: DEBUG cinder.coordination [req-d86e273f-eea4-4385-a088-e9e7da097d31 req-ba2258a3-8982-4e0b-a841-009f851b02ec tempest-TestShelveInstance-2059068282 None] Lock "cinder-quobyte-c22c4041-72e9-4e3e-99e3-e131db5f8013" released by "delete_volume" :: held 2.079s {{(pid=92060) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 04:52:00 devstack cinder-volume[92060]: DEBUG cinder.quota [req-d86e273f-eea4-4385-a088-e9e7da097d31 req-ba2258a3-8982-4e0b-a841-009f851b02ec tempest-TestShelveInstance-2059068282 None] Created reservations ['7fcf10e5-a0f4-45e8-96d0-8f535d827595', 'e6603480-30eb-4006-acbc-1c1441502cde', '830ae856-f57d-46fa-8351-3406969d8ac8', '5152f814-1756-42c6-99db-31b91e04ce52'] {{(pid=92060) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 17 04:52:00 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [req-d86e273f-eea4-4385-a088-e9e7da097d31 req-ba2258a3-8982-4e0b-a841-009f851b02ec tempest-TestShelveInstance-2059068282 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 04:52:00 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [req-d86e273f-eea4-4385-a088-e9e7da097d31 req-ba2258a3-8982-4e0b-a841-009f851b02ec tempest-TestShelveInstance-2059068282 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 04:52:00 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [req-d86e273f-eea4-4385-a088-e9e7da097d31 req-ba2258a3-8982-4e0b-a841-009f851b02ec tempest-TestShelveInstance-2059068282 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588': None} {{(pid=92060) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 17 04:52:00 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [req-d86e273f-eea4-4385-a088-e9e7da097d31 req-ba2258a3-8982-4e0b-a841-009f851b02ec tempest-TestShelveInstance-2059068282 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588'] {{(pid=92060) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 17 04:52:00 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [req-d86e273f-eea4-4385-a088-e9e7da097d31 req-ba2258a3-8982-4e0b-a841-009f851b02ec tempest-TestShelveInstance-2059068282 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 04:52:00 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [req-d86e273f-eea4-4385-a088-e9e7da097d31 req-ba2258a3-8982-4e0b-a841-009f851b02ec tempest-TestShelveInstance-2059068282 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:52:01 devstack sudo[107420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a Jun 17 04:52:01 devstack sudo[107420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:52:01 devstack sudo[107415]: pam_unix(sudo:session): session closed for user root Jun 17 04:52:01 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-c49f3461-0e9a-4b14-9944-e003cc67e35a tempest-VolumesActionsTest-580861366 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-f5b11e91-87ee-42fa-825f-0cbee1477699" returned: 0 in 0.731s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:52:01 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-c49f3461-0e9a-4b14-9944-e003cc67e35a tempest-VolumesActionsTest-580861366 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-f5b11e91-87ee-42fa-825f-0cbee1477699 {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:52:01 devstack sudo[107423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-f5b11e91-87ee-42fa-825f-0cbee1477699 Jun 17 04:52:01 devstack sudo[107423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:52:01 devstack sudo[107420]: pam_unix(sudo:session): session closed for user root Jun 17 04:52:01 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [req-d86e273f-eea4-4385-a088-e9e7da097d31 req-ba2258a3-8982-4e0b-a841-009f851b02ec tempest-TestShelveInstance-2059068282 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a" returned: 0 in 0.611s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:52:01 devstack cinder-volume[92060]: DEBUG cinder.manager [req-d86e273f-eea4-4385-a088-e9e7da097d31 req-ba2258a3-8982-4e0b-a841-009f851b02ec tempest-TestShelveInstance-2059068282 None] Notifying Schedulers of capabilities ... {{(pid=92060) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 17 04:52:01 devstack cinder-volume[92060]: INFO cinder.volume.manager [req-d86e273f-eea4-4385-a088-e9e7da097d31 req-ba2258a3-8982-4e0b-a841-009f851b02ec tempest-TestShelveInstance-2059068282 None] Deleted volume successfully. Jun 17 04:52:01 devstack cinder-volume[92060]: DEBUG cinder.coordination [req-d86e273f-eea4-4385-a088-e9e7da097d31 req-ba2258a3-8982-4e0b-a841-009f851b02ec tempest-TestShelveInstance-2059068282 None] Lock "cinder-c22c4041-72e9-4e3e-99e3-e131db5f8013-delete_volume" released by "delete_volume" :: held 2.916s {{(pid=92060) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 04:52:01 devstack sudo[107423]: pam_unix(sudo:session): session closed for user root Jun 17 04:52:01 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-c49f3461-0e9a-4b14-9944-e003cc67e35a tempest-VolumesActionsTest-580861366 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-f5b11e91-87ee-42fa-825f-0cbee1477699" returned: 0 in 0.591s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:52:01 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-c49f3461-0e9a-4b14-9944-e003cc67e35a tempest-VolumesActionsTest-580861366 None] Lock "cinder-quobyte-f5b11e91-87ee-42fa-825f-0cbee1477699" released by "delete_volume" :: held 1.372s {{(pid=92060) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 04:52:01 devstack cinder-volume[92060]: DEBUG cinder.quota [None req-c49f3461-0e9a-4b14-9944-e003cc67e35a tempest-VolumesActionsTest-580861366 None] Created reservations ['3ce285be-ad94-4acf-8b0f-0a22271f00fe', 'd5c1b014-8cde-4aec-b792-9994ed77f5cf', 'a6b4c885-6a99-4aa5-97aa-012e2f8cd553', 'f9e8727c-6869-4a3b-81a2-6e07525a2015'] {{(pid=92060) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 17 04:52:01 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-c49f3461-0e9a-4b14-9944-e003cc67e35a tempest-VolumesActionsTest-580861366 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 04:52:01 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-c49f3461-0e9a-4b14-9944-e003cc67e35a tempest-VolumesActionsTest-580861366 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 04:52:01 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-c49f3461-0e9a-4b14-9944-e003cc67e35a tempest-VolumesActionsTest-580861366 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588': None} {{(pid=92060) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 17 04:52:01 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-c49f3461-0e9a-4b14-9944-e003cc67e35a tempest-VolumesActionsTest-580861366 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588'] {{(pid=92060) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 17 04:52:01 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-c49f3461-0e9a-4b14-9944-e003cc67e35a tempest-VolumesActionsTest-580861366 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 04:52:01 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-c49f3461-0e9a-4b14-9944-e003cc67e35a tempest-VolumesActionsTest-580861366 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:52:01 devstack sudo[107428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a Jun 17 04:52:01 devstack sudo[107428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:52:02 devstack sudo[107428]: pam_unix(sudo:session): session closed for user root Jun 17 04:52:02 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-c49f3461-0e9a-4b14-9944-e003cc67e35a tempest-VolumesActionsTest-580861366 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a" returned: 0 in 0.644s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:52:02 devstack cinder-volume[92060]: DEBUG cinder.manager [None req-c49f3461-0e9a-4b14-9944-e003cc67e35a tempest-VolumesActionsTest-580861366 None] Notifying Schedulers of capabilities ... {{(pid=92060) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 17 04:52:02 devstack cinder-volume[92060]: INFO cinder.volume.manager [None req-c49f3461-0e9a-4b14-9944-e003cc67e35a tempest-VolumesActionsTest-580861366 None] Deleted volume successfully. Jun 17 04:52:02 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-c49f3461-0e9a-4b14-9944-e003cc67e35a tempest-VolumesActionsTest-580861366 None] Lock "cinder-f5b11e91-87ee-42fa-825f-0cbee1477699-delete_volume" released by "delete_volume" :: held 2.224s {{(pid=92060) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 04:52:11 devstack cinder-volume[92060]: DEBUG dbcounter [-] [92060] Writing DB stats cinder:SELECT=56,cinder:UPDATE=88,cinder:INSERT=14,cinder:DELETE=4 {{(pid=92060) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 17 04:52:12 devstack cinder-volume[92060]: DEBUG dbcounter [-] [92060] Writing DB stats cinder:SELECT=55,cinder:UPDATE=67,cinder:INSERT=22,cinder:DELETE=9 {{(pid=92060) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 17 04:52:16 devstack cinder-volume[92060]: DEBUG cinder.volume.flows.manager.create_volume [None req-614fef82-41bc-43ba-a229-f0c0c9f71bc8 tempest-VolumeAndVolumeTypeFromImageTest-504394099 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92060) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 17 04:52:16 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-614fef82-41bc-43ba-a229-f0c0c9f71bc8 tempest-VolumeAndVolumeTypeFromImageTest-504394099 None] Flow 'volume_create_manager' (3a487336-2a29-4c0c-8a68-ed64f935f3c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 17 04:52:16 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-614fef82-41bc-43ba-a229-f0c0c9f71bc8 tempest-VolumeAndVolumeTypeFromImageTest-504394099 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (917342d1-4b6f-4498-be9c-014cc5585eaa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:52:16 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-614fef82-41bc-43ba-a229-f0c0c9f71bc8 tempest-VolumeAndVolumeTypeFromImageTest-504394099 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (917342d1-4b6f-4498-be9c-014cc5585eaa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-17T02:52:16Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d2da0e74-0296-4344-b668-4d2d850db0e5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a56f4f65a18e402dbf5bef2870eb661c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T02:52:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T02:52:16Z,use_quota=True,user_id='3cc16728057f434ba83c98973585a1ce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4a5312e0-9824-4a75-a32b-a4dff5a2c021),volume_type_id=4a5312e0-9824-4a75-a32b-a4dff5a2c021)' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:52:16 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-614fef82-41bc-43ba-a229-f0c0c9f71bc8 tempest-VolumeAndVolumeTypeFromImageTest-504394099 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (109af106-952f-4c1e-86fb-ce5ab866205e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:52:16 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-614fef82-41bc-43ba-a229-f0c0c9f71bc8 tempest-VolumeAndVolumeTypeFromImageTest-504394099 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (109af106-952f-4c1e-86fb-ce5ab866205e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:52:16 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-614fef82-41bc-43ba-a229-f0c0c9f71bc8 tempest-VolumeAndVolumeTypeFromImageTest-504394099 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5a5ae8f6-574e-497b-9ebe-46a82de77d90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:52:16 devstack cinder-volume[92060]: DEBUG cinder.image.glance [None req-614fef82-41bc-43ba-a229-f0c0c9f71bc8 tempest-VolumeAndVolumeTypeFromImageTest-504394099 None] Creating Keystone auth plugin from conf {{(pid=92060) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jun 17 04:52:16 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-614fef82-41bc-43ba-a229-f0c0c9f71bc8 tempest-VolumeAndVolumeTypeFromImageTest-504394099 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5a5ae8f6-574e-497b-9ebe-46a82de77d90) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'd2da0e74-0296-4344-b668-4d2d850db0e5', 'volume_name': 'volume-d2da0e74-0296-4344-b668-4d2d850db0e5', 'volume_size': 1, 'image_id': '41d927c0-1c42-4c0d-b639-a92092b3d209', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/41d927c0-1c42-4c0d-b639-a92092b3d209', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '5908e20ce30a37aa782c0b869e297255', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'a56f4f65a18e402dbf5bef2870eb661c', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '86737d3745d069ae64a5af824eef23893955e328ccb3dd23f973f6cd39a4d149ca77ff8611428c1cc3e237afa941e1610d7ef6ca4b085f809ec43bd8ad3787cc', 'id': '41d927c0-1c42-4c0d-b639-a92092b3d209', 'created_at': datetime.datetime(2026, 6, 17, 2, 52, 14, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 17, 2, 52, 15, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/41d927c0-1c42-4c0d-b639-a92092b3d209/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:52:16 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-614fef82-41bc-43ba-a229-f0c0c9f71bc8 tempest-VolumeAndVolumeTypeFromImageTest-504394099 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b123797b-be10-475e-9865-3162b5d9655f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:52:16 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-614fef82-41bc-43ba-a229-f0c0c9f71bc8 tempest-VolumeAndVolumeTypeFromImageTest-504394099 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b123797b-be10-475e-9865-3162b5d9655f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:52:16 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-614fef82-41bc-43ba-a229-f0c0c9f71bc8 tempest-VolumeAndVolumeTypeFromImageTest-504394099 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4ccba5ad-e72b-4d9c-b099-74a4ab7bd6c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:52:16 devstack cinder-volume[92060]: INFO cinder.volume.flows.manager.create_volume [None req-614fef82-41bc-43ba-a229-f0c0c9f71bc8 tempest-VolumeAndVolumeTypeFromImageTest-504394099 None] Volume d2da0e74-0296-4344-b668-4d2d850db0e5: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-d2da0e74-0296-4344-b668-4d2d850db0e5', 'volume_size': 1, 'image_id': '41d927c0-1c42-4c0d-b639-a92092b3d209', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/41d927c0-1c42-4c0d-b639-a92092b3d209', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '5908e20ce30a37aa782c0b869e297255', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'a56f4f65a18e402dbf5bef2870eb661c', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '86737d3745d069ae64a5af824eef23893955e328ccb3dd23f973f6cd39a4d149ca77ff8611428c1cc3e237afa941e1610d7ef6ca4b085f809ec43bd8ad3787cc', 'id': '41d927c0-1c42-4c0d-b639-a92092b3d209', 'created_at': datetime.datetime(2026, 6, 17, 2, 52, 14, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 17, 2, 52, 15, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/41d927c0-1c42-4c0d-b639-a92092b3d209/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Jun 17 04:52:16 devstack cinder-volume[92060]: DEBUG cinder.volume.flows.manager.create_volume [None req-614fef82-41bc-43ba-a229-f0c0c9f71bc8 tempest-VolumeAndVolumeTypeFromImageTest-504394099 None] Trying to clone d2da0e74-0296-4344-b668-4d2d850db0e5 from image 41d927c0-1c42-4c0d-b639-a92092b3d209 at location (None, [{'url': 'file:///opt/stack/data/glance/images/41d927c0-1c42-4c0d-b639-a92092b3d209', 'metadata': {}}]). {{(pid=92060) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jun 17 04:52:16 devstack cinder-volume[92060]: DEBUG cinder.image.image_utils [None req-614fef82-41bc-43ba-a229-f0c0c9f71bc8 tempest-VolumeAndVolumeTypeFromImageTest-504394099 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_41d927c0-1c42-4c0d-b639-a92092b3d209_d9metw1ydevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=92060) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jun 17 04:52:16 devstack cinder-volume[92060]: INFO cinder.image.image_utils [None req-614fef82-41bc-43ba-a229-f0c0c9f71bc8 tempest-VolumeAndVolumeTypeFromImageTest-504394099 None] Image download 0.00 MB at 0.00 MB/s Jun 17 04:52:16 devstack cinder-volume[92060]: DEBUG oslo.privsep.daemon [-] privsep: reply[489dc13b-e4aa-4dd0-af13-c16f1663b560]: (4, 'raw') {{(pid=93130) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 04:52:16 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-614fef82-41bc-43ba-a229-f0c0c9f71bc8 tempest-VolumeAndVolumeTypeFromImageTest-504394099 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_41d927c0-1c42-4c0d-b639-a92092b3d209_d9metw1ydevstack@QuobyteHD {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:52:16 devstack sudo[107447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_41d927c0-1c42-4c0d-b639-a92092b3d209_d9metw1ydevstack@QuobyteHD Jun 17 04:52:16 devstack sudo[107447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:52:17 devstack sudo[107447]: pam_unix(sudo:session): session closed for user root Jun 17 04:52:17 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-614fef82-41bc-43ba-a229-f0c0c9f71bc8 tempest-VolumeAndVolumeTypeFromImageTest-504394099 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_41d927c0-1c42-4c0d-b639-a92092b3d209_d9metw1ydevstack@QuobyteHD" returned: 0 in 0.680s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:52:17 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-614fef82-41bc-43ba-a229-f0c0c9f71bc8 tempest-VolumeAndVolumeTypeFromImageTest-504394099 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_41d927c0-1c42-4c0d-b639-a92092b3d209_d9metw1ydevstack@QuobyteHD {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:52:17 devstack sudo[107451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_41d927c0-1c42-4c0d-b639-a92092b3d209_d9metw1ydevstack@QuobyteHD Jun 17 04:52:17 devstack sudo[107451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:52:18 devstack sudo[107451]: pam_unix(sudo:session): session closed for user root Jun 17 04:52:18 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-614fef82-41bc-43ba-a229-f0c0c9f71bc8 tempest-VolumeAndVolumeTypeFromImageTest-504394099 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_41d927c0-1c42-4c0d-b639-a92092b3d209_d9metw1ydevstack@QuobyteHD" returned: 1 in 0.689s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:52:18 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-614fef82-41bc-43ba-a229-f0c0c9f71bc8 tempest-VolumeAndVolumeTypeFromImageTest-504394099 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_41d927c0-1c42-4c0d-b639-a92092b3d209_d9metw1ydevstack@QuobyteHD' failed. Not Retrying. {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 17 04:52:18 devstack cinder-volume[92060]: DEBUG cinder.image.image_utils [None req-614fef82-41bc-43ba-a229-f0c0c9f71bc8 tempest-VolumeAndVolumeTypeFromImageTest-504394099 None] Temporary image 41d927c0-1c42-4c0d-b639-a92092b3d209 is fetched for user 3cc16728057f434ba83c98973585a1ce. {{(pid=92060) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jun 17 04:52:18 devstack cinder-volume[92060]: DEBUG oslo.privsep.daemon [-] privsep: reply[09bb0460-52ed-4719-8f02-4af70941fc35]: (4, 'raw') {{(pid=93130) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 04:52:18 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-614fef82-41bc-43ba-a229-f0c0c9f71bc8 tempest-VolumeAndVolumeTypeFromImageTest-504394099 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_41d927c0-1c42-4c0d-b639-a92092b3d209_d9metw1ydevstack@QuobyteHD {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:52:18 devstack sudo[107456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_41d927c0-1c42-4c0d-b639-a92092b3d209_d9metw1ydevstack@QuobyteHD Jun 17 04:52:18 devstack sudo[107456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:52:18 devstack sudo[107456]: pam_unix(sudo:session): session closed for user root Jun 17 04:52:18 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-614fef82-41bc-43ba-a229-f0c0c9f71bc8 tempest-VolumeAndVolumeTypeFromImageTest-504394099 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_41d927c0-1c42-4c0d-b639-a92092b3d209_d9metw1ydevstack@QuobyteHD" returned: 0 in 0.651s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:52:18 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-614fef82-41bc-43ba-a229-f0c0c9f71bc8 tempest-VolumeAndVolumeTypeFromImageTest-504394099 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_41d927c0-1c42-4c0d-b639-a92092b3d209_d9metw1ydevstack@QuobyteHD {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:52:18 devstack sudo[107460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_41d927c0-1c42-4c0d-b639-a92092b3d209_d9metw1ydevstack@QuobyteHD Jun 17 04:52:18 devstack sudo[107460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:52:19 devstack sudo[107460]: pam_unix(sudo:session): session closed for user root Jun 17 04:52:19 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-614fef82-41bc-43ba-a229-f0c0c9f71bc8 tempest-VolumeAndVolumeTypeFromImageTest-504394099 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_41d927c0-1c42-4c0d-b639-a92092b3d209_d9metw1ydevstack@QuobyteHD" returned: 1 in 0.729s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:52:19 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-614fef82-41bc-43ba-a229-f0c0c9f71bc8 tempest-VolumeAndVolumeTypeFromImageTest-504394099 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_41d927c0-1c42-4c0d-b639-a92092b3d209_d9metw1ydevstack@QuobyteHD' failed. Not Retrying. {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 17 04:52:19 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-614fef82-41bc-43ba-a229-f0c0c9f71bc8 tempest-VolumeAndVolumeTypeFromImageTest-504394099 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 04:52:19 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-614fef82-41bc-43ba-a229-f0c0c9f71bc8 tempest-VolumeAndVolumeTypeFromImageTest-504394099 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 04:52:19 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-614fef82-41bc-43ba-a229-f0c0c9f71bc8 tempest-VolumeAndVolumeTypeFromImageTest-504394099 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-17T02:52:16Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d2da0e74-0296-4344-b668-4d2d850db0e5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a56f4f65a18e402dbf5bef2870eb661c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T02:52:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T02:52:16Z,use_quota=True,user_id='3cc16728057f434ba83c98973585a1ce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4a5312e0-9824-4a75-a32b-a4dff5a2c021),volume_type_id=4a5312e0-9824-4a75-a32b-a4dff5a2c021)}" {{(pid=92060) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 17 04:52:19 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.remotefs [None req-614fef82-41bc-43ba-a229-f0c0c9f71bc8 tempest-VolumeAndVolumeTypeFromImageTest-504394099 None] Creating volume d2da0e74-0296-4344-b668-4d2d850db0e5 {{(pid=92060) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 17 04:52:19 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-614fef82-41bc-43ba-a229-f0c0c9f71bc8 tempest-VolumeAndVolumeTypeFromImageTest-504394099 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 04:52:19 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-614fef82-41bc-43ba-a229-f0c0c9f71bc8 tempest-VolumeAndVolumeTypeFromImageTest-504394099 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 04:52:19 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-614fef82-41bc-43ba-a229-f0c0c9f71bc8 tempest-VolumeAndVolumeTypeFromImageTest-504394099 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588': None} {{(pid=92060) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 17 04:52:19 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-614fef82-41bc-43ba-a229-f0c0c9f71bc8 tempest-VolumeAndVolumeTypeFromImageTest-504394099 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588'] {{(pid=92060) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 17 04:52:19 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-614fef82-41bc-43ba-a229-f0c0c9f71bc8 tempest-VolumeAndVolumeTypeFromImageTest-504394099 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 04:52:19 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-614fef82-41bc-43ba-a229-f0c0c9f71bc8 tempest-VolumeAndVolumeTypeFromImageTest-504394099 None] Selected osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588 as target Quobyte volume. {{(pid=92060) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 17 04:52:19 devstack cinder-volume[92060]: INFO cinder.volume.drivers.remotefs [None req-614fef82-41bc-43ba-a229-f0c0c9f71bc8 tempest-VolumeAndVolumeTypeFromImageTest-504394099 None] casted to osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588 Jun 17 04:52:19 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-614fef82-41bc-43ba-a229-f0c0c9f71bc8 tempest-VolumeAndVolumeTypeFromImageTest-504394099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-d2da0e74-0296-4344-b668-4d2d850db0e5 1073741824 {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:52:19 devstack sudo[107466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-d2da0e74-0296-4344-b668-4d2d850db0e5 1073741824 Jun 17 04:52:19 devstack sudo[107466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:52:20 devstack sudo[107466]: pam_unix(sudo:session): session closed for user root Jun 17 04:52:20 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-614fef82-41bc-43ba-a229-f0c0c9f71bc8 tempest-VolumeAndVolumeTypeFromImageTest-504394099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-d2da0e74-0296-4344-b668-4d2d850db0e5 1073741824" returned: 0 in 0.853s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:52:20 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-614fef82-41bc-43ba-a229-f0c0c9f71bc8 tempest-VolumeAndVolumeTypeFromImageTest-504394099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-d2da0e74-0296-4344-b668-4d2d850db0e5 {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:52:20 devstack sudo[107472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-d2da0e74-0296-4344-b668-4d2d850db0e5 Jun 17 04:52:20 devstack sudo[107472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:52:21 devstack sudo[107472]: pam_unix(sudo:session): session closed for user root Jun 17 04:52:21 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-614fef82-41bc-43ba-a229-f0c0c9f71bc8 tempest-VolumeAndVolumeTypeFromImageTest-504394099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-d2da0e74-0296-4344-b668-4d2d850db0e5" returned: 0 in 0.617s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:52:21 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-614fef82-41bc-43ba-a229-f0c0c9f71bc8 tempest-VolumeAndVolumeTypeFromImageTest-504394099 None] <== create_volume: return (1516ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588'} {{(pid=92060) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 17 04:52:21 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-614fef82-41bc-43ba-a229-f0c0c9f71bc8 tempest-VolumeAndVolumeTypeFromImageTest-504394099 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.519s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 04:52:21 devstack cinder-volume[92060]: DEBUG cinder.volume.volume_utils [None req-614fef82-41bc-43ba-a229-f0c0c9f71bc8 tempest-VolumeAndVolumeTypeFromImageTest-504394099 None] Attempting download of 41d927c0-1c42-4c0d-b639-a92092b3d209 ((None, [{'url': 'file:///opt/stack/data/glance/images/41d927c0-1c42-4c0d-b639-a92092b3d209', 'metadata': {}}])) to volume d2da0e74-0296-4344-b668-4d2d850db0e5. {{(pid=92060) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jun 17 04:52:21 devstack cinder-volume[92060]: DEBUG oslo.privsep.daemon [-] privsep: reply[da9b7c2a-94b9-4419-b594-24803bd5d124]: (4, 'raw') {{(pid=93130) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 04:52:21 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-614fef82-41bc-43ba-a229-f0c0c9f71bc8 tempest-VolumeAndVolumeTypeFromImageTest-504394099 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_41d927c0-1c42-4c0d-b639-a92092b3d209_1lany063 {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:52:21 devstack sudo[107475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_41d927c0-1c42-4c0d-b639-a92092b3d209_1lany063 Jun 17 04:52:21 devstack sudo[107475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:52:21 devstack sudo[107475]: pam_unix(sudo:session): session closed for user root Jun 17 04:52:21 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-614fef82-41bc-43ba-a229-f0c0c9f71bc8 tempest-VolumeAndVolumeTypeFromImageTest-504394099 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_41d927c0-1c42-4c0d-b639-a92092b3d209_1lany063" returned: 0 in 0.724s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:52:21 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-614fef82-41bc-43ba-a229-f0c0c9f71bc8 tempest-VolumeAndVolumeTypeFromImageTest-504394099 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_41d927c0-1c42-4c0d-b639-a92092b3d209_1lany063 {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:52:21 devstack sudo[107482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_41d927c0-1c42-4c0d-b639-a92092b3d209_1lany063 Jun 17 04:52:21 devstack sudo[107482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:52:22 devstack sudo[107482]: pam_unix(sudo:session): session closed for user root Jun 17 04:52:22 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-614fef82-41bc-43ba-a229-f0c0c9f71bc8 tempest-VolumeAndVolumeTypeFromImageTest-504394099 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_41d927c0-1c42-4c0d-b639-a92092b3d209_1lany063" returned: 1 in 0.654s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:52:22 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-614fef82-41bc-43ba-a229-f0c0c9f71bc8 tempest-VolumeAndVolumeTypeFromImageTest-504394099 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_41d927c0-1c42-4c0d-b639-a92092b3d209_1lany063' failed. Not Retrying. {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 17 04:52:22 devstack cinder-volume[92060]: DEBUG oslo.privsep.daemon [-] privsep: reply[291d2015-e1fd-431a-bd1f-1994c3613c0f]: (4, 'raw') {{(pid=93130) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 04:52:22 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-614fef82-41bc-43ba-a229-f0c0c9f71bc8 tempest-VolumeAndVolumeTypeFromImageTest-504394099 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_41d927c0-1c42-4c0d-b639-a92092b3d209_d9metw1ydevstack@QuobyteHD {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:52:22 devstack sudo[107486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_41d927c0-1c42-4c0d-b639-a92092b3d209_d9metw1ydevstack@QuobyteHD Jun 17 04:52:22 devstack sudo[107486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:52:23 devstack sudo[107486]: pam_unix(sudo:session): session closed for user root Jun 17 04:52:23 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-614fef82-41bc-43ba-a229-f0c0c9f71bc8 tempest-VolumeAndVolumeTypeFromImageTest-504394099 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_41d927c0-1c42-4c0d-b639-a92092b3d209_d9metw1ydevstack@QuobyteHD" returned: 0 in 0.675s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:52:23 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-614fef82-41bc-43ba-a229-f0c0c9f71bc8 tempest-VolumeAndVolumeTypeFromImageTest-504394099 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_41d927c0-1c42-4c0d-b639-a92092b3d209_d9metw1ydevstack@QuobyteHD {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:52:23 devstack sudo[107490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_41d927c0-1c42-4c0d-b639-a92092b3d209_d9metw1ydevstack@QuobyteHD Jun 17 04:52:23 devstack sudo[107490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:52:23 devstack sudo[107490]: pam_unix(sudo:session): session closed for user root Jun 17 04:52:23 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-614fef82-41bc-43ba-a229-f0c0c9f71bc8 tempest-VolumeAndVolumeTypeFromImageTest-504394099 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_41d927c0-1c42-4c0d-b639-a92092b3d209_d9metw1ydevstack@QuobyteHD" returned: 1 in 0.804s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:52:23 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-614fef82-41bc-43ba-a229-f0c0c9f71bc8 tempest-VolumeAndVolumeTypeFromImageTest-504394099 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_41d927c0-1c42-4c0d-b639-a92092b3d209_d9metw1ydevstack@QuobyteHD' failed. Not Retrying. {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 17 04:52:23 devstack cinder-volume[92060]: DEBUG cinder.image.image_utils [None req-614fef82-41bc-43ba-a229-f0c0c9f71bc8 tempest-VolumeAndVolumeTypeFromImageTest-504394099 None] 41d927c0-1c42-4c0d-b639-a92092b3d209 was raw, converting to raw {{(pid=92060) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jun 17 04:52:23 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-614fef82-41bc-43ba-a229-f0c0c9f71bc8 tempest-VolumeAndVolumeTypeFromImageTest-504394099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_41d927c0-1c42-4c0d-b639-a92092b3d209_d9metw1ydevstack@QuobyteHD /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-d2da0e74-0296-4344-b668-4d2d850db0e5 {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:52:24 devstack sudo[107495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_41d927c0-1c42-4c0d-b639-a92092b3d209_d9metw1ydevstack@QuobyteHD /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-d2da0e74-0296-4344-b668-4d2d850db0e5 Jun 17 04:52:24 devstack sudo[107495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:52:24 devstack cinder-volume[92060]: DEBUG cinder.volume.flows.manager.create_volume [None req-77c33c24-4b1a-49c7-b68d-6759148fa9cf tempest-VolumesActionsTest-1808403996 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92060) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 17 04:52:24 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-77c33c24-4b1a-49c7-b68d-6759148fa9cf tempest-VolumesActionsTest-1808403996 None] Flow 'volume_create_manager' (a4ebbce6-d458-4cc1-8c96-1573b73af502) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 17 04:52:24 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-77c33c24-4b1a-49c7-b68d-6759148fa9cf tempest-VolumesActionsTest-1808403996 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (83de9e59-da3a-4797-bea9-09dc2242d6fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:52:24 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-77c33c24-4b1a-49c7-b68d-6759148fa9cf tempest-VolumesActionsTest-1808403996 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (83de9e59-da3a-4797-bea9-09dc2242d6fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-17T02:52:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-929830814',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e32ad70e-580f-4af4-bd73-b9df2f0e5426,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9adf271b36184ffa8c9ab366e0304204',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T02:52:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T02:52:25Z,use_quota=True,user_id='22b476e9977a49b0b900268970cf0e3d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aad9ce24-93f9-41a6-baa1-5125964f96d1),volume_type_id=aad9ce24-93f9-41a6-baa1-5125964f96d1)' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:52:24 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-77c33c24-4b1a-49c7-b68d-6759148fa9cf tempest-VolumesActionsTest-1808403996 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ca30951f-04ca-478c-af7b-2ced6d01382d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:52:24 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-77c33c24-4b1a-49c7-b68d-6759148fa9cf tempest-VolumesActionsTest-1808403996 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ca30951f-04ca-478c-af7b-2ced6d01382d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:52:24 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-77c33c24-4b1a-49c7-b68d-6759148fa9cf tempest-VolumesActionsTest-1808403996 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5b1f6cae-6049-4927-8690-48f114809762) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:52:24 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-77c33c24-4b1a-49c7-b68d-6759148fa9cf tempest-VolumesActionsTest-1808403996 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5b1f6cae-6049-4927-8690-48f114809762) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e32ad70e-580f-4af4-bd73-b9df2f0e5426', 'volume_name': 'volume-e32ad70e-580f-4af4-bd73-b9df2f0e5426', 'volume_size': 1}' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:52:24 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-77c33c24-4b1a-49c7-b68d-6759148fa9cf tempest-VolumesActionsTest-1808403996 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4ad6a65c-2eba-4731-9d21-9a218213c3cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:52:24 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-77c33c24-4b1a-49c7-b68d-6759148fa9cf tempest-VolumesActionsTest-1808403996 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4ad6a65c-2eba-4731-9d21-9a218213c3cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:52:24 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-77c33c24-4b1a-49c7-b68d-6759148fa9cf tempest-VolumesActionsTest-1808403996 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0c0bd8c3-447c-4f14-a2b7-1b5f38a724ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:52:24 devstack cinder-volume[92060]: INFO cinder.volume.flows.manager.create_volume [None req-77c33c24-4b1a-49c7-b68d-6759148fa9cf tempest-VolumesActionsTest-1808403996 None] Volume e32ad70e-580f-4af4-bd73-b9df2f0e5426: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e32ad70e-580f-4af4-bd73-b9df2f0e5426', 'volume_size': 1} Jun 17 04:52:24 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-77c33c24-4b1a-49c7-b68d-6759148fa9cf tempest-VolumesActionsTest-1808403996 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 04:52:24 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-77c33c24-4b1a-49c7-b68d-6759148fa9cf tempest-VolumesActionsTest-1808403996 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 04:52:24 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-77c33c24-4b1a-49c7-b68d-6759148fa9cf tempest-VolumesActionsTest-1808403996 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-17T02:52:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-929830814',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e32ad70e-580f-4af4-bd73-b9df2f0e5426,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9adf271b36184ffa8c9ab366e0304204',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T02:52:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T02:52:25Z,use_quota=True,user_id='22b476e9977a49b0b900268970cf0e3d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aad9ce24-93f9-41a6-baa1-5125964f96d1),volume_type_id=aad9ce24-93f9-41a6-baa1-5125964f96d1)}" {{(pid=92060) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 17 04:52:24 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.remotefs [None req-77c33c24-4b1a-49c7-b68d-6759148fa9cf tempest-VolumesActionsTest-1808403996 None] Creating volume e32ad70e-580f-4af4-bd73-b9df2f0e5426 {{(pid=92060) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 17 04:52:24 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-77c33c24-4b1a-49c7-b68d-6759148fa9cf tempest-VolumesActionsTest-1808403996 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 04:52:24 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-77c33c24-4b1a-49c7-b68d-6759148fa9cf tempest-VolumesActionsTest-1808403996 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 04:52:24 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-77c33c24-4b1a-49c7-b68d-6759148fa9cf tempest-VolumesActionsTest-1808403996 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588': None} {{(pid=92060) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 17 04:52:24 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-77c33c24-4b1a-49c7-b68d-6759148fa9cf tempest-VolumesActionsTest-1808403996 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588'] {{(pid=92060) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 17 04:52:24 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-77c33c24-4b1a-49c7-b68d-6759148fa9cf tempest-VolumesActionsTest-1808403996 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 04:52:24 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-77c33c24-4b1a-49c7-b68d-6759148fa9cf tempest-VolumesActionsTest-1808403996 None] Selected osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588 as target Quobyte volume. {{(pid=92060) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 17 04:52:24 devstack cinder-volume[92060]: INFO cinder.volume.drivers.remotefs [None req-77c33c24-4b1a-49c7-b68d-6759148fa9cf tempest-VolumesActionsTest-1808403996 None] casted to osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588 Jun 17 04:52:24 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-77c33c24-4b1a-49c7-b68d-6759148fa9cf tempest-VolumesActionsTest-1808403996 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-e32ad70e-580f-4af4-bd73-b9df2f0e5426 1073741824 {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:52:24 devstack sudo[107534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-e32ad70e-580f-4af4-bd73-b9df2f0e5426 1073741824 Jun 17 04:52:24 devstack sudo[107534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:52:24 devstack sudo[107495]: pam_unix(sudo:session): session closed for user root Jun 17 04:52:24 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-614fef82-41bc-43ba-a229-f0c0c9f71bc8 tempest-VolumeAndVolumeTypeFromImageTest-504394099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_41d927c0-1c42-4c0d-b639-a92092b3d209_d9metw1ydevstack@QuobyteHD /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-d2da0e74-0296-4344-b668-4d2d850db0e5" returned: 0 in 0.771s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:52:24 devstack cinder-volume[92060]: DEBUG cinder.image.image_utils [None req-614fef82-41bc-43ba-a229-f0c0c9f71bc8 tempest-VolumeAndVolumeTypeFromImageTest-504394099 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_41d927c0-1c42-4c0d-b639-a92092b3d209_d9metw1ydevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-d2da0e74-0296-4344-b668-4d2d850db0e5 {{(pid=92060) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 17 04:52:24 devstack cinder-volume[92060]: INFO cinder.image.image_utils [None req-614fef82-41bc-43ba-a229-f0c0c9f71bc8 tempest-VolumeAndVolumeTypeFromImageTest-504394099 None] Converted 0.00 MB image at 0.00 MB/s Jun 17 04:52:24 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-614fef82-41bc-43ba-a229-f0c0c9f71bc8 tempest-VolumeAndVolumeTypeFromImageTest-504394099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-d2da0e74-0296-4344-b668-4d2d850db0e5 1G {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:52:24 devstack sudo[107536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-d2da0e74-0296-4344-b668-4d2d850db0e5 1G Jun 17 04:52:24 devstack sudo[107536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:52:25 devstack sudo[107536]: pam_unix(sudo:session): session closed for user root Jun 17 04:52:25 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-614fef82-41bc-43ba-a229-f0c0c9f71bc8 tempest-VolumeAndVolumeTypeFromImageTest-504394099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-d2da0e74-0296-4344-b668-4d2d850db0e5 1G" returned: 0 in 0.674s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:52:25 devstack cinder-volume[92060]: DEBUG oslo.privsep.daemon [-] privsep: reply[e56e6315-8b7d-4da5-9d23-b5dff08e844f]: (4, 'raw') {{(pid=93130) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 04:52:25 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-614fef82-41bc-43ba-a229-f0c0c9f71bc8 tempest-VolumeAndVolumeTypeFromImageTest-504394099 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-d2da0e74-0296-4344-b668-4d2d850db0e5 {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:52:25 devstack sudo[107534]: pam_unix(sudo:session): session closed for user root Jun 17 04:52:25 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-77c33c24-4b1a-49c7-b68d-6759148fa9cf tempest-VolumesActionsTest-1808403996 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-e32ad70e-580f-4af4-bd73-b9df2f0e5426 1073741824" returned: 0 in 0.799s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:52:25 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-77c33c24-4b1a-49c7-b68d-6759148fa9cf tempest-VolumesActionsTest-1808403996 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-e32ad70e-580f-4af4-bd73-b9df2f0e5426 {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:52:25 devstack sudo[107547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-e32ad70e-580f-4af4-bd73-b9df2f0e5426 Jun 17 04:52:25 devstack sudo[107547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:52:25 devstack sudo[107546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-d2da0e74-0296-4344-b668-4d2d850db0e5 Jun 17 04:52:25 devstack sudo[107546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:52:26 devstack sudo[107547]: pam_unix(sudo:session): session closed for user root Jun 17 04:52:26 devstack sudo[107546]: pam_unix(sudo:session): session closed for user root Jun 17 04:52:26 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-77c33c24-4b1a-49c7-b68d-6759148fa9cf tempest-VolumesActionsTest-1808403996 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-e32ad70e-580f-4af4-bd73-b9df2f0e5426" returned: 0 in 0.662s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:52:26 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-77c33c24-4b1a-49c7-b68d-6759148fa9cf tempest-VolumesActionsTest-1808403996 None] <== create_volume: return (1507ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588'} {{(pid=92060) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 17 04:52:26 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-77c33c24-4b1a-49c7-b68d-6759148fa9cf tempest-VolumesActionsTest-1808403996 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.510s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 04:52:26 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-614fef82-41bc-43ba-a229-f0c0c9f71bc8 tempest-VolumeAndVolumeTypeFromImageTest-504394099 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-d2da0e74-0296-4344-b668-4d2d850db0e5" returned: 0 in 0.749s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:52:26 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-614fef82-41bc-43ba-a229-f0c0c9f71bc8 tempest-VolumeAndVolumeTypeFromImageTest-504394099 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-d2da0e74-0296-4344-b668-4d2d850db0e5 {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:52:26 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-77c33c24-4b1a-49c7-b68d-6759148fa9cf tempest-VolumesActionsTest-1808403996 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0c0bd8c3-447c-4f14-a2b7-1b5f38a724ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e32ad70e-580f-4af4-bd73-b9df2f0e5426', 'volume_size': 1}' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:52:26 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-77c33c24-4b1a-49c7-b68d-6759148fa9cf tempest-VolumesActionsTest-1808403996 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d62dd907-8af7-4654-8989-2f766deceb9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:52:26 devstack cinder-volume[92060]: INFO cinder.volume.flows.manager.create_volume [None req-77c33c24-4b1a-49c7-b68d-6759148fa9cf tempest-VolumesActionsTest-1808403996 None] Volume volume-e32ad70e-580f-4af4-bd73-b9df2f0e5426 (e32ad70e-580f-4af4-bd73-b9df2f0e5426): created successfully Jun 17 04:52:26 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-77c33c24-4b1a-49c7-b68d-6759148fa9cf tempest-VolumesActionsTest-1808403996 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d62dd907-8af7-4654-8989-2f766deceb9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:52:26 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-77c33c24-4b1a-49c7-b68d-6759148fa9cf tempest-VolumesActionsTest-1808403996 None] Flow 'volume_create_manager' (a4ebbce6-d458-4cc1-8c96-1573b73af502) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92060) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 17 04:52:26 devstack cinder-volume[92060]: INFO cinder.volume.manager [None req-77c33c24-4b1a-49c7-b68d-6759148fa9cf tempest-VolumesActionsTest-1808403996 None] Created volume successfully. Jun 17 04:52:26 devstack sudo[107553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-d2da0e74-0296-4344-b668-4d2d850db0e5 Jun 17 04:52:26 devstack sudo[107553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:52:26 devstack sudo[107553]: pam_unix(sudo:session): session closed for user root Jun 17 04:52:26 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-614fef82-41bc-43ba-a229-f0c0c9f71bc8 tempest-VolumeAndVolumeTypeFromImageTest-504394099 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-d2da0e74-0296-4344-b668-4d2d850db0e5" returned: 1 in 0.685s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:52:26 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-614fef82-41bc-43ba-a229-f0c0c9f71bc8 tempest-VolumeAndVolumeTypeFromImageTest-504394099 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-d2da0e74-0296-4344-b668-4d2d850db0e5' failed. Not Retrying. {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 17 04:52:26 devstack cinder-volume[92060]: DEBUG cinder.volume.volume_utils [None req-614fef82-41bc-43ba-a229-f0c0c9f71bc8 tempest-VolumeAndVolumeTypeFromImageTest-504394099 None] Downloaded image 41d927c0-1c42-4c0d-b639-a92092b3d209 ((None, [{'url': 'file:///opt/stack/data/glance/images/41d927c0-1c42-4c0d-b639-a92092b3d209', 'metadata': {}}])) to volume d2da0e74-0296-4344-b668-4d2d850db0e5 successfully. {{(pid=92060) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jun 17 04:52:26 devstack cinder-volume[92060]: DEBUG cinder.image.image_utils [None req-614fef82-41bc-43ba-a229-f0c0c9f71bc8 tempest-VolumeAndVolumeTypeFromImageTest-504394099 None] Temporary image 41d927c0-1c42-4c0d-b639-a92092b3d209 for user 3cc16728057f434ba83c98973585a1ce is deleted. {{(pid=92060) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jun 17 04:52:26 devstack cinder-volume[92060]: DEBUG cinder.volume.volume_utils [None req-614fef82-41bc-43ba-a229-f0c0c9f71bc8 tempest-VolumeAndVolumeTypeFromImageTest-504394099 None] Marking volume d2da0e74-0296-4344-b668-4d2d850db0e5 as bootable. {{(pid=92060) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jun 17 04:52:26 devstack cinder-volume[92060]: DEBUG cinder.volume.flows.manager.create_volume [None req-614fef82-41bc-43ba-a229-f0c0c9f71bc8 tempest-VolumeAndVolumeTypeFromImageTest-504394099 None] Copying metadata from image 41d927c0-1c42-4c0d-b639-a92092b3d209 to d2da0e74-0296-4344-b668-4d2d850db0e5. {{(pid=92060) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jun 17 04:52:26 devstack cinder-volume[92060]: DEBUG cinder.volume.flows.manager.create_volume [None req-614fef82-41bc-43ba-a229-f0c0c9f71bc8 tempest-VolumeAndVolumeTypeFromImageTest-504394099 None] Creating volume glance metadata for volume d2da0e74-0296-4344-b668-4d2d850db0e5 backed by image 41d927c0-1c42-4c0d-b639-a92092b3d209 with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': '41d927c0-1c42-4c0d-b639-a92092b3d209', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': '5908e20ce30a37aa782c0b869e297255', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=92060) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jun 17 04:52:26 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-614fef82-41bc-43ba-a229-f0c0c9f71bc8 tempest-VolumeAndVolumeTypeFromImageTest-504394099 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4ccba5ad-e72b-4d9c-b099-74a4ab7bd6c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d2da0e74-0296-4344-b668-4d2d850db0e5', 'volume_size': 1, 'image_id': '41d927c0-1c42-4c0d-b639-a92092b3d209', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/41d927c0-1c42-4c0d-b639-a92092b3d209', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '5908e20ce30a37aa782c0b869e297255', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'a56f4f65a18e402dbf5bef2870eb661c', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '86737d3745d069ae64a5af824eef23893955e328ccb3dd23f973f6cd39a4d149ca77ff8611428c1cc3e237afa941e1610d7ef6ca4b085f809ec43bd8ad3787cc', 'id': '41d927c0-1c42-4c0d-b639-a92092b3d209', 'created_at': datetime.datetime(2026, 6, 17, 2, 52, 14, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 17, 2, 52, 15, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/41d927c0-1c42-4c0d-b639-a92092b3d209/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:52:26 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-614fef82-41bc-43ba-a229-f0c0c9f71bc8 tempest-VolumeAndVolumeTypeFromImageTest-504394099 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (30f6783d-b33b-4fc2-89ca-874523ee599a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:52:26 devstack cinder-volume[92060]: INFO cinder.volume.flows.manager.create_volume [None req-614fef82-41bc-43ba-a229-f0c0c9f71bc8 tempest-VolumeAndVolumeTypeFromImageTest-504394099 None] Volume volume-d2da0e74-0296-4344-b668-4d2d850db0e5 (d2da0e74-0296-4344-b668-4d2d850db0e5): created successfully Jun 17 04:52:27 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-614fef82-41bc-43ba-a229-f0c0c9f71bc8 tempest-VolumeAndVolumeTypeFromImageTest-504394099 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (30f6783d-b33b-4fc2-89ca-874523ee599a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:52:27 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-614fef82-41bc-43ba-a229-f0c0c9f71bc8 tempest-VolumeAndVolumeTypeFromImageTest-504394099 None] Flow 'volume_create_manager' (3a487336-2a29-4c0c-8a68-ed64f935f3c2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92060) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 17 04:52:27 devstack cinder-volume[92060]: INFO cinder.volume.manager [None req-614fef82-41bc-43ba-a229-f0c0c9f71bc8 tempest-VolumeAndVolumeTypeFromImageTest-504394099 None] Created volume successfully. Jun 17 04:52:27 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-fc57afb6-88a3-4c6d-85f6-740ca754f7b8 tempest-VolumeAndVolumeTypeFromImageTest-504394099 None] Acquiring lock "cinder-d2da0e74-0296-4344-b668-4d2d850db0e5-delete_volume" by "delete_volume" {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 04:52:27 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-fc57afb6-88a3-4c6d-85f6-740ca754f7b8 tempest-VolumeAndVolumeTypeFromImageTest-504394099 None] Lock "cinder-d2da0e74-0296-4344-b668-4d2d850db0e5-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 04:52:27 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-fc57afb6-88a3-4c6d-85f6-740ca754f7b8 tempest-VolumeAndVolumeTypeFromImageTest-504394099 None] Acquiring lock "cinder-quobyte-d2da0e74-0296-4344-b668-4d2d850db0e5" by "delete_volume" {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 04:52:27 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-fc57afb6-88a3-4c6d-85f6-740ca754f7b8 tempest-VolumeAndVolumeTypeFromImageTest-504394099 None] Lock "cinder-quobyte-d2da0e74-0296-4344-b668-4d2d850db0e5" acquired by "delete_volume" :: waited 0.020s {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 04:52:27 devstack cinder-volume[92060]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea1a1888-affd-4955-862a-06cd3366a120]: (4, 'raw') {{(pid=93130) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 04:52:27 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-fc57afb6-88a3-4c6d-85f6-740ca754f7b8 tempest-VolumeAndVolumeTypeFromImageTest-504394099 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-d2da0e74-0296-4344-b668-4d2d850db0e5 {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:52:28 devstack sudo[107560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-d2da0e74-0296-4344-b668-4d2d850db0e5 Jun 17 04:52:28 devstack sudo[107560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:52:28 devstack sudo[107560]: pam_unix(sudo:session): session closed for user root Jun 17 04:52:28 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-fc57afb6-88a3-4c6d-85f6-740ca754f7b8 tempest-VolumeAndVolumeTypeFromImageTest-504394099 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-d2da0e74-0296-4344-b668-4d2d850db0e5" returned: 0 in 0.736s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:52:28 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-fc57afb6-88a3-4c6d-85f6-740ca754f7b8 tempest-VolumeAndVolumeTypeFromImageTest-504394099 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-d2da0e74-0296-4344-b668-4d2d850db0e5 {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:52:28 devstack sudo[107564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-d2da0e74-0296-4344-b668-4d2d850db0e5 Jun 17 04:52:28 devstack sudo[107564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:52:29 devstack sudo[107564]: pam_unix(sudo:session): session closed for user root Jun 17 04:52:29 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-fc57afb6-88a3-4c6d-85f6-740ca754f7b8 tempest-VolumeAndVolumeTypeFromImageTest-504394099 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-d2da0e74-0296-4344-b668-4d2d850db0e5" returned: 1 in 0.691s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:52:29 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-fc57afb6-88a3-4c6d-85f6-740ca754f7b8 tempest-VolumeAndVolumeTypeFromImageTest-504394099 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-d2da0e74-0296-4344-b668-4d2d850db0e5' failed. Not Retrying. {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 17 04:52:29 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-fc57afb6-88a3-4c6d-85f6-740ca754f7b8 tempest-VolumeAndVolumeTypeFromImageTest-504394099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-d2da0e74-0296-4344-b668-4d2d850db0e5 {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:52:29 devstack sudo[107569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-d2da0e74-0296-4344-b668-4d2d850db0e5 Jun 17 04:52:29 devstack sudo[107569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:52:29 devstack sudo[107569]: pam_unix(sudo:session): session closed for user root Jun 17 04:52:29 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-fc57afb6-88a3-4c6d-85f6-740ca754f7b8 tempest-VolumeAndVolumeTypeFromImageTest-504394099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-d2da0e74-0296-4344-b668-4d2d850db0e5" returned: 0 in 0.606s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:52:30 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-fc57afb6-88a3-4c6d-85f6-740ca754f7b8 tempest-VolumeAndVolumeTypeFromImageTest-504394099 None] Lock "cinder-quobyte-d2da0e74-0296-4344-b668-4d2d850db0e5" released by "delete_volume" :: held 2.110s {{(pid=92060) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 04:52:30 devstack cinder-volume[92060]: WARNING cinder.quota [None req-fc57afb6-88a3-4c6d-85f6-740ca754f7b8 tempest-VolumeAndVolumeTypeFromImageTest-504394099 None] Deprecated: Default quota for resource: volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Jun 17 04:52:30 devstack cinder-volume[92060]: WARNING cinder.quota [None req-fc57afb6-88a3-4c6d-85f6-740ca754f7b8 tempest-VolumeAndVolumeTypeFromImageTest-504394099 None] Deprecated: Default quota for resource: gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Jun 17 04:52:30 devstack cinder-volume[92060]: DEBUG cinder.quota [None req-fc57afb6-88a3-4c6d-85f6-740ca754f7b8 tempest-VolumeAndVolumeTypeFromImageTest-504394099 None] Created reservations ['3a0f81cd-01f1-4a4d-8bc4-a8e04a982fa1', '2167be4d-7fcf-4f06-84dd-963fa9a2cf62', 'e6c45326-c440-491e-abd4-4ff863c842ad', '2612f189-25c2-4857-825e-3e9420d97646'] {{(pid=92060) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 17 04:52:30 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-fc57afb6-88a3-4c6d-85f6-740ca754f7b8 tempest-VolumeAndVolumeTypeFromImageTest-504394099 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 04:52:30 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-fc57afb6-88a3-4c6d-85f6-740ca754f7b8 tempest-VolumeAndVolumeTypeFromImageTest-504394099 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 04:52:30 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-fc57afb6-88a3-4c6d-85f6-740ca754f7b8 tempest-VolumeAndVolumeTypeFromImageTest-504394099 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588': None} {{(pid=92060) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 17 04:52:30 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-fc57afb6-88a3-4c6d-85f6-740ca754f7b8 tempest-VolumeAndVolumeTypeFromImageTest-504394099 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588'] {{(pid=92060) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 17 04:52:30 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-fc57afb6-88a3-4c6d-85f6-740ca754f7b8 tempest-VolumeAndVolumeTypeFromImageTest-504394099 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 04:52:30 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-fc57afb6-88a3-4c6d-85f6-740ca754f7b8 tempest-VolumeAndVolumeTypeFromImageTest-504394099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:52:30 devstack sudo[107572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a Jun 17 04:52:30 devstack sudo[107572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:52:30 devstack sudo[107572]: pam_unix(sudo:session): session closed for user root Jun 17 04:52:30 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-fc57afb6-88a3-4c6d-85f6-740ca754f7b8 tempest-VolumeAndVolumeTypeFromImageTest-504394099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a" returned: 0 in 0.639s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:52:30 devstack cinder-volume[92060]: DEBUG cinder.manager [None req-fc57afb6-88a3-4c6d-85f6-740ca754f7b8 tempest-VolumeAndVolumeTypeFromImageTest-504394099 None] Notifying Schedulers of capabilities ... {{(pid=92060) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 17 04:52:30 devstack cinder-volume[92060]: INFO cinder.volume.manager [None req-fc57afb6-88a3-4c6d-85f6-740ca754f7b8 tempest-VolumeAndVolumeTypeFromImageTest-504394099 None] Deleted volume successfully. Jun 17 04:52:30 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-fc57afb6-88a3-4c6d-85f6-740ca754f7b8 tempest-VolumeAndVolumeTypeFromImageTest-504394099 None] Lock "cinder-d2da0e74-0296-4344-b668-4d2d850db0e5-delete_volume" released by "delete_volume" :: held 2.955s {{(pid=92060) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 04:52:38 devstack cinder-volume[92060]: DEBUG cinder.volume.flows.manager.create_volume [None req-b31356b4-a4bc-4313-bbae-572f3b91dc33 tempest-VolumeImageDependencyTests-575128815 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92060) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 17 04:52:38 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-b31356b4-a4bc-4313-bbae-572f3b91dc33 tempest-VolumeImageDependencyTests-575128815 None] Flow 'volume_create_manager' (c88ccaa5-8a61-43fb-a9a5-f2b7102f54cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 17 04:52:38 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-b31356b4-a4bc-4313-bbae-572f3b91dc33 tempest-VolumeImageDependencyTests-575128815 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2fe71f05-4aa0-49f2-a1bb-31f7be515ae5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:52:38 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-b31356b4-a4bc-4313-bbae-572f3b91dc33 tempest-VolumeImageDependencyTests-575128815 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2fe71f05-4aa0-49f2-a1bb-31f7be515ae5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-17T02:52:38Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=54ca0d11-c400-4c7d-a8fc-ef2ddfd8b086,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b026223f2d7c4677a99470ed1ee18094',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T02:52:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T02:52:38Z,use_quota=True,user_id='4599bbe991604343ab3a24cff85e0e85',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aad9ce24-93f9-41a6-baa1-5125964f96d1),volume_type_id=aad9ce24-93f9-41a6-baa1-5125964f96d1)' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:52:38 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-b31356b4-a4bc-4313-bbae-572f3b91dc33 tempest-VolumeImageDependencyTests-575128815 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dca8c963-1357-4901-9294-fcb5125a0417) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:52:38 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-b31356b4-a4bc-4313-bbae-572f3b91dc33 tempest-VolumeImageDependencyTests-575128815 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dca8c963-1357-4901-9294-fcb5125a0417) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:52:38 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-b31356b4-a4bc-4313-bbae-572f3b91dc33 tempest-VolumeImageDependencyTests-575128815 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (258d6eaf-0300-4c1d-aae0-e7035683af50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:52:38 devstack cinder-volume[92060]: DEBUG cinder.image.glance [None req-b31356b4-a4bc-4313-bbae-572f3b91dc33 tempest-VolumeImageDependencyTests-575128815 None] Creating Keystone auth plugin from conf {{(pid=92060) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jun 17 04:52:38 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-b31356b4-a4bc-4313-bbae-572f3b91dc33 tempest-VolumeImageDependencyTests-575128815 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (258d6eaf-0300-4c1d-aae0-e7035683af50) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '54ca0d11-c400-4c7d-a8fc-ef2ddfd8b086', 'volume_name': 'volume-54ca0d11-c400-4c7d-a8fc-ef2ddfd8b086', 'volume_size': 1, 'image_id': '873881b6-80a0-452e-a992-4318113e9969', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/873881b6-80a0-452e-a992-4318113e9969', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '6cacc91fc365862dc2b0d2eafe523852', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'b026223f2d7c4677a99470ed1ee18094', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '3e5c6ebd7b73e7fe35f9d7554f74215a0952ade6a4d83ad0dfc93ab463bb5fefc7d8a0514ee5dc33217855375983af13c55172d38695d686fb2dc856dc000863', 'id': '873881b6-80a0-452e-a992-4318113e9969', 'created_at': datetime.datetime(2026, 6, 17, 2, 52, 36, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 17, 2, 52, 37, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/873881b6-80a0-452e-a992-4318113e9969/file', 'properties': {}}, 'image_service': }' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:52:38 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-b31356b4-a4bc-4313-bbae-572f3b91dc33 tempest-VolumeImageDependencyTests-575128815 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b46b11b1-110a-4411-958c-4ecbeb5fe81b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:52:38 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-b31356b4-a4bc-4313-bbae-572f3b91dc33 tempest-VolumeImageDependencyTests-575128815 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b46b11b1-110a-4411-958c-4ecbeb5fe81b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:52:38 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-b31356b4-a4bc-4313-bbae-572f3b91dc33 tempest-VolumeImageDependencyTests-575128815 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1ef56df1-77ee-4243-96ca-7ffad28946ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:52:38 devstack cinder-volume[92060]: INFO cinder.volume.flows.manager.create_volume [None req-b31356b4-a4bc-4313-bbae-572f3b91dc33 tempest-VolumeImageDependencyTests-575128815 None] Volume 54ca0d11-c400-4c7d-a8fc-ef2ddfd8b086: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-54ca0d11-c400-4c7d-a8fc-ef2ddfd8b086', 'volume_size': 1, 'image_id': '873881b6-80a0-452e-a992-4318113e9969', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/873881b6-80a0-452e-a992-4318113e9969', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '6cacc91fc365862dc2b0d2eafe523852', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'b026223f2d7c4677a99470ed1ee18094', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '3e5c6ebd7b73e7fe35f9d7554f74215a0952ade6a4d83ad0dfc93ab463bb5fefc7d8a0514ee5dc33217855375983af13c55172d38695d686fb2dc856dc000863', 'id': '873881b6-80a0-452e-a992-4318113e9969', 'created_at': datetime.datetime(2026, 6, 17, 2, 52, 36, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 17, 2, 52, 37, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/873881b6-80a0-452e-a992-4318113e9969/file', 'properties': {}}, 'image_service': } Jun 17 04:52:38 devstack cinder-volume[92060]: DEBUG cinder.volume.flows.manager.create_volume [None req-b31356b4-a4bc-4313-bbae-572f3b91dc33 tempest-VolumeImageDependencyTests-575128815 None] Trying to clone 54ca0d11-c400-4c7d-a8fc-ef2ddfd8b086 from image 873881b6-80a0-452e-a992-4318113e9969 at location (None, [{'url': 'file:///opt/stack/data/glance/images/873881b6-80a0-452e-a992-4318113e9969', 'metadata': {}}]). {{(pid=92060) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jun 17 04:52:38 devstack cinder-volume[92060]: DEBUG cinder.image.image_utils [None req-b31356b4-a4bc-4313-bbae-572f3b91dc33 tempest-VolumeImageDependencyTests-575128815 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_873881b6-80a0-452e-a992-4318113e9969_foa73ax9devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=92060) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jun 17 04:52:38 devstack cinder-volume[92060]: INFO cinder.image.image_utils [None req-b31356b4-a4bc-4313-bbae-572f3b91dc33 tempest-VolumeImageDependencyTests-575128815 None] Image download 0.00 MB at 0.00 MB/s Jun 17 04:52:38 devstack cinder-volume[92060]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3aa7952-1355-4831-9b39-7153550a01c7]: (4, 'raw') {{(pid=93130) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 04:52:38 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-b31356b4-a4bc-4313-bbae-572f3b91dc33 tempest-VolumeImageDependencyTests-575128815 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_873881b6-80a0-452e-a992-4318113e9969_foa73ax9devstack@QuobyteHD {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:52:38 devstack sudo[107598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_873881b6-80a0-452e-a992-4318113e9969_foa73ax9devstack@QuobyteHD Jun 17 04:52:38 devstack sudo[107598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:52:39 devstack sudo[107598]: pam_unix(sudo:session): session closed for user root Jun 17 04:52:39 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-b31356b4-a4bc-4313-bbae-572f3b91dc33 tempest-VolumeImageDependencyTests-575128815 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_873881b6-80a0-452e-a992-4318113e9969_foa73ax9devstack@QuobyteHD" returned: 0 in 0.933s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:52:39 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-b31356b4-a4bc-4313-bbae-572f3b91dc33 tempest-VolumeImageDependencyTests-575128815 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_873881b6-80a0-452e-a992-4318113e9969_foa73ax9devstack@QuobyteHD {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:52:39 devstack sudo[107658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_873881b6-80a0-452e-a992-4318113e9969_foa73ax9devstack@QuobyteHD Jun 17 04:52:39 devstack sudo[107658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:52:40 devstack sudo[107658]: pam_unix(sudo:session): session closed for user root Jun 17 04:52:40 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-b31356b4-a4bc-4313-bbae-572f3b91dc33 tempest-VolumeImageDependencyTests-575128815 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_873881b6-80a0-452e-a992-4318113e9969_foa73ax9devstack@QuobyteHD" returned: 1 in 0.808s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:52:40 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-b31356b4-a4bc-4313-bbae-572f3b91dc33 tempest-VolumeImageDependencyTests-575128815 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_873881b6-80a0-452e-a992-4318113e9969_foa73ax9devstack@QuobyteHD' failed. Not Retrying. {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 17 04:52:40 devstack cinder-volume[92060]: DEBUG cinder.image.image_utils [None req-b31356b4-a4bc-4313-bbae-572f3b91dc33 tempest-VolumeImageDependencyTests-575128815 None] Temporary image 873881b6-80a0-452e-a992-4318113e9969 is fetched for user 4599bbe991604343ab3a24cff85e0e85. {{(pid=92060) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jun 17 04:52:40 devstack cinder-volume[92060]: DEBUG oslo.privsep.daemon [-] privsep: reply[af3ef0f1-71dd-4964-971d-6b5f94570522]: (4, 'raw') {{(pid=93130) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 04:52:40 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-b31356b4-a4bc-4313-bbae-572f3b91dc33 tempest-VolumeImageDependencyTests-575128815 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_873881b6-80a0-452e-a992-4318113e9969_foa73ax9devstack@QuobyteHD {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:52:40 devstack sudo[107671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_873881b6-80a0-452e-a992-4318113e9969_foa73ax9devstack@QuobyteHD Jun 17 04:52:40 devstack sudo[107671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:52:41 devstack sudo[107671]: pam_unix(sudo:session): session closed for user root Jun 17 04:52:41 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-b31356b4-a4bc-4313-bbae-572f3b91dc33 tempest-VolumeImageDependencyTests-575128815 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_873881b6-80a0-452e-a992-4318113e9969_foa73ax9devstack@QuobyteHD" returned: 0 in 0.690s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:52:41 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-b31356b4-a4bc-4313-bbae-572f3b91dc33 tempest-VolumeImageDependencyTests-575128815 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_873881b6-80a0-452e-a992-4318113e9969_foa73ax9devstack@QuobyteHD {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:52:41 devstack sudo[107675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_873881b6-80a0-452e-a992-4318113e9969_foa73ax9devstack@QuobyteHD Jun 17 04:52:41 devstack sudo[107675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:52:41 devstack sudo[107675]: pam_unix(sudo:session): session closed for user root Jun 17 04:52:41 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-b31356b4-a4bc-4313-bbae-572f3b91dc33 tempest-VolumeImageDependencyTests-575128815 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_873881b6-80a0-452e-a992-4318113e9969_foa73ax9devstack@QuobyteHD" returned: 1 in 0.749s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:52:41 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-b31356b4-a4bc-4313-bbae-572f3b91dc33 tempest-VolumeImageDependencyTests-575128815 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_873881b6-80a0-452e-a992-4318113e9969_foa73ax9devstack@QuobyteHD' failed. Not Retrying. {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 17 04:52:41 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-b31356b4-a4bc-4313-bbae-572f3b91dc33 tempest-VolumeImageDependencyTests-575128815 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 04:52:41 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-b31356b4-a4bc-4313-bbae-572f3b91dc33 tempest-VolumeImageDependencyTests-575128815 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 04:52:41 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-b31356b4-a4bc-4313-bbae-572f3b91dc33 tempest-VolumeImageDependencyTests-575128815 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-17T02:52:38Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=54ca0d11-c400-4c7d-a8fc-ef2ddfd8b086,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b026223f2d7c4677a99470ed1ee18094',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T02:52:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T02:52:38Z,use_quota=True,user_id='4599bbe991604343ab3a24cff85e0e85',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aad9ce24-93f9-41a6-baa1-5125964f96d1),volume_type_id=aad9ce24-93f9-41a6-baa1-5125964f96d1)}" {{(pid=92060) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 17 04:52:41 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.remotefs [None req-b31356b4-a4bc-4313-bbae-572f3b91dc33 tempest-VolumeImageDependencyTests-575128815 None] Creating volume 54ca0d11-c400-4c7d-a8fc-ef2ddfd8b086 {{(pid=92060) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 17 04:52:41 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-b31356b4-a4bc-4313-bbae-572f3b91dc33 tempest-VolumeImageDependencyTests-575128815 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 04:52:41 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-b31356b4-a4bc-4313-bbae-572f3b91dc33 tempest-VolumeImageDependencyTests-575128815 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 04:52:41 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-b31356b4-a4bc-4313-bbae-572f3b91dc33 tempest-VolumeImageDependencyTests-575128815 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588': None} {{(pid=92060) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 17 04:52:41 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-b31356b4-a4bc-4313-bbae-572f3b91dc33 tempest-VolumeImageDependencyTests-575128815 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588'] {{(pid=92060) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 17 04:52:41 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-b31356b4-a4bc-4313-bbae-572f3b91dc33 tempest-VolumeImageDependencyTests-575128815 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 04:52:41 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-b31356b4-a4bc-4313-bbae-572f3b91dc33 tempest-VolumeImageDependencyTests-575128815 None] Selected osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588 as target Quobyte volume. {{(pid=92060) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 17 04:52:41 devstack cinder-volume[92060]: INFO cinder.volume.drivers.remotefs [None req-b31356b4-a4bc-4313-bbae-572f3b91dc33 tempest-VolumeImageDependencyTests-575128815 None] casted to osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588 Jun 17 04:52:41 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-b31356b4-a4bc-4313-bbae-572f3b91dc33 tempest-VolumeImageDependencyTests-575128815 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-54ca0d11-c400-4c7d-a8fc-ef2ddfd8b086 1073741824 {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:52:41 devstack sudo[107681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-54ca0d11-c400-4c7d-a8fc-ef2ddfd8b086 1073741824 Jun 17 04:52:41 devstack sudo[107681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:52:42 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-ad6ad7dd-8ce5-44d5-8310-230af113dde1 tempest-VolumesActionsTest-1808403996 None] Acquiring lock "cinder-e32ad70e-580f-4af4-bd73-b9df2f0e5426" by "attach_volume" {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 04:52:42 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-ad6ad7dd-8ce5-44d5-8310-230af113dde1 tempest-VolumesActionsTest-1808403996 None] Lock "cinder-e32ad70e-580f-4af4-bd73-b9df2f0e5426" acquired by "attach_volume" :: waited 0.019s {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 04:52:42 devstack sudo[107681]: pam_unix(sudo:session): session closed for user root Jun 17 04:52:42 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-b31356b4-a4bc-4313-bbae-572f3b91dc33 tempest-VolumeImageDependencyTests-575128815 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-54ca0d11-c400-4c7d-a8fc-ef2ddfd8b086 1073741824" returned: 0 in 0.859s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:52:42 devstack cinder-volume[92060]: INFO cinder.volume.manager [None req-ad6ad7dd-8ce5-44d5-8310-230af113dde1 tempest-VolumesActionsTest-1808403996 None] Attaching volume e32ad70e-580f-4af4-bd73-b9df2f0e5426 to instance c745d7b0-b346-4b07-a0d6-aba6205a86a8 at mountpoint /dev/vdb on host None. Jun 17 04:52:42 devstack cinder-volume[92060]: INFO cinder.volume.manager [None req-ad6ad7dd-8ce5-44d5-8310-230af113dde1 tempest-VolumesActionsTest-1808403996 None] Attach volume completed successfully. Jun 17 04:52:42 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-ad6ad7dd-8ce5-44d5-8310-230af113dde1 tempest-VolumesActionsTest-1808403996 None] Lock "cinder-e32ad70e-580f-4af4-bd73-b9df2f0e5426" released by "attach_volume" :: held 0.114s {{(pid=92060) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 04:52:42 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-b31356b4-a4bc-4313-bbae-572f3b91dc33 tempest-VolumeImageDependencyTests-575128815 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-54ca0d11-c400-4c7d-a8fc-ef2ddfd8b086 {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:52:42 devstack sudo[107686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-54ca0d11-c400-4c7d-a8fc-ef2ddfd8b086 Jun 17 04:52:42 devstack sudo[107686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:52:43 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-6a5a6abc-31d3-47af-b689-a8a469aabfce tempest-VolumesActionsTest-1808403996 None] Acquiring lock "cinder-e32ad70e-580f-4af4-bd73-b9df2f0e5426-detach_volume" by "detach_volume" {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 04:52:43 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-6a5a6abc-31d3-47af-b689-a8a469aabfce tempest-VolumesActionsTest-1808403996 None] Lock "cinder-e32ad70e-580f-4af4-bd73-b9df2f0e5426-detach_volume" acquired by "detach_volume" :: waited 0.022s {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 04:52:43 devstack cinder-volume[92060]: INFO cinder.volume.manager [None req-6a5a6abc-31d3-47af-b689-a8a469aabfce tempest-VolumesActionsTest-1808403996 None] Detaching volume e32ad70e-580f-4af4-bd73-b9df2f0e5426 from instance c745d7b0-b346-4b07-a0d6-aba6205a86a8. Jun 17 04:52:43 devstack cinder-volume[92060]: INFO cinder.volume.manager [None req-6a5a6abc-31d3-47af-b689-a8a469aabfce tempest-VolumesActionsTest-1808403996 None] Detach volume completed successfully. Jun 17 04:52:43 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-6a5a6abc-31d3-47af-b689-a8a469aabfce tempest-VolumesActionsTest-1808403996 None] Lock "cinder-e32ad70e-580f-4af4-bd73-b9df2f0e5426-detach_volume" released by "detach_volume" :: held 0.087s {{(pid=92060) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 04:52:43 devstack sudo[107686]: pam_unix(sudo:session): session closed for user root Jun 17 04:52:43 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-b31356b4-a4bc-4313-bbae-572f3b91dc33 tempest-VolumeImageDependencyTests-575128815 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-54ca0d11-c400-4c7d-a8fc-ef2ddfd8b086" returned: 0 in 0.655s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:52:43 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-b31356b4-a4bc-4313-bbae-572f3b91dc33 tempest-VolumeImageDependencyTests-575128815 None] <== create_volume: return (1588ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588'} {{(pid=92060) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 17 04:52:43 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-b31356b4-a4bc-4313-bbae-572f3b91dc33 tempest-VolumeImageDependencyTests-575128815 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.591s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 04:52:43 devstack cinder-volume[92060]: DEBUG cinder.volume.volume_utils [None req-b31356b4-a4bc-4313-bbae-572f3b91dc33 tempest-VolumeImageDependencyTests-575128815 None] Attempting download of 873881b6-80a0-452e-a992-4318113e9969 ((None, [{'url': 'file:///opt/stack/data/glance/images/873881b6-80a0-452e-a992-4318113e9969', 'metadata': {}}])) to volume 54ca0d11-c400-4c7d-a8fc-ef2ddfd8b086. {{(pid=92060) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jun 17 04:52:43 devstack cinder-volume[92060]: DEBUG oslo.privsep.daemon [-] privsep: reply[09db98b4-5ea2-407b-ba5d-8e29a8046dcc]: (4, 'raw') {{(pid=93130) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 04:52:43 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-b31356b4-a4bc-4313-bbae-572f3b91dc33 tempest-VolumeImageDependencyTests-575128815 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_873881b6-80a0-452e-a992-4318113e9969_8ghr_ka4 {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:52:43 devstack sudo[107689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_873881b6-80a0-452e-a992-4318113e9969_8ghr_ka4 Jun 17 04:52:43 devstack sudo[107689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:52:44 devstack sudo[107689]: pam_unix(sudo:session): session closed for user root Jun 17 04:52:44 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-b31356b4-a4bc-4313-bbae-572f3b91dc33 tempest-VolumeImageDependencyTests-575128815 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_873881b6-80a0-452e-a992-4318113e9969_8ghr_ka4" returned: 0 in 0.723s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:52:44 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-b31356b4-a4bc-4313-bbae-572f3b91dc33 tempest-VolumeImageDependencyTests-575128815 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_873881b6-80a0-452e-a992-4318113e9969_8ghr_ka4 {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:52:44 devstack sudo[107693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_873881b6-80a0-452e-a992-4318113e9969_8ghr_ka4 Jun 17 04:52:44 devstack sudo[107693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:52:44 devstack sudo[107693]: pam_unix(sudo:session): session closed for user root Jun 17 04:52:44 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-b31356b4-a4bc-4313-bbae-572f3b91dc33 tempest-VolumeImageDependencyTests-575128815 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_873881b6-80a0-452e-a992-4318113e9969_8ghr_ka4" returned: 1 in 0.708s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:52:44 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-b31356b4-a4bc-4313-bbae-572f3b91dc33 tempest-VolumeImageDependencyTests-575128815 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_873881b6-80a0-452e-a992-4318113e9969_8ghr_ka4' failed. Not Retrying. {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 17 04:52:44 devstack cinder-volume[92060]: DEBUG oslo.privsep.daemon [-] privsep: reply[36c231a6-82b8-4c41-917a-156ac736647e]: (4, 'raw') {{(pid=93130) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 04:52:44 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-b31356b4-a4bc-4313-bbae-572f3b91dc33 tempest-VolumeImageDependencyTests-575128815 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_873881b6-80a0-452e-a992-4318113e9969_foa73ax9devstack@QuobyteHD {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:52:44 devstack cinder-volume[92060]: DEBUG oslo_service.periodic_task [None req-60d279ad-ad8c-4d36-a4b8-f593e74fb922 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=92060) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 17 04:52:44 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-60d279ad-ad8c-4d36-a4b8-f593e74fb922 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 04:52:44 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-60d279ad-ad8c-4d36-a4b8-f593e74fb922 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 04:52:44 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-60d279ad-ad8c-4d36-a4b8-f593e74fb922 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588': None} {{(pid=92060) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 17 04:52:44 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-60d279ad-ad8c-4d36-a4b8-f593e74fb922 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588'] {{(pid=92060) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 17 04:52:45 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-60d279ad-ad8c-4d36-a4b8-f593e74fb922 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.037s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 04:52:45 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-60d279ad-ad8c-4d36-a4b8-f593e74fb922 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:52:45 devstack sudo[107707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a Jun 17 04:52:45 devstack sudo[107707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:52:45 devstack sudo[107697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_873881b6-80a0-452e-a992-4318113e9969_foa73ax9devstack@QuobyteHD Jun 17 04:52:45 devstack sudo[107697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:52:45 devstack sudo[107707]: pam_unix(sudo:session): session closed for user root Jun 17 04:52:45 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-60d279ad-ad8c-4d36-a4b8-f593e74fb922 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a" returned: 0 in 0.756s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:52:45 devstack cinder-volume[92060]: DEBUG cinder.manager [None req-60d279ad-ad8c-4d36-a4b8-f593e74fb922 None None] Notifying Schedulers of capabilities ... {{(pid=92060) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 17 04:52:45 devstack cinder-volume[92060]: DEBUG oslo_service.periodic_task [None req-60d279ad-ad8c-4d36-a4b8-f593e74fb922 None None] Running periodic task VolumeManager._thread_info {{(pid=92060) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 17 04:52:45 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-60d279ad-ad8c-4d36-a4b8-f593e74fb922 None None] thread count: 28 {{(pid=92060) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 17 04:52:45 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-60d279ad-ad8c-4d36-a4b8-f593e74fb922 None None] thread info: [<_MainThread(MainThread, started 130061806440576)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=92060) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 17 04:52:45 devstack sudo[107697]: pam_unix(sudo:session): session closed for user root Jun 17 04:52:45 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-b31356b4-a4bc-4313-bbae-572f3b91dc33 tempest-VolumeImageDependencyTests-575128815 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_873881b6-80a0-452e-a992-4318113e9969_foa73ax9devstack@QuobyteHD" returned: 0 in 0.906s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:52:45 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-b31356b4-a4bc-4313-bbae-572f3b91dc33 tempest-VolumeImageDependencyTests-575128815 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_873881b6-80a0-452e-a992-4318113e9969_foa73ax9devstack@QuobyteHD {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:52:45 devstack sudo[107744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_873881b6-80a0-452e-a992-4318113e9969_foa73ax9devstack@QuobyteHD Jun 17 04:52:45 devstack sudo[107744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:52:46 devstack sudo[107744]: pam_unix(sudo:session): session closed for user root Jun 17 04:52:46 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-b31356b4-a4bc-4313-bbae-572f3b91dc33 tempest-VolumeImageDependencyTests-575128815 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_873881b6-80a0-452e-a992-4318113e9969_foa73ax9devstack@QuobyteHD" returned: 1 in 0.687s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:52:46 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-b31356b4-a4bc-4313-bbae-572f3b91dc33 tempest-VolumeImageDependencyTests-575128815 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_873881b6-80a0-452e-a992-4318113e9969_foa73ax9devstack@QuobyteHD' failed. Not Retrying. {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 17 04:52:46 devstack cinder-volume[92060]: DEBUG cinder.image.image_utils [None req-b31356b4-a4bc-4313-bbae-572f3b91dc33 tempest-VolumeImageDependencyTests-575128815 None] 873881b6-80a0-452e-a992-4318113e9969 was raw, converting to raw {{(pid=92060) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jun 17 04:52:46 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-b31356b4-a4bc-4313-bbae-572f3b91dc33 tempest-VolumeImageDependencyTests-575128815 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_873881b6-80a0-452e-a992-4318113e9969_foa73ax9devstack@QuobyteHD /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-54ca0d11-c400-4c7d-a8fc-ef2ddfd8b086 {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:52:46 devstack sudo[107749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_873881b6-80a0-452e-a992-4318113e9969_foa73ax9devstack@QuobyteHD /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-54ca0d11-c400-4c7d-a8fc-ef2ddfd8b086 Jun 17 04:52:46 devstack sudo[107749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:52:47 devstack sudo[107749]: pam_unix(sudo:session): session closed for user root Jun 17 04:52:47 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-b31356b4-a4bc-4313-bbae-572f3b91dc33 tempest-VolumeImageDependencyTests-575128815 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_873881b6-80a0-452e-a992-4318113e9969_foa73ax9devstack@QuobyteHD /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-54ca0d11-c400-4c7d-a8fc-ef2ddfd8b086" returned: 0 in 0.734s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:52:47 devstack cinder-volume[92060]: DEBUG cinder.image.image_utils [None req-b31356b4-a4bc-4313-bbae-572f3b91dc33 tempest-VolumeImageDependencyTests-575128815 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_873881b6-80a0-452e-a992-4318113e9969_foa73ax9devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-54ca0d11-c400-4c7d-a8fc-ef2ddfd8b086 {{(pid=92060) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 17 04:52:47 devstack cinder-volume[92060]: INFO cinder.image.image_utils [None req-b31356b4-a4bc-4313-bbae-572f3b91dc33 tempest-VolumeImageDependencyTests-575128815 None] Converted 0.00 MB image at 0.00 MB/s Jun 17 04:52:47 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-b31356b4-a4bc-4313-bbae-572f3b91dc33 tempest-VolumeImageDependencyTests-575128815 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-54ca0d11-c400-4c7d-a8fc-ef2ddfd8b086 1G {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:52:47 devstack sudo[107755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-54ca0d11-c400-4c7d-a8fc-ef2ddfd8b086 1G Jun 17 04:52:47 devstack sudo[107755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:52:47 devstack sudo[107755]: pam_unix(sudo:session): session closed for user root Jun 17 04:52:47 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-b31356b4-a4bc-4313-bbae-572f3b91dc33 tempest-VolumeImageDependencyTests-575128815 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-54ca0d11-c400-4c7d-a8fc-ef2ddfd8b086 1G" returned: 0 in 0.645s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:52:47 devstack cinder-volume[92060]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfd78034-c073-4696-8240-cab6d4bc4080]: (4, 'raw') {{(pid=93130) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 04:52:47 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-b31356b4-a4bc-4313-bbae-572f3b91dc33 tempest-VolumeImageDependencyTests-575128815 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-54ca0d11-c400-4c7d-a8fc-ef2ddfd8b086 {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:52:48 devstack sudo[107760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-54ca0d11-c400-4c7d-a8fc-ef2ddfd8b086 Jun 17 04:52:48 devstack sudo[107760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:52:48 devstack sudo[107760]: pam_unix(sudo:session): session closed for user root Jun 17 04:52:48 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-b31356b4-a4bc-4313-bbae-572f3b91dc33 tempest-VolumeImageDependencyTests-575128815 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-54ca0d11-c400-4c7d-a8fc-ef2ddfd8b086" returned: 0 in 0.719s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:52:48 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-b31356b4-a4bc-4313-bbae-572f3b91dc33 tempest-VolumeImageDependencyTests-575128815 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-54ca0d11-c400-4c7d-a8fc-ef2ddfd8b086 {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:52:48 devstack sudo[107764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-54ca0d11-c400-4c7d-a8fc-ef2ddfd8b086 Jun 17 04:52:48 devstack sudo[107764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:52:49 devstack sudo[107764]: pam_unix(sudo:session): session closed for user root Jun 17 04:52:49 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-b31356b4-a4bc-4313-bbae-572f3b91dc33 tempest-VolumeImageDependencyTests-575128815 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-54ca0d11-c400-4c7d-a8fc-ef2ddfd8b086" returned: 1 in 0.683s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:52:49 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-b31356b4-a4bc-4313-bbae-572f3b91dc33 tempest-VolumeImageDependencyTests-575128815 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-54ca0d11-c400-4c7d-a8fc-ef2ddfd8b086' failed. Not Retrying. {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 17 04:52:49 devstack cinder-volume[92060]: DEBUG cinder.volume.volume_utils [None req-b31356b4-a4bc-4313-bbae-572f3b91dc33 tempest-VolumeImageDependencyTests-575128815 None] Downloaded image 873881b6-80a0-452e-a992-4318113e9969 ((None, [{'url': 'file:///opt/stack/data/glance/images/873881b6-80a0-452e-a992-4318113e9969', 'metadata': {}}])) to volume 54ca0d11-c400-4c7d-a8fc-ef2ddfd8b086 successfully. {{(pid=92060) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jun 17 04:52:49 devstack cinder-volume[92060]: DEBUG cinder.image.image_utils [None req-b31356b4-a4bc-4313-bbae-572f3b91dc33 tempest-VolumeImageDependencyTests-575128815 None] Temporary image 873881b6-80a0-452e-a992-4318113e9969 for user 4599bbe991604343ab3a24cff85e0e85 is deleted. {{(pid=92060) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jun 17 04:52:49 devstack cinder-volume[92060]: DEBUG cinder.volume.volume_utils [None req-b31356b4-a4bc-4313-bbae-572f3b91dc33 tempest-VolumeImageDependencyTests-575128815 None] Marking volume 54ca0d11-c400-4c7d-a8fc-ef2ddfd8b086 as bootable. {{(pid=92060) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jun 17 04:52:49 devstack cinder-volume[92060]: DEBUG cinder.volume.flows.manager.create_volume [None req-b31356b4-a4bc-4313-bbae-572f3b91dc33 tempest-VolumeImageDependencyTests-575128815 None] Copying metadata from image 873881b6-80a0-452e-a992-4318113e9969 to 54ca0d11-c400-4c7d-a8fc-ef2ddfd8b086. {{(pid=92060) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jun 17 04:52:49 devstack cinder-volume[92060]: DEBUG cinder.volume.flows.manager.create_volume [None req-b31356b4-a4bc-4313-bbae-572f3b91dc33 tempest-VolumeImageDependencyTests-575128815 None] Creating volume glance metadata for volume 54ca0d11-c400-4c7d-a8fc-ef2ddfd8b086 backed by image 873881b6-80a0-452e-a992-4318113e9969 with: {'image_id': '873881b6-80a0-452e-a992-4318113e9969', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': '6cacc91fc365862dc2b0d2eafe523852', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=92060) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jun 17 04:52:49 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-b31356b4-a4bc-4313-bbae-572f3b91dc33 tempest-VolumeImageDependencyTests-575128815 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1ef56df1-77ee-4243-96ca-7ffad28946ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-54ca0d11-c400-4c7d-a8fc-ef2ddfd8b086', 'volume_size': 1, 'image_id': '873881b6-80a0-452e-a992-4318113e9969', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/873881b6-80a0-452e-a992-4318113e9969', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '6cacc91fc365862dc2b0d2eafe523852', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'b026223f2d7c4677a99470ed1ee18094', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '3e5c6ebd7b73e7fe35f9d7554f74215a0952ade6a4d83ad0dfc93ab463bb5fefc7d8a0514ee5dc33217855375983af13c55172d38695d686fb2dc856dc000863', 'id': '873881b6-80a0-452e-a992-4318113e9969', 'created_at': datetime.datetime(2026, 6, 17, 2, 52, 36, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 17, 2, 52, 37, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/873881b6-80a0-452e-a992-4318113e9969/file', 'properties': {}}, 'image_service': }' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:52:49 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-b31356b4-a4bc-4313-bbae-572f3b91dc33 tempest-VolumeImageDependencyTests-575128815 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (292758f7-fd0f-400d-a8c3-cfe2c747d1cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:52:49 devstack cinder-volume[92060]: INFO cinder.volume.flows.manager.create_volume [None req-b31356b4-a4bc-4313-bbae-572f3b91dc33 tempest-VolumeImageDependencyTests-575128815 None] Volume volume-54ca0d11-c400-4c7d-a8fc-ef2ddfd8b086 (54ca0d11-c400-4c7d-a8fc-ef2ddfd8b086): created successfully Jun 17 04:52:49 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-b31356b4-a4bc-4313-bbae-572f3b91dc33 tempest-VolumeImageDependencyTests-575128815 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (292758f7-fd0f-400d-a8c3-cfe2c747d1cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:52:49 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-b31356b4-a4bc-4313-bbae-572f3b91dc33 tempest-VolumeImageDependencyTests-575128815 None] Flow 'volume_create_manager' (c88ccaa5-8a61-43fb-a9a5-f2b7102f54cd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92060) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 17 04:52:49 devstack cinder-volume[92060]: INFO cinder.volume.manager [None req-b31356b4-a4bc-4313-bbae-572f3b91dc33 tempest-VolumeImageDependencyTests-575128815 None] Created volume successfully. Jun 17 04:52:50 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-694b4f3b-942d-49ad-835e-0a68a84041fc tempest-VolumeImageDependencyTests-575128815 None] Acquiring lock "cinder-54ca0d11-c400-4c7d-a8fc-ef2ddfd8b086-delete_volume" by "delete_volume" {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 04:52:50 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-694b4f3b-942d-49ad-835e-0a68a84041fc tempest-VolumeImageDependencyTests-575128815 None] Lock "cinder-54ca0d11-c400-4c7d-a8fc-ef2ddfd8b086-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 04:52:50 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-694b4f3b-942d-49ad-835e-0a68a84041fc tempest-VolumeImageDependencyTests-575128815 None] Acquiring lock "cinder-quobyte-54ca0d11-c400-4c7d-a8fc-ef2ddfd8b086" by "delete_volume" {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 04:52:50 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-694b4f3b-942d-49ad-835e-0a68a84041fc tempest-VolumeImageDependencyTests-575128815 None] Lock "cinder-quobyte-54ca0d11-c400-4c7d-a8fc-ef2ddfd8b086" acquired by "delete_volume" :: waited 0.017s {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 04:52:50 devstack cinder-volume[92060]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bb63ff4-a816-427d-b46b-bec73eaf1ea5]: (4, 'raw') {{(pid=93130) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 04:52:50 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-694b4f3b-942d-49ad-835e-0a68a84041fc tempest-VolumeImageDependencyTests-575128815 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-54ca0d11-c400-4c7d-a8fc-ef2ddfd8b086 {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:52:50 devstack sudo[107770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-54ca0d11-c400-4c7d-a8fc-ef2ddfd8b086 Jun 17 04:52:50 devstack sudo[107770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:52:50 devstack sudo[107770]: pam_unix(sudo:session): session closed for user root Jun 17 04:52:50 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-694b4f3b-942d-49ad-835e-0a68a84041fc tempest-VolumeImageDependencyTests-575128815 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-54ca0d11-c400-4c7d-a8fc-ef2ddfd8b086" returned: 0 in 0.702s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:52:50 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-694b4f3b-942d-49ad-835e-0a68a84041fc tempest-VolumeImageDependencyTests-575128815 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-54ca0d11-c400-4c7d-a8fc-ef2ddfd8b086 {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:52:50 devstack sudo[107774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-54ca0d11-c400-4c7d-a8fc-ef2ddfd8b086 Jun 17 04:52:50 devstack sudo[107774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:52:51 devstack sudo[107774]: pam_unix(sudo:session): session closed for user root Jun 17 04:52:51 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-694b4f3b-942d-49ad-835e-0a68a84041fc tempest-VolumeImageDependencyTests-575128815 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-54ca0d11-c400-4c7d-a8fc-ef2ddfd8b086" returned: 1 in 0.696s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:52:51 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-694b4f3b-942d-49ad-835e-0a68a84041fc tempest-VolumeImageDependencyTests-575128815 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-54ca0d11-c400-4c7d-a8fc-ef2ddfd8b086' failed. Not Retrying. {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 17 04:52:51 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-694b4f3b-942d-49ad-835e-0a68a84041fc tempest-VolumeImageDependencyTests-575128815 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-54ca0d11-c400-4c7d-a8fc-ef2ddfd8b086 {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:52:51 devstack sudo[107782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-54ca0d11-c400-4c7d-a8fc-ef2ddfd8b086 Jun 17 04:52:51 devstack sudo[107782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:52:52 devstack sudo[107782]: pam_unix(sudo:session): session closed for user root Jun 17 04:52:52 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-694b4f3b-942d-49ad-835e-0a68a84041fc tempest-VolumeImageDependencyTests-575128815 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-54ca0d11-c400-4c7d-a8fc-ef2ddfd8b086" returned: 0 in 0.568s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:52:52 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-694b4f3b-942d-49ad-835e-0a68a84041fc tempest-VolumeImageDependencyTests-575128815 None] Lock "cinder-quobyte-54ca0d11-c400-4c7d-a8fc-ef2ddfd8b086" released by "delete_volume" :: held 2.028s {{(pid=92060) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 04:52:52 devstack cinder-volume[92060]: DEBUG cinder.quota [None req-694b4f3b-942d-49ad-835e-0a68a84041fc tempest-VolumeImageDependencyTests-575128815 None] Created reservations ['1a8dea1b-0fe7-4baf-9a6d-8d491003ced2', 'e3c11e6f-1401-4818-94ec-d6acf9a6bb32', '18059522-7071-4d79-8e90-0fdf71bbf642', '2ceef623-2514-4c54-bbc3-fee352bc4add'] {{(pid=92060) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 17 04:52:52 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-694b4f3b-942d-49ad-835e-0a68a84041fc tempest-VolumeImageDependencyTests-575128815 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 04:52:52 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-694b4f3b-942d-49ad-835e-0a68a84041fc tempest-VolumeImageDependencyTests-575128815 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 04:52:52 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-694b4f3b-942d-49ad-835e-0a68a84041fc tempest-VolumeImageDependencyTests-575128815 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588': None} {{(pid=92060) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 17 04:52:52 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-694b4f3b-942d-49ad-835e-0a68a84041fc tempest-VolumeImageDependencyTests-575128815 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588'] {{(pid=92060) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 17 04:52:52 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-694b4f3b-942d-49ad-835e-0a68a84041fc tempest-VolumeImageDependencyTests-575128815 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 04:52:52 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-694b4f3b-942d-49ad-835e-0a68a84041fc tempest-VolumeImageDependencyTests-575128815 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:52:52 devstack sudo[107785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a Jun 17 04:52:52 devstack sudo[107785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:52:52 devstack sudo[107785]: pam_unix(sudo:session): session closed for user root Jun 17 04:52:52 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-694b4f3b-942d-49ad-835e-0a68a84041fc tempest-VolumeImageDependencyTests-575128815 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a" returned: 0 in 0.579s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:52:52 devstack cinder-volume[92060]: DEBUG cinder.manager [None req-694b4f3b-942d-49ad-835e-0a68a84041fc tempest-VolumeImageDependencyTests-575128815 None] Notifying Schedulers of capabilities ... {{(pid=92060) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 17 04:52:52 devstack cinder-volume[92060]: INFO cinder.volume.manager [None req-694b4f3b-942d-49ad-835e-0a68a84041fc tempest-VolumeImageDependencyTests-575128815 None] Deleted volume successfully. Jun 17 04:52:52 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-694b4f3b-942d-49ad-835e-0a68a84041fc tempest-VolumeImageDependencyTests-575128815 None] Lock "cinder-54ca0d11-c400-4c7d-a8fc-ef2ddfd8b086-delete_volume" released by "delete_volume" :: held 2.830s {{(pid=92060) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 04:53:02 devstack cinder-volume[92060]: DEBUG dbcounter [-] [92060] Writing DB stats cinder:SELECT=35,cinder:INSERT=17,cinder:UPDATE=33,cinder:DELETE=2 {{(pid=92060) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 17 04:53:02 devstack cinder-volume[92060]: DEBUG dbcounter [-] [92060] Writing DB stats cinder:SELECT=34,cinder:UPDATE=30,cinder:DELETE=3,cinder:INSERT=15 {{(pid=92060) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 17 04:53:05 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-ab4a3444-d8ae-40dd-93c7-9b555ae391eb tempest-VolumesActionsTest-1808403996 None] Acquiring lock "cinder-e32ad70e-580f-4af4-bd73-b9df2f0e5426" by "attach_volume" {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 04:53:05 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-ab4a3444-d8ae-40dd-93c7-9b555ae391eb tempest-VolumesActionsTest-1808403996 None] Lock "cinder-e32ad70e-580f-4af4-bd73-b9df2f0e5426" acquired by "attach_volume" :: waited 0.024s {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 04:53:05 devstack cinder-volume[92060]: INFO cinder.volume.manager [None req-ab4a3444-d8ae-40dd-93c7-9b555ae391eb tempest-VolumesActionsTest-1808403996 None] Attaching volume e32ad70e-580f-4af4-bd73-b9df2f0e5426 to instance 247b8981-5c1e-49a4-8c0a-49d94acad671 at mountpoint /dev/vdb on host None. Jun 17 04:53:05 devstack cinder-volume[92060]: INFO cinder.volume.manager [None req-ab4a3444-d8ae-40dd-93c7-9b555ae391eb tempest-VolumesActionsTest-1808403996 None] Attach volume completed successfully. Jun 17 04:53:05 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-ab4a3444-d8ae-40dd-93c7-9b555ae391eb tempest-VolumesActionsTest-1808403996 None] Lock "cinder-e32ad70e-580f-4af4-bd73-b9df2f0e5426" released by "attach_volume" :: held 0.098s {{(pid=92060) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 04:53:06 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-1cc3a01f-7be8-4f07-8d7e-6b500fe85731 tempest-VolumesActionsTest-1808403996 None] Acquiring lock "cinder-e32ad70e-580f-4af4-bd73-b9df2f0e5426-detach_volume" by "detach_volume" {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 04:53:06 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-1cc3a01f-7be8-4f07-8d7e-6b500fe85731 tempest-VolumesActionsTest-1808403996 None] Lock "cinder-e32ad70e-580f-4af4-bd73-b9df2f0e5426-detach_volume" acquired by "detach_volume" :: waited 0.021s {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 04:53:06 devstack cinder-volume[92060]: INFO cinder.volume.manager [None req-1cc3a01f-7be8-4f07-8d7e-6b500fe85731 tempest-VolumesActionsTest-1808403996 None] Detaching volume e32ad70e-580f-4af4-bd73-b9df2f0e5426 from instance 247b8981-5c1e-49a4-8c0a-49d94acad671. Jun 17 04:53:06 devstack cinder-volume[92060]: INFO cinder.volume.manager [None req-1cc3a01f-7be8-4f07-8d7e-6b500fe85731 tempest-VolumesActionsTest-1808403996 None] Detach volume completed successfully. Jun 17 04:53:06 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-1cc3a01f-7be8-4f07-8d7e-6b500fe85731 tempest-VolumesActionsTest-1808403996 None] Lock "cinder-e32ad70e-580f-4af4-bd73-b9df2f0e5426-detach_volume" released by "detach_volume" :: held 0.055s {{(pid=92060) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 04:53:15 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-dd4f2284-24ae-4cd1-a93a-99b946697053 tempest-VolumesActionsTest-1808403996 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 04:53:15 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-dd4f2284-24ae-4cd1-a93a-99b946697053 tempest-VolumesActionsTest-1808403996 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 04:53:15 devstack cinder-volume[92060]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5f1c476-1953-4372-9e92-5a01f78f27b9]: (4, 'qcow2') {{(pid=93130) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 04:53:15 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-dd4f2284-24ae-4cd1-a93a-99b946697053 tempest-VolumesActionsTest-1808403996 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-e32ad70e-580f-4af4-bd73-b9df2f0e5426 {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:53:15 devstack sudo[107971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-e32ad70e-580f-4af4-bd73-b9df2f0e5426 Jun 17 04:53:15 devstack sudo[107971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:53:16 devstack cinder-volume[92060]: DEBUG dbcounter [-] [92060] Writing DB stats cinder:SELECT=9,cinder:UPDATE=2,cinder:INSERT=1 {{(pid=92060) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 17 04:53:16 devstack sudo[107971]: pam_unix(sudo:session): session closed for user root Jun 17 04:53:16 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-dd4f2284-24ae-4cd1-a93a-99b946697053 tempest-VolumesActionsTest-1808403996 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-e32ad70e-580f-4af4-bd73-b9df2f0e5426" returned: 0 in 0.709s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:53:16 devstack cinder-volume[92060]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6e068c5-b053-404d-816d-7140ac311ca9]: (4, 'qcow2') {{(pid=93130) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 04:53:16 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-dd4f2284-24ae-4cd1-a93a-99b946697053 tempest-VolumesActionsTest-1808403996 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-e32ad70e-580f-4af4-bd73-b9df2f0e5426 {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:53:16 devstack sudo[107976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-e32ad70e-580f-4af4-bd73-b9df2f0e5426 Jun 17 04:53:16 devstack sudo[107976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:53:16 devstack sudo[107976]: pam_unix(sudo:session): session closed for user root Jun 17 04:53:16 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-dd4f2284-24ae-4cd1-a93a-99b946697053 tempest-VolumesActionsTest-1808403996 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-e32ad70e-580f-4af4-bd73-b9df2f0e5426" returned: 0 in 0.699s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:53:16 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-dd4f2284-24ae-4cd1-a93a-99b946697053 tempest-VolumesActionsTest-1808403996 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-e32ad70e-580f-4af4-bd73-b9df2f0e5426 /opt/stack/data/cinder/conversion/e32ad70e-580f-4af4-bd73-b9df2f0e5426.temp_image.ca00dec4-85de-4427-aa70-57b7886cf9e28ewmkjcv.img {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:53:16 devstack sudo[107981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-e32ad70e-580f-4af4-bd73-b9df2f0e5426 /opt/stack/data/cinder/conversion/e32ad70e-580f-4af4-bd73-b9df2f0e5426.temp_image.ca00dec4-85de-4427-aa70-57b7886cf9e28ewmkjcv.img Jun 17 04:53:16 devstack sudo[107981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:53:21 devstack sudo[107981]: pam_unix(sudo:session): session closed for user root Jun 17 04:53:21 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-dd4f2284-24ae-4cd1-a93a-99b946697053 tempest-VolumesActionsTest-1808403996 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-e32ad70e-580f-4af4-bd73-b9df2f0e5426 /opt/stack/data/cinder/conversion/e32ad70e-580f-4af4-bd73-b9df2f0e5426.temp_image.ca00dec4-85de-4427-aa70-57b7886cf9e28ewmkjcv.img" returned: 0 in 4.116s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:53:21 devstack cinder-volume[92060]: DEBUG oslo.privsep.daemon [-] privsep: reply[46cbf745-a91b-4468-88ef-3f0118131f08]: (4, 'qcow2') {{(pid=93130) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 04:53:21 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-dd4f2284-24ae-4cd1-a93a-99b946697053 tempest-VolumesActionsTest-1808403996 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-e32ad70e-580f-4af4-bd73-b9df2f0e5426 {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:53:21 devstack sudo[107995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-e32ad70e-580f-4af4-bd73-b9df2f0e5426 Jun 17 04:53:21 devstack sudo[107995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:53:21 devstack sudo[107995]: pam_unix(sudo:session): session closed for user root Jun 17 04:53:21 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-dd4f2284-24ae-4cd1-a93a-99b946697053 tempest-VolumesActionsTest-1808403996 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-e32ad70e-580f-4af4-bd73-b9df2f0e5426" returned: 0 in 0.839s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:53:21 devstack cinder-volume[92060]: DEBUG cinder.image.image_utils [None req-dd4f2284-24ae-4cd1-a93a-99b946697053 tempest-VolumesActionsTest-1808403996 None] Image conversion details: src /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-e32ad70e-580f-4af4-bd73-b9df2f0e5426, size 1024.00 MB, duration 4.12 sec, destination /opt/stack/data/cinder/conversion/e32ad70e-580f-4af4-bd73-b9df2f0e5426.temp_image.ca00dec4-85de-4427-aa70-57b7886cf9e28ewmkjcv.img {{(pid=92060) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 17 04:53:21 devstack cinder-volume[92060]: INFO cinder.image.image_utils [None req-dd4f2284-24ae-4cd1-a93a-99b946697053 tempest-VolumesActionsTest-1808403996 None] Converted 1024.00 MB image at 248.69 MB/s Jun 17 04:53:21 devstack cinder-volume[92060]: DEBUG cinder.image.image_utils [None req-dd4f2284-24ae-4cd1-a93a-99b946697053 tempest-VolumesActionsTest-1808403996 None] ca00dec4-85de-4427-aa70-57b7886cf9e2 was raw, no need to convert to raw {{(pid=92060) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1162}} Jun 17 04:53:31 devstack cinder-volume[92060]: DEBUG dbcounter [-] [92060] Writing DB stats cinder:INSERT=1,cinder:SELECT=7,cinder:UPDATE=4 {{(pid=92060) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 17 04:53:40 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-dd4f2284-24ae-4cd1-a93a-99b946697053 tempest-VolumesActionsTest-1808403996 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 24.641s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 04:53:40 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-dd4f2284-24ae-4cd1-a93a-99b946697053 tempest-VolumesActionsTest-1808403996 None] Uploaded volume to glance image-id: ca00dec4-85de-4427-aa70-57b7886cf9e2. {{(pid=92060) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Jun 17 04:53:40 devstack cinder-volume[92060]: INFO cinder.volume.manager [None req-dd4f2284-24ae-4cd1-a93a-99b946697053 tempest-VolumesActionsTest-1808403996 None] Copy volume to image completed successfully. Jun 17 04:53:41 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-5b442bc7-00e8-4ded-8d1b-3ac599c0d5ab tempest-VolumesActionsTest-1808403996 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 04:53:41 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-5b442bc7-00e8-4ded-8d1b-3ac599c0d5ab tempest-VolumesActionsTest-1808403996 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 04:53:41 devstack cinder-volume[92060]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b258505-86de-4ae5-a071-29845dc5ff08]: (4, 'qcow2') {{(pid=93130) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 04:53:41 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-5b442bc7-00e8-4ded-8d1b-3ac599c0d5ab tempest-VolumesActionsTest-1808403996 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-e32ad70e-580f-4af4-bd73-b9df2f0e5426 {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:53:41 devstack sudo[108042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-e32ad70e-580f-4af4-bd73-b9df2f0e5426 Jun 17 04:53:41 devstack sudo[108042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:53:41 devstack sudo[108042]: pam_unix(sudo:session): session closed for user root Jun 17 04:53:41 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-5b442bc7-00e8-4ded-8d1b-3ac599c0d5ab tempest-VolumesActionsTest-1808403996 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-e32ad70e-580f-4af4-bd73-b9df2f0e5426" returned: 0 in 0.723s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:53:41 devstack cinder-volume[92060]: DEBUG oslo.privsep.daemon [-] privsep: reply[8932f1b3-da47-4c71-b735-02231d3fdbe1]: (4, 'qcow2') {{(pid=93130) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 04:53:41 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-5b442bc7-00e8-4ded-8d1b-3ac599c0d5ab tempest-VolumesActionsTest-1808403996 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-e32ad70e-580f-4af4-bd73-b9df2f0e5426 {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:53:41 devstack sudo[108048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-e32ad70e-580f-4af4-bd73-b9df2f0e5426 Jun 17 04:53:41 devstack sudo[108048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:53:42 devstack sudo[108048]: pam_unix(sudo:session): session closed for user root Jun 17 04:53:42 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-5b442bc7-00e8-4ded-8d1b-3ac599c0d5ab tempest-VolumesActionsTest-1808403996 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-e32ad70e-580f-4af4-bd73-b9df2f0e5426" returned: 0 in 0.721s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:53:42 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-5b442bc7-00e8-4ded-8d1b-3ac599c0d5ab tempest-VolumesActionsTest-1808403996 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-e32ad70e-580f-4af4-bd73-b9df2f0e5426 /opt/stack/data/cinder/conversion/e32ad70e-580f-4af4-bd73-b9df2f0e5426.temp_image.e57a9cc2-2727-4774-b657-9859b8196ba550k1j7li.img {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:53:42 devstack sudo[108053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-e32ad70e-580f-4af4-bd73-b9df2f0e5426 /opt/stack/data/cinder/conversion/e32ad70e-580f-4af4-bd73-b9df2f0e5426.temp_image.e57a9cc2-2727-4774-b657-9859b8196ba550k1j7li.img Jun 17 04:53:42 devstack sudo[108053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:53:44 devstack cinder-volume[92060]: DEBUG oslo_service.periodic_task [None req-60d279ad-ad8c-4d36-a4b8-f593e74fb922 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=92060) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 17 04:53:44 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-60d279ad-ad8c-4d36-a4b8-f593e74fb922 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 04:53:44 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-60d279ad-ad8c-4d36-a4b8-f593e74fb922 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 04:53:44 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-60d279ad-ad8c-4d36-a4b8-f593e74fb922 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588': None} {{(pid=92060) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 17 04:53:44 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-60d279ad-ad8c-4d36-a4b8-f593e74fb922 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588'] {{(pid=92060) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 17 04:53:44 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-60d279ad-ad8c-4d36-a4b8-f593e74fb922 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 04:53:44 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-60d279ad-ad8c-4d36-a4b8-f593e74fb922 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:53:45 devstack sudo[108067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a Jun 17 04:53:45 devstack sudo[108067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:53:46 devstack sudo[108067]: pam_unix(sudo:session): session closed for user root Jun 17 04:53:46 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-60d279ad-ad8c-4d36-a4b8-f593e74fb922 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a" returned: 0 in 1.283s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:53:46 devstack cinder-volume[92060]: DEBUG cinder.manager [None req-60d279ad-ad8c-4d36-a4b8-f593e74fb922 None None] Notifying Schedulers of capabilities ... {{(pid=92060) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 17 04:53:46 devstack cinder-volume[92060]: DEBUG oslo_service.periodic_task [None req-60d279ad-ad8c-4d36-a4b8-f593e74fb922 None None] Running periodic task VolumeManager._thread_info {{(pid=92060) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 17 04:53:46 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-60d279ad-ad8c-4d36-a4b8-f593e74fb922 None None] thread count: 28 {{(pid=92060) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 17 04:53:46 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-60d279ad-ad8c-4d36-a4b8-f593e74fb922 None None] thread info: [<_MainThread(MainThread, started 130061806440576)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=92060) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 17 04:53:46 devstack sudo[108053]: pam_unix(sudo:session): session closed for user root Jun 17 04:53:46 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-5b442bc7-00e8-4ded-8d1b-3ac599c0d5ab tempest-VolumesActionsTest-1808403996 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-e32ad70e-580f-4af4-bd73-b9df2f0e5426 /opt/stack/data/cinder/conversion/e32ad70e-580f-4af4-bd73-b9df2f0e5426.temp_image.e57a9cc2-2727-4774-b657-9859b8196ba550k1j7li.img" returned: 0 in 4.356s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:53:46 devstack cinder-volume[92060]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f832728-b12f-400b-bdf1-acfee83f1a85]: (4, 'qcow2') {{(pid=93130) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 04:53:46 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-5b442bc7-00e8-4ded-8d1b-3ac599c0d5ab tempest-VolumesActionsTest-1808403996 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-e32ad70e-580f-4af4-bd73-b9df2f0e5426 {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:53:47 devstack sudo[108070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-e32ad70e-580f-4af4-bd73-b9df2f0e5426 Jun 17 04:53:47 devstack sudo[108070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:53:47 devstack sudo[108070]: pam_unix(sudo:session): session closed for user root Jun 17 04:53:47 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-5b442bc7-00e8-4ded-8d1b-3ac599c0d5ab tempest-VolumesActionsTest-1808403996 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-e32ad70e-580f-4af4-bd73-b9df2f0e5426" returned: 0 in 0.859s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:53:47 devstack cinder-volume[92060]: DEBUG cinder.image.image_utils [None req-5b442bc7-00e8-4ded-8d1b-3ac599c0d5ab tempest-VolumesActionsTest-1808403996 None] Image conversion details: src /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-e32ad70e-580f-4af4-bd73-b9df2f0e5426, size 1024.00 MB, duration 4.36 sec, destination /opt/stack/data/cinder/conversion/e32ad70e-580f-4af4-bd73-b9df2f0e5426.temp_image.e57a9cc2-2727-4774-b657-9859b8196ba550k1j7li.img {{(pid=92060) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 17 04:53:47 devstack cinder-volume[92060]: INFO cinder.image.image_utils [None req-5b442bc7-00e8-4ded-8d1b-3ac599c0d5ab tempest-VolumesActionsTest-1808403996 None] Converted 1024.00 MB image at 235.02 MB/s Jun 17 04:53:47 devstack cinder-volume[92060]: DEBUG cinder.image.image_utils [None req-5b442bc7-00e8-4ded-8d1b-3ac599c0d5ab tempest-VolumesActionsTest-1808403996 None] e57a9cc2-2727-4774-b657-9859b8196ba5 was raw, converting to qcow2 {{(pid=92060) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1179}} Jun 17 04:53:47 devstack cinder-volume[92060]: DEBUG oslo.privsep.daemon [-] privsep: reply[39a937ca-2752-461c-b00b-6a97eb8324b9]: (4, 'raw') {{(pid=93130) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 04:53:47 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-5b442bc7-00e8-4ded-8d1b-3ac599c0d5ab tempest-VolumesActionsTest-1808403996 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/e32ad70e-580f-4af4-bd73-b9df2f0e5426.temp_image.e57a9cc2-2727-4774-b657-9859b8196ba550k1j7li.img {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:53:47 devstack sudo[108075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/e32ad70e-580f-4af4-bd73-b9df2f0e5426.temp_image.e57a9cc2-2727-4774-b657-9859b8196ba550k1j7li.img Jun 17 04:53:47 devstack sudo[108075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:53:48 devstack sudo[108075]: pam_unix(sudo:session): session closed for user root Jun 17 04:53:48 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-5b442bc7-00e8-4ded-8d1b-3ac599c0d5ab tempest-VolumesActionsTest-1808403996 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/e32ad70e-580f-4af4-bd73-b9df2f0e5426.temp_image.e57a9cc2-2727-4774-b657-9859b8196ba550k1j7li.img" returned: 0 in 0.643s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:53:48 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-5b442bc7-00e8-4ded-8d1b-3ac599c0d5ab tempest-VolumesActionsTest-1808403996 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/e32ad70e-580f-4af4-bd73-b9df2f0e5426.temp_image.e57a9cc2-2727-4774-b657-9859b8196ba550k1j7li.img {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:53:48 devstack sudo[108079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/e32ad70e-580f-4af4-bd73-b9df2f0e5426.temp_image.e57a9cc2-2727-4774-b657-9859b8196ba550k1j7li.img Jun 17 04:53:48 devstack sudo[108079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:53:49 devstack sudo[108079]: pam_unix(sudo:session): session closed for user root Jun 17 04:53:49 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-5b442bc7-00e8-4ded-8d1b-3ac599c0d5ab tempest-VolumesActionsTest-1808403996 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/e32ad70e-580f-4af4-bd73-b9df2f0e5426.temp_image.e57a9cc2-2727-4774-b657-9859b8196ba550k1j7li.img" returned: 1 in 0.640s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:53:49 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-5b442bc7-00e8-4ded-8d1b-3ac599c0d5ab tempest-VolumesActionsTest-1808403996 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/e32ad70e-580f-4af4-bd73-b9df2f0e5426.temp_image.e57a9cc2-2727-4774-b657-9859b8196ba550k1j7li.img' failed. Not Retrying. {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 17 04:53:49 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-5b442bc7-00e8-4ded-8d1b-3ac599c0d5ab tempest-VolumesActionsTest-1808403996 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/e32ad70e-580f-4af4-bd73-b9df2f0e5426.temp_image.e57a9cc2-2727-4774-b657-9859b8196ba550k1j7li.img /opt/stack/data/cinder/conversion/vol_upload_h5kamlc_ {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:53:49 devstack sudo[108084]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/e32ad70e-580f-4af4-bd73-b9df2f0e5426.temp_image.e57a9cc2-2727-4774-b657-9859b8196ba550k1j7li.img /opt/stack/data/cinder/conversion/vol_upload_h5kamlc_ Jun 17 04:53:49 devstack sudo[108084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:53:49 devstack sudo[108084]: pam_unix(sudo:session): session closed for user root Jun 17 04:53:49 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-5b442bc7-00e8-4ded-8d1b-3ac599c0d5ab tempest-VolumesActionsTest-1808403996 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/e32ad70e-580f-4af4-bd73-b9df2f0e5426.temp_image.e57a9cc2-2727-4774-b657-9859b8196ba550k1j7li.img /opt/stack/data/cinder/conversion/vol_upload_h5kamlc_" returned: 0 in 0.571s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:53:49 devstack cinder-volume[92060]: DEBUG cinder.image.image_utils [None req-5b442bc7-00e8-4ded-8d1b-3ac599c0d5ab tempest-VolumesActionsTest-1808403996 None] Image conversion details: src /opt/stack/data/cinder/conversion/e32ad70e-580f-4af4-bd73-b9df2f0e5426.temp_image.e57a9cc2-2727-4774-b657-9859b8196ba550k1j7li.img, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/conversion/vol_upload_h5kamlc_ {{(pid=92060) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 17 04:53:49 devstack cinder-volume[92060]: INFO cinder.image.image_utils [None req-5b442bc7-00e8-4ded-8d1b-3ac599c0d5ab tempest-VolumesActionsTest-1808403996 None] Converted 1024.00 MB image at 1024.00 MB/s Jun 17 04:53:49 devstack cinder-volume[92060]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f29c8f4-486a-472f-9906-c709293abb70]: (4, 'qcow2') {{(pid=93130) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 04:53:49 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-5b442bc7-00e8-4ded-8d1b-3ac599c0d5ab tempest-VolumesActionsTest-1808403996 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_h5kamlc_ {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:53:49 devstack sudo[108090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_h5kamlc_ Jun 17 04:53:49 devstack sudo[108090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:53:50 devstack sudo[108090]: pam_unix(sudo:session): session closed for user root Jun 17 04:53:50 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-5b442bc7-00e8-4ded-8d1b-3ac599c0d5ab tempest-VolumesActionsTest-1808403996 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_h5kamlc_" returned: 0 in 0.630s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:53:51 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-5b442bc7-00e8-4ded-8d1b-3ac599c0d5ab tempest-VolumesActionsTest-1808403996 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 10.385s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 04:53:51 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-5b442bc7-00e8-4ded-8d1b-3ac599c0d5ab tempest-VolumesActionsTest-1808403996 None] Uploaded volume to glance image-id: e57a9cc2-2727-4774-b657-9859b8196ba5. {{(pid=92060) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Jun 17 04:53:51 devstack cinder-volume[92060]: INFO cinder.volume.manager [None req-5b442bc7-00e8-4ded-8d1b-3ac599c0d5ab tempest-VolumesActionsTest-1808403996 None] Copy volume to image completed successfully. Jun 17 04:53:52 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-3258e931-97ec-452e-80eb-235c4a372ea7 tempest-VolumesActionsTest-1808403996 None] Acquiring lock "cinder-e32ad70e-580f-4af4-bd73-b9df2f0e5426-delete_volume" by "delete_volume" {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 04:53:52 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-3258e931-97ec-452e-80eb-235c4a372ea7 tempest-VolumesActionsTest-1808403996 None] Lock "cinder-e32ad70e-580f-4af4-bd73-b9df2f0e5426-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 04:53:52 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-3258e931-97ec-452e-80eb-235c4a372ea7 tempest-VolumesActionsTest-1808403996 None] Acquiring lock "cinder-quobyte-e32ad70e-580f-4af4-bd73-b9df2f0e5426" by "delete_volume" {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 04:53:52 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-3258e931-97ec-452e-80eb-235c4a372ea7 tempest-VolumesActionsTest-1808403996 None] Lock "cinder-quobyte-e32ad70e-580f-4af4-bd73-b9df2f0e5426" acquired by "delete_volume" :: waited 0.016s {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 04:53:52 devstack cinder-volume[92060]: DEBUG oslo.privsep.daemon [-] privsep: reply[87c4dee4-3ff4-49e8-a73e-adc6da4e2bda]: (4, 'qcow2') {{(pid=93130) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 04:53:52 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-3258e931-97ec-452e-80eb-235c4a372ea7 tempest-VolumesActionsTest-1808403996 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-e32ad70e-580f-4af4-bd73-b9df2f0e5426 {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:53:52 devstack sudo[108096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-e32ad70e-580f-4af4-bd73-b9df2f0e5426 Jun 17 04:53:52 devstack sudo[108096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:53:52 devstack sudo[108096]: pam_unix(sudo:session): session closed for user root Jun 17 04:53:52 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-3258e931-97ec-452e-80eb-235c4a372ea7 tempest-VolumesActionsTest-1808403996 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-e32ad70e-580f-4af4-bd73-b9df2f0e5426" returned: 0 in 0.672s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:53:52 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-3258e931-97ec-452e-80eb-235c4a372ea7 tempest-VolumesActionsTest-1808403996 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-e32ad70e-580f-4af4-bd73-b9df2f0e5426 {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:53:52 devstack sudo[108101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-e32ad70e-580f-4af4-bd73-b9df2f0e5426 Jun 17 04:53:52 devstack sudo[108101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:53:53 devstack sudo[108101]: pam_unix(sudo:session): session closed for user root Jun 17 04:53:53 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-3258e931-97ec-452e-80eb-235c4a372ea7 tempest-VolumesActionsTest-1808403996 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-e32ad70e-580f-4af4-bd73-b9df2f0e5426" returned: 0 in 0.598s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:53:53 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-3258e931-97ec-452e-80eb-235c4a372ea7 tempest-VolumesActionsTest-1808403996 None] Lock "cinder-quobyte-e32ad70e-580f-4af4-bd73-b9df2f0e5426" released by "delete_volume" :: held 1.308s {{(pid=92060) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 04:53:53 devstack cinder-volume[92060]: DEBUG cinder.quota [None req-3258e931-97ec-452e-80eb-235c4a372ea7 tempest-VolumesActionsTest-1808403996 None] Created reservations ['16530447-e22e-4bd2-9a54-ff9a18ae4c3a', '0acab72c-a386-4953-b139-8cb758035480', 'ba2de28f-cfcd-4226-92e9-256c220c4646', '2d4cecd5-b27a-407f-94d9-ae3295071e10'] {{(pid=92060) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 17 04:53:53 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-3258e931-97ec-452e-80eb-235c4a372ea7 tempest-VolumesActionsTest-1808403996 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 04:53:53 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-3258e931-97ec-452e-80eb-235c4a372ea7 tempest-VolumesActionsTest-1808403996 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 04:53:53 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-3258e931-97ec-452e-80eb-235c4a372ea7 tempest-VolumesActionsTest-1808403996 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588': None} {{(pid=92060) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 17 04:53:53 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-3258e931-97ec-452e-80eb-235c4a372ea7 tempest-VolumesActionsTest-1808403996 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588'] {{(pid=92060) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 17 04:53:53 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-3258e931-97ec-452e-80eb-235c4a372ea7 tempest-VolumesActionsTest-1808403996 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 04:53:53 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-3258e931-97ec-452e-80eb-235c4a372ea7 tempest-VolumesActionsTest-1808403996 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:53:53 devstack sudo[108104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a Jun 17 04:53:53 devstack sudo[108104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:53:54 devstack sudo[108104]: pam_unix(sudo:session): session closed for user root Jun 17 04:53:54 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-3258e931-97ec-452e-80eb-235c4a372ea7 tempest-VolumesActionsTest-1808403996 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a" returned: 0 in 0.601s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:53:54 devstack cinder-volume[92060]: DEBUG cinder.manager [None req-3258e931-97ec-452e-80eb-235c4a372ea7 tempest-VolumesActionsTest-1808403996 None] Notifying Schedulers of capabilities ... {{(pid=92060) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 17 04:53:54 devstack cinder-volume[92060]: INFO cinder.volume.manager [None req-3258e931-97ec-452e-80eb-235c4a372ea7 tempest-VolumesActionsTest-1808403996 None] Deleted volume successfully. Jun 17 04:53:54 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-3258e931-97ec-452e-80eb-235c4a372ea7 tempest-VolumesActionsTest-1808403996 None] Lock "cinder-e32ad70e-580f-4af4-bd73-b9df2f0e5426-delete_volume" released by "delete_volume" :: held 2.098s {{(pid=92060) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 04:53:59 devstack cinder-volume[92060]: DEBUG cinder.volume.flows.manager.create_volume [None req-69563baa-c550-4024-8ed6-5960f17b38b4 tempest-VolumesExtendTest-709449278 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92060) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 17 04:53:59 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-69563baa-c550-4024-8ed6-5960f17b38b4 tempest-VolumesExtendTest-709449278 None] Flow 'volume_create_manager' (169541d7-ab4f-41f7-b716-1f770096ab85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 17 04:53:59 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-69563baa-c550-4024-8ed6-5960f17b38b4 tempest-VolumesExtendTest-709449278 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (114e5f16-8b80-4d78-9941-0173450007ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:53:59 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-69563baa-c550-4024-8ed6-5960f17b38b4 tempest-VolumesExtendTest-709449278 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (114e5f16-8b80-4d78-9941-0173450007ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-17T02:54:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-715555471',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2b1dacc4-9851-4256-8db2-e7d980ff50db,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='40d1c93aba534bfa980c0ba21a65838a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T02:54:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T02:54:00Z,use_quota=True,user_id='f588f366383c49ce90a0b192965edcba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aad9ce24-93f9-41a6-baa1-5125964f96d1),volume_type_id=aad9ce24-93f9-41a6-baa1-5125964f96d1)' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:53:59 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-69563baa-c550-4024-8ed6-5960f17b38b4 tempest-VolumesExtendTest-709449278 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cbe4249c-6b85-4243-b552-17721ab3027b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:53:59 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-69563baa-c550-4024-8ed6-5960f17b38b4 tempest-VolumesExtendTest-709449278 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cbe4249c-6b85-4243-b552-17721ab3027b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:53:59 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-69563baa-c550-4024-8ed6-5960f17b38b4 tempest-VolumesExtendTest-709449278 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (26f682c9-3b3a-41ae-9ee3-c75169d154bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:53:59 devstack cinder-volume[92060]: DEBUG cinder.image.glance [None req-69563baa-c550-4024-8ed6-5960f17b38b4 tempest-VolumesExtendTest-709449278 None] Creating Keystone auth plugin from conf {{(pid=92060) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jun 17 04:54:00 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-69563baa-c550-4024-8ed6-5960f17b38b4 tempest-VolumesExtendTest-709449278 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (26f682c9-3b3a-41ae-9ee3-c75169d154bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '2b1dacc4-9851-4256-8db2-e7d980ff50db', 'volume_name': 'volume-2b1dacc4-9851-4256-8db2-e7d980ff50db', 'volume_size': 1, 'image_id': '5abcba5c-72fa-4ea5-881e-1f4f187259a5', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/5abcba5c-72fa-4ea5-881e-1f4f187259a5', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'ec7d18cca2734755a53ee22ace21508e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '5abcba5c-72fa-4ea5-881e-1f4f187259a5', 'created_at': datetime.datetime(2026, 6, 17, 2, 29, 47, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 17, 2, 29, 49, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/5abcba5c-72fa-4ea5-881e-1f4f187259a5/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:54:00 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-69563baa-c550-4024-8ed6-5960f17b38b4 tempest-VolumesExtendTest-709449278 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (97a0bd85-e28f-43ca-84e3-1d121ff5a705) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:54:00 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-69563baa-c550-4024-8ed6-5960f17b38b4 tempest-VolumesExtendTest-709449278 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (97a0bd85-e28f-43ca-84e3-1d121ff5a705) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:54:00 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-69563baa-c550-4024-8ed6-5960f17b38b4 tempest-VolumesExtendTest-709449278 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e3272678-3cca-406c-9ffb-2607a49b44c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:54:00 devstack cinder-volume[92060]: INFO cinder.volume.flows.manager.create_volume [None req-69563baa-c550-4024-8ed6-5960f17b38b4 tempest-VolumesExtendTest-709449278 None] Volume 2b1dacc4-9851-4256-8db2-e7d980ff50db: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-2b1dacc4-9851-4256-8db2-e7d980ff50db', 'volume_size': 1, 'image_id': '5abcba5c-72fa-4ea5-881e-1f4f187259a5', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/5abcba5c-72fa-4ea5-881e-1f4f187259a5', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'ec7d18cca2734755a53ee22ace21508e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '5abcba5c-72fa-4ea5-881e-1f4f187259a5', 'created_at': datetime.datetime(2026, 6, 17, 2, 29, 47, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 17, 2, 29, 49, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/5abcba5c-72fa-4ea5-881e-1f4f187259a5/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jun 17 04:54:00 devstack cinder-volume[92060]: DEBUG cinder.volume.flows.manager.create_volume [None req-69563baa-c550-4024-8ed6-5960f17b38b4 tempest-VolumesExtendTest-709449278 None] Trying to clone 2b1dacc4-9851-4256-8db2-e7d980ff50db from image 5abcba5c-72fa-4ea5-881e-1f4f187259a5 at location (None, [{'url': 'file:///opt/stack/data/glance/images/5abcba5c-72fa-4ea5-881e-1f4f187259a5', 'metadata': {}}]). {{(pid=92060) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jun 17 04:54:00 devstack cinder-volume[92060]: DEBUG cinder.image.image_utils [None req-69563baa-c550-4024-8ed6-5960f17b38b4 tempest-VolumesExtendTest-709449278 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_5abcba5c-72fa-4ea5-881e-1f4f187259a5_98id4p2zdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=92060) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jun 17 04:54:00 devstack cinder-volume[92060]: INFO cinder.image.image_utils [None req-69563baa-c550-4024-8ed6-5960f17b38b4 tempest-VolumesExtendTest-709449278 None] Image download 20.69 MB at 20.69 MB/s Jun 17 04:54:00 devstack cinder-volume[92060]: DEBUG oslo.privsep.daemon [-] privsep: reply[31b587fd-2d3e-48a6-8c79-8fdad4958deb]: (4, 'qcow2') {{(pid=93130) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 04:54:00 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-69563baa-c550-4024-8ed6-5960f17b38b4 tempest-VolumesExtendTest-709449278 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5abcba5c-72fa-4ea5-881e-1f4f187259a5_98id4p2zdevstack@QuobyteHD {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:54:00 devstack sudo[108111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5abcba5c-72fa-4ea5-881e-1f4f187259a5_98id4p2zdevstack@QuobyteHD Jun 17 04:54:00 devstack sudo[108111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:54:01 devstack sudo[108111]: pam_unix(sudo:session): session closed for user root Jun 17 04:54:01 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-69563baa-c550-4024-8ed6-5960f17b38b4 tempest-VolumesExtendTest-709449278 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5abcba5c-72fa-4ea5-881e-1f4f187259a5_98id4p2zdevstack@QuobyteHD" returned: 0 in 0.697s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:54:01 devstack cinder-volume[92060]: DEBUG cinder.image.image_utils [None req-69563baa-c550-4024-8ed6-5960f17b38b4 tempest-VolumesExtendTest-709449278 None] Temporary image 5abcba5c-72fa-4ea5-881e-1f4f187259a5 is fetched for user f588f366383c49ce90a0b192965edcba. {{(pid=92060) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jun 17 04:54:01 devstack cinder-volume[92060]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4b4fb03-fe92-4233-9591-2a0de08960e3]: (4, 'qcow2') {{(pid=93130) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 04:54:01 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-69563baa-c550-4024-8ed6-5960f17b38b4 tempest-VolumesExtendTest-709449278 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5abcba5c-72fa-4ea5-881e-1f4f187259a5_98id4p2zdevstack@QuobyteHD {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:54:01 devstack sudo[108116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5abcba5c-72fa-4ea5-881e-1f4f187259a5_98id4p2zdevstack@QuobyteHD Jun 17 04:54:01 devstack sudo[108116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:54:01 devstack sudo[108116]: pam_unix(sudo:session): session closed for user root Jun 17 04:54:01 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-69563baa-c550-4024-8ed6-5960f17b38b4 tempest-VolumesExtendTest-709449278 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5abcba5c-72fa-4ea5-881e-1f4f187259a5_98id4p2zdevstack@QuobyteHD" returned: 0 in 0.656s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:54:01 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-69563baa-c550-4024-8ed6-5960f17b38b4 tempest-VolumesExtendTest-709449278 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 04:54:01 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-69563baa-c550-4024-8ed6-5960f17b38b4 tempest-VolumesExtendTest-709449278 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 04:54:01 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-69563baa-c550-4024-8ed6-5960f17b38b4 tempest-VolumesExtendTest-709449278 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-17T02:54:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-715555471',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2b1dacc4-9851-4256-8db2-e7d980ff50db,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='40d1c93aba534bfa980c0ba21a65838a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T02:54:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T02:54:00Z,use_quota=True,user_id='f588f366383c49ce90a0b192965edcba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aad9ce24-93f9-41a6-baa1-5125964f96d1),volume_type_id=aad9ce24-93f9-41a6-baa1-5125964f96d1)}" {{(pid=92060) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 17 04:54:01 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.remotefs [None req-69563baa-c550-4024-8ed6-5960f17b38b4 tempest-VolumesExtendTest-709449278 None] Creating volume 2b1dacc4-9851-4256-8db2-e7d980ff50db {{(pid=92060) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 17 04:54:01 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-69563baa-c550-4024-8ed6-5960f17b38b4 tempest-VolumesExtendTest-709449278 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 04:54:01 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-69563baa-c550-4024-8ed6-5960f17b38b4 tempest-VolumesExtendTest-709449278 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 04:54:01 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-69563baa-c550-4024-8ed6-5960f17b38b4 tempest-VolumesExtendTest-709449278 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588': None} {{(pid=92060) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 17 04:54:01 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-69563baa-c550-4024-8ed6-5960f17b38b4 tempest-VolumesExtendTest-709449278 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588'] {{(pid=92060) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 17 04:54:01 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-69563baa-c550-4024-8ed6-5960f17b38b4 tempest-VolumesExtendTest-709449278 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 04:54:01 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-69563baa-c550-4024-8ed6-5960f17b38b4 tempest-VolumesExtendTest-709449278 None] Selected osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588 as target Quobyte volume. {{(pid=92060) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 17 04:54:01 devstack cinder-volume[92060]: INFO cinder.volume.drivers.remotefs [None req-69563baa-c550-4024-8ed6-5960f17b38b4 tempest-VolumesExtendTest-709449278 None] casted to osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588 Jun 17 04:54:01 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-69563baa-c550-4024-8ed6-5960f17b38b4 tempest-VolumesExtendTest-709449278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-2b1dacc4-9851-4256-8db2-e7d980ff50db 1073741824 {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:54:01 devstack sudo[108122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-2b1dacc4-9851-4256-8db2-e7d980ff50db 1073741824 Jun 17 04:54:01 devstack sudo[108122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:54:02 devstack sudo[108122]: pam_unix(sudo:session): session closed for user root Jun 17 04:54:02 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-69563baa-c550-4024-8ed6-5960f17b38b4 tempest-VolumesExtendTest-709449278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-2b1dacc4-9851-4256-8db2-e7d980ff50db 1073741824" returned: 0 in 0.779s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:54:02 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-69563baa-c550-4024-8ed6-5960f17b38b4 tempest-VolumesExtendTest-709449278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-2b1dacc4-9851-4256-8db2-e7d980ff50db {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:54:02 devstack sudo[108128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-2b1dacc4-9851-4256-8db2-e7d980ff50db Jun 17 04:54:02 devstack sudo[108128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:54:03 devstack sudo[108128]: pam_unix(sudo:session): session closed for user root Jun 17 04:54:03 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-69563baa-c550-4024-8ed6-5960f17b38b4 tempest-VolumesExtendTest-709449278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-2b1dacc4-9851-4256-8db2-e7d980ff50db" returned: 0 in 0.566s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:54:03 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-69563baa-c550-4024-8ed6-5960f17b38b4 tempest-VolumesExtendTest-709449278 None] <== create_volume: return (1384ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588'} {{(pid=92060) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 17 04:54:03 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-69563baa-c550-4024-8ed6-5960f17b38b4 tempest-VolumesExtendTest-709449278 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.387s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 04:54:03 devstack cinder-volume[92060]: DEBUG cinder.volume.volume_utils [None req-69563baa-c550-4024-8ed6-5960f17b38b4 tempest-VolumesExtendTest-709449278 None] Attempting download of 5abcba5c-72fa-4ea5-881e-1f4f187259a5 ((None, [{'url': 'file:///opt/stack/data/glance/images/5abcba5c-72fa-4ea5-881e-1f4f187259a5', 'metadata': {}}])) to volume 2b1dacc4-9851-4256-8db2-e7d980ff50db. {{(pid=92060) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jun 17 04:54:03 devstack cinder-volume[92060]: DEBUG oslo.privsep.daemon [-] privsep: reply[31e2abc0-5d46-4793-9f67-6b3b1349e55c]: (4, 'raw') {{(pid=93130) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 04:54:03 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-69563baa-c550-4024-8ed6-5960f17b38b4 tempest-VolumesExtendTest-709449278 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_5abcba5c-72fa-4ea5-881e-1f4f187259a5_gpoz4m0z {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:54:03 devstack sudo[108131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_5abcba5c-72fa-4ea5-881e-1f4f187259a5_gpoz4m0z Jun 17 04:54:03 devstack sudo[108131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:54:03 devstack sudo[108131]: pam_unix(sudo:session): session closed for user root Jun 17 04:54:03 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-69563baa-c550-4024-8ed6-5960f17b38b4 tempest-VolumesExtendTest-709449278 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_5abcba5c-72fa-4ea5-881e-1f4f187259a5_gpoz4m0z" returned: 0 in 0.658s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:54:03 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-69563baa-c550-4024-8ed6-5960f17b38b4 tempest-VolumesExtendTest-709449278 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5abcba5c-72fa-4ea5-881e-1f4f187259a5_gpoz4m0z {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:54:04 devstack sudo[108135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5abcba5c-72fa-4ea5-881e-1f4f187259a5_gpoz4m0z Jun 17 04:54:04 devstack sudo[108135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:54:04 devstack sudo[108135]: pam_unix(sudo:session): session closed for user root Jun 17 04:54:04 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-69563baa-c550-4024-8ed6-5960f17b38b4 tempest-VolumesExtendTest-709449278 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5abcba5c-72fa-4ea5-881e-1f4f187259a5_gpoz4m0z" returned: 1 in 0.689s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:54:04 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-69563baa-c550-4024-8ed6-5960f17b38b4 tempest-VolumesExtendTest-709449278 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5abcba5c-72fa-4ea5-881e-1f4f187259a5_gpoz4m0z' failed. Not Retrying. {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 17 04:54:04 devstack cinder-volume[92060]: DEBUG oslo.privsep.daemon [-] privsep: reply[46526003-1c72-4bd8-81e2-56cd8134c341]: (4, 'qcow2') {{(pid=93130) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 04:54:04 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-69563baa-c550-4024-8ed6-5960f17b38b4 tempest-VolumesExtendTest-709449278 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5abcba5c-72fa-4ea5-881e-1f4f187259a5_98id4p2zdevstack@QuobyteHD {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:54:04 devstack sudo[108139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5abcba5c-72fa-4ea5-881e-1f4f187259a5_98id4p2zdevstack@QuobyteHD Jun 17 04:54:04 devstack sudo[108139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:54:05 devstack sudo[108139]: pam_unix(sudo:session): session closed for user root Jun 17 04:54:05 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-69563baa-c550-4024-8ed6-5960f17b38b4 tempest-VolumesExtendTest-709449278 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5abcba5c-72fa-4ea5-881e-1f4f187259a5_98id4p2zdevstack@QuobyteHD" returned: 0 in 0.638s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:54:05 devstack cinder-volume[92060]: DEBUG cinder.image.image_utils [None req-69563baa-c550-4024-8ed6-5960f17b38b4 tempest-VolumesExtendTest-709449278 None] 5abcba5c-72fa-4ea5-881e-1f4f187259a5 was qcow2, converting to raw {{(pid=92060) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jun 17 04:54:05 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-69563baa-c550-4024-8ed6-5960f17b38b4 tempest-VolumesExtendTest-709449278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_5abcba5c-72fa-4ea5-881e-1f4f187259a5_98id4p2zdevstack@QuobyteHD /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-2b1dacc4-9851-4256-8db2-e7d980ff50db {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:54:05 devstack sudo[108144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_5abcba5c-72fa-4ea5-881e-1f4f187259a5_98id4p2zdevstack@QuobyteHD /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-2b1dacc4-9851-4256-8db2-e7d980ff50db Jun 17 04:54:05 devstack sudo[108144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:54:07 devstack sudo[108144]: pam_unix(sudo:session): session closed for user root Jun 17 04:54:07 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-69563baa-c550-4024-8ed6-5960f17b38b4 tempest-VolumesExtendTest-709449278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_5abcba5c-72fa-4ea5-881e-1f4f187259a5_98id4p2zdevstack@QuobyteHD /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-2b1dacc4-9851-4256-8db2-e7d980ff50db" returned: 0 in 1.743s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:54:07 devstack cinder-volume[92060]: DEBUG cinder.image.image_utils [None req-69563baa-c550-4024-8ed6-5960f17b38b4 tempest-VolumesExtendTest-709449278 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_5abcba5c-72fa-4ea5-881e-1f4f187259a5_98id4p2zdevstack@QuobyteHD, size 112.00 MB, duration 1.74 sec, destination /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-2b1dacc4-9851-4256-8db2-e7d980ff50db {{(pid=92060) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 17 04:54:07 devstack cinder-volume[92060]: INFO cinder.image.image_utils [None req-69563baa-c550-4024-8ed6-5960f17b38b4 tempest-VolumesExtendTest-709449278 None] Converted 112.00 MB image at 64.20 MB/s Jun 17 04:54:07 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-69563baa-c550-4024-8ed6-5960f17b38b4 tempest-VolumesExtendTest-709449278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-2b1dacc4-9851-4256-8db2-e7d980ff50db 1G {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:54:07 devstack sudo[108154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-2b1dacc4-9851-4256-8db2-e7d980ff50db 1G Jun 17 04:54:07 devstack sudo[108154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:54:07 devstack sudo[108154]: pam_unix(sudo:session): session closed for user root Jun 17 04:54:07 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-69563baa-c550-4024-8ed6-5960f17b38b4 tempest-VolumesExtendTest-709449278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-2b1dacc4-9851-4256-8db2-e7d980ff50db 1G" returned: 0 in 0.629s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:54:07 devstack cinder-volume[92060]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b54e43d-b80d-4346-97f4-ba39093eda75]: (4, 'raw') {{(pid=93130) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 04:54:07 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-69563baa-c550-4024-8ed6-5960f17b38b4 tempest-VolumesExtendTest-709449278 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-2b1dacc4-9851-4256-8db2-e7d980ff50db {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:54:07 devstack sudo[108161]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-2b1dacc4-9851-4256-8db2-e7d980ff50db Jun 17 04:54:07 devstack sudo[108161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:54:08 devstack sudo[108161]: pam_unix(sudo:session): session closed for user root Jun 17 04:54:08 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-69563baa-c550-4024-8ed6-5960f17b38b4 tempest-VolumesExtendTest-709449278 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-2b1dacc4-9851-4256-8db2-e7d980ff50db" returned: 0 in 0.697s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:54:08 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-69563baa-c550-4024-8ed6-5960f17b38b4 tempest-VolumesExtendTest-709449278 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-2b1dacc4-9851-4256-8db2-e7d980ff50db {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:54:08 devstack sudo[108165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-2b1dacc4-9851-4256-8db2-e7d980ff50db Jun 17 04:54:08 devstack sudo[108165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:54:09 devstack sudo[108165]: pam_unix(sudo:session): session closed for user root Jun 17 04:54:09 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-69563baa-c550-4024-8ed6-5960f17b38b4 tempest-VolumesExtendTest-709449278 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-2b1dacc4-9851-4256-8db2-e7d980ff50db" returned: 1 in 0.657s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:54:09 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-69563baa-c550-4024-8ed6-5960f17b38b4 tempest-VolumesExtendTest-709449278 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-2b1dacc4-9851-4256-8db2-e7d980ff50db' failed. Not Retrying. {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 17 04:54:09 devstack cinder-volume[92060]: DEBUG cinder.volume.volume_utils [None req-69563baa-c550-4024-8ed6-5960f17b38b4 tempest-VolumesExtendTest-709449278 None] Downloaded image 5abcba5c-72fa-4ea5-881e-1f4f187259a5 ((None, [{'url': 'file:///opt/stack/data/glance/images/5abcba5c-72fa-4ea5-881e-1f4f187259a5', 'metadata': {}}])) to volume 2b1dacc4-9851-4256-8db2-e7d980ff50db successfully. {{(pid=92060) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jun 17 04:54:09 devstack cinder-volume[92060]: DEBUG cinder.image.image_utils [None req-69563baa-c550-4024-8ed6-5960f17b38b4 tempest-VolumesExtendTest-709449278 None] Temporary image 5abcba5c-72fa-4ea5-881e-1f4f187259a5 for user f588f366383c49ce90a0b192965edcba is deleted. {{(pid=92060) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jun 17 04:54:09 devstack cinder-volume[92060]: DEBUG cinder.volume.volume_utils [None req-69563baa-c550-4024-8ed6-5960f17b38b4 tempest-VolumesExtendTest-709449278 None] Marking volume 2b1dacc4-9851-4256-8db2-e7d980ff50db as bootable. {{(pid=92060) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jun 17 04:54:09 devstack cinder-volume[92060]: DEBUG cinder.volume.flows.manager.create_volume [None req-69563baa-c550-4024-8ed6-5960f17b38b4 tempest-VolumesExtendTest-709449278 None] Copying metadata from image 5abcba5c-72fa-4ea5-881e-1f4f187259a5 to 2b1dacc4-9851-4256-8db2-e7d980ff50db. {{(pid=92060) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jun 17 04:54:09 devstack cinder-volume[92060]: DEBUG cinder.volume.flows.manager.create_volume [None req-69563baa-c550-4024-8ed6-5960f17b38b4 tempest-VolumesExtendTest-709449278 None] Creating volume glance metadata for volume 2b1dacc4-9851-4256-8db2-e7d980ff50db backed by image 5abcba5c-72fa-4ea5-881e-1f4f187259a5 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '5abcba5c-72fa-4ea5-881e-1f4f187259a5', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=92060) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jun 17 04:54:09 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-69563baa-c550-4024-8ed6-5960f17b38b4 tempest-VolumesExtendTest-709449278 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e3272678-3cca-406c-9ffb-2607a49b44c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2b1dacc4-9851-4256-8db2-e7d980ff50db', 'volume_size': 1, 'image_id': '5abcba5c-72fa-4ea5-881e-1f4f187259a5', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/5abcba5c-72fa-4ea5-881e-1f4f187259a5', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'ec7d18cca2734755a53ee22ace21508e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '5abcba5c-72fa-4ea5-881e-1f4f187259a5', 'created_at': datetime.datetime(2026, 6, 17, 2, 29, 47, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 17, 2, 29, 49, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/5abcba5c-72fa-4ea5-881e-1f4f187259a5/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:54:09 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-69563baa-c550-4024-8ed6-5960f17b38b4 tempest-VolumesExtendTest-709449278 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (122b5f23-80eb-4b39-aaaa-ae21943e640a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:54:09 devstack cinder-volume[92060]: INFO cinder.volume.flows.manager.create_volume [None req-69563baa-c550-4024-8ed6-5960f17b38b4 tempest-VolumesExtendTest-709449278 None] Volume volume-2b1dacc4-9851-4256-8db2-e7d980ff50db (2b1dacc4-9851-4256-8db2-e7d980ff50db): created successfully Jun 17 04:54:09 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-69563baa-c550-4024-8ed6-5960f17b38b4 tempest-VolumesExtendTest-709449278 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (122b5f23-80eb-4b39-aaaa-ae21943e640a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:54:09 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-69563baa-c550-4024-8ed6-5960f17b38b4 tempest-VolumesExtendTest-709449278 None] Flow 'volume_create_manager' (169541d7-ab4f-41f7-b716-1f770096ab85) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92060) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 17 04:54:09 devstack cinder-volume[92060]: INFO cinder.volume.manager [None req-69563baa-c550-4024-8ed6-5960f17b38b4 tempest-VolumesExtendTest-709449278 None] Created volume successfully. Jun 17 04:54:10 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-f12df315-3b7b-418e-941f-a96bd515df51 tempest-VolumesExtendTest-709449278 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 04:54:10 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-f12df315-3b7b-418e-941f-a96bd515df51 tempest-VolumesExtendTest-709449278 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.001s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 04:54:10 devstack cinder-volume[92060]: DEBUG oslo.privsep.daemon [-] privsep: reply[aeeb608f-f915-4cbd-a614-e36f529a5c7e]: (4, 'raw') {{(pid=93130) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 04:54:10 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-f12df315-3b7b-418e-941f-a96bd515df51 tempest-VolumesExtendTest-709449278 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-2b1dacc4-9851-4256-8db2-e7d980ff50db {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:54:10 devstack sudo[108176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-2b1dacc4-9851-4256-8db2-e7d980ff50db Jun 17 04:54:10 devstack sudo[108176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:54:11 devstack sudo[108176]: pam_unix(sudo:session): session closed for user root Jun 17 04:54:11 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-f12df315-3b7b-418e-941f-a96bd515df51 tempest-VolumesExtendTest-709449278 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-2b1dacc4-9851-4256-8db2-e7d980ff50db" returned: 0 in 0.674s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:54:11 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-f12df315-3b7b-418e-941f-a96bd515df51 tempest-VolumesExtendTest-709449278 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-2b1dacc4-9851-4256-8db2-e7d980ff50db {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:54:11 devstack sudo[108180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-2b1dacc4-9851-4256-8db2-e7d980ff50db Jun 17 04:54:11 devstack sudo[108180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:54:11 devstack sudo[108180]: pam_unix(sudo:session): session closed for user root Jun 17 04:54:11 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-f12df315-3b7b-418e-941f-a96bd515df51 tempest-VolumesExtendTest-709449278 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-2b1dacc4-9851-4256-8db2-e7d980ff50db" returned: 1 in 0.671s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:54:11 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-f12df315-3b7b-418e-941f-a96bd515df51 tempest-VolumesExtendTest-709449278 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-2b1dacc4-9851-4256-8db2-e7d980ff50db' failed. Not Retrying. {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 17 04:54:11 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-f12df315-3b7b-418e-941f-a96bd515df51 tempest-VolumesExtendTest-709449278 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-2b1dacc4-9851-4256-8db2-e7d980ff50db 2G {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:54:11 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-f12df315-3b7b-418e-941f-a96bd515df51 tempest-VolumesExtendTest-709449278 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-2b1dacc4-9851-4256-8db2-e7d980ff50db 2G" returned: 0 in 0.057s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:54:11 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-f12df315-3b7b-418e-941f-a96bd515df51 tempest-VolumesExtendTest-709449278 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 1.442s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 04:54:11 devstack cinder-volume[92060]: INFO cinder.volume.manager [None req-f12df315-3b7b-418e-941f-a96bd515df51 tempest-VolumesExtendTest-709449278 None] Extend volume completed successfully. Jun 17 04:54:12 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-dd5e8515-738a-4972-a041-fe16ac5053f3 tempest-VolumesExtendTest-709449278 None] Acquiring lock "cinder-2b1dacc4-9851-4256-8db2-e7d980ff50db-delete_volume" by "delete_volume" {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 04:54:12 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-dd5e8515-738a-4972-a041-fe16ac5053f3 tempest-VolumesExtendTest-709449278 None] Lock "cinder-2b1dacc4-9851-4256-8db2-e7d980ff50db-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 04:54:12 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-dd5e8515-738a-4972-a041-fe16ac5053f3 tempest-VolumesExtendTest-709449278 None] Acquiring lock "cinder-quobyte-2b1dacc4-9851-4256-8db2-e7d980ff50db" by "delete_volume" {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 04:54:12 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-dd5e8515-738a-4972-a041-fe16ac5053f3 tempest-VolumesExtendTest-709449278 None] Lock "cinder-quobyte-2b1dacc4-9851-4256-8db2-e7d980ff50db" acquired by "delete_volume" :: waited 0.014s {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 04:54:12 devstack cinder-volume[92060]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0ab28aa-028d-4eba-9a74-331083f1a6b9]: (4, 'raw') {{(pid=93130) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 04:54:12 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-dd5e8515-738a-4972-a041-fe16ac5053f3 tempest-VolumesExtendTest-709449278 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-2b1dacc4-9851-4256-8db2-e7d980ff50db {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:54:12 devstack sudo[108189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-2b1dacc4-9851-4256-8db2-e7d980ff50db Jun 17 04:54:12 devstack sudo[108189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:54:13 devstack sudo[108189]: pam_unix(sudo:session): session closed for user root Jun 17 04:54:13 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-dd5e8515-738a-4972-a041-fe16ac5053f3 tempest-VolumesExtendTest-709449278 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-2b1dacc4-9851-4256-8db2-e7d980ff50db" returned: 0 in 0.681s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:54:13 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-dd5e8515-738a-4972-a041-fe16ac5053f3 tempest-VolumesExtendTest-709449278 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-2b1dacc4-9851-4256-8db2-e7d980ff50db {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:54:13 devstack sudo[108193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-2b1dacc4-9851-4256-8db2-e7d980ff50db Jun 17 04:54:13 devstack sudo[108193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:54:14 devstack sudo[108193]: pam_unix(sudo:session): session closed for user root Jun 17 04:54:14 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-dd5e8515-738a-4972-a041-fe16ac5053f3 tempest-VolumesExtendTest-709449278 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-2b1dacc4-9851-4256-8db2-e7d980ff50db" returned: 1 in 0.691s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:54:14 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-dd5e8515-738a-4972-a041-fe16ac5053f3 tempest-VolumesExtendTest-709449278 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-2b1dacc4-9851-4256-8db2-e7d980ff50db' failed. Not Retrying. {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 17 04:54:14 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-dd5e8515-738a-4972-a041-fe16ac5053f3 tempest-VolumesExtendTest-709449278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-2b1dacc4-9851-4256-8db2-e7d980ff50db {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:54:14 devstack sudo[108198]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-2b1dacc4-9851-4256-8db2-e7d980ff50db Jun 17 04:54:14 devstack sudo[108198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:54:14 devstack sudo[108198]: pam_unix(sudo:session): session closed for user root Jun 17 04:54:14 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-dd5e8515-738a-4972-a041-fe16ac5053f3 tempest-VolumesExtendTest-709449278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-2b1dacc4-9851-4256-8db2-e7d980ff50db" returned: 0 in 0.589s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:54:14 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-dd5e8515-738a-4972-a041-fe16ac5053f3 tempest-VolumesExtendTest-709449278 None] Lock "cinder-quobyte-2b1dacc4-9851-4256-8db2-e7d980ff50db" released by "delete_volume" :: held 2.020s {{(pid=92060) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 04:54:14 devstack cinder-volume[92060]: DEBUG cinder.quota [None req-dd5e8515-738a-4972-a041-fe16ac5053f3 tempest-VolumesExtendTest-709449278 None] Created reservations ['c2c3d7e8-70a1-405f-9343-b1b8c03f606b', '3df345bc-1fbf-420c-b8b1-c7e87dc23f33', '68966af9-ee99-4f0a-8449-f55744e8a2d6', '023d1861-c3c3-40e9-b156-6abd3ad8e81e'] {{(pid=92060) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 17 04:54:14 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-dd5e8515-738a-4972-a041-fe16ac5053f3 tempest-VolumesExtendTest-709449278 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 04:54:14 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-dd5e8515-738a-4972-a041-fe16ac5053f3 tempest-VolumesExtendTest-709449278 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 04:54:14 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-dd5e8515-738a-4972-a041-fe16ac5053f3 tempest-VolumesExtendTest-709449278 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588': None} {{(pid=92060) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 17 04:54:14 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-dd5e8515-738a-4972-a041-fe16ac5053f3 tempest-VolumesExtendTest-709449278 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588'] {{(pid=92060) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 17 04:54:14 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-dd5e8515-738a-4972-a041-fe16ac5053f3 tempest-VolumesExtendTest-709449278 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 04:54:14 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-dd5e8515-738a-4972-a041-fe16ac5053f3 tempest-VolumesExtendTest-709449278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:54:14 devstack sudo[108201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a Jun 17 04:54:14 devstack sudo[108201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:54:15 devstack sudo[108201]: pam_unix(sudo:session): session closed for user root Jun 17 04:54:15 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-dd5e8515-738a-4972-a041-fe16ac5053f3 tempest-VolumesExtendTest-709449278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a" returned: 0 in 0.592s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:54:15 devstack cinder-volume[92060]: DEBUG cinder.manager [None req-dd5e8515-738a-4972-a041-fe16ac5053f3 tempest-VolumesExtendTest-709449278 None] Notifying Schedulers of capabilities ... {{(pid=92060) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 17 04:54:15 devstack cinder-volume[92060]: INFO cinder.volume.manager [None req-dd5e8515-738a-4972-a041-fe16ac5053f3 tempest-VolumesExtendTest-709449278 None] Deleted volume successfully. Jun 17 04:54:15 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-dd5e8515-738a-4972-a041-fe16ac5053f3 tempest-VolumesExtendTest-709449278 None] Lock "cinder-2b1dacc4-9851-4256-8db2-e7d980ff50db-delete_volume" released by "delete_volume" :: held 2.801s {{(pid=92060) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 04:54:16 devstack cinder-volume[92060]: DEBUG cinder.volume.flows.manager.create_volume [None req-e5058939-eec6-4ccc-aea5-c7c2486cce73 tempest-VolumesExtendTest-709449278 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92060) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 17 04:54:16 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-e5058939-eec6-4ccc-aea5-c7c2486cce73 tempest-VolumesExtendTest-709449278 None] Flow 'volume_create_manager' (03e6707f-33f6-4f25-b9b5-bb71a7c29b3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 17 04:54:16 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-e5058939-eec6-4ccc-aea5-c7c2486cce73 tempest-VolumesExtendTest-709449278 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a944b6df-28de-4ad1-8ade-09eabd94223e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:54:16 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-e5058939-eec6-4ccc-aea5-c7c2486cce73 tempest-VolumesExtendTest-709449278 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a944b6df-28de-4ad1-8ade-09eabd94223e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-17T02:54:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1509016586',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3e4fb007-e164-45aa-a28e-355ec325725a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='40d1c93aba534bfa980c0ba21a65838a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T02:54:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T02:54:16Z,use_quota=True,user_id='f588f366383c49ce90a0b192965edcba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aad9ce24-93f9-41a6-baa1-5125964f96d1),volume_type_id=aad9ce24-93f9-41a6-baa1-5125964f96d1)' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:54:16 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-e5058939-eec6-4ccc-aea5-c7c2486cce73 tempest-VolumesExtendTest-709449278 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a2b6375a-0431-437a-bc2a-d0ae0dbd23db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:54:16 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-e5058939-eec6-4ccc-aea5-c7c2486cce73 tempest-VolumesExtendTest-709449278 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a2b6375a-0431-437a-bc2a-d0ae0dbd23db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:54:16 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-e5058939-eec6-4ccc-aea5-c7c2486cce73 tempest-VolumesExtendTest-709449278 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9e5faacd-b3aa-4921-82cb-dc1db9bc664b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:54:16 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-e5058939-eec6-4ccc-aea5-c7c2486cce73 tempest-VolumesExtendTest-709449278 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9e5faacd-b3aa-4921-82cb-dc1db9bc664b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3e4fb007-e164-45aa-a28e-355ec325725a', 'volume_name': 'volume-3e4fb007-e164-45aa-a28e-355ec325725a', 'volume_size': 1}' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:54:16 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-e5058939-eec6-4ccc-aea5-c7c2486cce73 tempest-VolumesExtendTest-709449278 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (50d8aa95-e62d-49ad-8ec8-b80257d9b3fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:54:16 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-e5058939-eec6-4ccc-aea5-c7c2486cce73 tempest-VolumesExtendTest-709449278 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (50d8aa95-e62d-49ad-8ec8-b80257d9b3fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:54:16 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-e5058939-eec6-4ccc-aea5-c7c2486cce73 tempest-VolumesExtendTest-709449278 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1786d89b-8734-43f4-8e9e-fd8aae726845) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:54:16 devstack cinder-volume[92060]: INFO cinder.volume.flows.manager.create_volume [None req-e5058939-eec6-4ccc-aea5-c7c2486cce73 tempest-VolumesExtendTest-709449278 None] Volume 3e4fb007-e164-45aa-a28e-355ec325725a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3e4fb007-e164-45aa-a28e-355ec325725a', 'volume_size': 1} Jun 17 04:54:16 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-e5058939-eec6-4ccc-aea5-c7c2486cce73 tempest-VolumesExtendTest-709449278 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 04:54:16 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-e5058939-eec6-4ccc-aea5-c7c2486cce73 tempest-VolumesExtendTest-709449278 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 04:54:16 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-e5058939-eec6-4ccc-aea5-c7c2486cce73 tempest-VolumesExtendTest-709449278 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-17T02:54:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1509016586',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3e4fb007-e164-45aa-a28e-355ec325725a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='40d1c93aba534bfa980c0ba21a65838a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T02:54:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T02:54:16Z,use_quota=True,user_id='f588f366383c49ce90a0b192965edcba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aad9ce24-93f9-41a6-baa1-5125964f96d1),volume_type_id=aad9ce24-93f9-41a6-baa1-5125964f96d1)}" {{(pid=92060) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 17 04:54:16 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.remotefs [None req-e5058939-eec6-4ccc-aea5-c7c2486cce73 tempest-VolumesExtendTest-709449278 None] Creating volume 3e4fb007-e164-45aa-a28e-355ec325725a {{(pid=92060) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 17 04:54:16 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-e5058939-eec6-4ccc-aea5-c7c2486cce73 tempest-VolumesExtendTest-709449278 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 04:54:16 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-e5058939-eec6-4ccc-aea5-c7c2486cce73 tempest-VolumesExtendTest-709449278 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 04:54:16 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-e5058939-eec6-4ccc-aea5-c7c2486cce73 tempest-VolumesExtendTest-709449278 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588': None} {{(pid=92060) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 17 04:54:16 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-e5058939-eec6-4ccc-aea5-c7c2486cce73 tempest-VolumesExtendTest-709449278 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588'] {{(pid=92060) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 17 04:54:16 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-e5058939-eec6-4ccc-aea5-c7c2486cce73 tempest-VolumesExtendTest-709449278 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 04:54:16 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-e5058939-eec6-4ccc-aea5-c7c2486cce73 tempest-VolumesExtendTest-709449278 None] Selected osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588 as target Quobyte volume. {{(pid=92060) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 17 04:54:16 devstack cinder-volume[92060]: INFO cinder.volume.drivers.remotefs [None req-e5058939-eec6-4ccc-aea5-c7c2486cce73 tempest-VolumesExtendTest-709449278 None] casted to osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588 Jun 17 04:54:16 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-e5058939-eec6-4ccc-aea5-c7c2486cce73 tempest-VolumesExtendTest-709449278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-3e4fb007-e164-45aa-a28e-355ec325725a 1073741824 {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:54:16 devstack sudo[108204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-3e4fb007-e164-45aa-a28e-355ec325725a 1073741824 Jun 17 04:54:16 devstack sudo[108204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:54:17 devstack sudo[108204]: pam_unix(sudo:session): session closed for user root Jun 17 04:54:17 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-e5058939-eec6-4ccc-aea5-c7c2486cce73 tempest-VolumesExtendTest-709449278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-3e4fb007-e164-45aa-a28e-355ec325725a 1073741824" returned: 0 in 0.741s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:54:17 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-e5058939-eec6-4ccc-aea5-c7c2486cce73 tempest-VolumesExtendTest-709449278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-3e4fb007-e164-45aa-a28e-355ec325725a {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:54:17 devstack sudo[108209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-3e4fb007-e164-45aa-a28e-355ec325725a Jun 17 04:54:17 devstack sudo[108209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:54:17 devstack sudo[108209]: pam_unix(sudo:session): session closed for user root Jun 17 04:54:17 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-e5058939-eec6-4ccc-aea5-c7c2486cce73 tempest-VolumesExtendTest-709449278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-3e4fb007-e164-45aa-a28e-355ec325725a" returned: 0 in 0.578s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:54:17 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-e5058939-eec6-4ccc-aea5-c7c2486cce73 tempest-VolumesExtendTest-709449278 None] <== create_volume: return (1362ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588'} {{(pid=92060) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 17 04:54:17 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-e5058939-eec6-4ccc-aea5-c7c2486cce73 tempest-VolumesExtendTest-709449278 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.365s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 04:54:17 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-e5058939-eec6-4ccc-aea5-c7c2486cce73 tempest-VolumesExtendTest-709449278 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1786d89b-8734-43f4-8e9e-fd8aae726845) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3e4fb007-e164-45aa-a28e-355ec325725a', 'volume_size': 1}' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:54:17 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-e5058939-eec6-4ccc-aea5-c7c2486cce73 tempest-VolumesExtendTest-709449278 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6eafaeea-19c9-47a5-82e2-43bc6170cf56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:54:17 devstack cinder-volume[92060]: INFO cinder.volume.flows.manager.create_volume [None req-e5058939-eec6-4ccc-aea5-c7c2486cce73 tempest-VolumesExtendTest-709449278 None] Volume volume-3e4fb007-e164-45aa-a28e-355ec325725a (3e4fb007-e164-45aa-a28e-355ec325725a): created successfully Jun 17 04:54:17 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-e5058939-eec6-4ccc-aea5-c7c2486cce73 tempest-VolumesExtendTest-709449278 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6eafaeea-19c9-47a5-82e2-43bc6170cf56) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:54:17 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-e5058939-eec6-4ccc-aea5-c7c2486cce73 tempest-VolumesExtendTest-709449278 None] Flow 'volume_create_manager' (03e6707f-33f6-4f25-b9b5-bb71a7c29b3f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92060) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 17 04:54:17 devstack cinder-volume[92060]: INFO cinder.volume.manager [None req-e5058939-eec6-4ccc-aea5-c7c2486cce73 tempest-VolumesExtendTest-709449278 None] Created volume successfully. Jun 17 04:54:18 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-0c07bcbc-65b9-4d37-b4c4-26149cfbc487 tempest-VolumesExtendTest-709449278 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 04:54:18 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-0c07bcbc-65b9-4d37-b4c4-26149cfbc487 tempest-VolumesExtendTest-709449278 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 04:54:18 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.remotefs [None req-0c07bcbc-65b9-4d37-b4c4-26149cfbc487 tempest-VolumesExtendTest-709449278 None] Creating offline snapshot 68733426-321d-4589-ac1f-ca2d1a8fc4b1 of volume 3e4fb007-e164-45aa-a28e-355ec325725a {{(pid=92060) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 17 04:54:18 devstack cinder-volume[92060]: DEBUG oslo.privsep.daemon [-] privsep: reply[87f67073-03fc-456e-8897-13bcf83b09cd]: (4, 'qcow2') {{(pid=93130) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 04:54:18 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-0c07bcbc-65b9-4d37-b4c4-26149cfbc487 tempest-VolumesExtendTest-709449278 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-3e4fb007-e164-45aa-a28e-355ec325725a {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:54:18 devstack sudo[108212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-3e4fb007-e164-45aa-a28e-355ec325725a Jun 17 04:54:18 devstack sudo[108212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:54:19 devstack sudo[108212]: pam_unix(sudo:session): session closed for user root Jun 17 04:54:19 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-0c07bcbc-65b9-4d37-b4c4-26149cfbc487 tempest-VolumesExtendTest-709449278 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-3e4fb007-e164-45aa-a28e-355ec325725a" returned: 0 in 0.694s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:54:19 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-0c07bcbc-65b9-4d37-b4c4-26149cfbc487 tempest-VolumesExtendTest-709449278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-3e4fb007-e164-45aa-a28e-355ec325725a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-3e4fb007-e164-45aa-a28e-355ec325725a.68733426-321d-4589-ac1f-ca2d1a8fc4b1 1G {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:54:19 devstack sudo[108218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-3e4fb007-e164-45aa-a28e-355ec325725a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-3e4fb007-e164-45aa-a28e-355ec325725a.68733426-321d-4589-ac1f-ca2d1a8fc4b1 1G Jun 17 04:54:19 devstack sudo[108218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:54:20 devstack sudo[108218]: pam_unix(sudo:session): session closed for user root Jun 17 04:54:20 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-0c07bcbc-65b9-4d37-b4c4-26149cfbc487 tempest-VolumesExtendTest-709449278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-3e4fb007-e164-45aa-a28e-355ec325725a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-3e4fb007-e164-45aa-a28e-355ec325725a.68733426-321d-4589-ac1f-ca2d1a8fc4b1 1G" returned: 0 in 0.730s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:54:20 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-0c07bcbc-65b9-4d37-b4c4-26149cfbc487 tempest-VolumesExtendTest-709449278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3e4fb007-e164-45aa-a28e-355ec325725a -F qcow2 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-3e4fb007-e164-45aa-a28e-355ec325725a.68733426-321d-4589-ac1f-ca2d1a8fc4b1 {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:54:20 devstack sudo[108224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3e4fb007-e164-45aa-a28e-355ec325725a -F qcow2 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-3e4fb007-e164-45aa-a28e-355ec325725a.68733426-321d-4589-ac1f-ca2d1a8fc4b1 Jun 17 04:54:20 devstack sudo[108224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:54:20 devstack sudo[108224]: pam_unix(sudo:session): session closed for user root Jun 17 04:54:20 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-0c07bcbc-65b9-4d37-b4c4-26149cfbc487 tempest-VolumesExtendTest-709449278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3e4fb007-e164-45aa-a28e-355ec325725a -F qcow2 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-3e4fb007-e164-45aa-a28e-355ec325725a.68733426-321d-4589-ac1f-ca2d1a8fc4b1" returned: 0 in 0.627s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:54:20 devstack cinder-volume[92060]: WARNING cinder.volume.drivers.remotefs [None req-0c07bcbc-65b9-4d37-b4c4-26149cfbc487 tempest-VolumesExtendTest-709449278 None] /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-3e4fb007-e164-45aa-a28e-355ec325725a.68733426-321d-4589-ac1f-ca2d1a8fc4b1 is being set with open permissions: ugo+rw Jun 17 04:54:20 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-0c07bcbc-65b9-4d37-b4c4-26149cfbc487 tempest-VolumesExtendTest-709449278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-3e4fb007-e164-45aa-a28e-355ec325725a.68733426-321d-4589-ac1f-ca2d1a8fc4b1 {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:54:20 devstack sudo[108229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-3e4fb007-e164-45aa-a28e-355ec325725a.68733426-321d-4589-ac1f-ca2d1a8fc4b1 Jun 17 04:54:20 devstack sudo[108229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:54:21 devstack sudo[108229]: pam_unix(sudo:session): session closed for user root Jun 17 04:54:21 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-0c07bcbc-65b9-4d37-b4c4-26149cfbc487 tempest-VolumesExtendTest-709449278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-3e4fb007-e164-45aa-a28e-355ec325725a.68733426-321d-4589-ac1f-ca2d1a8fc4b1" returned: 0 in 0.575s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:54:21 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-0c07bcbc-65b9-4d37-b4c4-26149cfbc487 tempest-VolumesExtendTest-709449278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-3e4fb007-e164-45aa-a28e-355ec325725a.info {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:54:21 devstack sudo[108233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-3e4fb007-e164-45aa-a28e-355ec325725a.info Jun 17 04:54:21 devstack sudo[108233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:54:21 devstack sudo[108233]: pam_unix(sudo:session): session closed for user root Jun 17 04:54:21 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-0c07bcbc-65b9-4d37-b4c4-26149cfbc487 tempest-VolumesExtendTest-709449278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-3e4fb007-e164-45aa-a28e-355ec325725a.info" returned: 0 in 0.583s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:54:21 devstack cinder-volume[92060]: WARNING cinder.volume.drivers.remotefs [None req-0c07bcbc-65b9-4d37-b4c4-26149cfbc487 tempest-VolumesExtendTest-709449278 None] /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-3e4fb007-e164-45aa-a28e-355ec325725a.info is being set with open permissions: ugo+rw Jun 17 04:54:21 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-0c07bcbc-65b9-4d37-b4c4-26149cfbc487 tempest-VolumesExtendTest-709449278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-3e4fb007-e164-45aa-a28e-355ec325725a.info {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:54:21 devstack sudo[108238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-3e4fb007-e164-45aa-a28e-355ec325725a.info Jun 17 04:54:21 devstack sudo[108238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:54:22 devstack sudo[108238]: pam_unix(sudo:session): session closed for user root Jun 17 04:54:22 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-0c07bcbc-65b9-4d37-b4c4-26149cfbc487 tempest-VolumesExtendTest-709449278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-3e4fb007-e164-45aa-a28e-355ec325725a.info" returned: 0 in 0.575s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:54:22 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-0c07bcbc-65b9-4d37-b4c4-26149cfbc487 tempest-VolumesExtendTest-709449278 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.863s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 04:54:22 devstack cinder-volume[92060]: INFO cinder.volume.manager [None req-0c07bcbc-65b9-4d37-b4c4-26149cfbc487 tempest-VolumesExtendTest-709449278 None] Create snapshot completed successfully Jun 17 04:54:22 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-22890167-78e0-4937-942d-baae615bae5d tempest-VolumesExtendTest-709449278 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 04:54:22 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-22890167-78e0-4937-942d-baae615bae5d tempest-VolumesExtendTest-709449278 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.001s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 04:54:22 devstack cinder-volume[92060]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e2b0ceb-7108-451d-81b6-5a93bdd60355]: (4, 'qcow2') {{(pid=93130) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 04:54:22 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-22890167-78e0-4937-942d-baae615bae5d tempest-VolumesExtendTest-709449278 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-3e4fb007-e164-45aa-a28e-355ec325725a {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:54:22 devstack sudo[108242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-3e4fb007-e164-45aa-a28e-355ec325725a Jun 17 04:54:22 devstack sudo[108242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:54:23 devstack sudo[108242]: pam_unix(sudo:session): session closed for user root Jun 17 04:54:23 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-22890167-78e0-4937-942d-baae615bae5d tempest-VolumesExtendTest-709449278 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-3e4fb007-e164-45aa-a28e-355ec325725a" returned: 0 in 0.684s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:54:23 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-22890167-78e0-4937-942d-baae615bae5d tempest-VolumesExtendTest-709449278 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-3e4fb007-e164-45aa-a28e-355ec325725a.68733426-321d-4589-ac1f-ca2d1a8fc4b1 2G {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:54:23 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-22890167-78e0-4937-942d-baae615bae5d tempest-VolumesExtendTest-709449278 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-3e4fb007-e164-45aa-a28e-355ec325725a.68733426-321d-4589-ac1f-ca2d1a8fc4b1 2G" returned: 0 in 0.112s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:54:23 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-22890167-78e0-4937-942d-baae615bae5d tempest-VolumesExtendTest-709449278 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.827s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 04:54:23 devstack cinder-volume[92060]: INFO cinder.volume.manager [None req-22890167-78e0-4937-942d-baae615bae5d tempest-VolumesExtendTest-709449278 None] Extend volume completed successfully. Jun 17 04:54:24 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-fb78dc2a-7d3b-4dba-bab6-656f70179441 tempest-VolumesExtendTest-709449278 None] Acquiring lock "cinder-68733426-321d-4589-ac1f-ca2d1a8fc4b1-delete_snapshot" by "delete_snapshot" {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 04:54:24 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-fb78dc2a-7d3b-4dba-bab6-656f70179441 tempest-VolumesExtendTest-709449278 None] Lock "cinder-68733426-321d-4589-ac1f-ca2d1a8fc4b1-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 04:54:24 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-fb78dc2a-7d3b-4dba-bab6-656f70179441 tempest-VolumesExtendTest-709449278 None] Acquiring lock "cinder-quobyte-3e4fb007-e164-45aa-a28e-355ec325725a" by "delete_snapshot" {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 04:54:24 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-fb78dc2a-7d3b-4dba-bab6-656f70179441 tempest-VolumesExtendTest-709449278 None] Lock "cinder-quobyte-3e4fb007-e164-45aa-a28e-355ec325725a" acquired by "delete_snapshot" :: waited 0.015s {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 04:54:24 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-fb78dc2a-7d3b-4dba-bab6-656f70179441 tempest-VolumesExtendTest-709449278 None] Acquiring lock "cinder-quobyte-68733426-321d-4589-ac1f-ca2d1a8fc4b1" by "_delete_snapshot" {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 04:54:24 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-fb78dc2a-7d3b-4dba-bab6-656f70179441 tempest-VolumesExtendTest-709449278 None] Lock "cinder-quobyte-68733426-321d-4589-ac1f-ca2d1a8fc4b1" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 04:54:24 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.remotefs [None req-fb78dc2a-7d3b-4dba-bab6-656f70179441 tempest-VolumesExtendTest-709449278 None] Deleting offline snapshot 68733426-321d-4589-ac1f-ca2d1a8fc4b1 of volume 3e4fb007-e164-45aa-a28e-355ec325725a {{(pid=92060) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 17 04:54:24 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.remotefs [None req-fb78dc2a-7d3b-4dba-bab6-656f70179441 tempest-VolumesExtendTest-709449278 None] snapshot_file for this snap is: volume-3e4fb007-e164-45aa-a28e-355ec325725a.68733426-321d-4589-ac1f-ca2d1a8fc4b1 {{(pid=92060) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 17 04:54:24 devstack cinder-volume[92060]: DEBUG oslo.privsep.daemon [-] privsep: reply[964f82f1-528c-4455-91aa-df64ea0d566b]: (4, 'qcow2') {{(pid=93130) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 04:54:24 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-fb78dc2a-7d3b-4dba-bab6-656f70179441 tempest-VolumesExtendTest-709449278 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-3e4fb007-e164-45aa-a28e-355ec325725a.68733426-321d-4589-ac1f-ca2d1a8fc4b1 {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:54:24 devstack sudo[108250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-3e4fb007-e164-45aa-a28e-355ec325725a.68733426-321d-4589-ac1f-ca2d1a8fc4b1 Jun 17 04:54:24 devstack sudo[108250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:54:24 devstack sudo[108250]: pam_unix(sudo:session): session closed for user root Jun 17 04:54:24 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-fb78dc2a-7d3b-4dba-bab6-656f70179441 tempest-VolumesExtendTest-709449278 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-3e4fb007-e164-45aa-a28e-355ec325725a.68733426-321d-4589-ac1f-ca2d1a8fc4b1" returned: 0 in 0.670s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:54:24 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.remotefs [None req-fb78dc2a-7d3b-4dba-bab6-656f70179441 tempest-VolumesExtendTest-709449278 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3e4fb007-e164-45aa-a28e-355ec325725a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=92060) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 17 04:54:24 devstack cinder-volume[92060]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ed478a5-ea4a-49db-a335-82767ffd5a20]: (4, 'qcow2') {{(pid=93130) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 04:54:24 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-fb78dc2a-7d3b-4dba-bab6-656f70179441 tempest-VolumesExtendTest-709449278 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-3e4fb007-e164-45aa-a28e-355ec325725a {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:54:24 devstack sudo[108255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-3e4fb007-e164-45aa-a28e-355ec325725a Jun 17 04:54:24 devstack sudo[108255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:54:25 devstack sudo[108255]: pam_unix(sudo:session): session closed for user root Jun 17 04:54:25 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-fb78dc2a-7d3b-4dba-bab6-656f70179441 tempest-VolumesExtendTest-709449278 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-3e4fb007-e164-45aa-a28e-355ec325725a" returned: 0 in 0.688s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:54:25 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-fb78dc2a-7d3b-4dba-bab6-656f70179441 tempest-VolumesExtendTest-709449278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-3e4fb007-e164-45aa-a28e-355ec325725a.68733426-321d-4589-ac1f-ca2d1a8fc4b1 {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:54:25 devstack sudo[108294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-3e4fb007-e164-45aa-a28e-355ec325725a.68733426-321d-4589-ac1f-ca2d1a8fc4b1 Jun 17 04:54:25 devstack sudo[108294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:54:26 devstack sudo[108294]: pam_unix(sudo:session): session closed for user root Jun 17 04:54:26 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-fb78dc2a-7d3b-4dba-bab6-656f70179441 tempest-VolumesExtendTest-709449278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-3e4fb007-e164-45aa-a28e-355ec325725a.68733426-321d-4589-ac1f-ca2d1a8fc4b1" returned: 0 in 0.709s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:54:26 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-fb78dc2a-7d3b-4dba-bab6-656f70179441 tempest-VolumesExtendTest-709449278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-3e4fb007-e164-45aa-a28e-355ec325725a.68733426-321d-4589-ac1f-ca2d1a8fc4b1 {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:54:26 devstack sudo[108301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-3e4fb007-e164-45aa-a28e-355ec325725a.68733426-321d-4589-ac1f-ca2d1a8fc4b1 Jun 17 04:54:26 devstack sudo[108301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:54:26 devstack sudo[108301]: pam_unix(sudo:session): session closed for user root Jun 17 04:54:26 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-fb78dc2a-7d3b-4dba-bab6-656f70179441 tempest-VolumesExtendTest-709449278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-3e4fb007-e164-45aa-a28e-355ec325725a.68733426-321d-4589-ac1f-ca2d1a8fc4b1" returned: 0 in 0.572s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:54:26 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-fb78dc2a-7d3b-4dba-bab6-656f70179441 tempest-VolumesExtendTest-709449278 None] Lock "cinder-quobyte-68733426-321d-4589-ac1f-ca2d1a8fc4b1" released by "_delete_snapshot" :: held 2.732s {{(pid=92060) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 04:54:26 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-fb78dc2a-7d3b-4dba-bab6-656f70179441 tempest-VolumesExtendTest-709449278 None] Lock "cinder-quobyte-3e4fb007-e164-45aa-a28e-355ec325725a" released by "delete_snapshot" :: held 2.754s {{(pid=92060) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 04:54:26 devstack cinder-volume[92060]: DEBUG cinder.quota [None req-fb78dc2a-7d3b-4dba-bab6-656f70179441 tempest-VolumesExtendTest-709449278 None] Created reservations ['528e157a-783f-4b3a-8fb0-62914da95cbc', '1992d9c5-e9da-463d-8934-b4c536101d4f', '11e035c2-c672-4030-9d1b-d43b5f506548', '3ebc5dc6-9410-4cd5-a91b-3fba4559d6c0'] {{(pid=92060) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 17 04:54:26 devstack cinder-volume[92060]: INFO cinder.volume.manager [None req-fb78dc2a-7d3b-4dba-bab6-656f70179441 tempest-VolumesExtendTest-709449278 None] Delete snapshot completed successfully. Jun 17 04:54:26 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-fb78dc2a-7d3b-4dba-bab6-656f70179441 tempest-VolumesExtendTest-709449278 None] Lock "cinder-68733426-321d-4589-ac1f-ca2d1a8fc4b1-delete_snapshot" released by "delete_snapshot" :: held 2.880s {{(pid=92060) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 04:54:27 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-595cd7fb-c564-4161-bf2d-39b3ae3c0171 tempest-VolumesExtendTest-709449278 None] Acquiring lock "cinder-3e4fb007-e164-45aa-a28e-355ec325725a-delete_volume" by "delete_volume" {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 04:54:27 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-595cd7fb-c564-4161-bf2d-39b3ae3c0171 tempest-VolumesExtendTest-709449278 None] Lock "cinder-3e4fb007-e164-45aa-a28e-355ec325725a-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 04:54:27 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-595cd7fb-c564-4161-bf2d-39b3ae3c0171 tempest-VolumesExtendTest-709449278 None] Acquiring lock "cinder-quobyte-3e4fb007-e164-45aa-a28e-355ec325725a" by "delete_volume" {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 04:54:27 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-595cd7fb-c564-4161-bf2d-39b3ae3c0171 tempest-VolumesExtendTest-709449278 None] Lock "cinder-quobyte-3e4fb007-e164-45aa-a28e-355ec325725a" acquired by "delete_volume" :: waited 0.018s {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 04:54:27 devstack cinder-volume[92060]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb9b7185-2e87-4639-b4bf-cabf68cea72f]: (4, 'qcow2') {{(pid=93130) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 04:54:27 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-595cd7fb-c564-4161-bf2d-39b3ae3c0171 tempest-VolumesExtendTest-709449278 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-3e4fb007-e164-45aa-a28e-355ec325725a {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:54:27 devstack sudo[108304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-3e4fb007-e164-45aa-a28e-355ec325725a Jun 17 04:54:27 devstack sudo[108304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:54:28 devstack sudo[108304]: pam_unix(sudo:session): session closed for user root Jun 17 04:54:28 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-595cd7fb-c564-4161-bf2d-39b3ae3c0171 tempest-VolumesExtendTest-709449278 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-3e4fb007-e164-45aa-a28e-355ec325725a" returned: 0 in 0.680s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:54:28 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-595cd7fb-c564-4161-bf2d-39b3ae3c0171 tempest-VolumesExtendTest-709449278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-3e4fb007-e164-45aa-a28e-355ec325725a {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:54:28 devstack sudo[108309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-3e4fb007-e164-45aa-a28e-355ec325725a Jun 17 04:54:28 devstack sudo[108309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:54:28 devstack sudo[108309]: pam_unix(sudo:session): session closed for user root Jun 17 04:54:28 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-595cd7fb-c564-4161-bf2d-39b3ae3c0171 tempest-VolumesExtendTest-709449278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-3e4fb007-e164-45aa-a28e-355ec325725a" returned: 0 in 0.585s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:54:28 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-595cd7fb-c564-4161-bf2d-39b3ae3c0171 tempest-VolumesExtendTest-709449278 None] Lock "cinder-quobyte-3e4fb007-e164-45aa-a28e-355ec325725a" released by "delete_volume" :: held 1.317s {{(pid=92060) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 04:54:28 devstack cinder-volume[92060]: DEBUG cinder.quota [None req-595cd7fb-c564-4161-bf2d-39b3ae3c0171 tempest-VolumesExtendTest-709449278 None] Created reservations ['59db1e37-64fa-4c09-a156-c6aa0454fb4f', '8725d479-0b57-45ef-b0a9-2710c9bfd785', '2fda5be8-aff6-4443-b057-663dd8737130', '1723f0d7-7d1c-4933-81af-7efd0fc66d10'] {{(pid=92060) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 17 04:54:28 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-595cd7fb-c564-4161-bf2d-39b3ae3c0171 tempest-VolumesExtendTest-709449278 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 04:54:28 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-595cd7fb-c564-4161-bf2d-39b3ae3c0171 tempest-VolumesExtendTest-709449278 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 04:54:28 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-595cd7fb-c564-4161-bf2d-39b3ae3c0171 tempest-VolumesExtendTest-709449278 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588': None} {{(pid=92060) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 17 04:54:28 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-595cd7fb-c564-4161-bf2d-39b3ae3c0171 tempest-VolumesExtendTest-709449278 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588'] {{(pid=92060) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 17 04:54:28 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-595cd7fb-c564-4161-bf2d-39b3ae3c0171 tempest-VolumesExtendTest-709449278 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 04:54:28 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-595cd7fb-c564-4161-bf2d-39b3ae3c0171 tempest-VolumesExtendTest-709449278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:54:28 devstack sudo[108312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a Jun 17 04:54:28 devstack sudo[108312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:54:29 devstack sudo[108312]: pam_unix(sudo:session): session closed for user root Jun 17 04:54:29 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-595cd7fb-c564-4161-bf2d-39b3ae3c0171 tempest-VolumesExtendTest-709449278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a" returned: 0 in 0.592s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:54:29 devstack cinder-volume[92060]: DEBUG cinder.manager [None req-595cd7fb-c564-4161-bf2d-39b3ae3c0171 tempest-VolumesExtendTest-709449278 None] Notifying Schedulers of capabilities ... {{(pid=92060) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 17 04:54:29 devstack cinder-volume[92060]: INFO cinder.volume.manager [None req-595cd7fb-c564-4161-bf2d-39b3ae3c0171 tempest-VolumesExtendTest-709449278 None] Deleted volume successfully. Jun 17 04:54:29 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-595cd7fb-c564-4161-bf2d-39b3ae3c0171 tempest-VolumesExtendTest-709449278 None] Lock "cinder-3e4fb007-e164-45aa-a28e-355ec325725a-delete_volume" released by "delete_volume" :: held 2.088s {{(pid=92060) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 04:54:31 devstack cinder-volume[92060]: DEBUG cinder.volume.flows.manager.create_volume [None req-df4ca960-3b18-4a2f-b875-0e082df85719 tempest-VolumesSnapshotListTestJSON-1537392379 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92060) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 17 04:54:31 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-df4ca960-3b18-4a2f-b875-0e082df85719 tempest-VolumesSnapshotListTestJSON-1537392379 None] Flow 'volume_create_manager' (84f995f0-02aa-44df-82a6-1fdf35038253) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 17 04:54:31 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-df4ca960-3b18-4a2f-b875-0e082df85719 tempest-VolumesSnapshotListTestJSON-1537392379 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0f559372-f13a-4095-baf4-d014bc855f04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:54:31 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-df4ca960-3b18-4a2f-b875-0e082df85719 tempest-VolumesSnapshotListTestJSON-1537392379 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0f559372-f13a-4095-baf4-d014bc855f04) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-17T02:54:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-295457889',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1e21cb6a-00e1-4f78-9900-752098383a44,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='22f186318fc0489bb7497d71457eed73',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T02:54:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T02:54:32Z,use_quota=True,user_id='1c7702033b8a4c78b5c7096e3ccb2617',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aad9ce24-93f9-41a6-baa1-5125964f96d1),volume_type_id=aad9ce24-93f9-41a6-baa1-5125964f96d1)' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:54:31 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-df4ca960-3b18-4a2f-b875-0e082df85719 tempest-VolumesSnapshotListTestJSON-1537392379 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (62185efe-33f9-477a-a174-5f2643d5e6c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:54:31 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-df4ca960-3b18-4a2f-b875-0e082df85719 tempest-VolumesSnapshotListTestJSON-1537392379 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (62185efe-33f9-477a-a174-5f2643d5e6c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:54:31 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-df4ca960-3b18-4a2f-b875-0e082df85719 tempest-VolumesSnapshotListTestJSON-1537392379 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (35690b62-8e0a-47ae-a41c-0bfa3bb86767) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:54:31 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-df4ca960-3b18-4a2f-b875-0e082df85719 tempest-VolumesSnapshotListTestJSON-1537392379 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (35690b62-8e0a-47ae-a41c-0bfa3bb86767) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1e21cb6a-00e1-4f78-9900-752098383a44', 'volume_name': 'volume-1e21cb6a-00e1-4f78-9900-752098383a44', 'volume_size': 1}' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:54:31 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-df4ca960-3b18-4a2f-b875-0e082df85719 tempest-VolumesSnapshotListTestJSON-1537392379 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3bf759d6-6e1d-41a4-874b-5559921d6d3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:54:31 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-df4ca960-3b18-4a2f-b875-0e082df85719 tempest-VolumesSnapshotListTestJSON-1537392379 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3bf759d6-6e1d-41a4-874b-5559921d6d3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:54:31 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-df4ca960-3b18-4a2f-b875-0e082df85719 tempest-VolumesSnapshotListTestJSON-1537392379 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2782673e-5293-4282-9971-a0622b019ecf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:54:31 devstack cinder-volume[92060]: INFO cinder.volume.flows.manager.create_volume [None req-df4ca960-3b18-4a2f-b875-0e082df85719 tempest-VolumesSnapshotListTestJSON-1537392379 None] Volume 1e21cb6a-00e1-4f78-9900-752098383a44: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1e21cb6a-00e1-4f78-9900-752098383a44', 'volume_size': 1} Jun 17 04:54:31 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-df4ca960-3b18-4a2f-b875-0e082df85719 tempest-VolumesSnapshotListTestJSON-1537392379 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 04:54:31 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-df4ca960-3b18-4a2f-b875-0e082df85719 tempest-VolumesSnapshotListTestJSON-1537392379 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 04:54:31 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-df4ca960-3b18-4a2f-b875-0e082df85719 tempest-VolumesSnapshotListTestJSON-1537392379 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-17T02:54:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-295457889',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1e21cb6a-00e1-4f78-9900-752098383a44,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='22f186318fc0489bb7497d71457eed73',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T02:54:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T02:54:32Z,use_quota=True,user_id='1c7702033b8a4c78b5c7096e3ccb2617',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aad9ce24-93f9-41a6-baa1-5125964f96d1),volume_type_id=aad9ce24-93f9-41a6-baa1-5125964f96d1)}" {{(pid=92060) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 17 04:54:31 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.remotefs [None req-df4ca960-3b18-4a2f-b875-0e082df85719 tempest-VolumesSnapshotListTestJSON-1537392379 None] Creating volume 1e21cb6a-00e1-4f78-9900-752098383a44 {{(pid=92060) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 17 04:54:31 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-df4ca960-3b18-4a2f-b875-0e082df85719 tempest-VolumesSnapshotListTestJSON-1537392379 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 04:54:31 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-df4ca960-3b18-4a2f-b875-0e082df85719 tempest-VolumesSnapshotListTestJSON-1537392379 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 04:54:31 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-df4ca960-3b18-4a2f-b875-0e082df85719 tempest-VolumesSnapshotListTestJSON-1537392379 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588': None} {{(pid=92060) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 17 04:54:31 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-df4ca960-3b18-4a2f-b875-0e082df85719 tempest-VolumesSnapshotListTestJSON-1537392379 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588'] {{(pid=92060) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 17 04:54:31 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-df4ca960-3b18-4a2f-b875-0e082df85719 tempest-VolumesSnapshotListTestJSON-1537392379 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 04:54:31 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-df4ca960-3b18-4a2f-b875-0e082df85719 tempest-VolumesSnapshotListTestJSON-1537392379 None] Selected osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588 as target Quobyte volume. {{(pid=92060) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 17 04:54:31 devstack cinder-volume[92060]: INFO cinder.volume.drivers.remotefs [None req-df4ca960-3b18-4a2f-b875-0e082df85719 tempest-VolumesSnapshotListTestJSON-1537392379 None] casted to osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588 Jun 17 04:54:31 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-df4ca960-3b18-4a2f-b875-0e082df85719 tempest-VolumesSnapshotListTestJSON-1537392379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-1e21cb6a-00e1-4f78-9900-752098383a44 1073741824 {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:54:31 devstack sudo[108316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-1e21cb6a-00e1-4f78-9900-752098383a44 1073741824 Jun 17 04:54:31 devstack sudo[108316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:54:32 devstack sudo[108316]: pam_unix(sudo:session): session closed for user root Jun 17 04:54:32 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-df4ca960-3b18-4a2f-b875-0e082df85719 tempest-VolumesSnapshotListTestJSON-1537392379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-1e21cb6a-00e1-4f78-9900-752098383a44 1073741824" returned: 0 in 0.745s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:54:32 devstack cinder-volume[92060]: DEBUG dbcounter [-] [92060] Writing DB stats cinder:SELECT=50,cinder:UPDATE=45,cinder:INSERT=16,cinder:DELETE=5 {{(pid=92060) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 17 04:54:32 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-df4ca960-3b18-4a2f-b875-0e082df85719 tempest-VolumesSnapshotListTestJSON-1537392379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-1e21cb6a-00e1-4f78-9900-752098383a44 {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:54:32 devstack sudo[108321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-1e21cb6a-00e1-4f78-9900-752098383a44 Jun 17 04:54:32 devstack sudo[108321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:54:33 devstack sudo[108321]: pam_unix(sudo:session): session closed for user root Jun 17 04:54:33 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-df4ca960-3b18-4a2f-b875-0e082df85719 tempest-VolumesSnapshotListTestJSON-1537392379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-1e21cb6a-00e1-4f78-9900-752098383a44" returned: 0 in 0.583s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:54:33 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-df4ca960-3b18-4a2f-b875-0e082df85719 tempest-VolumesSnapshotListTestJSON-1537392379 None] <== create_volume: return (1368ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588'} {{(pid=92060) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 17 04:54:33 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-df4ca960-3b18-4a2f-b875-0e082df85719 tempest-VolumesSnapshotListTestJSON-1537392379 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.370s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 04:54:33 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-df4ca960-3b18-4a2f-b875-0e082df85719 tempest-VolumesSnapshotListTestJSON-1537392379 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2782673e-5293-4282-9971-a0622b019ecf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1e21cb6a-00e1-4f78-9900-752098383a44', 'volume_size': 1}' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:54:33 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-df4ca960-3b18-4a2f-b875-0e082df85719 tempest-VolumesSnapshotListTestJSON-1537392379 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (00eeec2c-288f-47da-bdc7-b059b9ee961e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:54:33 devstack cinder-volume[92060]: INFO cinder.volume.flows.manager.create_volume [None req-df4ca960-3b18-4a2f-b875-0e082df85719 tempest-VolumesSnapshotListTestJSON-1537392379 None] Volume volume-1e21cb6a-00e1-4f78-9900-752098383a44 (1e21cb6a-00e1-4f78-9900-752098383a44): created successfully Jun 17 04:54:33 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-df4ca960-3b18-4a2f-b875-0e082df85719 tempest-VolumesSnapshotListTestJSON-1537392379 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (00eeec2c-288f-47da-bdc7-b059b9ee961e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:54:33 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-df4ca960-3b18-4a2f-b875-0e082df85719 tempest-VolumesSnapshotListTestJSON-1537392379 None] Flow 'volume_create_manager' (84f995f0-02aa-44df-82a6-1fdf35038253) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92060) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 17 04:54:33 devstack cinder-volume[92060]: INFO cinder.volume.manager [None req-df4ca960-3b18-4a2f-b875-0e082df85719 tempest-VolumesSnapshotListTestJSON-1537392379 None] Created volume successfully. Jun 17 04:54:34 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-3d4369ee-ef57-4ede-86d6-5b9f63a6ffc0 tempest-VolumesSnapshotListTestJSON-1537392379 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 04:54:34 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-3d4369ee-ef57-4ede-86d6-5b9f63a6ffc0 tempest-VolumesSnapshotListTestJSON-1537392379 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 04:54:34 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.remotefs [None req-3d4369ee-ef57-4ede-86d6-5b9f63a6ffc0 tempest-VolumesSnapshotListTestJSON-1537392379 None] Creating offline snapshot 8311280e-dae3-4562-a75c-0e7b555e42f4 of volume 1e21cb6a-00e1-4f78-9900-752098383a44 {{(pid=92060) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 17 04:54:34 devstack cinder-volume[92060]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d1b2378-d0c1-4d67-adc1-bbabc61ba72b]: (4, 'qcow2') {{(pid=93130) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 04:54:34 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-3d4369ee-ef57-4ede-86d6-5b9f63a6ffc0 tempest-VolumesSnapshotListTestJSON-1537392379 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-1e21cb6a-00e1-4f78-9900-752098383a44 {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:54:34 devstack sudo[108324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-1e21cb6a-00e1-4f78-9900-752098383a44 Jun 17 04:54:34 devstack sudo[108324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:54:34 devstack sudo[108324]: pam_unix(sudo:session): session closed for user root Jun 17 04:54:34 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-3d4369ee-ef57-4ede-86d6-5b9f63a6ffc0 tempest-VolumesSnapshotListTestJSON-1537392379 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-1e21cb6a-00e1-4f78-9900-752098383a44" returned: 0 in 0.679s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:54:34 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-3d4369ee-ef57-4ede-86d6-5b9f63a6ffc0 tempest-VolumesSnapshotListTestJSON-1537392379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-1e21cb6a-00e1-4f78-9900-752098383a44,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-1e21cb6a-00e1-4f78-9900-752098383a44.8311280e-dae3-4562-a75c-0e7b555e42f4 1G {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:54:34 devstack sudo[108329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-1e21cb6a-00e1-4f78-9900-752098383a44,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-1e21cb6a-00e1-4f78-9900-752098383a44.8311280e-dae3-4562-a75c-0e7b555e42f4 1G Jun 17 04:54:34 devstack sudo[108329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:54:35 devstack sudo[108329]: pam_unix(sudo:session): session closed for user root Jun 17 04:54:35 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-3d4369ee-ef57-4ede-86d6-5b9f63a6ffc0 tempest-VolumesSnapshotListTestJSON-1537392379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-1e21cb6a-00e1-4f78-9900-752098383a44,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-1e21cb6a-00e1-4f78-9900-752098383a44.8311280e-dae3-4562-a75c-0e7b555e42f4 1G" returned: 0 in 0.755s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:54:35 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-3d4369ee-ef57-4ede-86d6-5b9f63a6ffc0 tempest-VolumesSnapshotListTestJSON-1537392379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1e21cb6a-00e1-4f78-9900-752098383a44 -F qcow2 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-1e21cb6a-00e1-4f78-9900-752098383a44.8311280e-dae3-4562-a75c-0e7b555e42f4 {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:54:35 devstack sudo[108334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1e21cb6a-00e1-4f78-9900-752098383a44 -F qcow2 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-1e21cb6a-00e1-4f78-9900-752098383a44.8311280e-dae3-4562-a75c-0e7b555e42f4 Jun 17 04:54:35 devstack sudo[108334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:54:36 devstack sudo[108334]: pam_unix(sudo:session): session closed for user root Jun 17 04:54:36 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-3d4369ee-ef57-4ede-86d6-5b9f63a6ffc0 tempest-VolumesSnapshotListTestJSON-1537392379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1e21cb6a-00e1-4f78-9900-752098383a44 -F qcow2 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-1e21cb6a-00e1-4f78-9900-752098383a44.8311280e-dae3-4562-a75c-0e7b555e42f4" returned: 0 in 0.627s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:54:36 devstack cinder-volume[92060]: WARNING cinder.volume.drivers.remotefs [None req-3d4369ee-ef57-4ede-86d6-5b9f63a6ffc0 tempest-VolumesSnapshotListTestJSON-1537392379 None] /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-1e21cb6a-00e1-4f78-9900-752098383a44.8311280e-dae3-4562-a75c-0e7b555e42f4 is being set with open permissions: ugo+rw Jun 17 04:54:36 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-3d4369ee-ef57-4ede-86d6-5b9f63a6ffc0 tempest-VolumesSnapshotListTestJSON-1537392379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-1e21cb6a-00e1-4f78-9900-752098383a44.8311280e-dae3-4562-a75c-0e7b555e42f4 {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:54:36 devstack sudo[108340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-1e21cb6a-00e1-4f78-9900-752098383a44.8311280e-dae3-4562-a75c-0e7b555e42f4 Jun 17 04:54:36 devstack sudo[108340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:54:36 devstack sudo[108340]: pam_unix(sudo:session): session closed for user root Jun 17 04:54:36 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-3d4369ee-ef57-4ede-86d6-5b9f63a6ffc0 tempest-VolumesSnapshotListTestJSON-1537392379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-1e21cb6a-00e1-4f78-9900-752098383a44.8311280e-dae3-4562-a75c-0e7b555e42f4" returned: 0 in 0.586s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:54:36 devstack cinder-volume[92060]: DEBUG dbcounter [-] [92060] Writing DB stats cinder:UPDATE=50,cinder:SELECT=39,cinder:INSERT=17,cinder:DELETE=1 {{(pid=92060) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 17 04:54:36 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-3d4369ee-ef57-4ede-86d6-5b9f63a6ffc0 tempest-VolumesSnapshotListTestJSON-1537392379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-1e21cb6a-00e1-4f78-9900-752098383a44.info {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:54:36 devstack sudo[108343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-1e21cb6a-00e1-4f78-9900-752098383a44.info Jun 17 04:54:36 devstack sudo[108343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:54:37 devstack sudo[108343]: pam_unix(sudo:session): session closed for user root Jun 17 04:54:37 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-3d4369ee-ef57-4ede-86d6-5b9f63a6ffc0 tempest-VolumesSnapshotListTestJSON-1537392379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-1e21cb6a-00e1-4f78-9900-752098383a44.info" returned: 0 in 0.601s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:54:37 devstack cinder-volume[92060]: WARNING cinder.volume.drivers.remotefs [None req-3d4369ee-ef57-4ede-86d6-5b9f63a6ffc0 tempest-VolumesSnapshotListTestJSON-1537392379 None] /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-1e21cb6a-00e1-4f78-9900-752098383a44.info is being set with open permissions: ugo+rw Jun 17 04:54:37 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-3d4369ee-ef57-4ede-86d6-5b9f63a6ffc0 tempest-VolumesSnapshotListTestJSON-1537392379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-1e21cb6a-00e1-4f78-9900-752098383a44.info {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:54:37 devstack sudo[108346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-1e21cb6a-00e1-4f78-9900-752098383a44.info Jun 17 04:54:37 devstack sudo[108346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:54:38 devstack sudo[108346]: pam_unix(sudo:session): session closed for user root Jun 17 04:54:38 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-3d4369ee-ef57-4ede-86d6-5b9f63a6ffc0 tempest-VolumesSnapshotListTestJSON-1537392379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-1e21cb6a-00e1-4f78-9900-752098383a44.info" returned: 0 in 0.577s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:54:38 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-3d4369ee-ef57-4ede-86d6-5b9f63a6ffc0 tempest-VolumesSnapshotListTestJSON-1537392379 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.912s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 04:54:38 devstack cinder-volume[92060]: INFO cinder.volume.manager [None req-3d4369ee-ef57-4ede-86d6-5b9f63a6ffc0 tempest-VolumesSnapshotListTestJSON-1537392379 None] Create snapshot completed successfully Jun 17 04:54:38 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-281ac0d2-d382-43c0-8485-374a7786ae44 tempest-VolumesSnapshotListTestJSON-1537392379 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 04:54:38 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-281ac0d2-d382-43c0-8485-374a7786ae44 tempest-VolumesSnapshotListTestJSON-1537392379 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 04:54:38 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.remotefs [None req-281ac0d2-d382-43c0-8485-374a7786ae44 tempest-VolumesSnapshotListTestJSON-1537392379 None] Creating offline snapshot 127933f1-1ab3-4414-8e6c-8f6d8f00cf59 of volume 1e21cb6a-00e1-4f78-9900-752098383a44 {{(pid=92060) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 17 04:54:38 devstack cinder-volume[92060]: DEBUG oslo.privsep.daemon [-] privsep: reply[86db166d-d92e-407a-90bc-b3ab9ce5cb88]: (4, 'qcow2') {{(pid=93130) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 04:54:38 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-281ac0d2-d382-43c0-8485-374a7786ae44 tempest-VolumesSnapshotListTestJSON-1537392379 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-1e21cb6a-00e1-4f78-9900-752098383a44.8311280e-dae3-4562-a75c-0e7b555e42f4 {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:54:38 devstack sudo[108349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-1e21cb6a-00e1-4f78-9900-752098383a44.8311280e-dae3-4562-a75c-0e7b555e42f4 Jun 17 04:54:38 devstack sudo[108349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:54:39 devstack sudo[108349]: pam_unix(sudo:session): session closed for user root Jun 17 04:54:39 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-281ac0d2-d382-43c0-8485-374a7786ae44 tempest-VolumesSnapshotListTestJSON-1537392379 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-1e21cb6a-00e1-4f78-9900-752098383a44.8311280e-dae3-4562-a75c-0e7b555e42f4" returned: 0 in 0.695s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:54:39 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.remotefs [None req-281ac0d2-d382-43c0-8485-374a7786ae44 tempest-VolumesSnapshotListTestJSON-1537392379 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1e21cb6a-00e1-4f78-9900-752098383a44(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=92060) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 17 04:54:39 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-281ac0d2-d382-43c0-8485-374a7786ae44 tempest-VolumesSnapshotListTestJSON-1537392379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-1e21cb6a-00e1-4f78-9900-752098383a44.8311280e-dae3-4562-a75c-0e7b555e42f4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-1e21cb6a-00e1-4f78-9900-752098383a44.127933f1-1ab3-4414-8e6c-8f6d8f00cf59 1G {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:54:39 devstack sudo[108354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-1e21cb6a-00e1-4f78-9900-752098383a44.8311280e-dae3-4562-a75c-0e7b555e42f4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-1e21cb6a-00e1-4f78-9900-752098383a44.127933f1-1ab3-4414-8e6c-8f6d8f00cf59 1G Jun 17 04:54:39 devstack sudo[108354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:54:39 devstack sudo[108354]: pam_unix(sudo:session): session closed for user root Jun 17 04:54:39 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-281ac0d2-d382-43c0-8485-374a7786ae44 tempest-VolumesSnapshotListTestJSON-1537392379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-1e21cb6a-00e1-4f78-9900-752098383a44.8311280e-dae3-4562-a75c-0e7b555e42f4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-1e21cb6a-00e1-4f78-9900-752098383a44.127933f1-1ab3-4414-8e6c-8f6d8f00cf59 1G" returned: 0 in 0.747s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:54:39 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-281ac0d2-d382-43c0-8485-374a7786ae44 tempest-VolumesSnapshotListTestJSON-1537392379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1e21cb6a-00e1-4f78-9900-752098383a44.8311280e-dae3-4562-a75c-0e7b555e42f4 -F qcow2 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-1e21cb6a-00e1-4f78-9900-752098383a44.127933f1-1ab3-4414-8e6c-8f6d8f00cf59 {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:54:39 devstack sudo[108360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1e21cb6a-00e1-4f78-9900-752098383a44.8311280e-dae3-4562-a75c-0e7b555e42f4 -F qcow2 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-1e21cb6a-00e1-4f78-9900-752098383a44.127933f1-1ab3-4414-8e6c-8f6d8f00cf59 Jun 17 04:54:39 devstack sudo[108360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:54:40 devstack sudo[108360]: pam_unix(sudo:session): session closed for user root Jun 17 04:54:40 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-281ac0d2-d382-43c0-8485-374a7786ae44 tempest-VolumesSnapshotListTestJSON-1537392379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1e21cb6a-00e1-4f78-9900-752098383a44.8311280e-dae3-4562-a75c-0e7b555e42f4 -F qcow2 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-1e21cb6a-00e1-4f78-9900-752098383a44.127933f1-1ab3-4414-8e6c-8f6d8f00cf59" returned: 0 in 0.617s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:54:40 devstack cinder-volume[92060]: WARNING cinder.volume.drivers.remotefs [None req-281ac0d2-d382-43c0-8485-374a7786ae44 tempest-VolumesSnapshotListTestJSON-1537392379 None] /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-1e21cb6a-00e1-4f78-9900-752098383a44.127933f1-1ab3-4414-8e6c-8f6d8f00cf59 is being set with open permissions: ugo+rw Jun 17 04:54:40 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-281ac0d2-d382-43c0-8485-374a7786ae44 tempest-VolumesSnapshotListTestJSON-1537392379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-1e21cb6a-00e1-4f78-9900-752098383a44.127933f1-1ab3-4414-8e6c-8f6d8f00cf59 {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:54:40 devstack sudo[108365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-1e21cb6a-00e1-4f78-9900-752098383a44.127933f1-1ab3-4414-8e6c-8f6d8f00cf59 Jun 17 04:54:40 devstack sudo[108365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:54:41 devstack sudo[108365]: pam_unix(sudo:session): session closed for user root Jun 17 04:54:41 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-281ac0d2-d382-43c0-8485-374a7786ae44 tempest-VolumesSnapshotListTestJSON-1537392379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-1e21cb6a-00e1-4f78-9900-752098383a44.127933f1-1ab3-4414-8e6c-8f6d8f00cf59" returned: 0 in 0.580s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:54:41 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-281ac0d2-d382-43c0-8485-374a7786ae44 tempest-VolumesSnapshotListTestJSON-1537392379 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.724s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 04:54:41 devstack cinder-volume[92060]: INFO cinder.volume.manager [None req-281ac0d2-d382-43c0-8485-374a7786ae44 tempest-VolumesSnapshotListTestJSON-1537392379 None] Create snapshot completed successfully Jun 17 04:54:41 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-311c262d-080e-4498-8dc2-5823926b9dc0 tempest-VolumesSnapshotListTestJSON-1537392379 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 04:54:41 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-311c262d-080e-4498-8dc2-5823926b9dc0 tempest-VolumesSnapshotListTestJSON-1537392379 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 04:54:41 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.remotefs [None req-311c262d-080e-4498-8dc2-5823926b9dc0 tempest-VolumesSnapshotListTestJSON-1537392379 None] Creating offline snapshot 8a79dde6-47cd-4837-943b-a9291417a2d7 of volume 1e21cb6a-00e1-4f78-9900-752098383a44 {{(pid=92060) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 17 04:54:41 devstack cinder-volume[92060]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab63d184-9520-4039-873b-6f801ce7d988]: (4, 'qcow2') {{(pid=93130) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 04:54:41 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-311c262d-080e-4498-8dc2-5823926b9dc0 tempest-VolumesSnapshotListTestJSON-1537392379 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-1e21cb6a-00e1-4f78-9900-752098383a44.127933f1-1ab3-4414-8e6c-8f6d8f00cf59 {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:54:41 devstack sudo[108369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-1e21cb6a-00e1-4f78-9900-752098383a44.127933f1-1ab3-4414-8e6c-8f6d8f00cf59 Jun 17 04:54:41 devstack sudo[108369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:54:42 devstack sudo[108369]: pam_unix(sudo:session): session closed for user root Jun 17 04:54:42 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-311c262d-080e-4498-8dc2-5823926b9dc0 tempest-VolumesSnapshotListTestJSON-1537392379 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-1e21cb6a-00e1-4f78-9900-752098383a44.127933f1-1ab3-4414-8e6c-8f6d8f00cf59" returned: 0 in 0.690s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:54:42 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.remotefs [None req-311c262d-080e-4498-8dc2-5823926b9dc0 tempest-VolumesSnapshotListTestJSON-1537392379 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1e21cb6a-00e1-4f78-9900-752098383a44(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=92060) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 17 04:54:42 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-311c262d-080e-4498-8dc2-5823926b9dc0 tempest-VolumesSnapshotListTestJSON-1537392379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-1e21cb6a-00e1-4f78-9900-752098383a44.127933f1-1ab3-4414-8e6c-8f6d8f00cf59,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-1e21cb6a-00e1-4f78-9900-752098383a44.8a79dde6-47cd-4837-943b-a9291417a2d7 1G {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:54:42 devstack sudo[108374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-1e21cb6a-00e1-4f78-9900-752098383a44.127933f1-1ab3-4414-8e6c-8f6d8f00cf59,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-1e21cb6a-00e1-4f78-9900-752098383a44.8a79dde6-47cd-4837-943b-a9291417a2d7 1G Jun 17 04:54:42 devstack sudo[108374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:54:43 devstack sudo[108374]: pam_unix(sudo:session): session closed for user root Jun 17 04:54:43 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-311c262d-080e-4498-8dc2-5823926b9dc0 tempest-VolumesSnapshotListTestJSON-1537392379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-1e21cb6a-00e1-4f78-9900-752098383a44.127933f1-1ab3-4414-8e6c-8f6d8f00cf59,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-1e21cb6a-00e1-4f78-9900-752098383a44.8a79dde6-47cd-4837-943b-a9291417a2d7 1G" returned: 0 in 0.778s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:54:43 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-311c262d-080e-4498-8dc2-5823926b9dc0 tempest-VolumesSnapshotListTestJSON-1537392379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1e21cb6a-00e1-4f78-9900-752098383a44.127933f1-1ab3-4414-8e6c-8f6d8f00cf59 -F qcow2 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-1e21cb6a-00e1-4f78-9900-752098383a44.8a79dde6-47cd-4837-943b-a9291417a2d7 {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:54:43 devstack sudo[108379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1e21cb6a-00e1-4f78-9900-752098383a44.127933f1-1ab3-4414-8e6c-8f6d8f00cf59 -F qcow2 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-1e21cb6a-00e1-4f78-9900-752098383a44.8a79dde6-47cd-4837-943b-a9291417a2d7 Jun 17 04:54:43 devstack sudo[108379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:54:43 devstack sudo[108379]: pam_unix(sudo:session): session closed for user root Jun 17 04:54:43 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-311c262d-080e-4498-8dc2-5823926b9dc0 tempest-VolumesSnapshotListTestJSON-1537392379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1e21cb6a-00e1-4f78-9900-752098383a44.127933f1-1ab3-4414-8e6c-8f6d8f00cf59 -F qcow2 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-1e21cb6a-00e1-4f78-9900-752098383a44.8a79dde6-47cd-4837-943b-a9291417a2d7" returned: 0 in 0.637s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:54:43 devstack cinder-volume[92060]: WARNING cinder.volume.drivers.remotefs [None req-311c262d-080e-4498-8dc2-5823926b9dc0 tempest-VolumesSnapshotListTestJSON-1537392379 None] /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-1e21cb6a-00e1-4f78-9900-752098383a44.8a79dde6-47cd-4837-943b-a9291417a2d7 is being set with open permissions: ugo+rw Jun 17 04:54:43 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-311c262d-080e-4498-8dc2-5823926b9dc0 tempest-VolumesSnapshotListTestJSON-1537392379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-1e21cb6a-00e1-4f78-9900-752098383a44.8a79dde6-47cd-4837-943b-a9291417a2d7 {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:54:43 devstack sudo[108384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-1e21cb6a-00e1-4f78-9900-752098383a44.8a79dde6-47cd-4837-943b-a9291417a2d7 Jun 17 04:54:43 devstack sudo[108384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:54:44 devstack sudo[108384]: pam_unix(sudo:session): session closed for user root Jun 17 04:54:44 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-311c262d-080e-4498-8dc2-5823926b9dc0 tempest-VolumesSnapshotListTestJSON-1537392379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-1e21cb6a-00e1-4f78-9900-752098383a44.8a79dde6-47cd-4837-943b-a9291417a2d7" returned: 0 in 0.568s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:54:44 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-311c262d-080e-4498-8dc2-5823926b9dc0 tempest-VolumesSnapshotListTestJSON-1537392379 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.760s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 04:54:44 devstack cinder-volume[92060]: INFO cinder.volume.manager [None req-311c262d-080e-4498-8dc2-5823926b9dc0 tempest-VolumesSnapshotListTestJSON-1537392379 None] Create snapshot completed successfully Jun 17 04:54:44 devstack cinder-volume[92060]: DEBUG oslo_service.periodic_task [None req-60d279ad-ad8c-4d36-a4b8-f593e74fb922 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=92060) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 17 04:54:44 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-60d279ad-ad8c-4d36-a4b8-f593e74fb922 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 04:54:44 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-60d279ad-ad8c-4d36-a4b8-f593e74fb922 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 04:54:44 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-60d279ad-ad8c-4d36-a4b8-f593e74fb922 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588': None} {{(pid=92060) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 17 04:54:44 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-60d279ad-ad8c-4d36-a4b8-f593e74fb922 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588'] {{(pid=92060) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 17 04:54:44 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-60d279ad-ad8c-4d36-a4b8-f593e74fb922 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 04:54:44 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-60d279ad-ad8c-4d36-a4b8-f593e74fb922 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:54:44 devstack sudo[108387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a Jun 17 04:54:44 devstack sudo[108387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:54:45 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-c59b29b8-f38d-44c6-b3a7-4189365e185b tempest-VolumesSnapshotListTestJSON-1537392379 None] Acquiring lock "cinder-8a79dde6-47cd-4837-943b-a9291417a2d7-delete_snapshot" by "delete_snapshot" {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 04:54:45 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-c59b29b8-f38d-44c6-b3a7-4189365e185b tempest-VolumesSnapshotListTestJSON-1537392379 None] Lock "cinder-8a79dde6-47cd-4837-943b-a9291417a2d7-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 04:54:45 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-c59b29b8-f38d-44c6-b3a7-4189365e185b tempest-VolumesSnapshotListTestJSON-1537392379 None] Acquiring lock "cinder-quobyte-1e21cb6a-00e1-4f78-9900-752098383a44" by "delete_snapshot" {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 04:54:45 devstack sudo[108387]: pam_unix(sudo:session): session closed for user root Jun 17 04:54:45 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-60d279ad-ad8c-4d36-a4b8-f593e74fb922 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a" returned: 0 in 0.582s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:54:45 devstack cinder-volume[92060]: DEBUG cinder.manager [None req-60d279ad-ad8c-4d36-a4b8-f593e74fb922 None None] Notifying Schedulers of capabilities ... {{(pid=92060) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 17 04:54:45 devstack cinder-volume[92060]: DEBUG oslo_service.periodic_task [None req-60d279ad-ad8c-4d36-a4b8-f593e74fb922 None None] Running periodic task VolumeManager._thread_info {{(pid=92060) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 17 04:54:45 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-60d279ad-ad8c-4d36-a4b8-f593e74fb922 None None] thread count: 28 {{(pid=92060) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 17 04:54:45 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-60d279ad-ad8c-4d36-a4b8-f593e74fb922 None None] thread info: [<_MainThread(MainThread, started 130061806440576)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=92060) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 17 04:54:45 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-c59b29b8-f38d-44c6-b3a7-4189365e185b tempest-VolumesSnapshotListTestJSON-1537392379 None] Lock "cinder-quobyte-1e21cb6a-00e1-4f78-9900-752098383a44" acquired by "delete_snapshot" :: waited 0.024s {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 04:54:45 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-c59b29b8-f38d-44c6-b3a7-4189365e185b tempest-VolumesSnapshotListTestJSON-1537392379 None] Acquiring lock "cinder-quobyte-8a79dde6-47cd-4837-943b-a9291417a2d7" by "_delete_snapshot" {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 04:54:45 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-c59b29b8-f38d-44c6-b3a7-4189365e185b tempest-VolumesSnapshotListTestJSON-1537392379 None] Lock "cinder-quobyte-8a79dde6-47cd-4837-943b-a9291417a2d7" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 04:54:45 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.remotefs [None req-c59b29b8-f38d-44c6-b3a7-4189365e185b tempest-VolumesSnapshotListTestJSON-1537392379 None] Deleting offline snapshot 8a79dde6-47cd-4837-943b-a9291417a2d7 of volume 1e21cb6a-00e1-4f78-9900-752098383a44 {{(pid=92060) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 17 04:54:45 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.remotefs [None req-c59b29b8-f38d-44c6-b3a7-4189365e185b tempest-VolumesSnapshotListTestJSON-1537392379 None] snapshot_file for this snap is: volume-1e21cb6a-00e1-4f78-9900-752098383a44.8a79dde6-47cd-4837-943b-a9291417a2d7 {{(pid=92060) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 17 04:54:45 devstack cinder-volume[92060]: DEBUG oslo.privsep.daemon [-] privsep: reply[b46be9a5-3e03-49de-a889-3a9920b18ab9]: (4, 'qcow2') {{(pid=93130) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 04:54:45 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-c59b29b8-f38d-44c6-b3a7-4189365e185b tempest-VolumesSnapshotListTestJSON-1537392379 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-1e21cb6a-00e1-4f78-9900-752098383a44.8a79dde6-47cd-4837-943b-a9291417a2d7 {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:54:45 devstack sudo[108390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-1e21cb6a-00e1-4f78-9900-752098383a44.8a79dde6-47cd-4837-943b-a9291417a2d7 Jun 17 04:54:45 devstack sudo[108390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:54:46 devstack sudo[108390]: pam_unix(sudo:session): session closed for user root Jun 17 04:54:46 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-c59b29b8-f38d-44c6-b3a7-4189365e185b tempest-VolumesSnapshotListTestJSON-1537392379 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-1e21cb6a-00e1-4f78-9900-752098383a44.8a79dde6-47cd-4837-943b-a9291417a2d7" returned: 0 in 0.684s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:54:46 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.remotefs [None req-c59b29b8-f38d-44c6-b3a7-4189365e185b tempest-VolumesSnapshotListTestJSON-1537392379 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1e21cb6a-00e1-4f78-9900-752098383a44(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=92060) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 17 04:54:46 devstack cinder-volume[92060]: DEBUG oslo.privsep.daemon [-] privsep: reply[7093cc98-5de1-4263-aa60-11329dfcd327]: (4, 'qcow2') {{(pid=93130) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 04:54:46 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-c59b29b8-f38d-44c6-b3a7-4189365e185b tempest-VolumesSnapshotListTestJSON-1537392379 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-1e21cb6a-00e1-4f78-9900-752098383a44.127933f1-1ab3-4414-8e6c-8f6d8f00cf59 {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:54:46 devstack sudo[108395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-1e21cb6a-00e1-4f78-9900-752098383a44.127933f1-1ab3-4414-8e6c-8f6d8f00cf59 Jun 17 04:54:46 devstack sudo[108395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:54:47 devstack sudo[108395]: pam_unix(sudo:session): session closed for user root Jun 17 04:54:47 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-c59b29b8-f38d-44c6-b3a7-4189365e185b tempest-VolumesSnapshotListTestJSON-1537392379 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-1e21cb6a-00e1-4f78-9900-752098383a44.127933f1-1ab3-4414-8e6c-8f6d8f00cf59" returned: 0 in 0.704s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:54:47 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.remotefs [None req-c59b29b8-f38d-44c6-b3a7-4189365e185b tempest-VolumesSnapshotListTestJSON-1537392379 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1e21cb6a-00e1-4f78-9900-752098383a44(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=92060) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 17 04:54:47 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-c59b29b8-f38d-44c6-b3a7-4189365e185b tempest-VolumesSnapshotListTestJSON-1537392379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-1e21cb6a-00e1-4f78-9900-752098383a44.8a79dde6-47cd-4837-943b-a9291417a2d7 {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:54:47 devstack sudo[108400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-1e21cb6a-00e1-4f78-9900-752098383a44.8a79dde6-47cd-4837-943b-a9291417a2d7 Jun 17 04:54:47 devstack sudo[108400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:54:47 devstack sudo[108400]: pam_unix(sudo:session): session closed for user root Jun 17 04:54:47 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-c59b29b8-f38d-44c6-b3a7-4189365e185b tempest-VolumesSnapshotListTestJSON-1537392379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-1e21cb6a-00e1-4f78-9900-752098383a44.8a79dde6-47cd-4837-943b-a9291417a2d7" returned: 0 in 0.732s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:54:47 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-c59b29b8-f38d-44c6-b3a7-4189365e185b tempest-VolumesSnapshotListTestJSON-1537392379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-1e21cb6a-00e1-4f78-9900-752098383a44.8a79dde6-47cd-4837-943b-a9291417a2d7 {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:54:47 devstack sudo[108405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-1e21cb6a-00e1-4f78-9900-752098383a44.8a79dde6-47cd-4837-943b-a9291417a2d7 Jun 17 04:54:47 devstack sudo[108405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:54:48 devstack sudo[108405]: pam_unix(sudo:session): session closed for user root Jun 17 04:54:48 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-c59b29b8-f38d-44c6-b3a7-4189365e185b tempest-VolumesSnapshotListTestJSON-1537392379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-1e21cb6a-00e1-4f78-9900-752098383a44.8a79dde6-47cd-4837-943b-a9291417a2d7" returned: 0 in 0.589s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:54:48 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-c59b29b8-f38d-44c6-b3a7-4189365e185b tempest-VolumesSnapshotListTestJSON-1537392379 None] Lock "cinder-quobyte-8a79dde6-47cd-4837-943b-a9291417a2d7" released by "_delete_snapshot" :: held 2.793s {{(pid=92060) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 04:54:48 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-c59b29b8-f38d-44c6-b3a7-4189365e185b tempest-VolumesSnapshotListTestJSON-1537392379 None] Lock "cinder-quobyte-1e21cb6a-00e1-4f78-9900-752098383a44" released by "delete_snapshot" :: held 2.813s {{(pid=92060) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 04:54:48 devstack cinder-volume[92060]: DEBUG cinder.quota [None req-c59b29b8-f38d-44c6-b3a7-4189365e185b tempest-VolumesSnapshotListTestJSON-1537392379 None] Created reservations ['51e7d4fd-ad4a-4f58-925d-50e8bcdd2318', '5a2eba5b-e5bd-4e9d-8804-b6f1a83e9ef5', '5d034852-268b-435a-9d09-3ca1592a3ce1', 'dfe0d5bb-e0ed-4f04-8343-17eb17f2a268'] {{(pid=92060) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 17 04:54:48 devstack cinder-volume[92060]: INFO cinder.volume.manager [None req-c59b29b8-f38d-44c6-b3a7-4189365e185b tempest-VolumesSnapshotListTestJSON-1537392379 None] Delete snapshot completed successfully. Jun 17 04:54:48 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-c59b29b8-f38d-44c6-b3a7-4189365e185b tempest-VolumesSnapshotListTestJSON-1537392379 None] Lock "cinder-8a79dde6-47cd-4837-943b-a9291417a2d7-delete_snapshot" released by "delete_snapshot" :: held 2.956s {{(pid=92060) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 04:54:48 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-111e8501-24dd-481b-a757-1fef7c596dea tempest-VolumesSnapshotListTestJSON-1537392379 None] Acquiring lock "cinder-127933f1-1ab3-4414-8e6c-8f6d8f00cf59-delete_snapshot" by "delete_snapshot" {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 04:54:48 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-111e8501-24dd-481b-a757-1fef7c596dea tempest-VolumesSnapshotListTestJSON-1537392379 None] Lock "cinder-127933f1-1ab3-4414-8e6c-8f6d8f00cf59-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 04:54:48 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-111e8501-24dd-481b-a757-1fef7c596dea tempest-VolumesSnapshotListTestJSON-1537392379 None] Acquiring lock "cinder-quobyte-1e21cb6a-00e1-4f78-9900-752098383a44" by "delete_snapshot" {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 04:54:48 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-111e8501-24dd-481b-a757-1fef7c596dea tempest-VolumesSnapshotListTestJSON-1537392379 None] Lock "cinder-quobyte-1e21cb6a-00e1-4f78-9900-752098383a44" acquired by "delete_snapshot" :: waited 0.016s {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 04:54:48 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-111e8501-24dd-481b-a757-1fef7c596dea tempest-VolumesSnapshotListTestJSON-1537392379 None] Acquiring lock "cinder-quobyte-127933f1-1ab3-4414-8e6c-8f6d8f00cf59" by "_delete_snapshot" {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 04:54:48 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-111e8501-24dd-481b-a757-1fef7c596dea tempest-VolumesSnapshotListTestJSON-1537392379 None] Lock "cinder-quobyte-127933f1-1ab3-4414-8e6c-8f6d8f00cf59" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 04:54:48 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.remotefs [None req-111e8501-24dd-481b-a757-1fef7c596dea tempest-VolumesSnapshotListTestJSON-1537392379 None] Deleting offline snapshot 127933f1-1ab3-4414-8e6c-8f6d8f00cf59 of volume 1e21cb6a-00e1-4f78-9900-752098383a44 {{(pid=92060) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 17 04:54:48 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.remotefs [None req-111e8501-24dd-481b-a757-1fef7c596dea tempest-VolumesSnapshotListTestJSON-1537392379 None] snapshot_file for this snap is: volume-1e21cb6a-00e1-4f78-9900-752098383a44.127933f1-1ab3-4414-8e6c-8f6d8f00cf59 {{(pid=92060) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 17 04:54:48 devstack cinder-volume[92060]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1b53cbb-8fa4-4f94-a597-164175bdb57f]: (4, 'qcow2') {{(pid=93130) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 04:54:48 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-111e8501-24dd-481b-a757-1fef7c596dea tempest-VolumesSnapshotListTestJSON-1537392379 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-1e21cb6a-00e1-4f78-9900-752098383a44.127933f1-1ab3-4414-8e6c-8f6d8f00cf59 {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:54:48 devstack sudo[108408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-1e21cb6a-00e1-4f78-9900-752098383a44.127933f1-1ab3-4414-8e6c-8f6d8f00cf59 Jun 17 04:54:48 devstack sudo[108408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:54:49 devstack sudo[108408]: pam_unix(sudo:session): session closed for user root Jun 17 04:54:49 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-111e8501-24dd-481b-a757-1fef7c596dea tempest-VolumesSnapshotListTestJSON-1537392379 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-1e21cb6a-00e1-4f78-9900-752098383a44.127933f1-1ab3-4414-8e6c-8f6d8f00cf59" returned: 0 in 0.710s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:54:49 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.remotefs [None req-111e8501-24dd-481b-a757-1fef7c596dea tempest-VolumesSnapshotListTestJSON-1537392379 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1e21cb6a-00e1-4f78-9900-752098383a44(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=92060) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 17 04:54:49 devstack cinder-volume[92060]: DEBUG oslo.privsep.daemon [-] privsep: reply[42e3a7e4-b090-4cf2-a6fc-8d3fe5929ccb]: (4, 'qcow2') {{(pid=93130) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 04:54:49 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-111e8501-24dd-481b-a757-1fef7c596dea tempest-VolumesSnapshotListTestJSON-1537392379 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-1e21cb6a-00e1-4f78-9900-752098383a44.8311280e-dae3-4562-a75c-0e7b555e42f4 {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:54:49 devstack sudo[108414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-1e21cb6a-00e1-4f78-9900-752098383a44.8311280e-dae3-4562-a75c-0e7b555e42f4 Jun 17 04:54:49 devstack sudo[108414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:54:50 devstack sudo[108414]: pam_unix(sudo:session): session closed for user root Jun 17 04:54:50 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-111e8501-24dd-481b-a757-1fef7c596dea tempest-VolumesSnapshotListTestJSON-1537392379 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-1e21cb6a-00e1-4f78-9900-752098383a44.8311280e-dae3-4562-a75c-0e7b555e42f4" returned: 0 in 0.728s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:54:50 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.remotefs [None req-111e8501-24dd-481b-a757-1fef7c596dea tempest-VolumesSnapshotListTestJSON-1537392379 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1e21cb6a-00e1-4f78-9900-752098383a44(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=92060) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 17 04:54:50 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-111e8501-24dd-481b-a757-1fef7c596dea tempest-VolumesSnapshotListTestJSON-1537392379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-1e21cb6a-00e1-4f78-9900-752098383a44.127933f1-1ab3-4414-8e6c-8f6d8f00cf59 {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:54:50 devstack sudo[108419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-1e21cb6a-00e1-4f78-9900-752098383a44.127933f1-1ab3-4414-8e6c-8f6d8f00cf59 Jun 17 04:54:50 devstack sudo[108419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:54:50 devstack sudo[108419]: pam_unix(sudo:session): session closed for user root Jun 17 04:54:50 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-111e8501-24dd-481b-a757-1fef7c596dea tempest-VolumesSnapshotListTestJSON-1537392379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-1e21cb6a-00e1-4f78-9900-752098383a44.127933f1-1ab3-4414-8e6c-8f6d8f00cf59" returned: 0 in 0.714s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:54:50 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-111e8501-24dd-481b-a757-1fef7c596dea tempest-VolumesSnapshotListTestJSON-1537392379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-1e21cb6a-00e1-4f78-9900-752098383a44.127933f1-1ab3-4414-8e6c-8f6d8f00cf59 {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:54:50 devstack sudo[108424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-1e21cb6a-00e1-4f78-9900-752098383a44.127933f1-1ab3-4414-8e6c-8f6d8f00cf59 Jun 17 04:54:50 devstack sudo[108424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:54:51 devstack sudo[108424]: pam_unix(sudo:session): session closed for user root Jun 17 04:54:51 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-111e8501-24dd-481b-a757-1fef7c596dea tempest-VolumesSnapshotListTestJSON-1537392379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-1e21cb6a-00e1-4f78-9900-752098383a44.127933f1-1ab3-4414-8e6c-8f6d8f00cf59" returned: 0 in 0.610s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:54:51 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-111e8501-24dd-481b-a757-1fef7c596dea tempest-VolumesSnapshotListTestJSON-1537392379 None] Lock "cinder-quobyte-127933f1-1ab3-4414-8e6c-8f6d8f00cf59" released by "_delete_snapshot" :: held 2.850s {{(pid=92060) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 04:54:51 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-111e8501-24dd-481b-a757-1fef7c596dea tempest-VolumesSnapshotListTestJSON-1537392379 None] Lock "cinder-quobyte-1e21cb6a-00e1-4f78-9900-752098383a44" released by "delete_snapshot" :: held 2.873s {{(pid=92060) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 04:54:51 devstack cinder-volume[92060]: DEBUG cinder.quota [None req-111e8501-24dd-481b-a757-1fef7c596dea tempest-VolumesSnapshotListTestJSON-1537392379 None] Created reservations ['12bc797a-b835-4519-b679-4a9a730cd264', 'f1705e0a-baac-4a83-9fe9-215690b23acb', '3994fb9c-7860-47c6-b0c0-c41a0d880bc7', '9f5878d4-b6a0-4a22-9734-64841242a5b1'] {{(pid=92060) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 17 04:54:51 devstack cinder-volume[92060]: INFO cinder.volume.manager [None req-111e8501-24dd-481b-a757-1fef7c596dea tempest-VolumesSnapshotListTestJSON-1537392379 None] Delete snapshot completed successfully. Jun 17 04:54:51 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-111e8501-24dd-481b-a757-1fef7c596dea tempest-VolumesSnapshotListTestJSON-1537392379 None] Lock "cinder-127933f1-1ab3-4414-8e6c-8f6d8f00cf59-delete_snapshot" released by "delete_snapshot" :: held 2.995s {{(pid=92060) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 04:54:51 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-fa7d7ef9-4fe1-4947-a5a9-d5ab760f5230 tempest-VolumesSnapshotListTestJSON-1537392379 None] Acquiring lock "cinder-8311280e-dae3-4562-a75c-0e7b555e42f4-delete_snapshot" by "delete_snapshot" {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 04:54:51 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-fa7d7ef9-4fe1-4947-a5a9-d5ab760f5230 tempest-VolumesSnapshotListTestJSON-1537392379 None] Lock "cinder-8311280e-dae3-4562-a75c-0e7b555e42f4-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 04:54:51 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-fa7d7ef9-4fe1-4947-a5a9-d5ab760f5230 tempest-VolumesSnapshotListTestJSON-1537392379 None] Acquiring lock "cinder-quobyte-1e21cb6a-00e1-4f78-9900-752098383a44" by "delete_snapshot" {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 04:54:51 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-fa7d7ef9-4fe1-4947-a5a9-d5ab760f5230 tempest-VolumesSnapshotListTestJSON-1537392379 None] Lock "cinder-quobyte-1e21cb6a-00e1-4f78-9900-752098383a44" acquired by "delete_snapshot" :: waited 0.013s {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 04:54:51 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-fa7d7ef9-4fe1-4947-a5a9-d5ab760f5230 tempest-VolumesSnapshotListTestJSON-1537392379 None] Acquiring lock "cinder-quobyte-8311280e-dae3-4562-a75c-0e7b555e42f4" by "_delete_snapshot" {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 04:54:51 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-fa7d7ef9-4fe1-4947-a5a9-d5ab760f5230 tempest-VolumesSnapshotListTestJSON-1537392379 None] Lock "cinder-quobyte-8311280e-dae3-4562-a75c-0e7b555e42f4" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 04:54:51 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.remotefs [None req-fa7d7ef9-4fe1-4947-a5a9-d5ab760f5230 tempest-VolumesSnapshotListTestJSON-1537392379 None] Deleting offline snapshot 8311280e-dae3-4562-a75c-0e7b555e42f4 of volume 1e21cb6a-00e1-4f78-9900-752098383a44 {{(pid=92060) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 17 04:54:51 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.remotefs [None req-fa7d7ef9-4fe1-4947-a5a9-d5ab760f5230 tempest-VolumesSnapshotListTestJSON-1537392379 None] snapshot_file for this snap is: volume-1e21cb6a-00e1-4f78-9900-752098383a44.8311280e-dae3-4562-a75c-0e7b555e42f4 {{(pid=92060) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 17 04:54:51 devstack cinder-volume[92060]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f30fedd-32c3-4271-a85b-a7fbee32d593]: (4, 'qcow2') {{(pid=93130) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 04:54:51 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-fa7d7ef9-4fe1-4947-a5a9-d5ab760f5230 tempest-VolumesSnapshotListTestJSON-1537392379 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-1e21cb6a-00e1-4f78-9900-752098383a44.8311280e-dae3-4562-a75c-0e7b555e42f4 {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:54:52 devstack sudo[108428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-1e21cb6a-00e1-4f78-9900-752098383a44.8311280e-dae3-4562-a75c-0e7b555e42f4 Jun 17 04:54:52 devstack sudo[108428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:54:52 devstack sudo[108428]: pam_unix(sudo:session): session closed for user root Jun 17 04:54:52 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-fa7d7ef9-4fe1-4947-a5a9-d5ab760f5230 tempest-VolumesSnapshotListTestJSON-1537392379 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-1e21cb6a-00e1-4f78-9900-752098383a44.8311280e-dae3-4562-a75c-0e7b555e42f4" returned: 0 in 0.716s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:54:52 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.remotefs [None req-fa7d7ef9-4fe1-4947-a5a9-d5ab760f5230 tempest-VolumesSnapshotListTestJSON-1537392379 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1e21cb6a-00e1-4f78-9900-752098383a44(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=92060) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 17 04:54:52 devstack cinder-volume[92060]: DEBUG oslo.privsep.daemon [-] privsep: reply[49d9ddac-b6f2-4d12-8dd0-e81f99a6f2cf]: (4, 'qcow2') {{(pid=93130) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 04:54:52 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-fa7d7ef9-4fe1-4947-a5a9-d5ab760f5230 tempest-VolumesSnapshotListTestJSON-1537392379 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-1e21cb6a-00e1-4f78-9900-752098383a44 {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:54:52 devstack sudo[108433]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-1e21cb6a-00e1-4f78-9900-752098383a44 Jun 17 04:54:52 devstack sudo[108433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:54:53 devstack sudo[108433]: pam_unix(sudo:session): session closed for user root Jun 17 04:54:53 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-fa7d7ef9-4fe1-4947-a5a9-d5ab760f5230 tempest-VolumesSnapshotListTestJSON-1537392379 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-1e21cb6a-00e1-4f78-9900-752098383a44" returned: 0 in 0.680s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:54:53 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-fa7d7ef9-4fe1-4947-a5a9-d5ab760f5230 tempest-VolumesSnapshotListTestJSON-1537392379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-1e21cb6a-00e1-4f78-9900-752098383a44.8311280e-dae3-4562-a75c-0e7b555e42f4 {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:54:53 devstack sudo[108438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-1e21cb6a-00e1-4f78-9900-752098383a44.8311280e-dae3-4562-a75c-0e7b555e42f4 Jun 17 04:54:53 devstack sudo[108438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:54:54 devstack sudo[108438]: pam_unix(sudo:session): session closed for user root Jun 17 04:54:54 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-fa7d7ef9-4fe1-4947-a5a9-d5ab760f5230 tempest-VolumesSnapshotListTestJSON-1537392379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-1e21cb6a-00e1-4f78-9900-752098383a44.8311280e-dae3-4562-a75c-0e7b555e42f4" returned: 0 in 0.684s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:54:54 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-fa7d7ef9-4fe1-4947-a5a9-d5ab760f5230 tempest-VolumesSnapshotListTestJSON-1537392379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-1e21cb6a-00e1-4f78-9900-752098383a44.8311280e-dae3-4562-a75c-0e7b555e42f4 {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:54:54 devstack sudo[108443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-1e21cb6a-00e1-4f78-9900-752098383a44.8311280e-dae3-4562-a75c-0e7b555e42f4 Jun 17 04:54:54 devstack sudo[108443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:54:54 devstack sudo[108443]: pam_unix(sudo:session): session closed for user root Jun 17 04:54:54 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-fa7d7ef9-4fe1-4947-a5a9-d5ab760f5230 tempest-VolumesSnapshotListTestJSON-1537392379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-1e21cb6a-00e1-4f78-9900-752098383a44.8311280e-dae3-4562-a75c-0e7b555e42f4" returned: 0 in 0.572s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:54:54 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-fa7d7ef9-4fe1-4947-a5a9-d5ab760f5230 tempest-VolumesSnapshotListTestJSON-1537392379 None] Lock "cinder-quobyte-8311280e-dae3-4562-a75c-0e7b555e42f4" released by "_delete_snapshot" :: held 2.748s {{(pid=92060) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 04:54:54 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-fa7d7ef9-4fe1-4947-a5a9-d5ab760f5230 tempest-VolumesSnapshotListTestJSON-1537392379 None] Lock "cinder-quobyte-1e21cb6a-00e1-4f78-9900-752098383a44" released by "delete_snapshot" :: held 2.768s {{(pid=92060) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 04:54:54 devstack cinder-volume[92060]: DEBUG cinder.quota [None req-fa7d7ef9-4fe1-4947-a5a9-d5ab760f5230 tempest-VolumesSnapshotListTestJSON-1537392379 None] Created reservations ['d7f62ea4-8a09-47f1-9e23-0eda77fd83dd', '6e626d2e-e360-4347-9806-e2413035a194', '4149e244-bb91-454a-ad22-fb9bda599f9b', 'b05ef819-48ce-4a7f-9aa3-4aa70b52312a'] {{(pid=92060) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 17 04:54:54 devstack cinder-volume[92060]: INFO cinder.volume.manager [None req-fa7d7ef9-4fe1-4947-a5a9-d5ab760f5230 tempest-VolumesSnapshotListTestJSON-1537392379 None] Delete snapshot completed successfully. Jun 17 04:54:54 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-fa7d7ef9-4fe1-4947-a5a9-d5ab760f5230 tempest-VolumesSnapshotListTestJSON-1537392379 None] Lock "cinder-8311280e-dae3-4562-a75c-0e7b555e42f4-delete_snapshot" released by "delete_snapshot" :: held 2.884s {{(pid=92060) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 04:54:55 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-24038daa-ac1d-4780-b2b6-f9387556c339 tempest-VolumesSnapshotListTestJSON-1537392379 None] Acquiring lock "cinder-1e21cb6a-00e1-4f78-9900-752098383a44-delete_volume" by "delete_volume" {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 04:54:55 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-24038daa-ac1d-4780-b2b6-f9387556c339 tempest-VolumesSnapshotListTestJSON-1537392379 None] Lock "cinder-1e21cb6a-00e1-4f78-9900-752098383a44-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 04:54:55 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-24038daa-ac1d-4780-b2b6-f9387556c339 tempest-VolumesSnapshotListTestJSON-1537392379 None] Acquiring lock "cinder-quobyte-1e21cb6a-00e1-4f78-9900-752098383a44" by "delete_volume" {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 04:54:55 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-24038daa-ac1d-4780-b2b6-f9387556c339 tempest-VolumesSnapshotListTestJSON-1537392379 None] Lock "cinder-quobyte-1e21cb6a-00e1-4f78-9900-752098383a44" acquired by "delete_volume" :: waited 0.016s {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 04:54:55 devstack cinder-volume[92060]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f4c53cd-e081-4407-8bf4-79e7d25dfda0]: (4, 'qcow2') {{(pid=93130) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 04:54:55 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-24038daa-ac1d-4780-b2b6-f9387556c339 tempest-VolumesSnapshotListTestJSON-1537392379 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-1e21cb6a-00e1-4f78-9900-752098383a44 {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:54:55 devstack sudo[108446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-1e21cb6a-00e1-4f78-9900-752098383a44 Jun 17 04:54:55 devstack sudo[108446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:54:55 devstack sudo[108446]: pam_unix(sudo:session): session closed for user root Jun 17 04:54:55 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-24038daa-ac1d-4780-b2b6-f9387556c339 tempest-VolumesSnapshotListTestJSON-1537392379 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-1e21cb6a-00e1-4f78-9900-752098383a44" returned: 0 in 0.681s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:54:55 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-24038daa-ac1d-4780-b2b6-f9387556c339 tempest-VolumesSnapshotListTestJSON-1537392379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-1e21cb6a-00e1-4f78-9900-752098383a44 {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:54:55 devstack sudo[108451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-1e21cb6a-00e1-4f78-9900-752098383a44 Jun 17 04:54:55 devstack sudo[108451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:54:56 devstack sudo[108451]: pam_unix(sudo:session): session closed for user root Jun 17 04:54:56 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-24038daa-ac1d-4780-b2b6-f9387556c339 tempest-VolumesSnapshotListTestJSON-1537392379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-1e21cb6a-00e1-4f78-9900-752098383a44" returned: 0 in 0.593s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:54:56 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-24038daa-ac1d-4780-b2b6-f9387556c339 tempest-VolumesSnapshotListTestJSON-1537392379 None] Lock "cinder-quobyte-1e21cb6a-00e1-4f78-9900-752098383a44" released by "delete_volume" :: held 1.327s {{(pid=92060) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 04:54:56 devstack cinder-volume[92060]: DEBUG cinder.quota [None req-24038daa-ac1d-4780-b2b6-f9387556c339 tempest-VolumesSnapshotListTestJSON-1537392379 None] Created reservations ['e1cf88f3-cf0f-4ff4-98f8-af45fb029502', '7eb9daa5-f700-45b7-9b33-67bcc029d492', '9cb484ce-cfeb-4cc8-9daf-a844566445c0', 'aba99a1a-9e71-4b55-9de4-8c1c37dc6cea'] {{(pid=92060) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 17 04:54:56 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-24038daa-ac1d-4780-b2b6-f9387556c339 tempest-VolumesSnapshotListTestJSON-1537392379 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 04:54:56 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-24038daa-ac1d-4780-b2b6-f9387556c339 tempest-VolumesSnapshotListTestJSON-1537392379 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 04:54:56 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-24038daa-ac1d-4780-b2b6-f9387556c339 tempest-VolumesSnapshotListTestJSON-1537392379 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588': None} {{(pid=92060) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 17 04:54:56 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-24038daa-ac1d-4780-b2b6-f9387556c339 tempest-VolumesSnapshotListTestJSON-1537392379 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588'] {{(pid=92060) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 17 04:54:56 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-24038daa-ac1d-4780-b2b6-f9387556c339 tempest-VolumesSnapshotListTestJSON-1537392379 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 04:54:56 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-24038daa-ac1d-4780-b2b6-f9387556c339 tempest-VolumesSnapshotListTestJSON-1537392379 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:54:56 devstack sudo[108454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a Jun 17 04:54:56 devstack sudo[108454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:54:57 devstack sudo[108454]: pam_unix(sudo:session): session closed for user root Jun 17 04:54:57 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-24038daa-ac1d-4780-b2b6-f9387556c339 tempest-VolumesSnapshotListTestJSON-1537392379 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a" returned: 0 in 0.599s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:54:57 devstack cinder-volume[92060]: DEBUG cinder.manager [None req-24038daa-ac1d-4780-b2b6-f9387556c339 tempest-VolumesSnapshotListTestJSON-1537392379 None] Notifying Schedulers of capabilities ... {{(pid=92060) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 17 04:54:57 devstack cinder-volume[92060]: INFO cinder.volume.manager [None req-24038daa-ac1d-4780-b2b6-f9387556c339 tempest-VolumesSnapshotListTestJSON-1537392379 None] Deleted volume successfully. Jun 17 04:54:57 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-24038daa-ac1d-4780-b2b6-f9387556c339 tempest-VolumesSnapshotListTestJSON-1537392379 None] Lock "cinder-1e21cb6a-00e1-4f78-9900-752098383a44-delete_volume" released by "delete_volume" :: held 2.105s {{(pid=92060) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 04:54:59 devstack cinder-volume[92060]: DEBUG cinder.volume.flows.manager.create_volume [None req-ee9569b2-08b7-4604-906d-7c4fabb7c5dc tempest-VolumesSnapshotNegativeTestJSON-1408344763 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92060) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 17 04:54:59 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-ee9569b2-08b7-4604-906d-7c4fabb7c5dc tempest-VolumesSnapshotNegativeTestJSON-1408344763 None] Flow 'volume_create_manager' (4da1e2e4-23bb-4c42-8aa6-38a781760a44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 17 04:54:59 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-ee9569b2-08b7-4604-906d-7c4fabb7c5dc tempest-VolumesSnapshotNegativeTestJSON-1408344763 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (69d83776-11ad-44bb-81d6-acd36d643bc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:55:00 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-ee9569b2-08b7-4604-906d-7c4fabb7c5dc tempest-VolumesSnapshotNegativeTestJSON-1408344763 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (69d83776-11ad-44bb-81d6-acd36d643bc0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-17T02:55:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1037103228',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aef86f1a-8baa-40a4-8680-fdf356a08443,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f1186f60fe284ef69a46f5bc3bc274b9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T02:55:00Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T02:55:00Z,use_quota=True,user_id='8ced2acd17364a2c9e243ec73637e036',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aad9ce24-93f9-41a6-baa1-5125964f96d1),volume_type_id=aad9ce24-93f9-41a6-baa1-5125964f96d1)' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:55:00 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-ee9569b2-08b7-4604-906d-7c4fabb7c5dc tempest-VolumesSnapshotNegativeTestJSON-1408344763 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f0c879a1-a73a-4bea-877c-d9e98fbf6e7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:55:00 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-ee9569b2-08b7-4604-906d-7c4fabb7c5dc tempest-VolumesSnapshotNegativeTestJSON-1408344763 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f0c879a1-a73a-4bea-877c-d9e98fbf6e7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:55:00 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-ee9569b2-08b7-4604-906d-7c4fabb7c5dc tempest-VolumesSnapshotNegativeTestJSON-1408344763 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c12e2f1a-ca22-4b11-a274-7f32e1a92f91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:55:00 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-ee9569b2-08b7-4604-906d-7c4fabb7c5dc tempest-VolumesSnapshotNegativeTestJSON-1408344763 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c12e2f1a-ca22-4b11-a274-7f32e1a92f91) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'aef86f1a-8baa-40a4-8680-fdf356a08443', 'volume_name': 'volume-aef86f1a-8baa-40a4-8680-fdf356a08443', 'volume_size': 2}' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:55:00 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-ee9569b2-08b7-4604-906d-7c4fabb7c5dc tempest-VolumesSnapshotNegativeTestJSON-1408344763 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9b8b21d4-0217-45e5-95d4-e9e858b477aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:55:00 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-ee9569b2-08b7-4604-906d-7c4fabb7c5dc tempest-VolumesSnapshotNegativeTestJSON-1408344763 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9b8b21d4-0217-45e5-95d4-e9e858b477aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:55:00 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-ee9569b2-08b7-4604-906d-7c4fabb7c5dc tempest-VolumesSnapshotNegativeTestJSON-1408344763 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dab43c58-f635-46a0-881d-d736b44dd0e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:55:00 devstack cinder-volume[92060]: INFO cinder.volume.flows.manager.create_volume [None req-ee9569b2-08b7-4604-906d-7c4fabb7c5dc tempest-VolumesSnapshotNegativeTestJSON-1408344763 None] Volume aef86f1a-8baa-40a4-8680-fdf356a08443: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-aef86f1a-8baa-40a4-8680-fdf356a08443', 'volume_size': 2} Jun 17 04:55:00 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-ee9569b2-08b7-4604-906d-7c4fabb7c5dc tempest-VolumesSnapshotNegativeTestJSON-1408344763 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 04:55:00 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-ee9569b2-08b7-4604-906d-7c4fabb7c5dc tempest-VolumesSnapshotNegativeTestJSON-1408344763 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 04:55:00 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-ee9569b2-08b7-4604-906d-7c4fabb7c5dc tempest-VolumesSnapshotNegativeTestJSON-1408344763 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-17T02:55:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1037103228',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aef86f1a-8baa-40a4-8680-fdf356a08443,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f1186f60fe284ef69a46f5bc3bc274b9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T02:55:00Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T02:55:00Z,use_quota=True,user_id='8ced2acd17364a2c9e243ec73637e036',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aad9ce24-93f9-41a6-baa1-5125964f96d1),volume_type_id=aad9ce24-93f9-41a6-baa1-5125964f96d1)}" {{(pid=92060) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 17 04:55:00 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.remotefs [None req-ee9569b2-08b7-4604-906d-7c4fabb7c5dc tempest-VolumesSnapshotNegativeTestJSON-1408344763 None] Creating volume aef86f1a-8baa-40a4-8680-fdf356a08443 {{(pid=92060) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 17 04:55:00 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-ee9569b2-08b7-4604-906d-7c4fabb7c5dc tempest-VolumesSnapshotNegativeTestJSON-1408344763 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 04:55:00 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-ee9569b2-08b7-4604-906d-7c4fabb7c5dc tempest-VolumesSnapshotNegativeTestJSON-1408344763 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 04:55:00 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-ee9569b2-08b7-4604-906d-7c4fabb7c5dc tempest-VolumesSnapshotNegativeTestJSON-1408344763 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588': None} {{(pid=92060) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 17 04:55:00 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-ee9569b2-08b7-4604-906d-7c4fabb7c5dc tempest-VolumesSnapshotNegativeTestJSON-1408344763 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588'] {{(pid=92060) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 17 04:55:00 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-ee9569b2-08b7-4604-906d-7c4fabb7c5dc tempest-VolumesSnapshotNegativeTestJSON-1408344763 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 04:55:00 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-ee9569b2-08b7-4604-906d-7c4fabb7c5dc tempest-VolumesSnapshotNegativeTestJSON-1408344763 None] Selected osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588 as target Quobyte volume. {{(pid=92060) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 17 04:55:00 devstack cinder-volume[92060]: INFO cinder.volume.drivers.remotefs [None req-ee9569b2-08b7-4604-906d-7c4fabb7c5dc tempest-VolumesSnapshotNegativeTestJSON-1408344763 None] casted to osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588 Jun 17 04:55:00 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-ee9569b2-08b7-4604-906d-7c4fabb7c5dc tempest-VolumesSnapshotNegativeTestJSON-1408344763 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-aef86f1a-8baa-40a4-8680-fdf356a08443 2147483648 {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:55:00 devstack sudo[108458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-aef86f1a-8baa-40a4-8680-fdf356a08443 2147483648 Jun 17 04:55:00 devstack sudo[108458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:55:00 devstack sudo[108458]: pam_unix(sudo:session): session closed for user root Jun 17 04:55:00 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-ee9569b2-08b7-4604-906d-7c4fabb7c5dc tempest-VolumesSnapshotNegativeTestJSON-1408344763 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-aef86f1a-8baa-40a4-8680-fdf356a08443 2147483648" returned: 0 in 0.772s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:55:00 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-ee9569b2-08b7-4604-906d-7c4fabb7c5dc tempest-VolumesSnapshotNegativeTestJSON-1408344763 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-aef86f1a-8baa-40a4-8680-fdf356a08443 {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:55:00 devstack sudo[108464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-aef86f1a-8baa-40a4-8680-fdf356a08443 Jun 17 04:55:00 devstack sudo[108464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:55:01 devstack sudo[108464]: pam_unix(sudo:session): session closed for user root Jun 17 04:55:01 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-ee9569b2-08b7-4604-906d-7c4fabb7c5dc tempest-VolumesSnapshotNegativeTestJSON-1408344763 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-aef86f1a-8baa-40a4-8680-fdf356a08443" returned: 0 in 0.569s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:55:01 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-ee9569b2-08b7-4604-906d-7c4fabb7c5dc tempest-VolumesSnapshotNegativeTestJSON-1408344763 None] <== create_volume: return (1380ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588'} {{(pid=92060) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 17 04:55:01 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-ee9569b2-08b7-4604-906d-7c4fabb7c5dc tempest-VolumesSnapshotNegativeTestJSON-1408344763 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.383s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 04:55:01 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-ee9569b2-08b7-4604-906d-7c4fabb7c5dc tempest-VolumesSnapshotNegativeTestJSON-1408344763 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dab43c58-f635-46a0-881d-d736b44dd0e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-aef86f1a-8baa-40a4-8680-fdf356a08443', 'volume_size': 2}' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:55:01 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-ee9569b2-08b7-4604-906d-7c4fabb7c5dc tempest-VolumesSnapshotNegativeTestJSON-1408344763 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (337f1d34-a0fc-4581-9c54-324ea1c3dd01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:55:01 devstack cinder-volume[92060]: INFO cinder.volume.flows.manager.create_volume [None req-ee9569b2-08b7-4604-906d-7c4fabb7c5dc tempest-VolumesSnapshotNegativeTestJSON-1408344763 None] Volume volume-aef86f1a-8baa-40a4-8680-fdf356a08443 (aef86f1a-8baa-40a4-8680-fdf356a08443): created successfully Jun 17 04:55:01 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-ee9569b2-08b7-4604-906d-7c4fabb7c5dc tempest-VolumesSnapshotNegativeTestJSON-1408344763 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (337f1d34-a0fc-4581-9c54-324ea1c3dd01) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:55:01 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-ee9569b2-08b7-4604-906d-7c4fabb7c5dc tempest-VolumesSnapshotNegativeTestJSON-1408344763 None] Flow 'volume_create_manager' (4da1e2e4-23bb-4c42-8aa6-38a781760a44) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92060) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 17 04:55:01 devstack cinder-volume[92060]: INFO cinder.volume.manager [None req-ee9569b2-08b7-4604-906d-7c4fabb7c5dc tempest-VolumesSnapshotNegativeTestJSON-1408344763 None] Created volume successfully. Jun 17 04:55:02 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-0214a1af-e548-4bf6-afa0-aa4935f9cd5b tempest-VolumesSnapshotNegativeTestJSON-1408344763 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 04:55:02 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-0214a1af-e548-4bf6-afa0-aa4935f9cd5b tempest-VolumesSnapshotNegativeTestJSON-1408344763 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 04:55:02 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.remotefs [None req-0214a1af-e548-4bf6-afa0-aa4935f9cd5b tempest-VolumesSnapshotNegativeTestJSON-1408344763 None] Creating offline snapshot b2c432b0-64c7-46aa-8319-d5c1d3092e45 of volume aef86f1a-8baa-40a4-8680-fdf356a08443 {{(pid=92060) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 17 04:55:02 devstack cinder-volume[92060]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff015687-22b9-49bc-8d2e-d60f5fe08cad]: (4, 'qcow2') {{(pid=93130) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 04:55:02 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-0214a1af-e548-4bf6-afa0-aa4935f9cd5b tempest-VolumesSnapshotNegativeTestJSON-1408344763 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-aef86f1a-8baa-40a4-8680-fdf356a08443 {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:55:02 devstack sudo[108471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-aef86f1a-8baa-40a4-8680-fdf356a08443 Jun 17 04:55:02 devstack sudo[108471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:55:02 devstack sudo[108471]: pam_unix(sudo:session): session closed for user root Jun 17 04:55:02 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-0214a1af-e548-4bf6-afa0-aa4935f9cd5b tempest-VolumesSnapshotNegativeTestJSON-1408344763 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-aef86f1a-8baa-40a4-8680-fdf356a08443" returned: 0 in 0.680s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:55:02 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-0214a1af-e548-4bf6-afa0-aa4935f9cd5b tempest-VolumesSnapshotNegativeTestJSON-1408344763 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-aef86f1a-8baa-40a4-8680-fdf356a08443,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-aef86f1a-8baa-40a4-8680-fdf356a08443.b2c432b0-64c7-46aa-8319-d5c1d3092e45 2G {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:55:02 devstack sudo[108476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-aef86f1a-8baa-40a4-8680-fdf356a08443,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-aef86f1a-8baa-40a4-8680-fdf356a08443.b2c432b0-64c7-46aa-8319-d5c1d3092e45 2G Jun 17 04:55:02 devstack sudo[108476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:55:03 devstack sudo[108476]: pam_unix(sudo:session): session closed for user root Jun 17 04:55:03 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-0214a1af-e548-4bf6-afa0-aa4935f9cd5b tempest-VolumesSnapshotNegativeTestJSON-1408344763 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-aef86f1a-8baa-40a4-8680-fdf356a08443,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-aef86f1a-8baa-40a4-8680-fdf356a08443.b2c432b0-64c7-46aa-8319-d5c1d3092e45 2G" returned: 0 in 0.734s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:55:03 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-0214a1af-e548-4bf6-afa0-aa4935f9cd5b tempest-VolumesSnapshotNegativeTestJSON-1408344763 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-aef86f1a-8baa-40a4-8680-fdf356a08443 -F qcow2 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-aef86f1a-8baa-40a4-8680-fdf356a08443.b2c432b0-64c7-46aa-8319-d5c1d3092e45 {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:55:03 devstack sudo[108481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-aef86f1a-8baa-40a4-8680-fdf356a08443 -F qcow2 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-aef86f1a-8baa-40a4-8680-fdf356a08443.b2c432b0-64c7-46aa-8319-d5c1d3092e45 Jun 17 04:55:03 devstack sudo[108481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:55:04 devstack sudo[108481]: pam_unix(sudo:session): session closed for user root Jun 17 04:55:04 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-0214a1af-e548-4bf6-afa0-aa4935f9cd5b tempest-VolumesSnapshotNegativeTestJSON-1408344763 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-aef86f1a-8baa-40a4-8680-fdf356a08443 -F qcow2 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-aef86f1a-8baa-40a4-8680-fdf356a08443.b2c432b0-64c7-46aa-8319-d5c1d3092e45" returned: 0 in 0.610s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:55:04 devstack cinder-volume[92060]: WARNING cinder.volume.drivers.remotefs [None req-0214a1af-e548-4bf6-afa0-aa4935f9cd5b tempest-VolumesSnapshotNegativeTestJSON-1408344763 None] /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-aef86f1a-8baa-40a4-8680-fdf356a08443.b2c432b0-64c7-46aa-8319-d5c1d3092e45 is being set with open permissions: ugo+rw Jun 17 04:55:04 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-0214a1af-e548-4bf6-afa0-aa4935f9cd5b tempest-VolumesSnapshotNegativeTestJSON-1408344763 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-aef86f1a-8baa-40a4-8680-fdf356a08443.b2c432b0-64c7-46aa-8319-d5c1d3092e45 {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:55:04 devstack sudo[108486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-aef86f1a-8baa-40a4-8680-fdf356a08443.b2c432b0-64c7-46aa-8319-d5c1d3092e45 Jun 17 04:55:04 devstack sudo[108486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:55:04 devstack sudo[108486]: pam_unix(sudo:session): session closed for user root Jun 17 04:55:04 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-0214a1af-e548-4bf6-afa0-aa4935f9cd5b tempest-VolumesSnapshotNegativeTestJSON-1408344763 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-aef86f1a-8baa-40a4-8680-fdf356a08443.b2c432b0-64c7-46aa-8319-d5c1d3092e45" returned: 0 in 0.564s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:55:04 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-0214a1af-e548-4bf6-afa0-aa4935f9cd5b tempest-VolumesSnapshotNegativeTestJSON-1408344763 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-aef86f1a-8baa-40a4-8680-fdf356a08443.info {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:55:04 devstack sudo[108489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-aef86f1a-8baa-40a4-8680-fdf356a08443.info Jun 17 04:55:04 devstack sudo[108489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:55:05 devstack sudo[108489]: pam_unix(sudo:session): session closed for user root Jun 17 04:55:05 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-0214a1af-e548-4bf6-afa0-aa4935f9cd5b tempest-VolumesSnapshotNegativeTestJSON-1408344763 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-aef86f1a-8baa-40a4-8680-fdf356a08443.info" returned: 0 in 0.575s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:55:05 devstack cinder-volume[92060]: WARNING cinder.volume.drivers.remotefs [None req-0214a1af-e548-4bf6-afa0-aa4935f9cd5b tempest-VolumesSnapshotNegativeTestJSON-1408344763 None] /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-aef86f1a-8baa-40a4-8680-fdf356a08443.info is being set with open permissions: ugo+rw Jun 17 04:55:05 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-0214a1af-e548-4bf6-afa0-aa4935f9cd5b tempest-VolumesSnapshotNegativeTestJSON-1408344763 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-aef86f1a-8baa-40a4-8680-fdf356a08443.info {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:55:05 devstack sudo[108492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-aef86f1a-8baa-40a4-8680-fdf356a08443.info Jun 17 04:55:05 devstack sudo[108492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:55:06 devstack sudo[108492]: pam_unix(sudo:session): session closed for user root Jun 17 04:55:06 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-0214a1af-e548-4bf6-afa0-aa4935f9cd5b tempest-VolumesSnapshotNegativeTestJSON-1408344763 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-aef86f1a-8baa-40a4-8680-fdf356a08443.info" returned: 0 in 0.569s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:55:06 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-0214a1af-e548-4bf6-afa0-aa4935f9cd5b tempest-VolumesSnapshotNegativeTestJSON-1408344763 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.816s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 04:55:06 devstack cinder-volume[92060]: INFO cinder.volume.manager [None req-0214a1af-e548-4bf6-afa0-aa4935f9cd5b tempest-VolumesSnapshotNegativeTestJSON-1408344763 None] Create snapshot completed successfully Jun 17 04:55:06 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-126391aa-7585-48e3-9411-e79b4f37e3e4 tempest-VolumesSnapshotNegativeTestJSON-1408344763 None] Acquiring lock "cinder-b2c432b0-64c7-46aa-8319-d5c1d3092e45-delete_snapshot" by "delete_snapshot" {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 04:55:06 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-126391aa-7585-48e3-9411-e79b4f37e3e4 tempest-VolumesSnapshotNegativeTestJSON-1408344763 None] Lock "cinder-b2c432b0-64c7-46aa-8319-d5c1d3092e45-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 04:55:06 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-126391aa-7585-48e3-9411-e79b4f37e3e4 tempest-VolumesSnapshotNegativeTestJSON-1408344763 None] Acquiring lock "cinder-quobyte-aef86f1a-8baa-40a4-8680-fdf356a08443" by "delete_snapshot" {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 04:55:06 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-126391aa-7585-48e3-9411-e79b4f37e3e4 tempest-VolumesSnapshotNegativeTestJSON-1408344763 None] Lock "cinder-quobyte-aef86f1a-8baa-40a4-8680-fdf356a08443" acquired by "delete_snapshot" :: waited 0.013s {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 04:55:06 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-126391aa-7585-48e3-9411-e79b4f37e3e4 tempest-VolumesSnapshotNegativeTestJSON-1408344763 None] Acquiring lock "cinder-quobyte-b2c432b0-64c7-46aa-8319-d5c1d3092e45" by "_delete_snapshot" {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 04:55:06 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-126391aa-7585-48e3-9411-e79b4f37e3e4 tempest-VolumesSnapshotNegativeTestJSON-1408344763 None] Lock "cinder-quobyte-b2c432b0-64c7-46aa-8319-d5c1d3092e45" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 04:55:06 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.remotefs [None req-126391aa-7585-48e3-9411-e79b4f37e3e4 tempest-VolumesSnapshotNegativeTestJSON-1408344763 None] Deleting offline snapshot b2c432b0-64c7-46aa-8319-d5c1d3092e45 of volume aef86f1a-8baa-40a4-8680-fdf356a08443 {{(pid=92060) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 17 04:55:06 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.remotefs [None req-126391aa-7585-48e3-9411-e79b4f37e3e4 tempest-VolumesSnapshotNegativeTestJSON-1408344763 None] snapshot_file for this snap is: volume-aef86f1a-8baa-40a4-8680-fdf356a08443.b2c432b0-64c7-46aa-8319-d5c1d3092e45 {{(pid=92060) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 17 04:55:06 devstack cinder-volume[92060]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd471621-8d8e-4b84-b48a-d554aa2c5842]: (4, 'qcow2') {{(pid=93130) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 04:55:06 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-126391aa-7585-48e3-9411-e79b4f37e3e4 tempest-VolumesSnapshotNegativeTestJSON-1408344763 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-aef86f1a-8baa-40a4-8680-fdf356a08443.b2c432b0-64c7-46aa-8319-d5c1d3092e45 {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:55:06 devstack sudo[108495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-aef86f1a-8baa-40a4-8680-fdf356a08443.b2c432b0-64c7-46aa-8319-d5c1d3092e45 Jun 17 04:55:06 devstack sudo[108495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:55:07 devstack sudo[108495]: pam_unix(sudo:session): session closed for user root Jun 17 04:55:07 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-126391aa-7585-48e3-9411-e79b4f37e3e4 tempest-VolumesSnapshotNegativeTestJSON-1408344763 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-aef86f1a-8baa-40a4-8680-fdf356a08443.b2c432b0-64c7-46aa-8319-d5c1d3092e45" returned: 0 in 0.696s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:55:07 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.remotefs [None req-126391aa-7585-48e3-9411-e79b4f37e3e4 tempest-VolumesSnapshotNegativeTestJSON-1408344763 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-aef86f1a-8baa-40a4-8680-fdf356a08443(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=92060) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 17 04:55:07 devstack cinder-volume[92060]: DEBUG oslo.privsep.daemon [-] privsep: reply[89dbface-26dc-4eb5-a17e-bfc6e6e83aae]: (4, 'qcow2') {{(pid=93130) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 04:55:07 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-126391aa-7585-48e3-9411-e79b4f37e3e4 tempest-VolumesSnapshotNegativeTestJSON-1408344763 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-aef86f1a-8baa-40a4-8680-fdf356a08443 {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:55:07 devstack sudo[108500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-aef86f1a-8baa-40a4-8680-fdf356a08443 Jun 17 04:55:07 devstack sudo[108500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:55:07 devstack sudo[108500]: pam_unix(sudo:session): session closed for user root Jun 17 04:55:07 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-126391aa-7585-48e3-9411-e79b4f37e3e4 tempest-VolumesSnapshotNegativeTestJSON-1408344763 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-aef86f1a-8baa-40a4-8680-fdf356a08443" returned: 0 in 0.674s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:55:07 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-126391aa-7585-48e3-9411-e79b4f37e3e4 tempest-VolumesSnapshotNegativeTestJSON-1408344763 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-aef86f1a-8baa-40a4-8680-fdf356a08443.b2c432b0-64c7-46aa-8319-d5c1d3092e45 {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:55:07 devstack sudo[108505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-aef86f1a-8baa-40a4-8680-fdf356a08443.b2c432b0-64c7-46aa-8319-d5c1d3092e45 Jun 17 04:55:07 devstack sudo[108505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:55:08 devstack sudo[108505]: pam_unix(sudo:session): session closed for user root Jun 17 04:55:08 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-126391aa-7585-48e3-9411-e79b4f37e3e4 tempest-VolumesSnapshotNegativeTestJSON-1408344763 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-aef86f1a-8baa-40a4-8680-fdf356a08443.b2c432b0-64c7-46aa-8319-d5c1d3092e45" returned: 0 in 0.635s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:55:08 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-126391aa-7585-48e3-9411-e79b4f37e3e4 tempest-VolumesSnapshotNegativeTestJSON-1408344763 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-aef86f1a-8baa-40a4-8680-fdf356a08443.b2c432b0-64c7-46aa-8319-d5c1d3092e45 {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:55:08 devstack sudo[108510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-aef86f1a-8baa-40a4-8680-fdf356a08443.b2c432b0-64c7-46aa-8319-d5c1d3092e45 Jun 17 04:55:08 devstack sudo[108510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:55:09 devstack sudo[108510]: pam_unix(sudo:session): session closed for user root Jun 17 04:55:09 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-126391aa-7585-48e3-9411-e79b4f37e3e4 tempest-VolumesSnapshotNegativeTestJSON-1408344763 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-aef86f1a-8baa-40a4-8680-fdf356a08443.b2c432b0-64c7-46aa-8319-d5c1d3092e45" returned: 0 in 0.612s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:55:09 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-126391aa-7585-48e3-9411-e79b4f37e3e4 tempest-VolumesSnapshotNegativeTestJSON-1408344763 None] Lock "cinder-quobyte-b2c432b0-64c7-46aa-8319-d5c1d3092e45" released by "_delete_snapshot" :: held 2.711s {{(pid=92060) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 04:55:09 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-126391aa-7585-48e3-9411-e79b4f37e3e4 tempest-VolumesSnapshotNegativeTestJSON-1408344763 None] Lock "cinder-quobyte-aef86f1a-8baa-40a4-8680-fdf356a08443" released by "delete_snapshot" :: held 2.731s {{(pid=92060) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 04:55:09 devstack cinder-volume[92060]: DEBUG cinder.quota [None req-126391aa-7585-48e3-9411-e79b4f37e3e4 tempest-VolumesSnapshotNegativeTestJSON-1408344763 None] Created reservations ['8a2bcda0-1dd6-4830-9889-a6cee1e67341', '1481f1e4-94c1-42f1-97ee-73ab5bbc562c', 'ef8ab599-83f9-4f53-9b0e-46fc776815da', '9bb3fe8e-10df-46df-8bcc-0889064ae83b'] {{(pid=92060) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 17 04:55:09 devstack cinder-volume[92060]: INFO cinder.volume.manager [None req-126391aa-7585-48e3-9411-e79b4f37e3e4 tempest-VolumesSnapshotNegativeTestJSON-1408344763 None] Delete snapshot completed successfully. Jun 17 04:55:09 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-126391aa-7585-48e3-9411-e79b4f37e3e4 tempest-VolumesSnapshotNegativeTestJSON-1408344763 None] Lock "cinder-b2c432b0-64c7-46aa-8319-d5c1d3092e45-delete_snapshot" released by "delete_snapshot" :: held 2.853s {{(pid=92060) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 04:55:09 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-4260b72d-64bc-45e0-9019-114de9e7082a tempest-VolumesSnapshotNegativeTestJSON-1408344763 None] Acquiring lock "cinder-aef86f1a-8baa-40a4-8680-fdf356a08443-delete_volume" by "delete_volume" {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 04:55:09 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-4260b72d-64bc-45e0-9019-114de9e7082a tempest-VolumesSnapshotNegativeTestJSON-1408344763 None] Lock "cinder-aef86f1a-8baa-40a4-8680-fdf356a08443-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 04:55:09 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-4260b72d-64bc-45e0-9019-114de9e7082a tempest-VolumesSnapshotNegativeTestJSON-1408344763 None] Acquiring lock "cinder-quobyte-aef86f1a-8baa-40a4-8680-fdf356a08443" by "delete_volume" {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 04:55:09 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-4260b72d-64bc-45e0-9019-114de9e7082a tempest-VolumesSnapshotNegativeTestJSON-1408344763 None] Lock "cinder-quobyte-aef86f1a-8baa-40a4-8680-fdf356a08443" acquired by "delete_volume" :: waited 0.013s {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 04:55:10 devstack cinder-volume[92060]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3cc8963-b432-4e7f-8512-1af4244c3b0a]: (4, 'qcow2') {{(pid=93130) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 04:55:10 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-4260b72d-64bc-45e0-9019-114de9e7082a tempest-VolumesSnapshotNegativeTestJSON-1408344763 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-aef86f1a-8baa-40a4-8680-fdf356a08443 {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:55:10 devstack sudo[108519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-aef86f1a-8baa-40a4-8680-fdf356a08443 Jun 17 04:55:10 devstack sudo[108519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:55:10 devstack sudo[108519]: pam_unix(sudo:session): session closed for user root Jun 17 04:55:10 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-4260b72d-64bc-45e0-9019-114de9e7082a tempest-VolumesSnapshotNegativeTestJSON-1408344763 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-aef86f1a-8baa-40a4-8680-fdf356a08443" returned: 0 in 0.669s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:55:10 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-4260b72d-64bc-45e0-9019-114de9e7082a tempest-VolumesSnapshotNegativeTestJSON-1408344763 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-aef86f1a-8baa-40a4-8680-fdf356a08443 {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:55:10 devstack sudo[108524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-aef86f1a-8baa-40a4-8680-fdf356a08443 Jun 17 04:55:10 devstack sudo[108524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:55:11 devstack sudo[108524]: pam_unix(sudo:session): session closed for user root Jun 17 04:55:11 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-4260b72d-64bc-45e0-9019-114de9e7082a tempest-VolumesSnapshotNegativeTestJSON-1408344763 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-aef86f1a-8baa-40a4-8680-fdf356a08443" returned: 0 in 0.585s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:55:11 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-4260b72d-64bc-45e0-9019-114de9e7082a tempest-VolumesSnapshotNegativeTestJSON-1408344763 None] Lock "cinder-quobyte-aef86f1a-8baa-40a4-8680-fdf356a08443" released by "delete_volume" :: held 1.304s {{(pid=92060) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 04:55:11 devstack cinder-volume[92060]: DEBUG cinder.quota [None req-4260b72d-64bc-45e0-9019-114de9e7082a tempest-VolumesSnapshotNegativeTestJSON-1408344763 None] Created reservations ['e16b58e9-efe7-4c99-a24a-577841bb96d2', 'db04db83-3841-4c75-957d-e29150b40d79', '83afd3fd-ef50-4e16-917a-24a244abd59d', '880692f9-5548-48d3-9449-94bd4de23442'] {{(pid=92060) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 17 04:55:11 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-4260b72d-64bc-45e0-9019-114de9e7082a tempest-VolumesSnapshotNegativeTestJSON-1408344763 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 04:55:11 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-4260b72d-64bc-45e0-9019-114de9e7082a tempest-VolumesSnapshotNegativeTestJSON-1408344763 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 04:55:11 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-4260b72d-64bc-45e0-9019-114de9e7082a tempest-VolumesSnapshotNegativeTestJSON-1408344763 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588': None} {{(pid=92060) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 17 04:55:11 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-4260b72d-64bc-45e0-9019-114de9e7082a tempest-VolumesSnapshotNegativeTestJSON-1408344763 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588'] {{(pid=92060) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 17 04:55:11 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-4260b72d-64bc-45e0-9019-114de9e7082a tempest-VolumesSnapshotNegativeTestJSON-1408344763 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 04:55:11 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-4260b72d-64bc-45e0-9019-114de9e7082a tempest-VolumesSnapshotNegativeTestJSON-1408344763 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:55:11 devstack sudo[108528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a Jun 17 04:55:11 devstack sudo[108528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:55:11 devstack sudo[108528]: pam_unix(sudo:session): session closed for user root Jun 17 04:55:11 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-4260b72d-64bc-45e0-9019-114de9e7082a tempest-VolumesSnapshotNegativeTestJSON-1408344763 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a" returned: 0 in 0.578s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:55:11 devstack cinder-volume[92060]: DEBUG cinder.manager [None req-4260b72d-64bc-45e0-9019-114de9e7082a tempest-VolumesSnapshotNegativeTestJSON-1408344763 None] Notifying Schedulers of capabilities ... {{(pid=92060) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 17 04:55:11 devstack cinder-volume[92060]: INFO cinder.volume.manager [None req-4260b72d-64bc-45e0-9019-114de9e7082a tempest-VolumesSnapshotNegativeTestJSON-1408344763 None] Deleted volume successfully. Jun 17 04:55:11 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-4260b72d-64bc-45e0-9019-114de9e7082a tempest-VolumesSnapshotNegativeTestJSON-1408344763 None] Lock "cinder-aef86f1a-8baa-40a4-8680-fdf356a08443-delete_volume" released by "delete_volume" :: held 2.050s {{(pid=92060) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 04:55:21 devstack cinder-volume[92060]: DEBUG dbcounter [-] [92060] Writing DB stats cinder:SELECT=38,cinder:DELETE=2,cinder:UPDATE=39,cinder:INSERT=13 {{(pid=92060) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 17 04:55:21 devstack cinder-volume[92060]: DEBUG dbcounter [-] [92060] Writing DB stats cinder:UPDATE=54,cinder:DELETE=6,cinder:SELECT=48,cinder:INSERT=14 {{(pid=92060) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 17 04:55:32 devstack cinder-volume[92060]: DEBUG cinder.volume.flows.manager.create_volume [None req-4d848f08-3b12-4e2b-b2f3-ddaecefbc12b tempest-TestServerVolumeAttachmentScenario-1307435199 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92060) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 17 04:55:32 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-4d848f08-3b12-4e2b-b2f3-ddaecefbc12b tempest-TestServerVolumeAttachmentScenario-1307435199 None] Flow 'volume_create_manager' (bd7de82e-0702-48ee-8e79-30acec72dfda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 17 04:55:32 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-4d848f08-3b12-4e2b-b2f3-ddaecefbc12b tempest-TestServerVolumeAttachmentScenario-1307435199 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e9239b2c-49f9-4387-8caa-d718c0d4408a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:55:32 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-4d848f08-3b12-4e2b-b2f3-ddaecefbc12b tempest-TestServerVolumeAttachmentScenario-1307435199 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e9239b2c-49f9-4387-8caa-d718c0d4408a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-17T02:55:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-680487662',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=271664e3-d10e-42f9-a457-bf51a0ba4b92,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9f9c4358dce144b485ceffd2fe415e9e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T02:55:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T02:55:32Z,use_quota=True,user_id='75378ccd739f41809907fef5e7381232',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aad9ce24-93f9-41a6-baa1-5125964f96d1),volume_type_id=aad9ce24-93f9-41a6-baa1-5125964f96d1)' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:55:32 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-4d848f08-3b12-4e2b-b2f3-ddaecefbc12b tempest-TestServerVolumeAttachmentScenario-1307435199 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (08d7ac8e-b6de-4001-a484-87193da81cf8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:55:32 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-4d848f08-3b12-4e2b-b2f3-ddaecefbc12b tempest-TestServerVolumeAttachmentScenario-1307435199 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (08d7ac8e-b6de-4001-a484-87193da81cf8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:55:32 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-4d848f08-3b12-4e2b-b2f3-ddaecefbc12b tempest-TestServerVolumeAttachmentScenario-1307435199 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d45e46d5-6a43-445f-88e0-706d764e3be3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:55:32 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-4d848f08-3b12-4e2b-b2f3-ddaecefbc12b tempest-TestServerVolumeAttachmentScenario-1307435199 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d45e46d5-6a43-445f-88e0-706d764e3be3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '271664e3-d10e-42f9-a457-bf51a0ba4b92', 'volume_name': 'volume-271664e3-d10e-42f9-a457-bf51a0ba4b92', 'volume_size': 1}' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:55:32 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-4d848f08-3b12-4e2b-b2f3-ddaecefbc12b tempest-TestServerVolumeAttachmentScenario-1307435199 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6609b475-7c2f-44a4-8a24-69e449c888b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:55:32 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-4d848f08-3b12-4e2b-b2f3-ddaecefbc12b tempest-TestServerVolumeAttachmentScenario-1307435199 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6609b475-7c2f-44a4-8a24-69e449c888b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:55:32 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-4d848f08-3b12-4e2b-b2f3-ddaecefbc12b tempest-TestServerVolumeAttachmentScenario-1307435199 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d62302d2-32fa-47b0-95c3-e0e0885c46ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:55:32 devstack cinder-volume[92060]: INFO cinder.volume.flows.manager.create_volume [None req-4d848f08-3b12-4e2b-b2f3-ddaecefbc12b tempest-TestServerVolumeAttachmentScenario-1307435199 None] Volume 271664e3-d10e-42f9-a457-bf51a0ba4b92: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-271664e3-d10e-42f9-a457-bf51a0ba4b92', 'volume_size': 1} Jun 17 04:55:32 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-4d848f08-3b12-4e2b-b2f3-ddaecefbc12b tempest-TestServerVolumeAttachmentScenario-1307435199 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 04:55:32 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-4d848f08-3b12-4e2b-b2f3-ddaecefbc12b tempest-TestServerVolumeAttachmentScenario-1307435199 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 04:55:32 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-4d848f08-3b12-4e2b-b2f3-ddaecefbc12b tempest-TestServerVolumeAttachmentScenario-1307435199 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-17T02:55:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-680487662',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=271664e3-d10e-42f9-a457-bf51a0ba4b92,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9f9c4358dce144b485ceffd2fe415e9e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T02:55:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T02:55:32Z,use_quota=True,user_id='75378ccd739f41809907fef5e7381232',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aad9ce24-93f9-41a6-baa1-5125964f96d1),volume_type_id=aad9ce24-93f9-41a6-baa1-5125964f96d1)}" {{(pid=92060) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 17 04:55:32 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.remotefs [None req-4d848f08-3b12-4e2b-b2f3-ddaecefbc12b tempest-TestServerVolumeAttachmentScenario-1307435199 None] Creating volume 271664e3-d10e-42f9-a457-bf51a0ba4b92 {{(pid=92060) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 17 04:55:32 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-4d848f08-3b12-4e2b-b2f3-ddaecefbc12b tempest-TestServerVolumeAttachmentScenario-1307435199 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 04:55:32 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-4d848f08-3b12-4e2b-b2f3-ddaecefbc12b tempest-TestServerVolumeAttachmentScenario-1307435199 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 04:55:32 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-4d848f08-3b12-4e2b-b2f3-ddaecefbc12b tempest-TestServerVolumeAttachmentScenario-1307435199 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588': None} {{(pid=92060) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 17 04:55:32 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-4d848f08-3b12-4e2b-b2f3-ddaecefbc12b tempest-TestServerVolumeAttachmentScenario-1307435199 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588'] {{(pid=92060) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 17 04:55:32 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-4d848f08-3b12-4e2b-b2f3-ddaecefbc12b tempest-TestServerVolumeAttachmentScenario-1307435199 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 04:55:32 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-4d848f08-3b12-4e2b-b2f3-ddaecefbc12b tempest-TestServerVolumeAttachmentScenario-1307435199 None] Selected osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588 as target Quobyte volume. {{(pid=92060) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 17 04:55:32 devstack cinder-volume[92060]: INFO cinder.volume.drivers.remotefs [None req-4d848f08-3b12-4e2b-b2f3-ddaecefbc12b tempest-TestServerVolumeAttachmentScenario-1307435199 None] casted to osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588 Jun 17 04:55:32 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-4d848f08-3b12-4e2b-b2f3-ddaecefbc12b tempest-TestServerVolumeAttachmentScenario-1307435199 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-271664e3-d10e-42f9-a457-bf51a0ba4b92 1073741824 {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:55:32 devstack sudo[108988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-271664e3-d10e-42f9-a457-bf51a0ba4b92 1073741824 Jun 17 04:55:32 devstack sudo[108988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:55:32 devstack cinder-volume[92060]: DEBUG cinder.volume.flows.manager.create_volume [None req-3db9524d-07ed-4cea-942d-0b5c018c9679 tempest-TestServerVolumeAttachmentScenario-1307435199 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92060) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 17 04:55:32 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-3db9524d-07ed-4cea-942d-0b5c018c9679 tempest-TestServerVolumeAttachmentScenario-1307435199 None] Flow 'volume_create_manager' (d91706dd-4cf1-412a-b883-f8da4b6e36e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 17 04:55:32 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-3db9524d-07ed-4cea-942d-0b5c018c9679 tempest-TestServerVolumeAttachmentScenario-1307435199 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1464ea11-b799-4c3c-bb15-d6bdd716ed99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:55:32 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-3db9524d-07ed-4cea-942d-0b5c018c9679 tempest-TestServerVolumeAttachmentScenario-1307435199 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1464ea11-b799-4c3c-bb15-d6bdd716ed99) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-17T02:55:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1076582959',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=618a56ea-9e94-4df8-9998-b54fe6f25412,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9f9c4358dce144b485ceffd2fe415e9e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T02:55:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T02:55:32Z,use_quota=True,user_id='75378ccd739f41809907fef5e7381232',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aad9ce24-93f9-41a6-baa1-5125964f96d1),volume_type_id=aad9ce24-93f9-41a6-baa1-5125964f96d1)' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:55:32 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-3db9524d-07ed-4cea-942d-0b5c018c9679 tempest-TestServerVolumeAttachmentScenario-1307435199 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d362ac19-fa76-41fe-9b45-c5d16726cf53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:55:32 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-3db9524d-07ed-4cea-942d-0b5c018c9679 tempest-TestServerVolumeAttachmentScenario-1307435199 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d362ac19-fa76-41fe-9b45-c5d16726cf53) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:55:32 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-3db9524d-07ed-4cea-942d-0b5c018c9679 tempest-TestServerVolumeAttachmentScenario-1307435199 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6c479191-48f7-484d-b2a8-82f8ade549dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:55:32 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-3db9524d-07ed-4cea-942d-0b5c018c9679 tempest-TestServerVolumeAttachmentScenario-1307435199 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6c479191-48f7-484d-b2a8-82f8ade549dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '618a56ea-9e94-4df8-9998-b54fe6f25412', 'volume_name': 'volume-618a56ea-9e94-4df8-9998-b54fe6f25412', 'volume_size': 1}' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:55:32 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-3db9524d-07ed-4cea-942d-0b5c018c9679 tempest-TestServerVolumeAttachmentScenario-1307435199 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d897b29a-66b1-4e1c-a2de-bae0a50a3177) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:55:32 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-3db9524d-07ed-4cea-942d-0b5c018c9679 tempest-TestServerVolumeAttachmentScenario-1307435199 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d897b29a-66b1-4e1c-a2de-bae0a50a3177) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:55:32 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-3db9524d-07ed-4cea-942d-0b5c018c9679 tempest-TestServerVolumeAttachmentScenario-1307435199 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (12dad84e-0c93-4856-87a8-e71fc047a1c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:55:32 devstack cinder-volume[92060]: INFO cinder.volume.flows.manager.create_volume [None req-3db9524d-07ed-4cea-942d-0b5c018c9679 tempest-TestServerVolumeAttachmentScenario-1307435199 None] Volume 618a56ea-9e94-4df8-9998-b54fe6f25412: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-618a56ea-9e94-4df8-9998-b54fe6f25412', 'volume_size': 1} Jun 17 04:55:32 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-3db9524d-07ed-4cea-942d-0b5c018c9679 tempest-TestServerVolumeAttachmentScenario-1307435199 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 04:55:33 devstack sudo[108988]: pam_unix(sudo:session): session closed for user root Jun 17 04:55:33 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-4d848f08-3b12-4e2b-b2f3-ddaecefbc12b tempest-TestServerVolumeAttachmentScenario-1307435199 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-271664e3-d10e-42f9-a457-bf51a0ba4b92 1073741824" returned: 0 in 0.810s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:55:33 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-4d848f08-3b12-4e2b-b2f3-ddaecefbc12b tempest-TestServerVolumeAttachmentScenario-1307435199 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-271664e3-d10e-42f9-a457-bf51a0ba4b92 {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:55:33 devstack sudo[108994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-271664e3-d10e-42f9-a457-bf51a0ba4b92 Jun 17 04:55:33 devstack sudo[108994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:55:33 devstack sudo[108994]: pam_unix(sudo:session): session closed for user root Jun 17 04:55:33 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-4d848f08-3b12-4e2b-b2f3-ddaecefbc12b tempest-TestServerVolumeAttachmentScenario-1307435199 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-271664e3-d10e-42f9-a457-bf51a0ba4b92" returned: 0 in 0.594s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:55:33 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-4d848f08-3b12-4e2b-b2f3-ddaecefbc12b tempest-TestServerVolumeAttachmentScenario-1307435199 None] <== create_volume: return (1442ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588'} {{(pid=92060) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 17 04:55:33 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-4d848f08-3b12-4e2b-b2f3-ddaecefbc12b tempest-TestServerVolumeAttachmentScenario-1307435199 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.445s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 04:55:33 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-3db9524d-07ed-4cea-942d-0b5c018c9679 tempest-TestServerVolumeAttachmentScenario-1307435199 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.106s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 04:55:33 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-3db9524d-07ed-4cea-942d-0b5c018c9679 tempest-TestServerVolumeAttachmentScenario-1307435199 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-17T02:55:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1076582959',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=618a56ea-9e94-4df8-9998-b54fe6f25412,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9f9c4358dce144b485ceffd2fe415e9e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T02:55:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T02:55:32Z,use_quota=True,user_id='75378ccd739f41809907fef5e7381232',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aad9ce24-93f9-41a6-baa1-5125964f96d1),volume_type_id=aad9ce24-93f9-41a6-baa1-5125964f96d1)}" {{(pid=92060) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 17 04:55:33 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.remotefs [None req-3db9524d-07ed-4cea-942d-0b5c018c9679 tempest-TestServerVolumeAttachmentScenario-1307435199 None] Creating volume 618a56ea-9e94-4df8-9998-b54fe6f25412 {{(pid=92060) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 17 04:55:33 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-3db9524d-07ed-4cea-942d-0b5c018c9679 tempest-TestServerVolumeAttachmentScenario-1307435199 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 04:55:33 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-3db9524d-07ed-4cea-942d-0b5c018c9679 tempest-TestServerVolumeAttachmentScenario-1307435199 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 04:55:33 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-3db9524d-07ed-4cea-942d-0b5c018c9679 tempest-TestServerVolumeAttachmentScenario-1307435199 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588': None} {{(pid=92060) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 17 04:55:33 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-3db9524d-07ed-4cea-942d-0b5c018c9679 tempest-TestServerVolumeAttachmentScenario-1307435199 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588'] {{(pid=92060) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 17 04:55:33 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-3db9524d-07ed-4cea-942d-0b5c018c9679 tempest-TestServerVolumeAttachmentScenario-1307435199 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 04:55:33 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-3db9524d-07ed-4cea-942d-0b5c018c9679 tempest-TestServerVolumeAttachmentScenario-1307435199 None] Selected osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588 as target Quobyte volume. {{(pid=92060) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 17 04:55:33 devstack cinder-volume[92060]: INFO cinder.volume.drivers.remotefs [None req-3db9524d-07ed-4cea-942d-0b5c018c9679 tempest-TestServerVolumeAttachmentScenario-1307435199 None] casted to osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588 Jun 17 04:55:33 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-3db9524d-07ed-4cea-942d-0b5c018c9679 tempest-TestServerVolumeAttachmentScenario-1307435199 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-618a56ea-9e94-4df8-9998-b54fe6f25412 1073741824 {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:55:33 devstack sudo[108997]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-618a56ea-9e94-4df8-9998-b54fe6f25412 1073741824 Jun 17 04:55:33 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-4d848f08-3b12-4e2b-b2f3-ddaecefbc12b tempest-TestServerVolumeAttachmentScenario-1307435199 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d62302d2-32fa-47b0-95c3-e0e0885c46ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-271664e3-d10e-42f9-a457-bf51a0ba4b92', 'volume_size': 1}' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:55:33 devstack sudo[108997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:55:33 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-4d848f08-3b12-4e2b-b2f3-ddaecefbc12b tempest-TestServerVolumeAttachmentScenario-1307435199 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (473dff91-de24-41c8-af9c-3aba8a532897) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:55:33 devstack cinder-volume[92060]: INFO cinder.volume.flows.manager.create_volume [None req-4d848f08-3b12-4e2b-b2f3-ddaecefbc12b tempest-TestServerVolumeAttachmentScenario-1307435199 None] Volume volume-271664e3-d10e-42f9-a457-bf51a0ba4b92 (271664e3-d10e-42f9-a457-bf51a0ba4b92): created successfully Jun 17 04:55:33 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-4d848f08-3b12-4e2b-b2f3-ddaecefbc12b tempest-TestServerVolumeAttachmentScenario-1307435199 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (473dff91-de24-41c8-af9c-3aba8a532897) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:55:33 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-4d848f08-3b12-4e2b-b2f3-ddaecefbc12b tempest-TestServerVolumeAttachmentScenario-1307435199 None] Flow 'volume_create_manager' (bd7de82e-0702-48ee-8e79-30acec72dfda) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92060) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 17 04:55:33 devstack cinder-volume[92060]: INFO cinder.volume.manager [None req-4d848f08-3b12-4e2b-b2f3-ddaecefbc12b tempest-TestServerVolumeAttachmentScenario-1307435199 None] Created volume successfully. Jun 17 04:55:34 devstack sudo[108997]: pam_unix(sudo:session): session closed for user root Jun 17 04:55:34 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-3db9524d-07ed-4cea-942d-0b5c018c9679 tempest-TestServerVolumeAttachmentScenario-1307435199 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-618a56ea-9e94-4df8-9998-b54fe6f25412 1073741824" returned: 0 in 0.816s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:55:34 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-3db9524d-07ed-4cea-942d-0b5c018c9679 tempest-TestServerVolumeAttachmentScenario-1307435199 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-618a56ea-9e94-4df8-9998-b54fe6f25412 {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:55:34 devstack sudo[109003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-618a56ea-9e94-4df8-9998-b54fe6f25412 Jun 17 04:55:34 devstack sudo[109003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:55:35 devstack sudo[109003]: pam_unix(sudo:session): session closed for user root Jun 17 04:55:35 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-3db9524d-07ed-4cea-942d-0b5c018c9679 tempest-TestServerVolumeAttachmentScenario-1307435199 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-618a56ea-9e94-4df8-9998-b54fe6f25412" returned: 0 in 0.593s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:55:35 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-3db9524d-07ed-4cea-942d-0b5c018c9679 tempest-TestServerVolumeAttachmentScenario-1307435199 None] <== create_volume: return (1450ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588'} {{(pid=92060) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 17 04:55:35 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-3db9524d-07ed-4cea-942d-0b5c018c9679 tempest-TestServerVolumeAttachmentScenario-1307435199 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.454s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 04:55:35 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-3db9524d-07ed-4cea-942d-0b5c018c9679 tempest-TestServerVolumeAttachmentScenario-1307435199 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (12dad84e-0c93-4856-87a8-e71fc047a1c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-618a56ea-9e94-4df8-9998-b54fe6f25412', 'volume_size': 1}' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:55:35 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-3db9524d-07ed-4cea-942d-0b5c018c9679 tempest-TestServerVolumeAttachmentScenario-1307435199 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dd92e490-2a4d-42a2-b243-eb31d0f19f44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:55:35 devstack cinder-volume[92060]: INFO cinder.volume.flows.manager.create_volume [None req-3db9524d-07ed-4cea-942d-0b5c018c9679 tempest-TestServerVolumeAttachmentScenario-1307435199 None] Volume volume-618a56ea-9e94-4df8-9998-b54fe6f25412 (618a56ea-9e94-4df8-9998-b54fe6f25412): created successfully Jun 17 04:55:35 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-3db9524d-07ed-4cea-942d-0b5c018c9679 tempest-TestServerVolumeAttachmentScenario-1307435199 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dd92e490-2a4d-42a2-b243-eb31d0f19f44) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:55:35 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-3db9524d-07ed-4cea-942d-0b5c018c9679 tempest-TestServerVolumeAttachmentScenario-1307435199 None] Flow 'volume_create_manager' (d91706dd-4cf1-412a-b883-f8da4b6e36e1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92060) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 17 04:55:35 devstack cinder-volume[92060]: INFO cinder.volume.manager [None req-3db9524d-07ed-4cea-942d-0b5c018c9679 tempest-TestServerVolumeAttachmentScenario-1307435199 None] Created volume successfully. Jun 17 04:55:44 devstack cinder-volume[92060]: DEBUG oslo_service.periodic_task [None req-60d279ad-ad8c-4d36-a4b8-f593e74fb922 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=92060) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 17 04:55:44 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-60d279ad-ad8c-4d36-a4b8-f593e74fb922 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 04:55:44 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-60d279ad-ad8c-4d36-a4b8-f593e74fb922 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 04:55:44 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-60d279ad-ad8c-4d36-a4b8-f593e74fb922 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588': None} {{(pid=92060) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 17 04:55:44 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-60d279ad-ad8c-4d36-a4b8-f593e74fb922 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588'] {{(pid=92060) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 17 04:55:44 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-60d279ad-ad8c-4d36-a4b8-f593e74fb922 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 04:55:44 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-60d279ad-ad8c-4d36-a4b8-f593e74fb922 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:55:44 devstack sudo[109029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a Jun 17 04:55:44 devstack sudo[109029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:55:45 devstack cinder-volume[92060]: DEBUG dbcounter [-] [92060] Writing DB stats cinder:SELECT=6,cinder:UPDATE=7,cinder:INSERT=1 {{(pid=92060) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 17 04:55:45 devstack cinder-volume[92060]: DEBUG dbcounter [-] [92060] Writing DB stats cinder:SELECT=2,cinder:UPDATE=5,cinder:INSERT=1,cinder:DELETE=2 {{(pid=92060) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 17 04:55:45 devstack sudo[109029]: pam_unix(sudo:session): session closed for user root Jun 17 04:55:45 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-60d279ad-ad8c-4d36-a4b8-f593e74fb922 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a" returned: 0 in 0.584s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:55:45 devstack cinder-volume[92060]: DEBUG cinder.manager [None req-60d279ad-ad8c-4d36-a4b8-f593e74fb922 None None] Notifying Schedulers of capabilities ... {{(pid=92060) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 17 04:55:45 devstack cinder-volume[92060]: DEBUG oslo_service.periodic_task [None req-60d279ad-ad8c-4d36-a4b8-f593e74fb922 None None] Running periodic task VolumeManager._thread_info {{(pid=92060) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 17 04:55:45 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-60d279ad-ad8c-4d36-a4b8-f593e74fb922 None None] thread count: 28 {{(pid=92060) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 17 04:55:45 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-60d279ad-ad8c-4d36-a4b8-f593e74fb922 None None] thread info: [<_MainThread(MainThread, started 130061806440576)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=92060) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 17 04:56:13 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [req-902157a6-490c-4ce7-b93e-77750fb31daa req-b86d4a82-6c67-4fe0-9cc8-af7d7cd21761 tempest-TestServerVolumeAttachmentScenario-1307435199 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 04:56:13 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [req-902157a6-490c-4ce7-b93e-77750fb31daa req-b86d4a82-6c67-4fe0-9cc8-af7d7cd21761 tempest-TestServerVolumeAttachmentScenario-1307435199 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 04:56:13 devstack cinder-volume[92060]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab6f8ce5-dc28-4517-9ae0-362b34a5ed76]: (4, 'qcow2') {{(pid=93130) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 04:56:13 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [req-902157a6-490c-4ce7-b93e-77750fb31daa req-b86d4a82-6c67-4fe0-9cc8-af7d7cd21761 tempest-TestServerVolumeAttachmentScenario-1307435199 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-271664e3-d10e-42f9-a457-bf51a0ba4b92 {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:56:13 devstack sudo[109140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-271664e3-d10e-42f9-a457-bf51a0ba4b92 Jun 17 04:56:13 devstack sudo[109140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:56:14 devstack sudo[109140]: pam_unix(sudo:session): session closed for user root Jun 17 04:56:14 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [req-902157a6-490c-4ce7-b93e-77750fb31daa req-b86d4a82-6c67-4fe0-9cc8-af7d7cd21761 tempest-TestServerVolumeAttachmentScenario-1307435199 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-271664e3-d10e-42f9-a457-bf51a0ba4b92" returned: 0 in 0.685s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:56:14 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [req-902157a6-490c-4ce7-b93e-77750fb31daa req-b86d4a82-6c67-4fe0-9cc8-af7d7cd21761 tempest-TestServerVolumeAttachmentScenario-1307435199 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.701s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 04:56:14 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [req-902157a6-490c-4ce7-b93e-77750fb31daa req-b86d4a82-6c67-4fe0-9cc8-af7d7cd21761 tempest-TestServerVolumeAttachmentScenario-1307435199 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588', 'name': 'volume-271664e3-d10e-42f9-a457-bf51a0ba4b92', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '6d1af565-a4b4-4a48-a08f-2bf7a960f32a', 'enforce_multipath': True} {{(pid=92060) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 17 04:56:14 devstack cinder-volume[92060]: INFO cinder.volume.manager [req-902157a6-490c-4ce7-b93e-77750fb31daa req-b86d4a82-6c67-4fe0-9cc8-af7d7cd21761 tempest-TestServerVolumeAttachmentScenario-1307435199 None] attachment_update completed successfully. Jun 17 04:56:23 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [req-93a67569-f94f-41b3-a5a4-217705dea427 req-f40f1f29-a646-4dd9-94c9-085d50c6016a tempest-TestServerVolumeAttachmentScenario-1307435199 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 04:56:23 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [req-93a67569-f94f-41b3-a5a4-217705dea427 req-f40f1f29-a646-4dd9-94c9-085d50c6016a tempest-TestServerVolumeAttachmentScenario-1307435199 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 04:56:23 devstack cinder-volume[92060]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad512a63-532e-4185-a23b-c477372f677a]: (4, 'qcow2') {{(pid=93130) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 04:56:23 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [req-93a67569-f94f-41b3-a5a4-217705dea427 req-f40f1f29-a646-4dd9-94c9-085d50c6016a tempest-TestServerVolumeAttachmentScenario-1307435199 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-618a56ea-9e94-4df8-9998-b54fe6f25412 {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:56:23 devstack sudo[109539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-618a56ea-9e94-4df8-9998-b54fe6f25412 Jun 17 04:56:23 devstack sudo[109539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:56:24 devstack cinder-volume[92060]: DEBUG dbcounter [-] [92060] Writing DB stats cinder:SELECT=8 {{(pid=92060) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 17 04:56:24 devstack sudo[109539]: pam_unix(sudo:session): session closed for user root Jun 17 04:56:24 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [req-93a67569-f94f-41b3-a5a4-217705dea427 req-f40f1f29-a646-4dd9-94c9-085d50c6016a tempest-TestServerVolumeAttachmentScenario-1307435199 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-618a56ea-9e94-4df8-9998-b54fe6f25412" returned: 0 in 0.686s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:56:24 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [req-93a67569-f94f-41b3-a5a4-217705dea427 req-f40f1f29-a646-4dd9-94c9-085d50c6016a tempest-TestServerVolumeAttachmentScenario-1307435199 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.700s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 04:56:24 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [req-93a67569-f94f-41b3-a5a4-217705dea427 req-f40f1f29-a646-4dd9-94c9-085d50c6016a tempest-TestServerVolumeAttachmentScenario-1307435199 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588', 'name': 'volume-618a56ea-9e94-4df8-9998-b54fe6f25412', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '4f25a98b-6c8d-4bc7-9228-0dc8147efa16', 'enforce_multipath': True} {{(pid=92060) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 17 04:56:24 devstack cinder-volume[92060]: INFO cinder.volume.manager [req-93a67569-f94f-41b3-a5a4-217705dea427 req-f40f1f29-a646-4dd9-94c9-085d50c6016a tempest-TestServerVolumeAttachmentScenario-1307435199 None] attachment_update completed successfully. Jun 17 04:56:30 devstack cinder-volume[92060]: INFO cinder.volume.manager [req-4b01e702-b121-4277-8323-483fdeeeaf9e req-63d5510c-8997-4d34-b400-ba0bcfa1aa87 tempest-TestServerVolumeAttachmentScenario-1307435199 None] Terminate volume connection completed successfully. Jun 17 04:56:30 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [req-4b01e702-b121-4277-8323-483fdeeeaf9e req-63d5510c-8997-4d34-b400-ba0bcfa1aa87 tempest-TestServerVolumeAttachmentScenario-1307435199 None] Deleting attachment 4f25a98b-6c8d-4bc7-9228-0dc8147efa16. {{(pid=92060) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 17 04:56:33 devstack cinder-volume[92060]: INFO cinder.volume.manager [req-5a766e6d-42fc-460f-9616-962e70517738 req-c3677dc3-c995-413a-9ade-73a3dbf08751 tempest-TestServerVolumeAttachmentScenario-1307435199 None] Terminate volume connection completed successfully. Jun 17 04:56:33 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [req-5a766e6d-42fc-460f-9616-962e70517738 req-c3677dc3-c995-413a-9ade-73a3dbf08751 tempest-TestServerVolumeAttachmentScenario-1307435199 None] Deleting attachment 6d1af565-a4b4-4a48-a08f-2bf7a960f32a. {{(pid=92060) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 17 04:56:43 devstack cinder-volume[92060]: DEBUG dbcounter [-] [92060] Writing DB stats cinder:SELECT=7,cinder:UPDATE=2 {{(pid=92060) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 17 04:56:43 devstack cinder-volume[92060]: DEBUG dbcounter [-] [92060] Writing DB stats cinder:SELECT=12,cinder:UPDATE=5 {{(pid=92060) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 17 04:56:44 devstack cinder-volume[92060]: DEBUG oslo_service.periodic_task [None req-60d279ad-ad8c-4d36-a4b8-f593e74fb922 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=92060) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 17 04:56:44 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-60d279ad-ad8c-4d36-a4b8-f593e74fb922 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 04:56:44 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-60d279ad-ad8c-4d36-a4b8-f593e74fb922 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 04:56:44 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-60d279ad-ad8c-4d36-a4b8-f593e74fb922 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588': None} {{(pid=92060) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 17 04:56:44 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-60d279ad-ad8c-4d36-a4b8-f593e74fb922 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588'] {{(pid=92060) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 17 04:56:44 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-60d279ad-ad8c-4d36-a4b8-f593e74fb922 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 04:56:44 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-60d279ad-ad8c-4d36-a4b8-f593e74fb922 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:56:45 devstack sudo[109655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a Jun 17 04:56:45 devstack sudo[109655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:56:45 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-12bb1eb3-67dd-42db-a2b5-f65a446ce0d8 tempest-TestServerVolumeAttachmentScenario-1307435199 None] Acquiring lock "cinder-618a56ea-9e94-4df8-9998-b54fe6f25412-delete_volume" by "delete_volume" {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 04:56:45 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-12bb1eb3-67dd-42db-a2b5-f65a446ce0d8 tempest-TestServerVolumeAttachmentScenario-1307435199 None] Lock "cinder-618a56ea-9e94-4df8-9998-b54fe6f25412-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 04:56:45 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-12bb1eb3-67dd-42db-a2b5-f65a446ce0d8 tempest-TestServerVolumeAttachmentScenario-1307435199 None] Acquiring lock "cinder-quobyte-618a56ea-9e94-4df8-9998-b54fe6f25412" by "delete_volume" {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 04:56:45 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-12bb1eb3-67dd-42db-a2b5-f65a446ce0d8 tempest-TestServerVolumeAttachmentScenario-1307435199 None] Lock "cinder-quobyte-618a56ea-9e94-4df8-9998-b54fe6f25412" acquired by "delete_volume" :: waited 0.014s {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 04:56:45 devstack cinder-volume[92060]: DEBUG oslo.privsep.daemon [-] privsep: reply[fca5142d-5613-4a94-9c8c-2bc216f8e460]: (4, 'qcow2') {{(pid=93130) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 04:56:45 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-12bb1eb3-67dd-42db-a2b5-f65a446ce0d8 tempest-TestServerVolumeAttachmentScenario-1307435199 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-618a56ea-9e94-4df8-9998-b54fe6f25412 {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:56:45 devstack sudo[109657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-618a56ea-9e94-4df8-9998-b54fe6f25412 Jun 17 04:56:45 devstack sudo[109657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:56:45 devstack sudo[109655]: pam_unix(sudo:session): session closed for user root Jun 17 04:56:45 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-60d279ad-ad8c-4d36-a4b8-f593e74fb922 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a" returned: 0 in 0.638s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:56:45 devstack cinder-volume[92060]: DEBUG cinder.manager [None req-60d279ad-ad8c-4d36-a4b8-f593e74fb922 None None] Notifying Schedulers of capabilities ... {{(pid=92060) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 17 04:56:45 devstack cinder-volume[92060]: DEBUG oslo_service.periodic_task [None req-60d279ad-ad8c-4d36-a4b8-f593e74fb922 None None] Running periodic task VolumeManager._thread_info {{(pid=92060) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 17 04:56:45 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-60d279ad-ad8c-4d36-a4b8-f593e74fb922 None None] thread count: 28 {{(pid=92060) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 17 04:56:45 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-60d279ad-ad8c-4d36-a4b8-f593e74fb922 None None] thread info: [<_MainThread(MainThread, started 130061806440576)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=92060) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 17 04:56:45 devstack sudo[109657]: pam_unix(sudo:session): session closed for user root Jun 17 04:56:45 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-12bb1eb3-67dd-42db-a2b5-f65a446ce0d8 tempest-TestServerVolumeAttachmentScenario-1307435199 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-618a56ea-9e94-4df8-9998-b54fe6f25412" returned: 0 in 0.700s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:56:45 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-12bb1eb3-67dd-42db-a2b5-f65a446ce0d8 tempest-TestServerVolumeAttachmentScenario-1307435199 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-618a56ea-9e94-4df8-9998-b54fe6f25412 {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:56:45 devstack sudo[109663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-618a56ea-9e94-4df8-9998-b54fe6f25412 Jun 17 04:56:45 devstack sudo[109663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:56:46 devstack sudo[109663]: pam_unix(sudo:session): session closed for user root Jun 17 04:56:46 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-12bb1eb3-67dd-42db-a2b5-f65a446ce0d8 tempest-TestServerVolumeAttachmentScenario-1307435199 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-618a56ea-9e94-4df8-9998-b54fe6f25412" returned: 0 in 0.600s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:56:46 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-12bb1eb3-67dd-42db-a2b5-f65a446ce0d8 tempest-TestServerVolumeAttachmentScenario-1307435199 None] Lock "cinder-quobyte-618a56ea-9e94-4df8-9998-b54fe6f25412" released by "delete_volume" :: held 1.336s {{(pid=92060) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 04:56:46 devstack cinder-volume[92060]: DEBUG cinder.quota [None req-12bb1eb3-67dd-42db-a2b5-f65a446ce0d8 tempest-TestServerVolumeAttachmentScenario-1307435199 None] Created reservations ['3287b58e-463c-425f-bb3e-2e153c49cc28', '8d69cc08-fec5-4453-8e1a-a983bdd64814', '97909bf5-d1a8-4864-bb05-5f094a330c31', '20dde164-73ed-4842-97ce-30505a6126b2'] {{(pid=92060) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 17 04:56:46 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-12bb1eb3-67dd-42db-a2b5-f65a446ce0d8 tempest-TestServerVolumeAttachmentScenario-1307435199 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 04:56:46 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-12bb1eb3-67dd-42db-a2b5-f65a446ce0d8 tempest-TestServerVolumeAttachmentScenario-1307435199 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 04:56:46 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-12bb1eb3-67dd-42db-a2b5-f65a446ce0d8 tempest-TestServerVolumeAttachmentScenario-1307435199 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588': None} {{(pid=92060) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 17 04:56:46 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-12bb1eb3-67dd-42db-a2b5-f65a446ce0d8 tempest-TestServerVolumeAttachmentScenario-1307435199 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588'] {{(pid=92060) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 17 04:56:46 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-12bb1eb3-67dd-42db-a2b5-f65a446ce0d8 tempest-TestServerVolumeAttachmentScenario-1307435199 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 04:56:46 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-12bb1eb3-67dd-42db-a2b5-f65a446ce0d8 tempest-TestServerVolumeAttachmentScenario-1307435199 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:56:46 devstack sudo[109666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a Jun 17 04:56:46 devstack sudo[109666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:56:47 devstack sudo[109666]: pam_unix(sudo:session): session closed for user root Jun 17 04:56:47 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-12bb1eb3-67dd-42db-a2b5-f65a446ce0d8 tempest-TestServerVolumeAttachmentScenario-1307435199 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a" returned: 0 in 0.570s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:56:47 devstack cinder-volume[92060]: DEBUG cinder.manager [None req-12bb1eb3-67dd-42db-a2b5-f65a446ce0d8 tempest-TestServerVolumeAttachmentScenario-1307435199 None] Notifying Schedulers of capabilities ... {{(pid=92060) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 17 04:56:47 devstack cinder-volume[92060]: INFO cinder.volume.manager [None req-12bb1eb3-67dd-42db-a2b5-f65a446ce0d8 tempest-TestServerVolumeAttachmentScenario-1307435199 None] Deleted volume successfully. Jun 17 04:56:47 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-12bb1eb3-67dd-42db-a2b5-f65a446ce0d8 tempest-TestServerVolumeAttachmentScenario-1307435199 None] Lock "cinder-618a56ea-9e94-4df8-9998-b54fe6f25412-delete_volume" released by "delete_volume" :: held 2.105s {{(pid=92060) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 04:56:47 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-bcd00cbf-255b-493f-b920-026266c650df tempest-TestServerVolumeAttachmentScenario-1307435199 None] Acquiring lock "cinder-271664e3-d10e-42f9-a457-bf51a0ba4b92-delete_volume" by "delete_volume" {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 04:56:47 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-bcd00cbf-255b-493f-b920-026266c650df tempest-TestServerVolumeAttachmentScenario-1307435199 None] Lock "cinder-271664e3-d10e-42f9-a457-bf51a0ba4b92-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 04:56:47 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-bcd00cbf-255b-493f-b920-026266c650df tempest-TestServerVolumeAttachmentScenario-1307435199 None] Acquiring lock "cinder-quobyte-271664e3-d10e-42f9-a457-bf51a0ba4b92" by "delete_volume" {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 04:56:47 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-bcd00cbf-255b-493f-b920-026266c650df tempest-TestServerVolumeAttachmentScenario-1307435199 None] Lock "cinder-quobyte-271664e3-d10e-42f9-a457-bf51a0ba4b92" acquired by "delete_volume" :: waited 0.016s {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 04:56:47 devstack cinder-volume[92060]: DEBUG oslo.privsep.daemon [-] privsep: reply[f81d24cf-fa95-4e10-b2d2-d5108f2c7711]: (4, 'qcow2') {{(pid=93130) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 04:56:47 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-bcd00cbf-255b-493f-b920-026266c650df tempest-TestServerVolumeAttachmentScenario-1307435199 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-271664e3-d10e-42f9-a457-bf51a0ba4b92 {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:56:47 devstack sudo[109669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-271664e3-d10e-42f9-a457-bf51a0ba4b92 Jun 17 04:56:47 devstack sudo[109669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:56:48 devstack sudo[109669]: pam_unix(sudo:session): session closed for user root Jun 17 04:56:48 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-bcd00cbf-255b-493f-b920-026266c650df tempest-TestServerVolumeAttachmentScenario-1307435199 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-271664e3-d10e-42f9-a457-bf51a0ba4b92" returned: 0 in 0.668s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:56:48 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-bcd00cbf-255b-493f-b920-026266c650df tempest-TestServerVolumeAttachmentScenario-1307435199 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-271664e3-d10e-42f9-a457-bf51a0ba4b92 {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:56:48 devstack sudo[109674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-271664e3-d10e-42f9-a457-bf51a0ba4b92 Jun 17 04:56:48 devstack sudo[109674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:56:48 devstack sudo[109674]: pam_unix(sudo:session): session closed for user root Jun 17 04:56:48 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-bcd00cbf-255b-493f-b920-026266c650df tempest-TestServerVolumeAttachmentScenario-1307435199 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-271664e3-d10e-42f9-a457-bf51a0ba4b92" returned: 0 in 0.594s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:56:48 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-bcd00cbf-255b-493f-b920-026266c650df tempest-TestServerVolumeAttachmentScenario-1307435199 None] Lock "cinder-quobyte-271664e3-d10e-42f9-a457-bf51a0ba4b92" released by "delete_volume" :: held 1.299s {{(pid=92060) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 04:56:48 devstack cinder-volume[92060]: DEBUG cinder.quota [None req-bcd00cbf-255b-493f-b920-026266c650df tempest-TestServerVolumeAttachmentScenario-1307435199 None] Created reservations ['1526c41f-a1fd-4042-8710-4cc5c94fc68e', 'f1e11c57-0108-49a4-8cdd-f141ea23e935', '3a629014-f85a-4035-9f81-905c8896733f', '9cb64d06-7a01-4e23-b9d0-35739864953f'] {{(pid=92060) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 17 04:56:48 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-bcd00cbf-255b-493f-b920-026266c650df tempest-TestServerVolumeAttachmentScenario-1307435199 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 04:56:48 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-bcd00cbf-255b-493f-b920-026266c650df tempest-TestServerVolumeAttachmentScenario-1307435199 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 04:56:48 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-bcd00cbf-255b-493f-b920-026266c650df tempest-TestServerVolumeAttachmentScenario-1307435199 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588': None} {{(pid=92060) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 17 04:56:48 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-bcd00cbf-255b-493f-b920-026266c650df tempest-TestServerVolumeAttachmentScenario-1307435199 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588'] {{(pid=92060) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 17 04:56:48 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-bcd00cbf-255b-493f-b920-026266c650df tempest-TestServerVolumeAttachmentScenario-1307435199 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 04:56:48 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-bcd00cbf-255b-493f-b920-026266c650df tempest-TestServerVolumeAttachmentScenario-1307435199 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:56:48 devstack sudo[109677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a Jun 17 04:56:48 devstack sudo[109677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:56:49 devstack sudo[109677]: pam_unix(sudo:session): session closed for user root Jun 17 04:56:49 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-bcd00cbf-255b-493f-b920-026266c650df tempest-TestServerVolumeAttachmentScenario-1307435199 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a" returned: 0 in 0.568s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:56:49 devstack cinder-volume[92060]: DEBUG cinder.manager [None req-bcd00cbf-255b-493f-b920-026266c650df tempest-TestServerVolumeAttachmentScenario-1307435199 None] Notifying Schedulers of capabilities ... {{(pid=92060) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 17 04:56:49 devstack cinder-volume[92060]: INFO cinder.volume.manager [None req-bcd00cbf-255b-493f-b920-026266c650df tempest-TestServerVolumeAttachmentScenario-1307435199 None] Deleted volume successfully. Jun 17 04:56:49 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-bcd00cbf-255b-493f-b920-026266c650df tempest-TestServerVolumeAttachmentScenario-1307435199 None] Lock "cinder-271664e3-d10e-42f9-a457-bf51a0ba4b92-delete_volume" released by "delete_volume" :: held 2.053s {{(pid=92060) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 04:56:58 devstack cinder-volume[92060]: DEBUG dbcounter [-] [92060] Writing DB stats cinder:UPDATE=16,cinder:SELECT=11,cinder:INSERT=5,cinder:DELETE=1 {{(pid=92060) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 17 04:56:59 devstack cinder-volume[92060]: DEBUG dbcounter [-] [92060] Writing DB stats cinder:SELECT=9,cinder:INSERT=3,cinder:UPDATE=16,cinder:DELETE=1 {{(pid=92060) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 17 04:57:18 devstack cinder-volume[92060]: DEBUG cinder.volume.flows.manager.create_volume [None req-9d58c42b-e8f0-4c06-a1f3-886d9d83f313 tempest-TestStampPattern-1289616937 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92060) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 17 04:57:18 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-9d58c42b-e8f0-4c06-a1f3-886d9d83f313 tempest-TestStampPattern-1289616937 None] Flow 'volume_create_manager' (3f99d85d-0e5b-4077-95c6-6c237f82068d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 17 04:57:18 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-9d58c42b-e8f0-4c06-a1f3-886d9d83f313 tempest-TestStampPattern-1289616937 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e7b2efcc-b4c6-4960-961f-064322f1acc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:57:18 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-9d58c42b-e8f0-4c06-a1f3-886d9d83f313 tempest-TestStampPattern-1289616937 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e7b2efcc-b4c6-4960-961f-064322f1acc2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-17T02:57:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1948288479',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a697433e-1fa5-4b34-b0b2-ad480ef9807e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3ee5440660d44121a1672b411a72b971',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T02:57:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T02:57:18Z,use_quota=True,user_id='e067936feee646dfb2700d4bc2d46899',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aad9ce24-93f9-41a6-baa1-5125964f96d1),volume_type_id=aad9ce24-93f9-41a6-baa1-5125964f96d1)' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:57:18 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-9d58c42b-e8f0-4c06-a1f3-886d9d83f313 tempest-TestStampPattern-1289616937 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (056b0bab-8a4a-4167-b186-b24e7d10c47d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:57:18 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-9d58c42b-e8f0-4c06-a1f3-886d9d83f313 tempest-TestStampPattern-1289616937 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (056b0bab-8a4a-4167-b186-b24e7d10c47d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:57:18 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-9d58c42b-e8f0-4c06-a1f3-886d9d83f313 tempest-TestStampPattern-1289616937 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (249673ef-5c71-4039-82c5-b62211aff05a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:57:18 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-9d58c42b-e8f0-4c06-a1f3-886d9d83f313 tempest-TestStampPattern-1289616937 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (249673ef-5c71-4039-82c5-b62211aff05a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a697433e-1fa5-4b34-b0b2-ad480ef9807e', 'volume_name': 'volume-a697433e-1fa5-4b34-b0b2-ad480ef9807e', 'volume_size': 1}' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:57:18 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-9d58c42b-e8f0-4c06-a1f3-886d9d83f313 tempest-TestStampPattern-1289616937 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f8f14f36-90a2-4eba-87f1-23527d24fc0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:57:18 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-9d58c42b-e8f0-4c06-a1f3-886d9d83f313 tempest-TestStampPattern-1289616937 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f8f14f36-90a2-4eba-87f1-23527d24fc0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:57:18 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-9d58c42b-e8f0-4c06-a1f3-886d9d83f313 tempest-TestStampPattern-1289616937 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (170040dd-1891-4e5f-b8f9-fdcd0fb6a4e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:57:18 devstack cinder-volume[92060]: INFO cinder.volume.flows.manager.create_volume [None req-9d58c42b-e8f0-4c06-a1f3-886d9d83f313 tempest-TestStampPattern-1289616937 None] Volume a697433e-1fa5-4b34-b0b2-ad480ef9807e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a697433e-1fa5-4b34-b0b2-ad480ef9807e', 'volume_size': 1} Jun 17 04:57:18 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-9d58c42b-e8f0-4c06-a1f3-886d9d83f313 tempest-TestStampPattern-1289616937 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 04:57:18 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-9d58c42b-e8f0-4c06-a1f3-886d9d83f313 tempest-TestStampPattern-1289616937 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 04:57:18 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-9d58c42b-e8f0-4c06-a1f3-886d9d83f313 tempest-TestStampPattern-1289616937 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-17T02:57:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1948288479',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a697433e-1fa5-4b34-b0b2-ad480ef9807e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3ee5440660d44121a1672b411a72b971',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T02:57:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T02:57:18Z,use_quota=True,user_id='e067936feee646dfb2700d4bc2d46899',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aad9ce24-93f9-41a6-baa1-5125964f96d1),volume_type_id=aad9ce24-93f9-41a6-baa1-5125964f96d1)}" {{(pid=92060) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 17 04:57:18 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.remotefs [None req-9d58c42b-e8f0-4c06-a1f3-886d9d83f313 tempest-TestStampPattern-1289616937 None] Creating volume a697433e-1fa5-4b34-b0b2-ad480ef9807e {{(pid=92060) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 17 04:57:18 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-9d58c42b-e8f0-4c06-a1f3-886d9d83f313 tempest-TestStampPattern-1289616937 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 04:57:18 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-9d58c42b-e8f0-4c06-a1f3-886d9d83f313 tempest-TestStampPattern-1289616937 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 04:57:18 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-9d58c42b-e8f0-4c06-a1f3-886d9d83f313 tempest-TestStampPattern-1289616937 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588': None} {{(pid=92060) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 17 04:57:18 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-9d58c42b-e8f0-4c06-a1f3-886d9d83f313 tempest-TestStampPattern-1289616937 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588'] {{(pid=92060) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 17 04:57:18 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-9d58c42b-e8f0-4c06-a1f3-886d9d83f313 tempest-TestStampPattern-1289616937 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 04:57:18 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-9d58c42b-e8f0-4c06-a1f3-886d9d83f313 tempest-TestStampPattern-1289616937 None] Selected osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588 as target Quobyte volume. {{(pid=92060) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 17 04:57:18 devstack cinder-volume[92060]: INFO cinder.volume.drivers.remotefs [None req-9d58c42b-e8f0-4c06-a1f3-886d9d83f313 tempest-TestStampPattern-1289616937 None] casted to osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588 Jun 17 04:57:18 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-9d58c42b-e8f0-4c06-a1f3-886d9d83f313 tempest-TestStampPattern-1289616937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-a697433e-1fa5-4b34-b0b2-ad480ef9807e 1073741824 {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:57:18 devstack sudo[109694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-a697433e-1fa5-4b34-b0b2-ad480ef9807e 1073741824 Jun 17 04:57:18 devstack sudo[109694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:57:19 devstack sudo[109694]: pam_unix(sudo:session): session closed for user root Jun 17 04:57:19 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-9d58c42b-e8f0-4c06-a1f3-886d9d83f313 tempest-TestStampPattern-1289616937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-a697433e-1fa5-4b34-b0b2-ad480ef9807e 1073741824" returned: 0 in 0.862s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:57:19 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-9d58c42b-e8f0-4c06-a1f3-886d9d83f313 tempest-TestStampPattern-1289616937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-a697433e-1fa5-4b34-b0b2-ad480ef9807e {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:57:19 devstack sudo[109702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-a697433e-1fa5-4b34-b0b2-ad480ef9807e Jun 17 04:57:19 devstack sudo[109702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:57:20 devstack sudo[109702]: pam_unix(sudo:session): session closed for user root Jun 17 04:57:20 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-9d58c42b-e8f0-4c06-a1f3-886d9d83f313 tempest-TestStampPattern-1289616937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-a697433e-1fa5-4b34-b0b2-ad480ef9807e" returned: 0 in 0.593s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:57:20 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-9d58c42b-e8f0-4c06-a1f3-886d9d83f313 tempest-TestStampPattern-1289616937 None] <== create_volume: return (1497ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588'} {{(pid=92060) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 17 04:57:20 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-9d58c42b-e8f0-4c06-a1f3-886d9d83f313 tempest-TestStampPattern-1289616937 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.500s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 04:57:20 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-9d58c42b-e8f0-4c06-a1f3-886d9d83f313 tempest-TestStampPattern-1289616937 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (170040dd-1891-4e5f-b8f9-fdcd0fb6a4e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a697433e-1fa5-4b34-b0b2-ad480ef9807e', 'volume_size': 1}' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:57:20 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-9d58c42b-e8f0-4c06-a1f3-886d9d83f313 tempest-TestStampPattern-1289616937 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fd1dd410-b1d8-4a2c-be08-50318d8f9918) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:57:20 devstack cinder-volume[92060]: INFO cinder.volume.flows.manager.create_volume [None req-9d58c42b-e8f0-4c06-a1f3-886d9d83f313 tempest-TestStampPattern-1289616937 None] Volume volume-a697433e-1fa5-4b34-b0b2-ad480ef9807e (a697433e-1fa5-4b34-b0b2-ad480ef9807e): created successfully Jun 17 04:57:20 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-9d58c42b-e8f0-4c06-a1f3-886d9d83f313 tempest-TestStampPattern-1289616937 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fd1dd410-b1d8-4a2c-be08-50318d8f9918) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:57:20 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-9d58c42b-e8f0-4c06-a1f3-886d9d83f313 tempest-TestStampPattern-1289616937 None] Flow 'volume_create_manager' (3f99d85d-0e5b-4077-95c6-6c237f82068d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92060) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 17 04:57:20 devstack cinder-volume[92060]: INFO cinder.volume.manager [None req-9d58c42b-e8f0-4c06-a1f3-886d9d83f313 tempest-TestStampPattern-1289616937 None] Created volume successfully. Jun 17 04:57:30 devstack cinder-volume[92060]: DEBUG dbcounter [-] [92060] Writing DB stats cinder:SELECT=2,cinder:UPDATE=4 {{(pid=92060) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 17 04:57:30 devstack cinder-volume[92060]: DEBUG dbcounter [-] [92060] Writing DB stats cinder:UPDATE=2,cinder:SELECT=2,cinder:INSERT=1,cinder:DELETE=1 {{(pid=92060) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 17 04:57:44 devstack cinder-volume[92060]: DEBUG oslo_service.periodic_task [None req-60d279ad-ad8c-4d36-a4b8-f593e74fb922 None None] Running periodic task VolumeManager._thread_info {{(pid=92060) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 17 04:57:44 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-60d279ad-ad8c-4d36-a4b8-f593e74fb922 None None] thread count: 28 {{(pid=92060) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 17 04:57:44 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-60d279ad-ad8c-4d36-a4b8-f593e74fb922 None None] thread info: [<_MainThread(MainThread, started 130061806440576)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=92060) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 17 04:57:59 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [req-3de1d9f2-834b-4356-9074-881240ed6159 req-0fee785a-f3e2-4080-a2ac-7e35b582d085 tempest-TestStampPattern-1289616937 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 04:57:59 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [req-3de1d9f2-834b-4356-9074-881240ed6159 req-0fee785a-f3e2-4080-a2ac-7e35b582d085 tempest-TestStampPattern-1289616937 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 04:57:59 devstack cinder-volume[92060]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf9e9986-ba0b-4824-9896-01f1c92f0b62]: (4, 'qcow2') {{(pid=93130) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 04:57:59 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [req-3de1d9f2-834b-4356-9074-881240ed6159 req-0fee785a-f3e2-4080-a2ac-7e35b582d085 tempest-TestStampPattern-1289616937 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-a697433e-1fa5-4b34-b0b2-ad480ef9807e {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:57:59 devstack sudo[109868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-a697433e-1fa5-4b34-b0b2-ad480ef9807e Jun 17 04:57:59 devstack sudo[109868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:58:00 devstack sudo[109868]: pam_unix(sudo:session): session closed for user root Jun 17 04:58:00 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [req-3de1d9f2-834b-4356-9074-881240ed6159 req-0fee785a-f3e2-4080-a2ac-7e35b582d085 tempest-TestStampPattern-1289616937 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-a697433e-1fa5-4b34-b0b2-ad480ef9807e" returned: 0 in 0.687s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:58:00 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [req-3de1d9f2-834b-4356-9074-881240ed6159 req-0fee785a-f3e2-4080-a2ac-7e35b582d085 tempest-TestStampPattern-1289616937 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.703s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 04:58:00 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [req-3de1d9f2-834b-4356-9074-881240ed6159 req-0fee785a-f3e2-4080-a2ac-7e35b582d085 tempest-TestStampPattern-1289616937 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588', 'name': 'volume-a697433e-1fa5-4b34-b0b2-ad480ef9807e', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'ef1a8103-51b9-40b2-ae9d-53e1bb7498fe', 'enforce_multipath': True} {{(pid=92060) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 17 04:58:00 devstack cinder-volume[92060]: INFO cinder.volume.manager [req-3de1d9f2-834b-4356-9074-881240ed6159 req-0fee785a-f3e2-4080-a2ac-7e35b582d085 tempest-TestStampPattern-1289616937 None] attachment_update completed successfully. Jun 17 04:58:08 devstack cinder-volume[92060]: INFO cinder.volume.manager [req-ac1cb6c8-39a1-4f53-81fd-d7fbf60eeedc req-3a321f9a-74db-43e1-8cf9-8fbc1ba09f31 tempest-TestStampPattern-1289616937 None] Terminate volume connection completed successfully. Jun 17 04:58:08 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [req-ac1cb6c8-39a1-4f53-81fd-d7fbf60eeedc req-3a321f9a-74db-43e1-8cf9-8fbc1ba09f31 tempest-TestStampPattern-1289616937 None] Deleting attachment ef1a8103-51b9-40b2-ae9d-53e1bb7498fe. {{(pid=92060) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 17 04:58:10 devstack cinder-volume[92060]: DEBUG dbcounter [-] [92060] Writing DB stats cinder:SELECT=8,cinder:UPDATE=1 {{(pid=92060) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 17 04:58:10 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-67d6a263-4d08-4547-8879-5fb75ae80189 tempest-TestStampPattern-1289616937 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 04:58:10 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-67d6a263-4d08-4547-8879-5fb75ae80189 tempest-TestStampPattern-1289616937 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 04:58:10 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.remotefs [None req-67d6a263-4d08-4547-8879-5fb75ae80189 tempest-TestStampPattern-1289616937 None] Creating offline snapshot f50fe664-65e5-4805-9d56-3b9bee27f636 of volume a697433e-1fa5-4b34-b0b2-ad480ef9807e {{(pid=92060) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 17 04:58:10 devstack cinder-volume[92060]: DEBUG oslo.privsep.daemon [-] privsep: reply[61731928-ec71-4b43-8fda-834e2fd7891b]: (4, 'qcow2') {{(pid=93130) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 04:58:10 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-67d6a263-4d08-4547-8879-5fb75ae80189 tempest-TestStampPattern-1289616937 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-a697433e-1fa5-4b34-b0b2-ad480ef9807e {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:58:10 devstack sudo[110313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-a697433e-1fa5-4b34-b0b2-ad480ef9807e Jun 17 04:58:10 devstack sudo[110313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:58:11 devstack sudo[110313]: pam_unix(sudo:session): session closed for user root Jun 17 04:58:11 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-67d6a263-4d08-4547-8879-5fb75ae80189 tempest-TestStampPattern-1289616937 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-a697433e-1fa5-4b34-b0b2-ad480ef9807e" returned: 0 in 0.691s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:58:11 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-67d6a263-4d08-4547-8879-5fb75ae80189 tempest-TestStampPattern-1289616937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-a697433e-1fa5-4b34-b0b2-ad480ef9807e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-a697433e-1fa5-4b34-b0b2-ad480ef9807e.f50fe664-65e5-4805-9d56-3b9bee27f636 1G {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:58:11 devstack sudo[110318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-a697433e-1fa5-4b34-b0b2-ad480ef9807e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-a697433e-1fa5-4b34-b0b2-ad480ef9807e.f50fe664-65e5-4805-9d56-3b9bee27f636 1G Jun 17 04:58:11 devstack sudo[110318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:58:11 devstack sudo[110318]: pam_unix(sudo:session): session closed for user root Jun 17 04:58:11 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-67d6a263-4d08-4547-8879-5fb75ae80189 tempest-TestStampPattern-1289616937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-a697433e-1fa5-4b34-b0b2-ad480ef9807e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-a697433e-1fa5-4b34-b0b2-ad480ef9807e.f50fe664-65e5-4805-9d56-3b9bee27f636 1G" returned: 0 in 0.758s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:58:11 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-67d6a263-4d08-4547-8879-5fb75ae80189 tempest-TestStampPattern-1289616937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a697433e-1fa5-4b34-b0b2-ad480ef9807e -F qcow2 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-a697433e-1fa5-4b34-b0b2-ad480ef9807e.f50fe664-65e5-4805-9d56-3b9bee27f636 {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:58:11 devstack sudo[110325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a697433e-1fa5-4b34-b0b2-ad480ef9807e -F qcow2 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-a697433e-1fa5-4b34-b0b2-ad480ef9807e.f50fe664-65e5-4805-9d56-3b9bee27f636 Jun 17 04:58:11 devstack sudo[110325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:58:12 devstack sudo[110325]: pam_unix(sudo:session): session closed for user root Jun 17 04:58:12 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-67d6a263-4d08-4547-8879-5fb75ae80189 tempest-TestStampPattern-1289616937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a697433e-1fa5-4b34-b0b2-ad480ef9807e -F qcow2 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-a697433e-1fa5-4b34-b0b2-ad480ef9807e.f50fe664-65e5-4805-9d56-3b9bee27f636" returned: 0 in 0.648s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:58:12 devstack cinder-volume[92060]: WARNING cinder.volume.drivers.remotefs [None req-67d6a263-4d08-4547-8879-5fb75ae80189 tempest-TestStampPattern-1289616937 None] /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-a697433e-1fa5-4b34-b0b2-ad480ef9807e.f50fe664-65e5-4805-9d56-3b9bee27f636 is being set with open permissions: ugo+rw Jun 17 04:58:12 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-67d6a263-4d08-4547-8879-5fb75ae80189 tempest-TestStampPattern-1289616937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-a697433e-1fa5-4b34-b0b2-ad480ef9807e.f50fe664-65e5-4805-9d56-3b9bee27f636 {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:58:12 devstack sudo[110331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-a697433e-1fa5-4b34-b0b2-ad480ef9807e.f50fe664-65e5-4805-9d56-3b9bee27f636 Jun 17 04:58:12 devstack sudo[110331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:58:13 devstack sudo[110331]: pam_unix(sudo:session): session closed for user root Jun 17 04:58:13 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-67d6a263-4d08-4547-8879-5fb75ae80189 tempest-TestStampPattern-1289616937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-a697433e-1fa5-4b34-b0b2-ad480ef9807e.f50fe664-65e5-4805-9d56-3b9bee27f636" returned: 0 in 0.580s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:58:13 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-67d6a263-4d08-4547-8879-5fb75ae80189 tempest-TestStampPattern-1289616937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-a697433e-1fa5-4b34-b0b2-ad480ef9807e.info {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:58:13 devstack sudo[110334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-a697433e-1fa5-4b34-b0b2-ad480ef9807e.info Jun 17 04:58:13 devstack sudo[110334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:58:13 devstack sudo[110334]: pam_unix(sudo:session): session closed for user root Jun 17 04:58:13 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-67d6a263-4d08-4547-8879-5fb75ae80189 tempest-TestStampPattern-1289616937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-a697433e-1fa5-4b34-b0b2-ad480ef9807e.info" returned: 0 in 0.589s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:58:13 devstack cinder-volume[92060]: WARNING cinder.volume.drivers.remotefs [None req-67d6a263-4d08-4547-8879-5fb75ae80189 tempest-TestStampPattern-1289616937 None] /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-a697433e-1fa5-4b34-b0b2-ad480ef9807e.info is being set with open permissions: ugo+rw Jun 17 04:58:13 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-67d6a263-4d08-4547-8879-5fb75ae80189 tempest-TestStampPattern-1289616937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-a697433e-1fa5-4b34-b0b2-ad480ef9807e.info {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:58:13 devstack sudo[110337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-a697433e-1fa5-4b34-b0b2-ad480ef9807e.info Jun 17 04:58:13 devstack sudo[110337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:58:14 devstack sudo[110337]: pam_unix(sudo:session): session closed for user root Jun 17 04:58:14 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-67d6a263-4d08-4547-8879-5fb75ae80189 tempest-TestStampPattern-1289616937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-a697433e-1fa5-4b34-b0b2-ad480ef9807e.info" returned: 0 in 0.577s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:58:14 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-67d6a263-4d08-4547-8879-5fb75ae80189 tempest-TestStampPattern-1289616937 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.928s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 04:58:14 devstack cinder-volume[92060]: INFO cinder.volume.manager [None req-67d6a263-4d08-4547-8879-5fb75ae80189 tempest-TestStampPattern-1289616937 None] Create snapshot completed successfully Jun 17 04:58:24 devstack cinder-volume[92060]: DEBUG cinder.volume.flows.manager.create_volume [None req-f6ee4446-e532-4052-995c-ff28da2fc47d tempest-TestStampPattern-1289616937 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92060) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 17 04:58:24 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-f6ee4446-e532-4052-995c-ff28da2fc47d tempest-TestStampPattern-1289616937 None] Flow 'volume_create_manager' (23472514-e8a5-4c72-9d92-f87d2a15bf50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 17 04:58:24 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-f6ee4446-e532-4052-995c-ff28da2fc47d tempest-TestStampPattern-1289616937 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9c5f062e-b93e-40be-8b7f-eec207d6863e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:58:24 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-f6ee4446-e532-4052-995c-ff28da2fc47d tempest-TestStampPattern-1289616937 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9c5f062e-b93e-40be-8b7f-eec207d6863e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-17T02:58:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1223031617',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=44c4c099-5a83-4703-8e5e-d0c8bcd4db4a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3ee5440660d44121a1672b411a72b971',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T02:58:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=f50fe664-65e5-4805-9d56-3b9bee27f636,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T02:58:24Z,use_quota=True,user_id='e067936feee646dfb2700d4bc2d46899',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aad9ce24-93f9-41a6-baa1-5125964f96d1),volume_type_id=aad9ce24-93f9-41a6-baa1-5125964f96d1)' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:58:24 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-f6ee4446-e532-4052-995c-ff28da2fc47d tempest-TestStampPattern-1289616937 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (255246f7-70c5-4a91-a24c-8ec3986488d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:58:24 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-f6ee4446-e532-4052-995c-ff28da2fc47d tempest-TestStampPattern-1289616937 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (255246f7-70c5-4a91-a24c-8ec3986488d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:58:24 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-f6ee4446-e532-4052-995c-ff28da2fc47d tempest-TestStampPattern-1289616937 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ec90ad8b-7df8-4770-917b-7a8c60d99953) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:58:24 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-f6ee4446-e532-4052-995c-ff28da2fc47d tempest-TestStampPattern-1289616937 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ec90ad8b-7df8-4770-917b-7a8c60d99953) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '44c4c099-5a83-4703-8e5e-d0c8bcd4db4a', 'volume_name': 'volume-44c4c099-5a83-4703-8e5e-d0c8bcd4db4a', 'volume_size': 1, 'snapshot_id': 'f50fe664-65e5-4805-9d56-3b9bee27f636'}' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:58:24 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-f6ee4446-e532-4052-995c-ff28da2fc47d tempest-TestStampPattern-1289616937 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8eb14f7e-3c38-4057-a95c-61fe4820560e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:58:24 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-f6ee4446-e532-4052-995c-ff28da2fc47d tempest-TestStampPattern-1289616937 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8eb14f7e-3c38-4057-a95c-61fe4820560e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:58:24 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-f6ee4446-e532-4052-995c-ff28da2fc47d tempest-TestStampPattern-1289616937 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5d1185d7-04ba-4de1-8bb6-349550b82177) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:58:24 devstack cinder-volume[92060]: INFO cinder.volume.flows.manager.create_volume [None req-f6ee4446-e532-4052-995c-ff28da2fc47d tempest-TestStampPattern-1289616937 None] Volume 44c4c099-5a83-4703-8e5e-d0c8bcd4db4a: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-44c4c099-5a83-4703-8e5e-d0c8bcd4db4a', 'volume_size': 1, 'snapshot_id': 'f50fe664-65e5-4805-9d56-3b9bee27f636'} Jun 17 04:58:24 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-f6ee4446-e532-4052-995c-ff28da2fc47d tempest-TestStampPattern-1289616937 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 04:58:24 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-f6ee4446-e532-4052-995c-ff28da2fc47d tempest-TestStampPattern-1289616937 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 04:58:24 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-f6ee4446-e532-4052-995c-ff28da2fc47d tempest-TestStampPattern-1289616937 None] Acquiring lock "cinder-quobyte-f50fe664-65e5-4805-9d56-3b9bee27f636-44c4c099-5a83-4703-8e5e-d0c8bcd4db4a" by "_create_volume_from_snapshot" {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 04:58:24 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-f6ee4446-e532-4052-995c-ff28da2fc47d tempest-TestStampPattern-1289616937 None] Lock "cinder-quobyte-f50fe664-65e5-4805-9d56-3b9bee27f636-44c4c099-5a83-4703-8e5e-d0c8bcd4db4a" acquired by "_create_volume_from_snapshot" :: waited 0.015s {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 04:58:24 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-f6ee4446-e532-4052-995c-ff28da2fc47d tempest-TestStampPattern-1289616937 None] Creating volume 44c4c099-5a83-4703-8e5e-d0c8bcd4db4a from snapshot f50fe664-65e5-4805-9d56-3b9bee27f636 {{(pid=92060) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jun 17 04:58:24 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-f6ee4446-e532-4052-995c-ff28da2fc47d tempest-TestStampPattern-1289616937 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 04:58:24 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-f6ee4446-e532-4052-995c-ff28da2fc47d tempest-TestStampPattern-1289616937 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 04:58:24 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-f6ee4446-e532-4052-995c-ff28da2fc47d tempest-TestStampPattern-1289616937 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588': None} {{(pid=92060) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 17 04:58:24 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-f6ee4446-e532-4052-995c-ff28da2fc47d tempest-TestStampPattern-1289616937 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588'] {{(pid=92060) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 17 04:58:24 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-f6ee4446-e532-4052-995c-ff28da2fc47d tempest-TestStampPattern-1289616937 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 04:58:24 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-f6ee4446-e532-4052-995c-ff28da2fc47d tempest-TestStampPattern-1289616937 None] Selected osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588 as target Quobyte volume. {{(pid=92060) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 17 04:58:24 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-f6ee4446-e532-4052-995c-ff28da2fc47d tempest-TestStampPattern-1289616937 None] Acquiring lock "cinder-quobyte-44c4c099-5a83-4703-8e5e-d0c8bcd4db4a" by "_copy_volume_from_snapshot" {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 04:58:24 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-f6ee4446-e532-4052-995c-ff28da2fc47d tempest-TestStampPattern-1289616937 None] Lock "cinder-quobyte-44c4c099-5a83-4703-8e5e-d0c8bcd4db4a" acquired by "_copy_volume_from_snapshot" :: waited 0.015s {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 04:58:24 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-f6ee4446-e532-4052-995c-ff28da2fc47d tempest-TestStampPattern-1289616937 None] snapshot: f50fe664-65e5-4805-9d56-3b9bee27f636, volume: 44c4c099-5a83-4703-8e5e-d0c8bcd4db4a, {{(pid=92060) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jun 17 04:58:24 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-f6ee4446-e532-4052-995c-ff28da2fc47d tempest-TestStampPattern-1289616937 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 04:58:24 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-f6ee4446-e532-4052-995c-ff28da2fc47d tempest-TestStampPattern-1289616937 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 04:58:24 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-f6ee4446-e532-4052-995c-ff28da2fc47d tempest-TestStampPattern-1289616937 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588': None} {{(pid=92060) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 17 04:58:24 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-f6ee4446-e532-4052-995c-ff28da2fc47d tempest-TestStampPattern-1289616937 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588'] {{(pid=92060) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 17 04:58:24 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-f6ee4446-e532-4052-995c-ff28da2fc47d tempest-TestStampPattern-1289616937 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 04:58:24 devstack cinder-volume[92060]: DEBUG oslo.privsep.daemon [-] privsep: reply[b96b2816-94e6-4de9-9c26-a9ac93f19911]: (4, 'qcow2') {{(pid=93130) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 04:58:24 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-f6ee4446-e532-4052-995c-ff28da2fc47d tempest-TestStampPattern-1289616937 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-a697433e-1fa5-4b34-b0b2-ad480ef9807e.f50fe664-65e5-4805-9d56-3b9bee27f636 {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:58:24 devstack sudo[110376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-a697433e-1fa5-4b34-b0b2-ad480ef9807e.f50fe664-65e5-4805-9d56-3b9bee27f636 Jun 17 04:58:24 devstack sudo[110376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:58:24 devstack sudo[110376]: pam_unix(sudo:session): session closed for user root Jun 17 04:58:24 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-f6ee4446-e532-4052-995c-ff28da2fc47d tempest-TestStampPattern-1289616937 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-a697433e-1fa5-4b34-b0b2-ad480ef9807e.f50fe664-65e5-4805-9d56-3b9bee27f636" returned: 0 in 0.710s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:58:24 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.remotefs [None req-f6ee4446-e532-4052-995c-ff28da2fc47d tempest-TestStampPattern-1289616937 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a697433e-1fa5-4b34-b0b2-ad480ef9807e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=92060) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 17 04:58:24 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-f6ee4446-e532-4052-995c-ff28da2fc47d tempest-TestStampPattern-1289616937 None] will copy from snapshot at /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-a697433e-1fa5-4b34-b0b2-ad480ef9807e {{(pid=92060) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jun 17 04:58:24 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-f6ee4446-e532-4052-995c-ff28da2fc47d tempest-TestStampPattern-1289616937 None] Creating direct copy from snapshot {{(pid=92060) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jun 17 04:58:24 devstack cinder-volume[92060]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff40a99f-9548-46bd-a14a-96615f685dc0]: (4, 'qcow2') {{(pid=93130) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 04:58:24 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-f6ee4446-e532-4052-995c-ff28da2fc47d tempest-TestStampPattern-1289616937 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-a697433e-1fa5-4b34-b0b2-ad480ef9807e {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:58:25 devstack sudo[110383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-a697433e-1fa5-4b34-b0b2-ad480ef9807e Jun 17 04:58:25 devstack sudo[110383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:58:25 devstack sudo[110383]: pam_unix(sudo:session): session closed for user root Jun 17 04:58:25 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-f6ee4446-e532-4052-995c-ff28da2fc47d tempest-TestStampPattern-1289616937 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-a697433e-1fa5-4b34-b0b2-ad480ef9807e" returned: 0 in 0.688s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:58:25 devstack cinder-volume[92060]: DEBUG cinder.utils [None req-f6ee4446-e532-4052-995c-ff28da2fc47d tempest-TestStampPattern-1289616937 None] Path /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-44c4c099-5a83-4703-8e5e-d0c8bcd4db4a not found in is_blk_device check {{(pid=92060) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jun 17 04:58:25 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-f6ee4446-e532-4052-995c-ff28da2fc47d tempest-TestStampPattern-1289616937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-a697433e-1fa5-4b34-b0b2-ad480ef9807e /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-44c4c099-5a83-4703-8e5e-d0c8bcd4db4a {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:58:25 devstack sudo[110388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-a697433e-1fa5-4b34-b0b2-ad480ef9807e /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-44c4c099-5a83-4703-8e5e-d0c8bcd4db4a Jun 17 04:58:25 devstack sudo[110388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:58:30 devstack sudo[110388]: pam_unix(sudo:session): session closed for user root Jun 17 04:58:30 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-f6ee4446-e532-4052-995c-ff28da2fc47d tempest-TestStampPattern-1289616937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-a697433e-1fa5-4b34-b0b2-ad480ef9807e /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-44c4c099-5a83-4703-8e5e-d0c8bcd4db4a" returned: 0 in 4.920s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:58:30 devstack cinder-volume[92060]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f59f159-3ecb-4a95-88e2-ace9f7e78b8b]: (4, 'qcow2') {{(pid=93130) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 04:58:30 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-f6ee4446-e532-4052-995c-ff28da2fc47d tempest-TestStampPattern-1289616937 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-a697433e-1fa5-4b34-b0b2-ad480ef9807e {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:58:30 devstack sudo[110438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-a697433e-1fa5-4b34-b0b2-ad480ef9807e Jun 17 04:58:30 devstack sudo[110438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:58:31 devstack sudo[110438]: pam_unix(sudo:session): session closed for user root Jun 17 04:58:31 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-f6ee4446-e532-4052-995c-ff28da2fc47d tempest-TestStampPattern-1289616937 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-a697433e-1fa5-4b34-b0b2-ad480ef9807e" returned: 0 in 0.963s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:58:31 devstack cinder-volume[92060]: DEBUG cinder.image.image_utils [None req-f6ee4446-e532-4052-995c-ff28da2fc47d tempest-TestStampPattern-1289616937 None] Image conversion details: src /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-a697433e-1fa5-4b34-b0b2-ad480ef9807e, size 1024.00 MB, duration 4.92 sec, destination /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-44c4c099-5a83-4703-8e5e-d0c8bcd4db4a {{(pid=92060) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 17 04:58:31 devstack cinder-volume[92060]: INFO cinder.image.image_utils [None req-f6ee4446-e532-4052-995c-ff28da2fc47d tempest-TestStampPattern-1289616937 None] Converted 1024.00 MB image at 208.06 MB/s Jun 17 04:58:31 devstack cinder-volume[92060]: WARNING cinder.volume.drivers.remotefs [None req-f6ee4446-e532-4052-995c-ff28da2fc47d tempest-TestStampPattern-1289616937 None] /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-44c4c099-5a83-4703-8e5e-d0c8bcd4db4a is being set with open permissions: ugo+rw Jun 17 04:58:31 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-f6ee4446-e532-4052-995c-ff28da2fc47d tempest-TestStampPattern-1289616937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-44c4c099-5a83-4703-8e5e-d0c8bcd4db4a {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:58:31 devstack sudo[110445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-44c4c099-5a83-4703-8e5e-d0c8bcd4db4a Jun 17 04:58:31 devstack sudo[110445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:58:32 devstack sudo[110445]: pam_unix(sudo:session): session closed for user root Jun 17 04:58:32 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-f6ee4446-e532-4052-995c-ff28da2fc47d tempest-TestStampPattern-1289616937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-44c4c099-5a83-4703-8e5e-d0c8bcd4db4a" returned: 0 in 0.637s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:58:32 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-f6ee4446-e532-4052-995c-ff28da2fc47d tempest-TestStampPattern-1289616937 None] Lock "cinder-quobyte-44c4c099-5a83-4703-8e5e-d0c8bcd4db4a" released by "_copy_volume_from_snapshot" :: held 8.017s {{(pid=92060) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 04:58:32 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-f6ee4446-e532-4052-995c-ff28da2fc47d tempest-TestStampPattern-1289616937 None] Lock "cinder-quobyte-f50fe664-65e5-4805-9d56-3b9bee27f636-44c4c099-5a83-4703-8e5e-d0c8bcd4db4a" released by "_create_volume_from_snapshot" :: held 8.047s {{(pid=92060) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 04:58:32 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-f6ee4446-e532-4052-995c-ff28da2fc47d tempest-TestStampPattern-1289616937 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.064s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 04:58:32 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-f6ee4446-e532-4052-995c-ff28da2fc47d tempest-TestStampPattern-1289616937 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5d1185d7-04ba-4de1-8bb6-349550b82177) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-44c4c099-5a83-4703-8e5e-d0c8bcd4db4a', 'volume_size': 1, 'snapshot_id': 'f50fe664-65e5-4805-9d56-3b9bee27f636'}' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:58:32 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-f6ee4446-e532-4052-995c-ff28da2fc47d tempest-TestStampPattern-1289616937 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1764ef44-bd49-4852-8758-64d9a62d5877) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 04:58:32 devstack cinder-volume[92060]: INFO cinder.volume.flows.manager.create_volume [None req-f6ee4446-e532-4052-995c-ff28da2fc47d tempest-TestStampPattern-1289616937 None] Volume volume-44c4c099-5a83-4703-8e5e-d0c8bcd4db4a (44c4c099-5a83-4703-8e5e-d0c8bcd4db4a): created successfully Jun 17 04:58:32 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-f6ee4446-e532-4052-995c-ff28da2fc47d tempest-TestStampPattern-1289616937 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1764ef44-bd49-4852-8758-64d9a62d5877) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 04:58:32 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-f6ee4446-e532-4052-995c-ff28da2fc47d tempest-TestStampPattern-1289616937 None] Flow 'volume_create_manager' (23472514-e8a5-4c72-9d92-f87d2a15bf50) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92060) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 17 04:58:32 devstack cinder-volume[92060]: INFO cinder.volume.manager [None req-f6ee4446-e532-4052-995c-ff28da2fc47d tempest-TestStampPattern-1289616937 None] Created volume successfully. Jun 17 04:58:42 devstack cinder-volume[92060]: DEBUG dbcounter [-] [92060] Writing DB stats cinder:SELECT=8,cinder:UPDATE=6,cinder:INSERT=1 {{(pid=92060) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 17 04:58:42 devstack cinder-volume[92060]: DEBUG dbcounter [-] [92060] Writing DB stats cinder:SELECT=10,cinder:UPDATE=4,cinder:DELETE=2 {{(pid=92060) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 17 04:58:44 devstack cinder-volume[92060]: DEBUG oslo_service.periodic_task [None req-60d279ad-ad8c-4d36-a4b8-f593e74fb922 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=92060) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 17 04:58:44 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-60d279ad-ad8c-4d36-a4b8-f593e74fb922 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 04:58:44 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-60d279ad-ad8c-4d36-a4b8-f593e74fb922 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 04:58:44 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-60d279ad-ad8c-4d36-a4b8-f593e74fb922 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588': None} {{(pid=92060) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 17 04:58:44 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-60d279ad-ad8c-4d36-a4b8-f593e74fb922 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588'] {{(pid=92060) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 17 04:58:44 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-60d279ad-ad8c-4d36-a4b8-f593e74fb922 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 04:58:44 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-60d279ad-ad8c-4d36-a4b8-f593e74fb922 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:58:45 devstack sudo[110531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a Jun 17 04:58:45 devstack sudo[110531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:58:45 devstack sudo[110531]: pam_unix(sudo:session): session closed for user root Jun 17 04:58:45 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-60d279ad-ad8c-4d36-a4b8-f593e74fb922 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a" returned: 0 in 0.606s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:58:45 devstack cinder-volume[92060]: DEBUG cinder.manager [None req-60d279ad-ad8c-4d36-a4b8-f593e74fb922 None None] Notifying Schedulers of capabilities ... {{(pid=92060) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 17 04:58:45 devstack cinder-volume[92060]: DEBUG oslo_service.periodic_task [None req-60d279ad-ad8c-4d36-a4b8-f593e74fb922 None None] Running periodic task VolumeManager._thread_info {{(pid=92060) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 17 04:58:45 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-60d279ad-ad8c-4d36-a4b8-f593e74fb922 None None] thread count: 28 {{(pid=92060) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 17 04:58:45 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-60d279ad-ad8c-4d36-a4b8-f593e74fb922 None None] thread info: [<_MainThread(MainThread, started 130061806440576)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=92060) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 17 04:59:21 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [req-a68adf75-55d3-48eb-a9ab-ca7b8ab70c5e req-f9c957e7-01dc-4364-8991-470a12030d92 tempest-TestStampPattern-1289616937 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 04:59:21 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [req-a68adf75-55d3-48eb-a9ab-ca7b8ab70c5e req-f9c957e7-01dc-4364-8991-470a12030d92 tempest-TestStampPattern-1289616937 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 04:59:21 devstack cinder-volume[92060]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1d84b85-5004-4220-a748-849fd70e459c]: (4, 'qcow2') {{(pid=93130) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 04:59:21 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [req-a68adf75-55d3-48eb-a9ab-ca7b8ab70c5e req-f9c957e7-01dc-4364-8991-470a12030d92 tempest-TestStampPattern-1289616937 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-44c4c099-5a83-4703-8e5e-d0c8bcd4db4a {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:59:21 devstack sudo[110567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-44c4c099-5a83-4703-8e5e-d0c8bcd4db4a Jun 17 04:59:21 devstack sudo[110567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:59:21 devstack sudo[110567]: pam_unix(sudo:session): session closed for user root Jun 17 04:59:21 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [req-a68adf75-55d3-48eb-a9ab-ca7b8ab70c5e req-f9c957e7-01dc-4364-8991-470a12030d92 tempest-TestStampPattern-1289616937 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-44c4c099-5a83-4703-8e5e-d0c8bcd4db4a" returned: 0 in 0.704s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:59:21 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [req-a68adf75-55d3-48eb-a9ab-ca7b8ab70c5e req-f9c957e7-01dc-4364-8991-470a12030d92 tempest-TestStampPattern-1289616937 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.727s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 04:59:22 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [req-a68adf75-55d3-48eb-a9ab-ca7b8ab70c5e req-f9c957e7-01dc-4364-8991-470a12030d92 tempest-TestStampPattern-1289616937 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588', 'name': 'volume-44c4c099-5a83-4703-8e5e-d0c8bcd4db4a', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '13c4399a-e010-4e83-aaba-b1f0c713f8f6', 'enforce_multipath': True} {{(pid=92060) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 17 04:59:22 devstack cinder-volume[92060]: INFO cinder.volume.manager [req-a68adf75-55d3-48eb-a9ab-ca7b8ab70c5e req-f9c957e7-01dc-4364-8991-470a12030d92 tempest-TestStampPattern-1289616937 None] attachment_update completed successfully. Jun 17 04:59:28 devstack cinder-volume[92060]: INFO cinder.volume.manager [req-c23a7c00-c676-4c20-ae23-f089664580d4 req-cd5e4cfc-c496-4d6c-b495-192d38f6081e tempest-TestStampPattern-1289616937 None] Terminate volume connection completed successfully. Jun 17 04:59:28 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [req-c23a7c00-c676-4c20-ae23-f089664580d4 req-cd5e4cfc-c496-4d6c-b495-192d38f6081e tempest-TestStampPattern-1289616937 None] Deleting attachment 13c4399a-e010-4e83-aaba-b1f0c713f8f6. {{(pid=92060) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 17 04:59:37 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-4316a0bf-2075-460f-84ce-69f6a5b9af76 tempest-TestStampPattern-1289616937 None] Acquiring lock "cinder-44c4c099-5a83-4703-8e5e-d0c8bcd4db4a-delete_volume" by "delete_volume" {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 04:59:37 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-4316a0bf-2075-460f-84ce-69f6a5b9af76 tempest-TestStampPattern-1289616937 None] Lock "cinder-44c4c099-5a83-4703-8e5e-d0c8bcd4db4a-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 04:59:37 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-4316a0bf-2075-460f-84ce-69f6a5b9af76 tempest-TestStampPattern-1289616937 None] Acquiring lock "cinder-quobyte-44c4c099-5a83-4703-8e5e-d0c8bcd4db4a" by "delete_volume" {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 04:59:37 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-4316a0bf-2075-460f-84ce-69f6a5b9af76 tempest-TestStampPattern-1289616937 None] Lock "cinder-quobyte-44c4c099-5a83-4703-8e5e-d0c8bcd4db4a" acquired by "delete_volume" :: waited 0.021s {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 04:59:37 devstack cinder-volume[92060]: DEBUG oslo.privsep.daemon [-] privsep: reply[5249f40f-9a73-4d82-b0b0-907f9e8ea34a]: (4, 'qcow2') {{(pid=93130) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 04:59:37 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-4316a0bf-2075-460f-84ce-69f6a5b9af76 tempest-TestStampPattern-1289616937 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-44c4c099-5a83-4703-8e5e-d0c8bcd4db4a {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:59:37 devstack sudo[111073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-44c4c099-5a83-4703-8e5e-d0c8bcd4db4a Jun 17 04:59:37 devstack sudo[111073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:59:38 devstack sudo[111073]: pam_unix(sudo:session): session closed for user root Jun 17 04:59:38 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-4316a0bf-2075-460f-84ce-69f6a5b9af76 tempest-TestStampPattern-1289616937 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-44c4c099-5a83-4703-8e5e-d0c8bcd4db4a" returned: 0 in 0.681s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:59:38 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-4316a0bf-2075-460f-84ce-69f6a5b9af76 tempest-TestStampPattern-1289616937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-44c4c099-5a83-4703-8e5e-d0c8bcd4db4a {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:59:38 devstack sudo[111078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-44c4c099-5a83-4703-8e5e-d0c8bcd4db4a Jun 17 04:59:38 devstack sudo[111078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:59:38 devstack sudo[111078]: pam_unix(sudo:session): session closed for user root Jun 17 04:59:38 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-4316a0bf-2075-460f-84ce-69f6a5b9af76 tempest-TestStampPattern-1289616937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-44c4c099-5a83-4703-8e5e-d0c8bcd4db4a" returned: 0 in 0.586s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:59:38 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-4316a0bf-2075-460f-84ce-69f6a5b9af76 tempest-TestStampPattern-1289616937 None] Lock "cinder-quobyte-44c4c099-5a83-4703-8e5e-d0c8bcd4db4a" released by "delete_volume" :: held 1.310s {{(pid=92060) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 04:59:38 devstack cinder-volume[92060]: DEBUG cinder.quota [None req-4316a0bf-2075-460f-84ce-69f6a5b9af76 tempest-TestStampPattern-1289616937 None] Created reservations ['37c4aeb8-f0eb-4897-be7a-b3b4cd2a8861', 'ac3466ba-d05f-4112-a608-64c11dcd9f33', 'ba04a78e-df94-40ef-9c8d-a6a3128888c3', '57a21fde-2735-4a4b-b68c-957a97cd2180'] {{(pid=92060) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 17 04:59:38 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-4316a0bf-2075-460f-84ce-69f6a5b9af76 tempest-TestStampPattern-1289616937 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 04:59:38 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-4316a0bf-2075-460f-84ce-69f6a5b9af76 tempest-TestStampPattern-1289616937 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 04:59:38 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-4316a0bf-2075-460f-84ce-69f6a5b9af76 tempest-TestStampPattern-1289616937 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588': None} {{(pid=92060) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 17 04:59:38 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-4316a0bf-2075-460f-84ce-69f6a5b9af76 tempest-TestStampPattern-1289616937 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588'] {{(pid=92060) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 17 04:59:38 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-4316a0bf-2075-460f-84ce-69f6a5b9af76 tempest-TestStampPattern-1289616937 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 04:59:38 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-4316a0bf-2075-460f-84ce-69f6a5b9af76 tempest-TestStampPattern-1289616937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:59:38 devstack sudo[111081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a Jun 17 04:59:38 devstack sudo[111081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:59:39 devstack sudo[111081]: pam_unix(sudo:session): session closed for user root Jun 17 04:59:39 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-4316a0bf-2075-460f-84ce-69f6a5b9af76 tempest-TestStampPattern-1289616937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a" returned: 0 in 0.589s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:59:39 devstack cinder-volume[92060]: DEBUG cinder.manager [None req-4316a0bf-2075-460f-84ce-69f6a5b9af76 tempest-TestStampPattern-1289616937 None] Notifying Schedulers of capabilities ... {{(pid=92060) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 17 04:59:39 devstack cinder-volume[92060]: INFO cinder.volume.manager [None req-4316a0bf-2075-460f-84ce-69f6a5b9af76 tempest-TestStampPattern-1289616937 None] Deleted volume successfully. Jun 17 04:59:39 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-4316a0bf-2075-460f-84ce-69f6a5b9af76 tempest-TestStampPattern-1289616937 None] Lock "cinder-44c4c099-5a83-4703-8e5e-d0c8bcd4db4a-delete_volume" released by "delete_volume" :: held 2.076s {{(pid=92060) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 04:59:39 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-4265c541-8bb4-4ef7-96bc-0d7b2d92a9f2 tempest-TestStampPattern-1289616937 None] Acquiring lock "cinder-f50fe664-65e5-4805-9d56-3b9bee27f636-delete_snapshot" by "delete_snapshot" {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 04:59:39 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-4265c541-8bb4-4ef7-96bc-0d7b2d92a9f2 tempest-TestStampPattern-1289616937 None] Lock "cinder-f50fe664-65e5-4805-9d56-3b9bee27f636-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 04:59:39 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-4265c541-8bb4-4ef7-96bc-0d7b2d92a9f2 tempest-TestStampPattern-1289616937 None] Acquiring lock "cinder-quobyte-a697433e-1fa5-4b34-b0b2-ad480ef9807e" by "delete_snapshot" {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 04:59:39 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-4265c541-8bb4-4ef7-96bc-0d7b2d92a9f2 tempest-TestStampPattern-1289616937 None] Lock "cinder-quobyte-a697433e-1fa5-4b34-b0b2-ad480ef9807e" acquired by "delete_snapshot" :: waited 0.018s {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 04:59:39 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-4265c541-8bb4-4ef7-96bc-0d7b2d92a9f2 tempest-TestStampPattern-1289616937 None] Acquiring lock "cinder-quobyte-f50fe664-65e5-4805-9d56-3b9bee27f636" by "_delete_snapshot" {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 04:59:39 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-4265c541-8bb4-4ef7-96bc-0d7b2d92a9f2 tempest-TestStampPattern-1289616937 None] Lock "cinder-quobyte-f50fe664-65e5-4805-9d56-3b9bee27f636" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 04:59:39 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.remotefs [None req-4265c541-8bb4-4ef7-96bc-0d7b2d92a9f2 tempest-TestStampPattern-1289616937 None] Deleting offline snapshot f50fe664-65e5-4805-9d56-3b9bee27f636 of volume a697433e-1fa5-4b34-b0b2-ad480ef9807e {{(pid=92060) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 17 04:59:39 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.remotefs [None req-4265c541-8bb4-4ef7-96bc-0d7b2d92a9f2 tempest-TestStampPattern-1289616937 None] snapshot_file for this snap is: volume-a697433e-1fa5-4b34-b0b2-ad480ef9807e.f50fe664-65e5-4805-9d56-3b9bee27f636 {{(pid=92060) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 17 04:59:39 devstack cinder-volume[92060]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e3fda40-9770-4b88-927d-002be14f100f]: (4, 'qcow2') {{(pid=93130) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 04:59:39 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-4265c541-8bb4-4ef7-96bc-0d7b2d92a9f2 tempest-TestStampPattern-1289616937 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-a697433e-1fa5-4b34-b0b2-ad480ef9807e.f50fe664-65e5-4805-9d56-3b9bee27f636 {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:59:39 devstack sudo[111084]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-a697433e-1fa5-4b34-b0b2-ad480ef9807e.f50fe664-65e5-4805-9d56-3b9bee27f636 Jun 17 04:59:39 devstack sudo[111084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:59:40 devstack sudo[111084]: pam_unix(sudo:session): session closed for user root Jun 17 04:59:40 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-4265c541-8bb4-4ef7-96bc-0d7b2d92a9f2 tempest-TestStampPattern-1289616937 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-a697433e-1fa5-4b34-b0b2-ad480ef9807e.f50fe664-65e5-4805-9d56-3b9bee27f636" returned: 0 in 0.713s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:59:40 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.remotefs [None req-4265c541-8bb4-4ef7-96bc-0d7b2d92a9f2 tempest-TestStampPattern-1289616937 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a697433e-1fa5-4b34-b0b2-ad480ef9807e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=92060) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 17 04:59:40 devstack cinder-volume[92060]: DEBUG oslo.privsep.daemon [-] privsep: reply[10ed1b77-935b-4b21-adc5-0e1fdfbc5899]: (4, 'qcow2') {{(pid=93130) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 04:59:40 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-4265c541-8bb4-4ef7-96bc-0d7b2d92a9f2 tempest-TestStampPattern-1289616937 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-a697433e-1fa5-4b34-b0b2-ad480ef9807e {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:59:40 devstack sudo[111089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-a697433e-1fa5-4b34-b0b2-ad480ef9807e Jun 17 04:59:40 devstack sudo[111089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:59:41 devstack sudo[111089]: pam_unix(sudo:session): session closed for user root Jun 17 04:59:41 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-4265c541-8bb4-4ef7-96bc-0d7b2d92a9f2 tempest-TestStampPattern-1289616937 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-a697433e-1fa5-4b34-b0b2-ad480ef9807e" returned: 0 in 0.693s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:59:41 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-4265c541-8bb4-4ef7-96bc-0d7b2d92a9f2 tempest-TestStampPattern-1289616937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-a697433e-1fa5-4b34-b0b2-ad480ef9807e.f50fe664-65e5-4805-9d56-3b9bee27f636 {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:59:41 devstack sudo[111094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-a697433e-1fa5-4b34-b0b2-ad480ef9807e.f50fe664-65e5-4805-9d56-3b9bee27f636 Jun 17 04:59:41 devstack sudo[111094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:59:41 devstack sudo[111094]: pam_unix(sudo:session): session closed for user root Jun 17 04:59:41 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-4265c541-8bb4-4ef7-96bc-0d7b2d92a9f2 tempest-TestStampPattern-1289616937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-a697433e-1fa5-4b34-b0b2-ad480ef9807e.f50fe664-65e5-4805-9d56-3b9bee27f636" returned: 0 in 0.686s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:59:41 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-4265c541-8bb4-4ef7-96bc-0d7b2d92a9f2 tempest-TestStampPattern-1289616937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-a697433e-1fa5-4b34-b0b2-ad480ef9807e.f50fe664-65e5-4805-9d56-3b9bee27f636 {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:59:41 devstack sudo[111100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-a697433e-1fa5-4b34-b0b2-ad480ef9807e.f50fe664-65e5-4805-9d56-3b9bee27f636 Jun 17 04:59:41 devstack sudo[111100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:59:42 devstack sudo[111100]: pam_unix(sudo:session): session closed for user root Jun 17 04:59:42 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-4265c541-8bb4-4ef7-96bc-0d7b2d92a9f2 tempest-TestStampPattern-1289616937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-a697433e-1fa5-4b34-b0b2-ad480ef9807e.f50fe664-65e5-4805-9d56-3b9bee27f636" returned: 0 in 0.618s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:59:42 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-4265c541-8bb4-4ef7-96bc-0d7b2d92a9f2 tempest-TestStampPattern-1289616937 None] Lock "cinder-quobyte-f50fe664-65e5-4805-9d56-3b9bee27f636" released by "_delete_snapshot" :: held 2.796s {{(pid=92060) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 04:59:42 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-4265c541-8bb4-4ef7-96bc-0d7b2d92a9f2 tempest-TestStampPattern-1289616937 None] Lock "cinder-quobyte-a697433e-1fa5-4b34-b0b2-ad480ef9807e" released by "delete_snapshot" :: held 2.817s {{(pid=92060) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 04:59:42 devstack cinder-volume[92060]: DEBUG cinder.quota [None req-4265c541-8bb4-4ef7-96bc-0d7b2d92a9f2 tempest-TestStampPattern-1289616937 None] Created reservations ['27c1f6ab-944f-4170-b80b-58974fb655c4', 'e71be1d2-3c58-415e-858c-a3e6290fde0c', 'e38b48ac-1dc4-45df-a7d8-e36fada85a2d', 'c18a7513-3b92-4d6a-affd-dff202ed9138'] {{(pid=92060) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 17 04:59:42 devstack cinder-volume[92060]: INFO cinder.volume.manager [None req-4265c541-8bb4-4ef7-96bc-0d7b2d92a9f2 tempest-TestStampPattern-1289616937 None] Delete snapshot completed successfully. Jun 17 04:59:42 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-4265c541-8bb4-4ef7-96bc-0d7b2d92a9f2 tempest-TestStampPattern-1289616937 None] Lock "cinder-f50fe664-65e5-4805-9d56-3b9bee27f636-delete_snapshot" released by "delete_snapshot" :: held 2.940s {{(pid=92060) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 04:59:44 devstack cinder-volume[92060]: DEBUG oslo_service.periodic_task [None req-60d279ad-ad8c-4d36-a4b8-f593e74fb922 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=92060) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 17 04:59:44 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-60d279ad-ad8c-4d36-a4b8-f593e74fb922 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 04:59:44 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-60d279ad-ad8c-4d36-a4b8-f593e74fb922 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 04:59:44 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-60d279ad-ad8c-4d36-a4b8-f593e74fb922 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588': None} {{(pid=92060) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 17 04:59:44 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-60d279ad-ad8c-4d36-a4b8-f593e74fb922 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588'] {{(pid=92060) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 17 04:59:44 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-60d279ad-ad8c-4d36-a4b8-f593e74fb922 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 04:59:44 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-60d279ad-ad8c-4d36-a4b8-f593e74fb922 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:59:45 devstack sudo[111154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a Jun 17 04:59:45 devstack sudo[111154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:59:45 devstack sudo[111154]: pam_unix(sudo:session): session closed for user root Jun 17 04:59:45 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-60d279ad-ad8c-4d36-a4b8-f593e74fb922 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a" returned: 0 in 0.654s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:59:45 devstack cinder-volume[92060]: DEBUG cinder.manager [None req-60d279ad-ad8c-4d36-a4b8-f593e74fb922 None None] Notifying Schedulers of capabilities ... {{(pid=92060) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 17 04:59:45 devstack cinder-volume[92060]: DEBUG oslo_service.periodic_task [None req-60d279ad-ad8c-4d36-a4b8-f593e74fb922 None None] Running periodic task VolumeManager._thread_info {{(pid=92060) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 17 04:59:45 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-60d279ad-ad8c-4d36-a4b8-f593e74fb922 None None] thread count: 28 {{(pid=92060) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 17 04:59:45 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-60d279ad-ad8c-4d36-a4b8-f593e74fb922 None None] thread info: [<_MainThread(MainThread, started 130061806440576)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=92060) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 17 04:59:49 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-f51e5c5a-0708-4017-acba-bab91d586ca0 tempest-TestStampPattern-1289616937 None] Acquiring lock "cinder-a697433e-1fa5-4b34-b0b2-ad480ef9807e-delete_volume" by "delete_volume" {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 04:59:49 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-f51e5c5a-0708-4017-acba-bab91d586ca0 tempest-TestStampPattern-1289616937 None] Lock "cinder-a697433e-1fa5-4b34-b0b2-ad480ef9807e-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 04:59:49 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-f51e5c5a-0708-4017-acba-bab91d586ca0 tempest-TestStampPattern-1289616937 None] Acquiring lock "cinder-quobyte-a697433e-1fa5-4b34-b0b2-ad480ef9807e" by "delete_volume" {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 04:59:49 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-f51e5c5a-0708-4017-acba-bab91d586ca0 tempest-TestStampPattern-1289616937 None] Lock "cinder-quobyte-a697433e-1fa5-4b34-b0b2-ad480ef9807e" acquired by "delete_volume" :: waited 0.014s {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 04:59:49 devstack cinder-volume[92060]: DEBUG oslo.privsep.daemon [-] privsep: reply[910170e9-015a-4683-bf79-7d788624d2b2]: (4, 'qcow2') {{(pid=93130) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 04:59:49 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-f51e5c5a-0708-4017-acba-bab91d586ca0 tempest-TestStampPattern-1289616937 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-a697433e-1fa5-4b34-b0b2-ad480ef9807e {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:59:50 devstack sudo[111160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-a697433e-1fa5-4b34-b0b2-ad480ef9807e Jun 17 04:59:50 devstack sudo[111160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:59:50 devstack sudo[111160]: pam_unix(sudo:session): session closed for user root Jun 17 04:59:50 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-f51e5c5a-0708-4017-acba-bab91d586ca0 tempest-TestStampPattern-1289616937 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-a697433e-1fa5-4b34-b0b2-ad480ef9807e" returned: 0 in 0.698s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:59:50 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-f51e5c5a-0708-4017-acba-bab91d586ca0 tempest-TestStampPattern-1289616937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-a697433e-1fa5-4b34-b0b2-ad480ef9807e {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:59:50 devstack sudo[111165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-a697433e-1fa5-4b34-b0b2-ad480ef9807e Jun 17 04:59:50 devstack sudo[111165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:59:51 devstack sudo[111165]: pam_unix(sudo:session): session closed for user root Jun 17 04:59:51 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-f51e5c5a-0708-4017-acba-bab91d586ca0 tempest-TestStampPattern-1289616937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-a697433e-1fa5-4b34-b0b2-ad480ef9807e" returned: 0 in 0.606s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:59:51 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-f51e5c5a-0708-4017-acba-bab91d586ca0 tempest-TestStampPattern-1289616937 None] Lock "cinder-quobyte-a697433e-1fa5-4b34-b0b2-ad480ef9807e" released by "delete_volume" :: held 1.361s {{(pid=92060) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 04:59:51 devstack cinder-volume[92060]: DEBUG cinder.quota [None req-f51e5c5a-0708-4017-acba-bab91d586ca0 tempest-TestStampPattern-1289616937 None] Created reservations ['0bdd1b0b-6fc7-423a-a950-0029f8613aa7', '6d721515-6ff6-44b9-b23e-814eab56ac2d', '4ca5f00a-3fa5-4b2d-83ea-4330a7dec91a', '12203ff1-6f37-40aa-9dda-d941266a3b21'] {{(pid=92060) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 17 04:59:51 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-f51e5c5a-0708-4017-acba-bab91d586ca0 tempest-TestStampPattern-1289616937 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 04:59:51 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-f51e5c5a-0708-4017-acba-bab91d586ca0 tempest-TestStampPattern-1289616937 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 04:59:51 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-f51e5c5a-0708-4017-acba-bab91d586ca0 tempest-TestStampPattern-1289616937 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588': None} {{(pid=92060) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 17 04:59:51 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-f51e5c5a-0708-4017-acba-bab91d586ca0 tempest-TestStampPattern-1289616937 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588'] {{(pid=92060) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 17 04:59:51 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-f51e5c5a-0708-4017-acba-bab91d586ca0 tempest-TestStampPattern-1289616937 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 04:59:51 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-f51e5c5a-0708-4017-acba-bab91d586ca0 tempest-TestStampPattern-1289616937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 04:59:51 devstack sudo[111168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a Jun 17 04:59:51 devstack sudo[111168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 04:59:51 devstack sudo[111168]: pam_unix(sudo:session): session closed for user root Jun 17 04:59:51 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-f51e5c5a-0708-4017-acba-bab91d586ca0 tempest-TestStampPattern-1289616937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a" returned: 0 in 0.577s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 04:59:51 devstack cinder-volume[92060]: DEBUG cinder.manager [None req-f51e5c5a-0708-4017-acba-bab91d586ca0 tempest-TestStampPattern-1289616937 None] Notifying Schedulers of capabilities ... {{(pid=92060) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 17 04:59:52 devstack cinder-volume[92060]: INFO cinder.volume.manager [None req-f51e5c5a-0708-4017-acba-bab91d586ca0 tempest-TestStampPattern-1289616937 None] Deleted volume successfully. Jun 17 04:59:52 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-f51e5c5a-0708-4017-acba-bab91d586ca0 tempest-TestStampPattern-1289616937 None] Lock "cinder-a697433e-1fa5-4b34-b0b2-ad480ef9807e-delete_volume" released by "delete_volume" :: held 2.133s {{(pid=92060) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 05:00:01 devstack cinder-volume[92060]: DEBUG dbcounter [-] [92060] Writing DB stats cinder:SELECT=21,cinder:UPDATE=21,cinder:INSERT=8,cinder:DELETE=1 {{(pid=92060) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 17 05:00:02 devstack cinder-volume[92060]: DEBUG dbcounter [-] [92060] Writing DB stats cinder:SELECT=23,cinder:UPDATE=25,cinder:INSERT=4,cinder:DELETE=1 {{(pid=92060) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 17 05:00:10 devstack cinder-volume[92060]: DEBUG cinder.volume.flows.manager.create_volume [None req-1f24eb9c-6291-459f-b8fb-b528aa91a838 tempest-CreateVolumesFromSourceVolumeTest-1564008756 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92060) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 17 05:00:10 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-1f24eb9c-6291-459f-b8fb-b528aa91a838 tempest-CreateVolumesFromSourceVolumeTest-1564008756 None] Flow 'volume_create_manager' (67f7f187-2f61-4279-aa6f-b472cc3ecda0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 17 05:00:10 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-1f24eb9c-6291-459f-b8fb-b528aa91a838 tempest-CreateVolumesFromSourceVolumeTest-1564008756 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (13f95551-faf6-4d90-81ca-a400cadadbf5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:00:10 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-1f24eb9c-6291-459f-b8fb-b528aa91a838 tempest-CreateVolumesFromSourceVolumeTest-1564008756 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (13f95551-faf6-4d90-81ca-a400cadadbf5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-17T03:00:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-959691163',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ad522341-9908-4746-836a-01ce61603302,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3322152864f84a628abc1acba10e4364',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T03:00:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T03:00:10Z,use_quota=True,user_id='0986412f49d24fcc9987a9813fcb2e8b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aad9ce24-93f9-41a6-baa1-5125964f96d1),volume_type_id=aad9ce24-93f9-41a6-baa1-5125964f96d1)' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:00:10 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-1f24eb9c-6291-459f-b8fb-b528aa91a838 tempest-CreateVolumesFromSourceVolumeTest-1564008756 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bef5cde3-1b49-475c-b64e-f36df79cfc97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:00:10 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-1f24eb9c-6291-459f-b8fb-b528aa91a838 tempest-CreateVolumesFromSourceVolumeTest-1564008756 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bef5cde3-1b49-475c-b64e-f36df79cfc97) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:00:10 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-1f24eb9c-6291-459f-b8fb-b528aa91a838 tempest-CreateVolumesFromSourceVolumeTest-1564008756 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (41ba52ec-d10b-4da7-a5e0-c19ecceb5e36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:00:10 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-1f24eb9c-6291-459f-b8fb-b528aa91a838 tempest-CreateVolumesFromSourceVolumeTest-1564008756 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (41ba52ec-d10b-4da7-a5e0-c19ecceb5e36) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ad522341-9908-4746-836a-01ce61603302', 'volume_name': 'volume-ad522341-9908-4746-836a-01ce61603302', 'volume_size': 1}' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:00:10 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-1f24eb9c-6291-459f-b8fb-b528aa91a838 tempest-CreateVolumesFromSourceVolumeTest-1564008756 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6358f660-990a-4708-b447-b058dfa53604) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:00:10 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-1f24eb9c-6291-459f-b8fb-b528aa91a838 tempest-CreateVolumesFromSourceVolumeTest-1564008756 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6358f660-990a-4708-b447-b058dfa53604) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:00:10 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-1f24eb9c-6291-459f-b8fb-b528aa91a838 tempest-CreateVolumesFromSourceVolumeTest-1564008756 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (16db4560-01aa-4e2c-a4fe-f163a6e1cfee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:00:10 devstack cinder-volume[92060]: INFO cinder.volume.flows.manager.create_volume [None req-1f24eb9c-6291-459f-b8fb-b528aa91a838 tempest-CreateVolumesFromSourceVolumeTest-1564008756 None] Volume ad522341-9908-4746-836a-01ce61603302: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ad522341-9908-4746-836a-01ce61603302', 'volume_size': 1} Jun 17 05:00:10 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-1f24eb9c-6291-459f-b8fb-b528aa91a838 tempest-CreateVolumesFromSourceVolumeTest-1564008756 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 05:00:10 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-1f24eb9c-6291-459f-b8fb-b528aa91a838 tempest-CreateVolumesFromSourceVolumeTest-1564008756 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 05:00:10 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-1f24eb9c-6291-459f-b8fb-b528aa91a838 tempest-CreateVolumesFromSourceVolumeTest-1564008756 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-17T03:00:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-959691163',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ad522341-9908-4746-836a-01ce61603302,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3322152864f84a628abc1acba10e4364',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T03:00:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T03:00:10Z,use_quota=True,user_id='0986412f49d24fcc9987a9813fcb2e8b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aad9ce24-93f9-41a6-baa1-5125964f96d1),volume_type_id=aad9ce24-93f9-41a6-baa1-5125964f96d1)}" {{(pid=92060) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 17 05:00:10 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.remotefs [None req-1f24eb9c-6291-459f-b8fb-b528aa91a838 tempest-CreateVolumesFromSourceVolumeTest-1564008756 None] Creating volume ad522341-9908-4746-836a-01ce61603302 {{(pid=92060) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 17 05:00:10 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-1f24eb9c-6291-459f-b8fb-b528aa91a838 tempest-CreateVolumesFromSourceVolumeTest-1564008756 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 05:00:10 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-1f24eb9c-6291-459f-b8fb-b528aa91a838 tempest-CreateVolumesFromSourceVolumeTest-1564008756 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 05:00:10 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-1f24eb9c-6291-459f-b8fb-b528aa91a838 tempest-CreateVolumesFromSourceVolumeTest-1564008756 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588': None} {{(pid=92060) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 17 05:00:10 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-1f24eb9c-6291-459f-b8fb-b528aa91a838 tempest-CreateVolumesFromSourceVolumeTest-1564008756 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588'] {{(pid=92060) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 17 05:00:10 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-1f24eb9c-6291-459f-b8fb-b528aa91a838 tempest-CreateVolumesFromSourceVolumeTest-1564008756 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 05:00:10 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-1f24eb9c-6291-459f-b8fb-b528aa91a838 tempest-CreateVolumesFromSourceVolumeTest-1564008756 None] Selected osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588 as target Quobyte volume. {{(pid=92060) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 17 05:00:10 devstack cinder-volume[92060]: INFO cinder.volume.drivers.remotefs [None req-1f24eb9c-6291-459f-b8fb-b528aa91a838 tempest-CreateVolumesFromSourceVolumeTest-1564008756 None] casted to osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588 Jun 17 05:00:10 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-1f24eb9c-6291-459f-b8fb-b528aa91a838 tempest-CreateVolumesFromSourceVolumeTest-1564008756 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-ad522341-9908-4746-836a-01ce61603302 1073741824 {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:00:10 devstack cinder-volume[92060]: DEBUG cinder.volume.flows.manager.create_volume [None req-20162ae9-08e3-4638-8789-3e2119d4a943 tempest-CreateVolumesFromImageTest-705949209 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92060) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 17 05:00:10 devstack sudo[111222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-ad522341-9908-4746-836a-01ce61603302 1073741824 Jun 17 05:00:10 devstack sudo[111222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:00:10 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-20162ae9-08e3-4638-8789-3e2119d4a943 tempest-CreateVolumesFromImageTest-705949209 None] Flow 'volume_create_manager' (209406c5-e4e0-4b12-bc6b-9a210c852cca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 17 05:00:10 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-20162ae9-08e3-4638-8789-3e2119d4a943 tempest-CreateVolumesFromImageTest-705949209 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a3f63fd4-5d17-4bb0-8cdc-3db3d70536cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:00:10 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-20162ae9-08e3-4638-8789-3e2119d4a943 tempest-CreateVolumesFromImageTest-705949209 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a3f63fd4-5d17-4bb0-8cdc-3db3d70536cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-17T03:00:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1953447492',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cd8454e0-42a0-4717-8c46-926b3ca3fc7e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0803031093df468c8f644909fc689527',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T03:00:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T03:00:11Z,use_quota=True,user_id='81d5f8781dcb45f0b54c05acd0584493',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aad9ce24-93f9-41a6-baa1-5125964f96d1),volume_type_id=aad9ce24-93f9-41a6-baa1-5125964f96d1)' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:00:10 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-20162ae9-08e3-4638-8789-3e2119d4a943 tempest-CreateVolumesFromImageTest-705949209 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e1588459-5636-4b24-8488-70f4c2ba30c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:00:10 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-20162ae9-08e3-4638-8789-3e2119d4a943 tempest-CreateVolumesFromImageTest-705949209 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e1588459-5636-4b24-8488-70f4c2ba30c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:00:10 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-20162ae9-08e3-4638-8789-3e2119d4a943 tempest-CreateVolumesFromImageTest-705949209 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (330ae259-c9f5-4b93-8391-503a99ccc549) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:00:10 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-20162ae9-08e3-4638-8789-3e2119d4a943 tempest-CreateVolumesFromImageTest-705949209 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (330ae259-c9f5-4b93-8391-503a99ccc549) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cd8454e0-42a0-4717-8c46-926b3ca3fc7e', 'volume_name': 'volume-cd8454e0-42a0-4717-8c46-926b3ca3fc7e', 'volume_size': 1}' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:00:10 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-20162ae9-08e3-4638-8789-3e2119d4a943 tempest-CreateVolumesFromImageTest-705949209 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (874cf11a-58a4-45c6-ac44-ccb32b7f9f6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:00:10 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-20162ae9-08e3-4638-8789-3e2119d4a943 tempest-CreateVolumesFromImageTest-705949209 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (874cf11a-58a4-45c6-ac44-ccb32b7f9f6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:00:10 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-20162ae9-08e3-4638-8789-3e2119d4a943 tempest-CreateVolumesFromImageTest-705949209 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ebfeff71-4c1f-4c3f-8471-a4c61d1511e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:00:10 devstack cinder-volume[92060]: INFO cinder.volume.flows.manager.create_volume [None req-20162ae9-08e3-4638-8789-3e2119d4a943 tempest-CreateVolumesFromImageTest-705949209 None] Volume cd8454e0-42a0-4717-8c46-926b3ca3fc7e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cd8454e0-42a0-4717-8c46-926b3ca3fc7e', 'volume_size': 1} Jun 17 05:00:10 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-20162ae9-08e3-4638-8789-3e2119d4a943 tempest-CreateVolumesFromImageTest-705949209 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 05:00:10 devstack cinder-volume[92060]: DEBUG cinder.volume.flows.manager.create_volume [None req-beb9fdd5-cc20-4aac-8420-174bc62715ae tempest-CreateVolumesFromImageTest-705949209 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92060) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 17 05:00:10 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-beb9fdd5-cc20-4aac-8420-174bc62715ae tempest-CreateVolumesFromImageTest-705949209 None] Flow 'volume_create_manager' (cd6f5a92-2af2-421a-b9fe-77408890a290) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 17 05:00:11 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-beb9fdd5-cc20-4aac-8420-174bc62715ae tempest-CreateVolumesFromImageTest-705949209 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ffa8e4c3-e2cb-4499-8ca4-1cc887a83bf8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:00:11 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-beb9fdd5-cc20-4aac-8420-174bc62715ae tempest-CreateVolumesFromImageTest-705949209 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ffa8e4c3-e2cb-4499-8ca4-1cc887a83bf8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-17T03:00:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-52062141',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=835a1c49-fe0c-4005-ba84-449fdb1a5a74,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0803031093df468c8f644909fc689527',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T03:00:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T03:00:11Z,use_quota=True,user_id='81d5f8781dcb45f0b54c05acd0584493',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aad9ce24-93f9-41a6-baa1-5125964f96d1),volume_type_id=aad9ce24-93f9-41a6-baa1-5125964f96d1)' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:00:11 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-beb9fdd5-cc20-4aac-8420-174bc62715ae tempest-CreateVolumesFromImageTest-705949209 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (38c46c52-f321-468d-8781-5f8464b7ab2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:00:11 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-beb9fdd5-cc20-4aac-8420-174bc62715ae tempest-CreateVolumesFromImageTest-705949209 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (38c46c52-f321-468d-8781-5f8464b7ab2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:00:11 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-beb9fdd5-cc20-4aac-8420-174bc62715ae tempest-CreateVolumesFromImageTest-705949209 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6cd22a08-f3eb-475b-8d59-ec83655d2a3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:00:11 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-beb9fdd5-cc20-4aac-8420-174bc62715ae tempest-CreateVolumesFromImageTest-705949209 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6cd22a08-f3eb-475b-8d59-ec83655d2a3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '835a1c49-fe0c-4005-ba84-449fdb1a5a74', 'volume_name': 'volume-835a1c49-fe0c-4005-ba84-449fdb1a5a74', 'volume_size': 1}' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:00:11 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-beb9fdd5-cc20-4aac-8420-174bc62715ae tempest-CreateVolumesFromImageTest-705949209 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9426cc0e-72b8-4be9-b0fc-9bbb07f2c0e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:00:11 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-beb9fdd5-cc20-4aac-8420-174bc62715ae tempest-CreateVolumesFromImageTest-705949209 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9426cc0e-72b8-4be9-b0fc-9bbb07f2c0e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:00:11 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-beb9fdd5-cc20-4aac-8420-174bc62715ae tempest-CreateVolumesFromImageTest-705949209 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (09b8889d-dc77-4102-bd49-5f779d849db0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:00:11 devstack cinder-volume[92060]: INFO cinder.volume.flows.manager.create_volume [None req-beb9fdd5-cc20-4aac-8420-174bc62715ae tempest-CreateVolumesFromImageTest-705949209 None] Volume 835a1c49-fe0c-4005-ba84-449fdb1a5a74: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-835a1c49-fe0c-4005-ba84-449fdb1a5a74', 'volume_size': 1} Jun 17 05:00:11 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-beb9fdd5-cc20-4aac-8420-174bc62715ae tempest-CreateVolumesFromImageTest-705949209 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 05:00:11 devstack cinder-volume[92060]: DEBUG cinder.volume.flows.manager.create_volume [None req-6abaf4a0-412b-4858-9087-74108a83ee7d tempest-CinderUnicodeTest-1057368418 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92060) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 17 05:00:11 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-6abaf4a0-412b-4858-9087-74108a83ee7d tempest-CinderUnicodeTest-1057368418 None] Flow 'volume_create_manager' (00799201-f31a-477f-b833-b069df507c7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 17 05:00:11 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-6abaf4a0-412b-4858-9087-74108a83ee7d tempest-CinderUnicodeTest-1057368418 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (97507f52-b233-43d7-866c-df084f248311) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:00:11 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-6abaf4a0-412b-4858-9087-74108a83ee7d tempest-CinderUnicodeTest-1057368418 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (97507f52-b233-43d7-866c-df084f248311) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-17T03:00:11Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=751528c8-62bf-4dd6-8857-b9136f21fae6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a858f0965a344ab8b18a9a88ee493f83',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T03:00:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T03:00:11Z,use_quota=True,user_id='526beab6b2624db7a81826f50f104e1a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aad9ce24-93f9-41a6-baa1-5125964f96d1),volume_type_id=aad9ce24-93f9-41a6-baa1-5125964f96d1)' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:00:11 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-6abaf4a0-412b-4858-9087-74108a83ee7d tempest-CinderUnicodeTest-1057368418 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1ec43d2f-ffd9-4f8f-a857-ed50475cb450) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:00:11 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-6abaf4a0-412b-4858-9087-74108a83ee7d tempest-CinderUnicodeTest-1057368418 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1ec43d2f-ffd9-4f8f-a857-ed50475cb450) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:00:11 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-6abaf4a0-412b-4858-9087-74108a83ee7d tempest-CinderUnicodeTest-1057368418 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f773ad4b-b7dc-4830-b580-6fa90409a49a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:00:11 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-6abaf4a0-412b-4858-9087-74108a83ee7d tempest-CinderUnicodeTest-1057368418 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f773ad4b-b7dc-4830-b580-6fa90409a49a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '751528c8-62bf-4dd6-8857-b9136f21fae6', 'volume_name': 'volume-751528c8-62bf-4dd6-8857-b9136f21fae6', 'volume_size': 1}' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:00:11 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-6abaf4a0-412b-4858-9087-74108a83ee7d tempest-CinderUnicodeTest-1057368418 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (53a87f96-097a-4205-92e3-84b183bc32a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:00:11 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-6abaf4a0-412b-4858-9087-74108a83ee7d tempest-CinderUnicodeTest-1057368418 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (53a87f96-097a-4205-92e3-84b183bc32a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:00:11 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-6abaf4a0-412b-4858-9087-74108a83ee7d tempest-CinderUnicodeTest-1057368418 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2781f117-31e1-473c-896a-183a65409030) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:00:11 devstack cinder-volume[92060]: INFO cinder.volume.flows.manager.create_volume [None req-6abaf4a0-412b-4858-9087-74108a83ee7d tempest-CinderUnicodeTest-1057368418 None] Volume 751528c8-62bf-4dd6-8857-b9136f21fae6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-751528c8-62bf-4dd6-8857-b9136f21fae6', 'volume_size': 1} Jun 17 05:00:11 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-6abaf4a0-412b-4858-9087-74108a83ee7d tempest-CinderUnicodeTest-1057368418 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 05:00:11 devstack cinder-volume[92060]: DEBUG cinder.volume.flows.manager.create_volume [None req-f1e0d302-d4f1-4d91-a1b7-dc78658d24ec tempest-CreateVolumesFromImageTest-705949209 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92060) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 17 05:00:11 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-f1e0d302-d4f1-4d91-a1b7-dc78658d24ec tempest-CreateVolumesFromImageTest-705949209 None] Flow 'volume_create_manager' (dabf4ba5-2e78-4fc0-a761-8a075f27be43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 17 05:00:11 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-f1e0d302-d4f1-4d91-a1b7-dc78658d24ec tempest-CreateVolumesFromImageTest-705949209 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cb6f3c93-5d70-414c-846d-934999a40e08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:00:11 devstack sudo[111222]: pam_unix(sudo:session): session closed for user root Jun 17 05:00:11 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-1f24eb9c-6291-459f-b8fb-b528aa91a838 tempest-CreateVolumesFromSourceVolumeTest-1564008756 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-ad522341-9908-4746-836a-01ce61603302 1073741824" returned: 0 in 1.036s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:00:11 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-f1e0d302-d4f1-4d91-a1b7-dc78658d24ec tempest-CreateVolumesFromImageTest-705949209 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cb6f3c93-5d70-414c-846d-934999a40e08) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-17T03:00:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-922861284',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9577aaf9-3403-4724-9386-70e4d44c62c5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0803031093df468c8f644909fc689527',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T03:00:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T03:00:12Z,use_quota=True,user_id='81d5f8781dcb45f0b54c05acd0584493',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aad9ce24-93f9-41a6-baa1-5125964f96d1),volume_type_id=aad9ce24-93f9-41a6-baa1-5125964f96d1)' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:00:11 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-f1e0d302-d4f1-4d91-a1b7-dc78658d24ec tempest-CreateVolumesFromImageTest-705949209 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (51256d55-16c5-4052-bf5f-4a73a84ecb79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:00:11 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-f1e0d302-d4f1-4d91-a1b7-dc78658d24ec tempest-CreateVolumesFromImageTest-705949209 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (51256d55-16c5-4052-bf5f-4a73a84ecb79) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:00:11 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-f1e0d302-d4f1-4d91-a1b7-dc78658d24ec tempest-CreateVolumesFromImageTest-705949209 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a98e0752-ac74-44e5-a49e-05f9cf71177a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:00:11 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-f1e0d302-d4f1-4d91-a1b7-dc78658d24ec tempest-CreateVolumesFromImageTest-705949209 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a98e0752-ac74-44e5-a49e-05f9cf71177a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9577aaf9-3403-4724-9386-70e4d44c62c5', 'volume_name': 'volume-9577aaf9-3403-4724-9386-70e4d44c62c5', 'volume_size': 1}' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:00:11 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-f1e0d302-d4f1-4d91-a1b7-dc78658d24ec tempest-CreateVolumesFromImageTest-705949209 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (55a490d0-4af8-461c-9ca8-fe712e6b6f92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:00:11 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-f1e0d302-d4f1-4d91-a1b7-dc78658d24ec tempest-CreateVolumesFromImageTest-705949209 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (55a490d0-4af8-461c-9ca8-fe712e6b6f92) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:00:11 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-f1e0d302-d4f1-4d91-a1b7-dc78658d24ec tempest-CreateVolumesFromImageTest-705949209 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4d0703bc-41e3-4ae8-9876-d88bb09d5edc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:00:11 devstack cinder-volume[92060]: INFO cinder.volume.flows.manager.create_volume [None req-f1e0d302-d4f1-4d91-a1b7-dc78658d24ec tempest-CreateVolumesFromImageTest-705949209 None] Volume 9577aaf9-3403-4724-9386-70e4d44c62c5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9577aaf9-3403-4724-9386-70e4d44c62c5', 'volume_size': 1} Jun 17 05:00:11 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-f1e0d302-d4f1-4d91-a1b7-dc78658d24ec tempest-CreateVolumesFromImageTest-705949209 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 05:00:11 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-1f24eb9c-6291-459f-b8fb-b528aa91a838 tempest-CreateVolumesFromSourceVolumeTest-1564008756 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-ad522341-9908-4746-836a-01ce61603302 {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:00:11 devstack sudo[111230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-ad522341-9908-4746-836a-01ce61603302 Jun 17 05:00:11 devstack sudo[111230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:00:12 devstack cinder-volume[92060]: DEBUG cinder.volume.flows.manager.create_volume [None req-a833f91c-e01f-4bea-a4da-b57370ff8c21 tempest-CreateVolumesFromImageTest-705949209 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92060) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 17 05:00:12 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-a833f91c-e01f-4bea-a4da-b57370ff8c21 tempest-CreateVolumesFromImageTest-705949209 None] Flow 'volume_create_manager' (03828845-d4f1-46bf-91c5-1f31e3f8458b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 17 05:00:12 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-a833f91c-e01f-4bea-a4da-b57370ff8c21 tempest-CreateVolumesFromImageTest-705949209 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bb6c9c02-99d3-40cf-acfe-b49d174d436f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:00:12 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-a833f91c-e01f-4bea-a4da-b57370ff8c21 tempest-CreateVolumesFromImageTest-705949209 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bb6c9c02-99d3-40cf-acfe-b49d174d436f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-17T03:00:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-148716515',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=72715447-8624-458f-89ff-2d0660524b63,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0803031093df468c8f644909fc689527',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T03:00:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T03:00:12Z,use_quota=True,user_id='81d5f8781dcb45f0b54c05acd0584493',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aad9ce24-93f9-41a6-baa1-5125964f96d1),volume_type_id=aad9ce24-93f9-41a6-baa1-5125964f96d1)' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:00:12 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-a833f91c-e01f-4bea-a4da-b57370ff8c21 tempest-CreateVolumesFromImageTest-705949209 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ecdc9b96-4506-4107-929e-daadb397d522) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:00:12 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-a833f91c-e01f-4bea-a4da-b57370ff8c21 tempest-CreateVolumesFromImageTest-705949209 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ecdc9b96-4506-4107-929e-daadb397d522) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:00:12 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-a833f91c-e01f-4bea-a4da-b57370ff8c21 tempest-CreateVolumesFromImageTest-705949209 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fb990634-608e-4510-b429-43980e4aa181) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:00:12 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-a833f91c-e01f-4bea-a4da-b57370ff8c21 tempest-CreateVolumesFromImageTest-705949209 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fb990634-608e-4510-b429-43980e4aa181) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '72715447-8624-458f-89ff-2d0660524b63', 'volume_name': 'volume-72715447-8624-458f-89ff-2d0660524b63', 'volume_size': 1}' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:00:12 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-a833f91c-e01f-4bea-a4da-b57370ff8c21 tempest-CreateVolumesFromImageTest-705949209 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9ea34155-16d1-40a0-b5e7-e209c65b59be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:00:12 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-a833f91c-e01f-4bea-a4da-b57370ff8c21 tempest-CreateVolumesFromImageTest-705949209 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9ea34155-16d1-40a0-b5e7-e209c65b59be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:00:12 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-a833f91c-e01f-4bea-a4da-b57370ff8c21 tempest-CreateVolumesFromImageTest-705949209 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8f8e1e68-0f27-4e78-a044-2a6fd97067c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:00:12 devstack cinder-volume[92060]: INFO cinder.volume.flows.manager.create_volume [None req-a833f91c-e01f-4bea-a4da-b57370ff8c21 tempest-CreateVolumesFromImageTest-705949209 None] Volume 72715447-8624-458f-89ff-2d0660524b63: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-72715447-8624-458f-89ff-2d0660524b63', 'volume_size': 1} Jun 17 05:00:12 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-a833f91c-e01f-4bea-a4da-b57370ff8c21 tempest-CreateVolumesFromImageTest-705949209 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 05:00:12 devstack cinder-volume[92060]: DEBUG cinder.volume.flows.manager.create_volume [None req-93406fb1-5efb-429b-9c7f-7ae6ae91abe2 tempest-CreateVolumesFromImageTest-705949209 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92060) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 17 05:00:12 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-93406fb1-5efb-429b-9c7f-7ae6ae91abe2 tempest-CreateVolumesFromImageTest-705949209 None] Flow 'volume_create_manager' (0f9f4826-d5aa-4e08-b417-8f8ac8b16c74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 17 05:00:12 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-93406fb1-5efb-429b-9c7f-7ae6ae91abe2 tempest-CreateVolumesFromImageTest-705949209 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f77eb130-be99-4fe1-8d48-0119b8d79778) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:00:12 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-93406fb1-5efb-429b-9c7f-7ae6ae91abe2 tempest-CreateVolumesFromImageTest-705949209 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f77eb130-be99-4fe1-8d48-0119b8d79778) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-17T03:00:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-401976990',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bd24ec34-2c53-46e0-b1a1-4c21f35ce1a4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0803031093df468c8f644909fc689527',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T03:00:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T03:00:12Z,use_quota=True,user_id='81d5f8781dcb45f0b54c05acd0584493',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aad9ce24-93f9-41a6-baa1-5125964f96d1),volume_type_id=aad9ce24-93f9-41a6-baa1-5125964f96d1)' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:00:12 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-93406fb1-5efb-429b-9c7f-7ae6ae91abe2 tempest-CreateVolumesFromImageTest-705949209 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (576e9c51-2cf0-45ba-b95c-7676e81b4c68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:00:12 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-93406fb1-5efb-429b-9c7f-7ae6ae91abe2 tempest-CreateVolumesFromImageTest-705949209 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (576e9c51-2cf0-45ba-b95c-7676e81b4c68) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:00:12 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-93406fb1-5efb-429b-9c7f-7ae6ae91abe2 tempest-CreateVolumesFromImageTest-705949209 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a8edee89-e3b0-41d4-8755-54b7a322c1a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:00:12 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-93406fb1-5efb-429b-9c7f-7ae6ae91abe2 tempest-CreateVolumesFromImageTest-705949209 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a8edee89-e3b0-41d4-8755-54b7a322c1a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bd24ec34-2c53-46e0-b1a1-4c21f35ce1a4', 'volume_name': 'volume-bd24ec34-2c53-46e0-b1a1-4c21f35ce1a4', 'volume_size': 1}' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:00:12 devstack sudo[111230]: pam_unix(sudo:session): session closed for user root Jun 17 05:00:12 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-93406fb1-5efb-429b-9c7f-7ae6ae91abe2 tempest-CreateVolumesFromImageTest-705949209 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0b055409-33f4-48d1-9b03-63278da8e206) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:00:12 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-93406fb1-5efb-429b-9c7f-7ae6ae91abe2 tempest-CreateVolumesFromImageTest-705949209 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0b055409-33f4-48d1-9b03-63278da8e206) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:00:12 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-93406fb1-5efb-429b-9c7f-7ae6ae91abe2 tempest-CreateVolumesFromImageTest-705949209 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (958b0092-3bc8-4c46-8b68-c045117ecc07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:00:12 devstack cinder-volume[92060]: INFO cinder.volume.flows.manager.create_volume [None req-93406fb1-5efb-429b-9c7f-7ae6ae91abe2 tempest-CreateVolumesFromImageTest-705949209 None] Volume bd24ec34-2c53-46e0-b1a1-4c21f35ce1a4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bd24ec34-2c53-46e0-b1a1-4c21f35ce1a4', 'volume_size': 1} Jun 17 05:00:12 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-93406fb1-5efb-429b-9c7f-7ae6ae91abe2 tempest-CreateVolumesFromImageTest-705949209 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 05:00:12 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-1f24eb9c-6291-459f-b8fb-b528aa91a838 tempest-CreateVolumesFromSourceVolumeTest-1564008756 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-ad522341-9908-4746-836a-01ce61603302" returned: 0 in 0.735s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:00:12 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-1f24eb9c-6291-459f-b8fb-b528aa91a838 tempest-CreateVolumesFromSourceVolumeTest-1564008756 None] <== create_volume: return (1871ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588'} {{(pid=92060) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 17 05:00:12 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-1f24eb9c-6291-459f-b8fb-b528aa91a838 tempest-CreateVolumesFromSourceVolumeTest-1564008756 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.874s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 05:00:12 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-20162ae9-08e3-4638-8789-3e2119d4a943 tempest-CreateVolumesFromImageTest-705949209 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.723s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 05:00:12 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-20162ae9-08e3-4638-8789-3e2119d4a943 tempest-CreateVolumesFromImageTest-705949209 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-17T03:00:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1953447492',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cd8454e0-42a0-4717-8c46-926b3ca3fc7e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0803031093df468c8f644909fc689527',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T03:00:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T03:00:11Z,use_quota=True,user_id='81d5f8781dcb45f0b54c05acd0584493',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aad9ce24-93f9-41a6-baa1-5125964f96d1),volume_type_id=aad9ce24-93f9-41a6-baa1-5125964f96d1)}" {{(pid=92060) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 17 05:00:12 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.remotefs [None req-20162ae9-08e3-4638-8789-3e2119d4a943 tempest-CreateVolumesFromImageTest-705949209 None] Creating volume cd8454e0-42a0-4717-8c46-926b3ca3fc7e {{(pid=92060) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 17 05:00:12 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-20162ae9-08e3-4638-8789-3e2119d4a943 tempest-CreateVolumesFromImageTest-705949209 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 05:00:12 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-20162ae9-08e3-4638-8789-3e2119d4a943 tempest-CreateVolumesFromImageTest-705949209 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 05:00:12 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-20162ae9-08e3-4638-8789-3e2119d4a943 tempest-CreateVolumesFromImageTest-705949209 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588': None} {{(pid=92060) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 17 05:00:12 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-20162ae9-08e3-4638-8789-3e2119d4a943 tempest-CreateVolumesFromImageTest-705949209 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588'] {{(pid=92060) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 17 05:00:12 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-20162ae9-08e3-4638-8789-3e2119d4a943 tempest-CreateVolumesFromImageTest-705949209 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 05:00:12 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-20162ae9-08e3-4638-8789-3e2119d4a943 tempest-CreateVolumesFromImageTest-705949209 None] Selected osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588 as target Quobyte volume. {{(pid=92060) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 17 05:00:12 devstack cinder-volume[92060]: INFO cinder.volume.drivers.remotefs [None req-20162ae9-08e3-4638-8789-3e2119d4a943 tempest-CreateVolumesFromImageTest-705949209 None] casted to osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588 Jun 17 05:00:12 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-20162ae9-08e3-4638-8789-3e2119d4a943 tempest-CreateVolumesFromImageTest-705949209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-cd8454e0-42a0-4717-8c46-926b3ca3fc7e 1073741824 {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:00:12 devstack sudo[111233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-cd8454e0-42a0-4717-8c46-926b3ca3fc7e 1073741824 Jun 17 05:00:12 devstack sudo[111233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:00:12 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-1f24eb9c-6291-459f-b8fb-b528aa91a838 tempest-CreateVolumesFromSourceVolumeTest-1564008756 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (16db4560-01aa-4e2c-a4fe-f163a6e1cfee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ad522341-9908-4746-836a-01ce61603302', 'volume_size': 1}' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:00:12 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-1f24eb9c-6291-459f-b8fb-b528aa91a838 tempest-CreateVolumesFromSourceVolumeTest-1564008756 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ab7835e9-6cae-4786-994c-d550a51d8ca3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:00:12 devstack cinder-volume[92060]: INFO cinder.volume.flows.manager.create_volume [None req-1f24eb9c-6291-459f-b8fb-b528aa91a838 tempest-CreateVolumesFromSourceVolumeTest-1564008756 None] Volume volume-ad522341-9908-4746-836a-01ce61603302 (ad522341-9908-4746-836a-01ce61603302): created successfully Jun 17 05:00:12 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-1f24eb9c-6291-459f-b8fb-b528aa91a838 tempest-CreateVolumesFromSourceVolumeTest-1564008756 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ab7835e9-6cae-4786-994c-d550a51d8ca3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:00:12 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-1f24eb9c-6291-459f-b8fb-b528aa91a838 tempest-CreateVolumesFromSourceVolumeTest-1564008756 None] Flow 'volume_create_manager' (67f7f187-2f61-4279-aa6f-b472cc3ecda0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92060) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 17 05:00:12 devstack cinder-volume[92060]: INFO cinder.volume.manager [None req-1f24eb9c-6291-459f-b8fb-b528aa91a838 tempest-CreateVolumesFromSourceVolumeTest-1564008756 None] Created volume successfully. Jun 17 05:00:13 devstack sudo[111233]: pam_unix(sudo:session): session closed for user root Jun 17 05:00:13 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-20162ae9-08e3-4638-8789-3e2119d4a943 tempest-CreateVolumesFromImageTest-705949209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-cd8454e0-42a0-4717-8c46-926b3ca3fc7e 1073741824" returned: 0 in 0.790s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:00:13 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-20162ae9-08e3-4638-8789-3e2119d4a943 tempest-CreateVolumesFromImageTest-705949209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-cd8454e0-42a0-4717-8c46-926b3ca3fc7e {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:00:13 devstack sudo[111240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-cd8454e0-42a0-4717-8c46-926b3ca3fc7e Jun 17 05:00:13 devstack sudo[111240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:00:13 devstack sudo[111240]: pam_unix(sudo:session): session closed for user root Jun 17 05:00:13 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-20162ae9-08e3-4638-8789-3e2119d4a943 tempest-CreateVolumesFromImageTest-705949209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-cd8454e0-42a0-4717-8c46-926b3ca3fc7e" returned: 0 in 0.615s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:00:13 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-20162ae9-08e3-4638-8789-3e2119d4a943 tempest-CreateVolumesFromImageTest-705949209 None] <== create_volume: return (1451ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588'} {{(pid=92060) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 17 05:00:13 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-20162ae9-08e3-4638-8789-3e2119d4a943 tempest-CreateVolumesFromImageTest-705949209 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.454s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 05:00:14 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-beb9fdd5-cc20-4aac-8420-174bc62715ae tempest-CreateVolumesFromImageTest-705949209 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.940s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 05:00:14 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-beb9fdd5-cc20-4aac-8420-174bc62715ae tempest-CreateVolumesFromImageTest-705949209 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-17T03:00:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-52062141',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=835a1c49-fe0c-4005-ba84-449fdb1a5a74,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0803031093df468c8f644909fc689527',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T03:00:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T03:00:11Z,use_quota=True,user_id='81d5f8781dcb45f0b54c05acd0584493',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aad9ce24-93f9-41a6-baa1-5125964f96d1),volume_type_id=aad9ce24-93f9-41a6-baa1-5125964f96d1)}" {{(pid=92060) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 17 05:00:14 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.remotefs [None req-beb9fdd5-cc20-4aac-8420-174bc62715ae tempest-CreateVolumesFromImageTest-705949209 None] Creating volume 835a1c49-fe0c-4005-ba84-449fdb1a5a74 {{(pid=92060) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 17 05:00:14 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-beb9fdd5-cc20-4aac-8420-174bc62715ae tempest-CreateVolumesFromImageTest-705949209 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 05:00:14 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-beb9fdd5-cc20-4aac-8420-174bc62715ae tempest-CreateVolumesFromImageTest-705949209 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 05:00:14 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-beb9fdd5-cc20-4aac-8420-174bc62715ae tempest-CreateVolumesFromImageTest-705949209 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588': None} {{(pid=92060) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 17 05:00:14 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-beb9fdd5-cc20-4aac-8420-174bc62715ae tempest-CreateVolumesFromImageTest-705949209 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588'] {{(pid=92060) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 17 05:00:14 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-beb9fdd5-cc20-4aac-8420-174bc62715ae tempest-CreateVolumesFromImageTest-705949209 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 05:00:14 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-beb9fdd5-cc20-4aac-8420-174bc62715ae tempest-CreateVolumesFromImageTest-705949209 None] Selected osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588 as target Quobyte volume. {{(pid=92060) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 17 05:00:14 devstack cinder-volume[92060]: INFO cinder.volume.drivers.remotefs [None req-beb9fdd5-cc20-4aac-8420-174bc62715ae tempest-CreateVolumesFromImageTest-705949209 None] casted to osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588 Jun 17 05:00:14 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-beb9fdd5-cc20-4aac-8420-174bc62715ae tempest-CreateVolumesFromImageTest-705949209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-835a1c49-fe0c-4005-ba84-449fdb1a5a74 1073741824 {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:00:14 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-20162ae9-08e3-4638-8789-3e2119d4a943 tempest-CreateVolumesFromImageTest-705949209 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ebfeff71-4c1f-4c3f-8471-a4c61d1511e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cd8454e0-42a0-4717-8c46-926b3ca3fc7e', 'volume_size': 1}' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:00:14 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-20162ae9-08e3-4638-8789-3e2119d4a943 tempest-CreateVolumesFromImageTest-705949209 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (37a020da-272e-4337-9df0-8bb2ba4d6dab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:00:14 devstack sudo[111243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-835a1c49-fe0c-4005-ba84-449fdb1a5a74 1073741824 Jun 17 05:00:14 devstack sudo[111243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:00:14 devstack cinder-volume[92060]: INFO cinder.volume.flows.manager.create_volume [None req-20162ae9-08e3-4638-8789-3e2119d4a943 tempest-CreateVolumesFromImageTest-705949209 None] Volume volume-cd8454e0-42a0-4717-8c46-926b3ca3fc7e (cd8454e0-42a0-4717-8c46-926b3ca3fc7e): created successfully Jun 17 05:00:14 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-20162ae9-08e3-4638-8789-3e2119d4a943 tempest-CreateVolumesFromImageTest-705949209 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (37a020da-272e-4337-9df0-8bb2ba4d6dab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:00:14 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-20162ae9-08e3-4638-8789-3e2119d4a943 tempest-CreateVolumesFromImageTest-705949209 None] Flow 'volume_create_manager' (209406c5-e4e0-4b12-bc6b-9a210c852cca) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92060) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 17 05:00:14 devstack cinder-volume[92060]: INFO cinder.volume.manager [None req-20162ae9-08e3-4638-8789-3e2119d4a943 tempest-CreateVolumesFromImageTest-705949209 None] Created volume successfully. Jun 17 05:00:14 devstack cinder-volume[92060]: DEBUG cinder.volume.flows.manager.create_volume [None req-794c538b-5268-4ca1-875d-03c9c2c79ae6 tempest-CreateVolumesFromSourceVolumeTest-1564008756 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92060) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 17 05:00:14 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-794c538b-5268-4ca1-875d-03c9c2c79ae6 tempest-CreateVolumesFromSourceVolumeTest-1564008756 None] Flow 'volume_create_manager' (f240abbe-c451-4dc4-a7d2-d242a23cd22b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 17 05:00:14 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-794c538b-5268-4ca1-875d-03c9c2c79ae6 tempest-CreateVolumesFromSourceVolumeTest-1564008756 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (21c95128-78c1-43e0-b464-ce33baf32fb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:00:14 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-794c538b-5268-4ca1-875d-03c9c2c79ae6 tempest-CreateVolumesFromSourceVolumeTest-1564008756 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (21c95128-78c1-43e0-b464-ce33baf32fb6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-17T03:00:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-934048937',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=594828e9-f007-48ea-a750-2ff8bbcf4fc6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3322152864f84a628abc1acba10e4364',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T03:00:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T03:00:14Z,use_quota=True,user_id='0986412f49d24fcc9987a9813fcb2e8b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aad9ce24-93f9-41a6-baa1-5125964f96d1),volume_type_id=aad9ce24-93f9-41a6-baa1-5125964f96d1)' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:00:14 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-794c538b-5268-4ca1-875d-03c9c2c79ae6 tempest-CreateVolumesFromSourceVolumeTest-1564008756 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e7704fed-7950-4fba-88a6-047c98dbacd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:00:14 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-794c538b-5268-4ca1-875d-03c9c2c79ae6 tempest-CreateVolumesFromSourceVolumeTest-1564008756 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e7704fed-7950-4fba-88a6-047c98dbacd2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:00:14 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-794c538b-5268-4ca1-875d-03c9c2c79ae6 tempest-CreateVolumesFromSourceVolumeTest-1564008756 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7a5ed981-05f3-44e0-8616-007cdea9e0f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:00:14 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-794c538b-5268-4ca1-875d-03c9c2c79ae6 tempest-CreateVolumesFromSourceVolumeTest-1564008756 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7a5ed981-05f3-44e0-8616-007cdea9e0f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '594828e9-f007-48ea-a750-2ff8bbcf4fc6', 'volume_name': 'volume-594828e9-f007-48ea-a750-2ff8bbcf4fc6', 'volume_size': 1}' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:00:14 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-794c538b-5268-4ca1-875d-03c9c2c79ae6 tempest-CreateVolumesFromSourceVolumeTest-1564008756 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3ed2dd16-cad8-4866-ae09-a4bbde79dcc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:00:14 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-794c538b-5268-4ca1-875d-03c9c2c79ae6 tempest-CreateVolumesFromSourceVolumeTest-1564008756 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3ed2dd16-cad8-4866-ae09-a4bbde79dcc7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:00:14 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-794c538b-5268-4ca1-875d-03c9c2c79ae6 tempest-CreateVolumesFromSourceVolumeTest-1564008756 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (faebecf1-9bfa-4c6d-ac59-3dd97335d80e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:00:14 devstack cinder-volume[92060]: INFO cinder.volume.flows.manager.create_volume [None req-794c538b-5268-4ca1-875d-03c9c2c79ae6 tempest-CreateVolumesFromSourceVolumeTest-1564008756 None] Volume 594828e9-f007-48ea-a750-2ff8bbcf4fc6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-594828e9-f007-48ea-a750-2ff8bbcf4fc6', 'volume_size': 1} Jun 17 05:00:14 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-794c538b-5268-4ca1-875d-03c9c2c79ae6 tempest-CreateVolumesFromSourceVolumeTest-1564008756 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 05:00:14 devstack cinder-volume[92060]: DEBUG cinder.volume.flows.manager.create_volume [None req-53eaef93-664c-455c-a1d0-8b0d4da9b16c tempest-VolumeAndVolumeTypeFromImageTest-1250188327 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92060) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 17 05:00:14 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-53eaef93-664c-455c-a1d0-8b0d4da9b16c tempest-VolumeAndVolumeTypeFromImageTest-1250188327 None] Flow 'volume_create_manager' (3a248069-474d-4255-89e9-9bab7d239de8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 17 05:00:14 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-53eaef93-664c-455c-a1d0-8b0d4da9b16c tempest-VolumeAndVolumeTypeFromImageTest-1250188327 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (93782012-9f52-4728-b16c-7c69e17c0e33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:00:14 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-53eaef93-664c-455c-a1d0-8b0d4da9b16c tempest-VolumeAndVolumeTypeFromImageTest-1250188327 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (93782012-9f52-4728-b16c-7c69e17c0e33) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-17T03:00:14Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bd0081a8-1bcf-49d7-8b06-273b0d62dc13,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='47b57bae04f6485e85eede8f4130f4f6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T03:00:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T03:00:14Z,use_quota=True,user_id='bf70ab77178e4c9b91f92f9da516a916',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d5d5937-e41b-4165-b0c2-6efe6a768890),volume_type_id=2d5d5937-e41b-4165-b0c2-6efe6a768890)' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:00:14 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-53eaef93-664c-455c-a1d0-8b0d4da9b16c tempest-VolumeAndVolumeTypeFromImageTest-1250188327 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0f09d67e-dc14-4c10-bbb0-91e3f2d97bb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:00:14 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-53eaef93-664c-455c-a1d0-8b0d4da9b16c tempest-VolumeAndVolumeTypeFromImageTest-1250188327 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0f09d67e-dc14-4c10-bbb0-91e3f2d97bb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:00:14 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-53eaef93-664c-455c-a1d0-8b0d4da9b16c tempest-VolumeAndVolumeTypeFromImageTest-1250188327 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (34fa30a7-bab3-40e2-845e-5cca4d0d155c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:00:14 devstack cinder-volume[92060]: DEBUG cinder.image.glance [None req-53eaef93-664c-455c-a1d0-8b0d4da9b16c tempest-VolumeAndVolumeTypeFromImageTest-1250188327 None] Creating Keystone auth plugin from conf {{(pid=92060) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jun 17 05:00:14 devstack cinder-volume[92060]: DEBUG cinder.volume.flows.manager.create_volume [None req-367b77af-d6fc-4c23-9bd0-4268499c862b tempest-CreateVolumesFromSourceVolumeTest-1564008756 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92060) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 17 05:00:14 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-367b77af-d6fc-4c23-9bd0-4268499c862b tempest-CreateVolumesFromSourceVolumeTest-1564008756 None] Flow 'volume_create_manager' (b375a849-761e-432e-ad97-983af27f7664) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 17 05:00:14 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-367b77af-d6fc-4c23-9bd0-4268499c862b tempest-CreateVolumesFromSourceVolumeTest-1564008756 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f6cce3fd-a671-4c18-b227-cd87d9e5c709) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:00:14 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-367b77af-d6fc-4c23-9bd0-4268499c862b tempest-CreateVolumesFromSourceVolumeTest-1564008756 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f6cce3fd-a671-4c18-b227-cd87d9e5c709) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-17T03:00:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-926583073',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8bad494b-7e1f-4eaf-81da-0099fbb31aba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3322152864f84a628abc1acba10e4364',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T03:00:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T03:00:15Z,use_quota=True,user_id='0986412f49d24fcc9987a9813fcb2e8b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aad9ce24-93f9-41a6-baa1-5125964f96d1),volume_type_id=aad9ce24-93f9-41a6-baa1-5125964f96d1)' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:00:14 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-367b77af-d6fc-4c23-9bd0-4268499c862b tempest-CreateVolumesFromSourceVolumeTest-1564008756 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (17bd9df0-a5d9-4350-adf7-ee110f356aaa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:00:14 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-367b77af-d6fc-4c23-9bd0-4268499c862b tempest-CreateVolumesFromSourceVolumeTest-1564008756 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (17bd9df0-a5d9-4350-adf7-ee110f356aaa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:00:14 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-367b77af-d6fc-4c23-9bd0-4268499c862b tempest-CreateVolumesFromSourceVolumeTest-1564008756 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (648edb18-aa74-4ac7-9d1b-a9f38b5344a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:00:14 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-367b77af-d6fc-4c23-9bd0-4268499c862b tempest-CreateVolumesFromSourceVolumeTest-1564008756 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (648edb18-aa74-4ac7-9d1b-a9f38b5344a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8bad494b-7e1f-4eaf-81da-0099fbb31aba', 'volume_name': 'volume-8bad494b-7e1f-4eaf-81da-0099fbb31aba', 'volume_size': 1}' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:00:14 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-367b77af-d6fc-4c23-9bd0-4268499c862b tempest-CreateVolumesFromSourceVolumeTest-1564008756 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (73f30d21-33a2-4504-ab82-cc9b236794d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:00:14 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-367b77af-d6fc-4c23-9bd0-4268499c862b tempest-CreateVolumesFromSourceVolumeTest-1564008756 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (73f30d21-33a2-4504-ab82-cc9b236794d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:00:14 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-367b77af-d6fc-4c23-9bd0-4268499c862b tempest-CreateVolumesFromSourceVolumeTest-1564008756 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4e7c137e-2786-4ff4-9080-0e827f06c886) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:00:14 devstack cinder-volume[92060]: INFO cinder.volume.flows.manager.create_volume [None req-367b77af-d6fc-4c23-9bd0-4268499c862b tempest-CreateVolumesFromSourceVolumeTest-1564008756 None] Volume 8bad494b-7e1f-4eaf-81da-0099fbb31aba: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8bad494b-7e1f-4eaf-81da-0099fbb31aba', 'volume_size': 1} Jun 17 05:00:14 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-367b77af-d6fc-4c23-9bd0-4268499c862b tempest-CreateVolumesFromSourceVolumeTest-1564008756 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 05:00:15 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-53eaef93-664c-455c-a1d0-8b0d4da9b16c tempest-VolumeAndVolumeTypeFromImageTest-1250188327 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (34fa30a7-bab3-40e2-845e-5cca4d0d155c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'bd0081a8-1bcf-49d7-8b06-273b0d62dc13', 'volume_name': 'volume-bd0081a8-1bcf-49d7-8b06-273b0d62dc13', 'volume_size': 1, 'image_id': 'dfb60546-63e8-4d51-8faf-a70933c69c67', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/dfb60546-63e8-4d51-8faf-a70933c69c67', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '071234d8ee1e3b20a7aeb4e84b1fbdaf', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '47b57bae04f6485e85eede8f4130f4f6', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '91c73fc7ce2a8d9a79d785349c9b9bccf63e99edf8feb9b1f8166b3ffdffb2637c0e58d770318488a63368a1f94e3a35176a4c1778dae1e54e0c3f9f13228fca', 'id': 'dfb60546-63e8-4d51-8faf-a70933c69c67', 'created_at': datetime.datetime(2026, 6, 17, 3, 0, 12, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 17, 3, 0, 13, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/dfb60546-63e8-4d51-8faf-a70933c69c67/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:00:15 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-53eaef93-664c-455c-a1d0-8b0d4da9b16c tempest-VolumeAndVolumeTypeFromImageTest-1250188327 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b4fd16c8-fb13-4350-82a3-d372e31ef005) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:00:15 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-53eaef93-664c-455c-a1d0-8b0d4da9b16c tempest-VolumeAndVolumeTypeFromImageTest-1250188327 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b4fd16c8-fb13-4350-82a3-d372e31ef005) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:00:15 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-53eaef93-664c-455c-a1d0-8b0d4da9b16c tempest-VolumeAndVolumeTypeFromImageTest-1250188327 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (da2e0189-ec56-44cd-81f6-f09003c84ecd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:00:15 devstack cinder-volume[92060]: INFO cinder.volume.flows.manager.create_volume [None req-53eaef93-664c-455c-a1d0-8b0d4da9b16c tempest-VolumeAndVolumeTypeFromImageTest-1250188327 None] Volume bd0081a8-1bcf-49d7-8b06-273b0d62dc13: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-bd0081a8-1bcf-49d7-8b06-273b0d62dc13', 'volume_size': 1, 'image_id': 'dfb60546-63e8-4d51-8faf-a70933c69c67', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/dfb60546-63e8-4d51-8faf-a70933c69c67', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '071234d8ee1e3b20a7aeb4e84b1fbdaf', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '47b57bae04f6485e85eede8f4130f4f6', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '91c73fc7ce2a8d9a79d785349c9b9bccf63e99edf8feb9b1f8166b3ffdffb2637c0e58d770318488a63368a1f94e3a35176a4c1778dae1e54e0c3f9f13228fca', 'id': 'dfb60546-63e8-4d51-8faf-a70933c69c67', 'created_at': datetime.datetime(2026, 6, 17, 3, 0, 12, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 17, 3, 0, 13, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/dfb60546-63e8-4d51-8faf-a70933c69c67/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Jun 17 05:00:15 devstack cinder-volume[92060]: DEBUG cinder.volume.flows.manager.create_volume [None req-53eaef93-664c-455c-a1d0-8b0d4da9b16c tempest-VolumeAndVolumeTypeFromImageTest-1250188327 None] Trying to clone bd0081a8-1bcf-49d7-8b06-273b0d62dc13 from image dfb60546-63e8-4d51-8faf-a70933c69c67 at location (None, [{'url': 'file:///opt/stack/data/glance/images/dfb60546-63e8-4d51-8faf-a70933c69c67', 'metadata': {}}]). {{(pid=92060) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jun 17 05:00:15 devstack cinder-volume[92060]: DEBUG cinder.volume.flows.manager.create_volume [None req-af026fd9-efc3-45fa-8315-73590690740a tempest-CreateVolumesFromSourceVolumeTest-1564008756 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92060) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 17 05:00:15 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-af026fd9-efc3-45fa-8315-73590690740a tempest-CreateVolumesFromSourceVolumeTest-1564008756 None] Flow 'volume_create_manager' (fdd65a98-4098-47cf-9375-b1bdfa2f49de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 17 05:00:15 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-af026fd9-efc3-45fa-8315-73590690740a tempest-CreateVolumesFromSourceVolumeTest-1564008756 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e056a5a7-6351-4115-9e4a-7e86e2e971c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:00:15 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-af026fd9-efc3-45fa-8315-73590690740a tempest-CreateVolumesFromSourceVolumeTest-1564008756 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e056a5a7-6351-4115-9e4a-7e86e2e971c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-17T03:00:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2099895705',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e1b27c21-6230-4e3d-9a6f-574c5f8ae1ed,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3322152864f84a628abc1acba10e4364',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T03:00:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T03:00:15Z,use_quota=True,user_id='0986412f49d24fcc9987a9813fcb2e8b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aad9ce24-93f9-41a6-baa1-5125964f96d1),volume_type_id=aad9ce24-93f9-41a6-baa1-5125964f96d1)' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:00:15 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-af026fd9-efc3-45fa-8315-73590690740a tempest-CreateVolumesFromSourceVolumeTest-1564008756 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (045745bd-6e2d-4ad9-9730-d1ae23bbe2c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:00:15 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-af026fd9-efc3-45fa-8315-73590690740a tempest-CreateVolumesFromSourceVolumeTest-1564008756 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (045745bd-6e2d-4ad9-9730-d1ae23bbe2c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:00:15 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-af026fd9-efc3-45fa-8315-73590690740a tempest-CreateVolumesFromSourceVolumeTest-1564008756 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (35f3bd23-7db6-4abf-9c2c-057be224a522) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:00:15 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-af026fd9-efc3-45fa-8315-73590690740a tempest-CreateVolumesFromSourceVolumeTest-1564008756 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (35f3bd23-7db6-4abf-9c2c-057be224a522) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e1b27c21-6230-4e3d-9a6f-574c5f8ae1ed', 'volume_name': 'volume-e1b27c21-6230-4e3d-9a6f-574c5f8ae1ed', 'volume_size': 1}' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:00:15 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-af026fd9-efc3-45fa-8315-73590690740a tempest-CreateVolumesFromSourceVolumeTest-1564008756 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9f0d86a3-4724-47e6-8a11-63ef209a948c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:00:15 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-af026fd9-efc3-45fa-8315-73590690740a tempest-CreateVolumesFromSourceVolumeTest-1564008756 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9f0d86a3-4724-47e6-8a11-63ef209a948c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:00:15 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-af026fd9-efc3-45fa-8315-73590690740a tempest-CreateVolumesFromSourceVolumeTest-1564008756 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f6ddfef9-dbbe-4bbd-81af-6b07853c19a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:00:15 devstack cinder-volume[92060]: INFO cinder.volume.flows.manager.create_volume [None req-af026fd9-efc3-45fa-8315-73590690740a tempest-CreateVolumesFromSourceVolumeTest-1564008756 None] Volume e1b27c21-6230-4e3d-9a6f-574c5f8ae1ed: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e1b27c21-6230-4e3d-9a6f-574c5f8ae1ed', 'volume_size': 1} Jun 17 05:00:15 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-af026fd9-efc3-45fa-8315-73590690740a tempest-CreateVolumesFromSourceVolumeTest-1564008756 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 05:00:15 devstack cinder-volume[92060]: DEBUG cinder.image.image_utils [None req-53eaef93-664c-455c-a1d0-8b0d4da9b16c tempest-VolumeAndVolumeTypeFromImageTest-1250188327 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_dfb60546-63e8-4d51-8faf-a70933c69c67_vf_fwdqddevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=92060) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jun 17 05:00:15 devstack cinder-volume[92060]: INFO cinder.image.image_utils [None req-53eaef93-664c-455c-a1d0-8b0d4da9b16c tempest-VolumeAndVolumeTypeFromImageTest-1250188327 None] Image download 0.00 MB at 0.00 MB/s Jun 17 05:00:15 devstack sudo[111243]: pam_unix(sudo:session): session closed for user root Jun 17 05:00:15 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-beb9fdd5-cc20-4aac-8420-174bc62715ae tempest-CreateVolumesFromImageTest-705949209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-835a1c49-fe0c-4005-ba84-449fdb1a5a74 1073741824" returned: 0 in 1.186s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:00:15 devstack cinder-volume[92060]: DEBUG oslo.privsep.daemon [-] privsep: reply[41f70df4-4a29-4398-beb9-74c8635710fa]: (4, 'raw') {{(pid=93130) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 05:00:15 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-53eaef93-664c-455c-a1d0-8b0d4da9b16c tempest-VolumeAndVolumeTypeFromImageTest-1250188327 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_dfb60546-63e8-4d51-8faf-a70933c69c67_vf_fwdqddevstack@QuobyteHD {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:00:15 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-beb9fdd5-cc20-4aac-8420-174bc62715ae tempest-CreateVolumesFromImageTest-705949209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-835a1c49-fe0c-4005-ba84-449fdb1a5a74 {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:00:15 devstack sudo[111250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-835a1c49-fe0c-4005-ba84-449fdb1a5a74 Jun 17 05:00:15 devstack sudo[111250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:00:15 devstack sudo[111249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_dfb60546-63e8-4d51-8faf-a70933c69c67_vf_fwdqddevstack@QuobyteHD Jun 17 05:00:15 devstack sudo[111249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:00:15 devstack cinder-volume[92060]: DEBUG cinder.volume.flows.manager.create_volume [None req-f80ce35a-6d23-4bd8-badb-bcba4d6c3177 tempest-CreateVolumesFromSourceVolumeTest-1564008756 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92060) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 17 05:00:15 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-f80ce35a-6d23-4bd8-badb-bcba4d6c3177 tempest-CreateVolumesFromSourceVolumeTest-1564008756 None] Flow 'volume_create_manager' (6cc35bd0-a364-4fb9-9ecb-9d6c39eb9a24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 17 05:00:15 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-f80ce35a-6d23-4bd8-badb-bcba4d6c3177 tempest-CreateVolumesFromSourceVolumeTest-1564008756 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (daea0205-c412-4074-84f5-5e23dfe7b2be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:00:15 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-f80ce35a-6d23-4bd8-badb-bcba4d6c3177 tempest-CreateVolumesFromSourceVolumeTest-1564008756 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (daea0205-c412-4074-84f5-5e23dfe7b2be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-17T03:00:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-712959608',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f898195d-a849-4913-8639-b7a748656143,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3322152864f84a628abc1acba10e4364',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T03:00:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T03:00:15Z,use_quota=True,user_id='0986412f49d24fcc9987a9813fcb2e8b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aad9ce24-93f9-41a6-baa1-5125964f96d1),volume_type_id=aad9ce24-93f9-41a6-baa1-5125964f96d1)' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:00:15 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-f80ce35a-6d23-4bd8-badb-bcba4d6c3177 tempest-CreateVolumesFromSourceVolumeTest-1564008756 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a0336218-4590-47b4-a576-7de92d0a4452) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:00:15 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-f80ce35a-6d23-4bd8-badb-bcba4d6c3177 tempest-CreateVolumesFromSourceVolumeTest-1564008756 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a0336218-4590-47b4-a576-7de92d0a4452) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:00:15 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-f80ce35a-6d23-4bd8-badb-bcba4d6c3177 tempest-CreateVolumesFromSourceVolumeTest-1564008756 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d459c69d-05e2-4bfa-bf58-5687556b4c15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:00:15 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-f80ce35a-6d23-4bd8-badb-bcba4d6c3177 tempest-CreateVolumesFromSourceVolumeTest-1564008756 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d459c69d-05e2-4bfa-bf58-5687556b4c15) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f898195d-a849-4913-8639-b7a748656143', 'volume_name': 'volume-f898195d-a849-4913-8639-b7a748656143', 'volume_size': 1}' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:00:15 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-f80ce35a-6d23-4bd8-badb-bcba4d6c3177 tempest-CreateVolumesFromSourceVolumeTest-1564008756 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (329e1e6a-75e0-4230-a367-5ef15d164981) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:00:15 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-f80ce35a-6d23-4bd8-badb-bcba4d6c3177 tempest-CreateVolumesFromSourceVolumeTest-1564008756 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (329e1e6a-75e0-4230-a367-5ef15d164981) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:00:15 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-f80ce35a-6d23-4bd8-badb-bcba4d6c3177 tempest-CreateVolumesFromSourceVolumeTest-1564008756 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e796e22e-8b5c-4682-881d-c12f0814aba0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:00:15 devstack cinder-volume[92060]: INFO cinder.volume.flows.manager.create_volume [None req-f80ce35a-6d23-4bd8-badb-bcba4d6c3177 tempest-CreateVolumesFromSourceVolumeTest-1564008756 None] Volume f898195d-a849-4913-8639-b7a748656143: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f898195d-a849-4913-8639-b7a748656143', 'volume_size': 1} Jun 17 05:00:15 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-f80ce35a-6d23-4bd8-badb-bcba4d6c3177 tempest-CreateVolumesFromSourceVolumeTest-1564008756 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 05:00:15 devstack cinder-volume[92060]: DEBUG cinder.volume.flows.manager.create_volume [None req-f3799d34-de77-46f7-8a2e-becb845bad77 tempest-CreateVolumesFromSourceVolumeTest-1564008756 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92060) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 17 05:00:15 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-f3799d34-de77-46f7-8a2e-becb845bad77 tempest-CreateVolumesFromSourceVolumeTest-1564008756 None] Flow 'volume_create_manager' (d72aa4be-0b2c-40d9-a31d-5636877fd622) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 17 05:00:15 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-f3799d34-de77-46f7-8a2e-becb845bad77 tempest-CreateVolumesFromSourceVolumeTest-1564008756 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (89eb0320-fdc3-4e1f-9911-f1ea2bab43da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:00:15 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-f3799d34-de77-46f7-8a2e-becb845bad77 tempest-CreateVolumesFromSourceVolumeTest-1564008756 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (89eb0320-fdc3-4e1f-9911-f1ea2bab43da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-17T03:00:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-759789323',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0662b888-5ece-41e2-9104-cf3fd63e6668,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3322152864f84a628abc1acba10e4364',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T03:00:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T03:00:16Z,use_quota=True,user_id='0986412f49d24fcc9987a9813fcb2e8b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aad9ce24-93f9-41a6-baa1-5125964f96d1),volume_type_id=aad9ce24-93f9-41a6-baa1-5125964f96d1)' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:00:15 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-f3799d34-de77-46f7-8a2e-becb845bad77 tempest-CreateVolumesFromSourceVolumeTest-1564008756 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4fd65f55-d846-4dee-9910-dec794285fe2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:00:15 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-f3799d34-de77-46f7-8a2e-becb845bad77 tempest-CreateVolumesFromSourceVolumeTest-1564008756 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4fd65f55-d846-4dee-9910-dec794285fe2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:00:15 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-f3799d34-de77-46f7-8a2e-becb845bad77 tempest-CreateVolumesFromSourceVolumeTest-1564008756 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4a1b4f6b-361c-4ead-9353-2da0111653e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:00:15 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-f3799d34-de77-46f7-8a2e-becb845bad77 tempest-CreateVolumesFromSourceVolumeTest-1564008756 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4a1b4f6b-361c-4ead-9353-2da0111653e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0662b888-5ece-41e2-9104-cf3fd63e6668', 'volume_name': 'volume-0662b888-5ece-41e2-9104-cf3fd63e6668', 'volume_size': 1}' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:00:15 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-f3799d34-de77-46f7-8a2e-becb845bad77 tempest-CreateVolumesFromSourceVolumeTest-1564008756 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9d5b4836-179e-4a82-8ea6-412255dd1244) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:00:15 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-f3799d34-de77-46f7-8a2e-becb845bad77 tempest-CreateVolumesFromSourceVolumeTest-1564008756 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9d5b4836-179e-4a82-8ea6-412255dd1244) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:00:15 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-f3799d34-de77-46f7-8a2e-becb845bad77 tempest-CreateVolumesFromSourceVolumeTest-1564008756 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f084b782-ee15-4102-a1e6-ce4dc3b4767a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:00:15 devstack cinder-volume[92060]: INFO cinder.volume.flows.manager.create_volume [None req-f3799d34-de77-46f7-8a2e-becb845bad77 tempest-CreateVolumesFromSourceVolumeTest-1564008756 None] Volume 0662b888-5ece-41e2-9104-cf3fd63e6668: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0662b888-5ece-41e2-9104-cf3fd63e6668', 'volume_size': 1} Jun 17 05:00:15 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-f3799d34-de77-46f7-8a2e-becb845bad77 tempest-CreateVolumesFromSourceVolumeTest-1564008756 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 05:00:15 devstack sudo[111250]: pam_unix(sudo:session): session closed for user root Jun 17 05:00:15 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-beb9fdd5-cc20-4aac-8420-174bc62715ae tempest-CreateVolumesFromImageTest-705949209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-835a1c49-fe0c-4005-ba84-449fdb1a5a74" returned: 0 in 0.724s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:00:15 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-beb9fdd5-cc20-4aac-8420-174bc62715ae tempest-CreateVolumesFromImageTest-705949209 None] <== create_volume: return (1977ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588'} {{(pid=92060) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 17 05:00:15 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-beb9fdd5-cc20-4aac-8420-174bc62715ae tempest-CreateVolumesFromImageTest-705949209 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.980s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 05:00:15 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-6abaf4a0-412b-4858-9087-74108a83ee7d tempest-CinderUnicodeTest-1057368418 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.588s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 05:00:15 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-6abaf4a0-412b-4858-9087-74108a83ee7d tempest-CinderUnicodeTest-1057368418 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-17T03:00:11Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=751528c8-62bf-4dd6-8857-b9136f21fae6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a858f0965a344ab8b18a9a88ee493f83',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T03:00:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T03:00:11Z,use_quota=True,user_id='526beab6b2624db7a81826f50f104e1a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aad9ce24-93f9-41a6-baa1-5125964f96d1),volume_type_id=aad9ce24-93f9-41a6-baa1-5125964f96d1)}" {{(pid=92060) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 17 05:00:15 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.remotefs [None req-6abaf4a0-412b-4858-9087-74108a83ee7d tempest-CinderUnicodeTest-1057368418 None] Creating volume 751528c8-62bf-4dd6-8857-b9136f21fae6 {{(pid=92060) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 17 05:00:15 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-6abaf4a0-412b-4858-9087-74108a83ee7d tempest-CinderUnicodeTest-1057368418 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 05:00:15 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-6abaf4a0-412b-4858-9087-74108a83ee7d tempest-CinderUnicodeTest-1057368418 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 05:00:15 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-6abaf4a0-412b-4858-9087-74108a83ee7d tempest-CinderUnicodeTest-1057368418 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588': None} {{(pid=92060) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 17 05:00:15 devstack sudo[111249]: pam_unix(sudo:session): session closed for user root Jun 17 05:00:15 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-6abaf4a0-412b-4858-9087-74108a83ee7d tempest-CinderUnicodeTest-1057368418 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588'] {{(pid=92060) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 17 05:00:15 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-6abaf4a0-412b-4858-9087-74108a83ee7d tempest-CinderUnicodeTest-1057368418 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 05:00:15 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-6abaf4a0-412b-4858-9087-74108a83ee7d tempest-CinderUnicodeTest-1057368418 None] Selected osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588 as target Quobyte volume. {{(pid=92060) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 17 05:00:15 devstack cinder-volume[92060]: INFO cinder.volume.drivers.remotefs [None req-6abaf4a0-412b-4858-9087-74108a83ee7d tempest-CinderUnicodeTest-1057368418 None] casted to osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588 Jun 17 05:00:15 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-6abaf4a0-412b-4858-9087-74108a83ee7d tempest-CinderUnicodeTest-1057368418 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-751528c8-62bf-4dd6-8857-b9136f21fae6 1073741824 {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:00:16 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-53eaef93-664c-455c-a1d0-8b0d4da9b16c tempest-VolumeAndVolumeTypeFromImageTest-1250188327 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_dfb60546-63e8-4d51-8faf-a70933c69c67_vf_fwdqddevstack@QuobyteHD" returned: 0 in 0.781s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:00:16 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-53eaef93-664c-455c-a1d0-8b0d4da9b16c tempest-VolumeAndVolumeTypeFromImageTest-1250188327 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_dfb60546-63e8-4d51-8faf-a70933c69c67_vf_fwdqddevstack@QuobyteHD {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:00:16 devstack sudo[111256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-751528c8-62bf-4dd6-8857-b9136f21fae6 1073741824 Jun 17 05:00:16 devstack sudo[111256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:00:16 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-beb9fdd5-cc20-4aac-8420-174bc62715ae tempest-CreateVolumesFromImageTest-705949209 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (09b8889d-dc77-4102-bd49-5f779d849db0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-835a1c49-fe0c-4005-ba84-449fdb1a5a74', 'volume_size': 1}' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:00:16 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-beb9fdd5-cc20-4aac-8420-174bc62715ae tempest-CreateVolumesFromImageTest-705949209 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (669778e7-0947-406b-a894-85b06fcf80cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:00:16 devstack cinder-volume[92060]: INFO cinder.volume.flows.manager.create_volume [None req-beb9fdd5-cc20-4aac-8420-174bc62715ae tempest-CreateVolumesFromImageTest-705949209 None] Volume volume-835a1c49-fe0c-4005-ba84-449fdb1a5a74 (835a1c49-fe0c-4005-ba84-449fdb1a5a74): created successfully Jun 17 05:00:16 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-beb9fdd5-cc20-4aac-8420-174bc62715ae tempest-CreateVolumesFromImageTest-705949209 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (669778e7-0947-406b-a894-85b06fcf80cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:00:16 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-beb9fdd5-cc20-4aac-8420-174bc62715ae tempest-CreateVolumesFromImageTest-705949209 None] Flow 'volume_create_manager' (cd6f5a92-2af2-421a-b9fe-77408890a290) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92060) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 17 05:00:16 devstack cinder-volume[92060]: INFO cinder.volume.manager [None req-beb9fdd5-cc20-4aac-8420-174bc62715ae tempest-CreateVolumesFromImageTest-705949209 None] Created volume successfully. Jun 17 05:00:16 devstack sudo[111257]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_dfb60546-63e8-4d51-8faf-a70933c69c67_vf_fwdqddevstack@QuobyteHD Jun 17 05:00:16 devstack sudo[111257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:00:16 devstack sudo[111257]: pam_unix(sudo:session): session closed for user root Jun 17 05:00:16 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-53eaef93-664c-455c-a1d0-8b0d4da9b16c tempest-VolumeAndVolumeTypeFromImageTest-1250188327 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_dfb60546-63e8-4d51-8faf-a70933c69c67_vf_fwdqddevstack@QuobyteHD" returned: 1 in 0.683s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:00:16 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-53eaef93-664c-455c-a1d0-8b0d4da9b16c tempest-VolumeAndVolumeTypeFromImageTest-1250188327 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_dfb60546-63e8-4d51-8faf-a70933c69c67_vf_fwdqddevstack@QuobyteHD' failed. Not Retrying. {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 17 05:00:16 devstack cinder-volume[92060]: DEBUG cinder.image.image_utils [None req-53eaef93-664c-455c-a1d0-8b0d4da9b16c tempest-VolumeAndVolumeTypeFromImageTest-1250188327 None] Temporary image dfb60546-63e8-4d51-8faf-a70933c69c67 is fetched for user bf70ab77178e4c9b91f92f9da516a916. {{(pid=92060) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jun 17 05:00:16 devstack cinder-volume[92060]: DEBUG oslo.privsep.daemon [-] privsep: reply[5598f2b3-cd16-4240-9e13-36f4d36da725]: (4, 'raw') {{(pid=93130) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 05:00:16 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-53eaef93-664c-455c-a1d0-8b0d4da9b16c tempest-VolumeAndVolumeTypeFromImageTest-1250188327 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_dfb60546-63e8-4d51-8faf-a70933c69c67_vf_fwdqddevstack@QuobyteHD {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:00:16 devstack sudo[111256]: pam_unix(sudo:session): session closed for user root Jun 17 05:00:16 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-6abaf4a0-412b-4858-9087-74108a83ee7d tempest-CinderUnicodeTest-1057368418 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-751528c8-62bf-4dd6-8857-b9136f21fae6 1073741824" returned: 0 in 0.787s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:00:16 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-6abaf4a0-412b-4858-9087-74108a83ee7d tempest-CinderUnicodeTest-1057368418 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-751528c8-62bf-4dd6-8857-b9136f21fae6 {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:00:16 devstack sudo[111267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-751528c8-62bf-4dd6-8857-b9136f21fae6 Jun 17 05:00:16 devstack sudo[111267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:00:16 devstack sudo[111266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_dfb60546-63e8-4d51-8faf-a70933c69c67_vf_fwdqddevstack@QuobyteHD Jun 17 05:00:16 devstack sudo[111266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:00:17 devstack sudo[111267]: pam_unix(sudo:session): session closed for user root Jun 17 05:00:17 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-6abaf4a0-412b-4858-9087-74108a83ee7d tempest-CinderUnicodeTest-1057368418 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-751528c8-62bf-4dd6-8857-b9136f21fae6" returned: 0 in 0.586s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:00:17 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-6abaf4a0-412b-4858-9087-74108a83ee7d tempest-CinderUnicodeTest-1057368418 None] <== create_volume: return (1418ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588'} {{(pid=92060) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 17 05:00:17 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-6abaf4a0-412b-4858-9087-74108a83ee7d tempest-CinderUnicodeTest-1057368418 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.423s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 05:00:17 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-f1e0d302-d4f1-4d91-a1b7-dc78658d24ec tempest-CreateVolumesFromImageTest-705949209 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.634s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 05:00:17 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-f1e0d302-d4f1-4d91-a1b7-dc78658d24ec tempest-CreateVolumesFromImageTest-705949209 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-17T03:00:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-922861284',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9577aaf9-3403-4724-9386-70e4d44c62c5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0803031093df468c8f644909fc689527',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T03:00:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T03:00:12Z,use_quota=True,user_id='81d5f8781dcb45f0b54c05acd0584493',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aad9ce24-93f9-41a6-baa1-5125964f96d1),volume_type_id=aad9ce24-93f9-41a6-baa1-5125964f96d1)}" {{(pid=92060) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 17 05:00:17 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.remotefs [None req-f1e0d302-d4f1-4d91-a1b7-dc78658d24ec tempest-CreateVolumesFromImageTest-705949209 None] Creating volume 9577aaf9-3403-4724-9386-70e4d44c62c5 {{(pid=92060) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 17 05:00:17 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-f1e0d302-d4f1-4d91-a1b7-dc78658d24ec tempest-CreateVolumesFromImageTest-705949209 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 05:00:17 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-f1e0d302-d4f1-4d91-a1b7-dc78658d24ec tempest-CreateVolumesFromImageTest-705949209 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 05:00:17 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-f1e0d302-d4f1-4d91-a1b7-dc78658d24ec tempest-CreateVolumesFromImageTest-705949209 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588': None} {{(pid=92060) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 17 05:00:17 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-f1e0d302-d4f1-4d91-a1b7-dc78658d24ec tempest-CreateVolumesFromImageTest-705949209 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588'] {{(pid=92060) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 17 05:00:17 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-f1e0d302-d4f1-4d91-a1b7-dc78658d24ec tempest-CreateVolumesFromImageTest-705949209 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 05:00:17 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-f1e0d302-d4f1-4d91-a1b7-dc78658d24ec tempest-CreateVolumesFromImageTest-705949209 None] Selected osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588 as target Quobyte volume. {{(pid=92060) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 17 05:00:17 devstack cinder-volume[92060]: INFO cinder.volume.drivers.remotefs [None req-f1e0d302-d4f1-4d91-a1b7-dc78658d24ec tempest-CreateVolumesFromImageTest-705949209 None] casted to osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588 Jun 17 05:00:17 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-f1e0d302-d4f1-4d91-a1b7-dc78658d24ec tempest-CreateVolumesFromImageTest-705949209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-9577aaf9-3403-4724-9386-70e4d44c62c5 1073741824 {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:00:17 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-6abaf4a0-412b-4858-9087-74108a83ee7d tempest-CinderUnicodeTest-1057368418 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2781f117-31e1-473c-896a-183a65409030) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-751528c8-62bf-4dd6-8857-b9136f21fae6', 'volume_size': 1}' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:00:17 devstack sudo[111273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-9577aaf9-3403-4724-9386-70e4d44c62c5 1073741824 Jun 17 05:00:17 devstack sudo[111273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:00:17 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-6abaf4a0-412b-4858-9087-74108a83ee7d tempest-CinderUnicodeTest-1057368418 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7b15b48d-f4e3-4445-9547-41ff9e9c9c8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:00:17 devstack sudo[111266]: pam_unix(sudo:session): session closed for user root Jun 17 05:00:17 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-53eaef93-664c-455c-a1d0-8b0d4da9b16c tempest-VolumeAndVolumeTypeFromImageTest-1250188327 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_dfb60546-63e8-4d51-8faf-a70933c69c67_vf_fwdqddevstack@QuobyteHD" returned: 0 in 0.714s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:00:17 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-53eaef93-664c-455c-a1d0-8b0d4da9b16c tempest-VolumeAndVolumeTypeFromImageTest-1250188327 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_dfb60546-63e8-4d51-8faf-a70933c69c67_vf_fwdqddevstack@QuobyteHD {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:00:17 devstack cinder-volume[92060]: INFO cinder.volume.flows.manager.create_volume [None req-6abaf4a0-412b-4858-9087-74108a83ee7d tempest-CinderUnicodeTest-1057368418 None] Volume volume-751528c8-62bf-4dd6-8857-b9136f21fae6 (751528c8-62bf-4dd6-8857-b9136f21fae6): created successfully Jun 17 05:00:17 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-6abaf4a0-412b-4858-9087-74108a83ee7d tempest-CinderUnicodeTest-1057368418 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7b15b48d-f4e3-4445-9547-41ff9e9c9c8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:00:17 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-6abaf4a0-412b-4858-9087-74108a83ee7d tempest-CinderUnicodeTest-1057368418 None] Flow 'volume_create_manager' (00799201-f31a-477f-b833-b069df507c7f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92060) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 17 05:00:17 devstack cinder-volume[92060]: INFO cinder.volume.manager [None req-6abaf4a0-412b-4858-9087-74108a83ee7d tempest-CinderUnicodeTest-1057368418 None] Created volume successfully. Jun 17 05:00:17 devstack sudo[111275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_dfb60546-63e8-4d51-8faf-a70933c69c67_vf_fwdqddevstack@QuobyteHD Jun 17 05:00:17 devstack sudo[111275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:00:18 devstack sudo[111275]: pam_unix(sudo:session): session closed for user root Jun 17 05:00:18 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-53eaef93-664c-455c-a1d0-8b0d4da9b16c tempest-VolumeAndVolumeTypeFromImageTest-1250188327 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_dfb60546-63e8-4d51-8faf-a70933c69c67_vf_fwdqddevstack@QuobyteHD" returned: 1 in 0.758s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:00:18 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-53eaef93-664c-455c-a1d0-8b0d4da9b16c tempest-VolumeAndVolumeTypeFromImageTest-1250188327 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_dfb60546-63e8-4d51-8faf-a70933c69c67_vf_fwdqddevstack@QuobyteHD' failed. Not Retrying. {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 17 05:00:18 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-53eaef93-664c-455c-a1d0-8b0d4da9b16c tempest-VolumeAndVolumeTypeFromImageTest-1250188327 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 05:00:18 devstack cinder-volume[92060]: DEBUG cinder.volume.flows.manager.create_volume [None req-7c0d2668-000a-4b34-b8ba-3c4fc12d6482 tempest-CinderUnicodeTest-1057368418 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92060) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 17 05:00:18 devstack sudo[111273]: pam_unix(sudo:session): session closed for user root Jun 17 05:00:18 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-7c0d2668-000a-4b34-b8ba-3c4fc12d6482 tempest-CinderUnicodeTest-1057368418 None] Flow 'volume_create_manager' (016ab532-020f-4630-8aee-115494c56e30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 17 05:00:18 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-7c0d2668-000a-4b34-b8ba-3c4fc12d6482 tempest-CinderUnicodeTest-1057368418 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (df999da4-c921-4831-b347-c182592bd89c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:00:18 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-f1e0d302-d4f1-4d91-a1b7-dc78658d24ec tempest-CreateVolumesFromImageTest-705949209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-9577aaf9-3403-4724-9386-70e4d44c62c5 1073741824" returned: 0 in 0.843s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:00:18 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-7c0d2668-000a-4b34-b8ba-3c4fc12d6482 tempest-CinderUnicodeTest-1057368418 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (df999da4-c921-4831-b347-c182592bd89c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-17T03:00:18Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1915087236',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=60809320-9ba6-4bae-a662-f2c91ebf6158,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a858f0965a344ab8b18a9a88ee493f83',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T03:00:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T03:00:18Z,use_quota=True,user_id='526beab6b2624db7a81826f50f104e1a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aad9ce24-93f9-41a6-baa1-5125964f96d1),volume_type_id=aad9ce24-93f9-41a6-baa1-5125964f96d1)' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:00:18 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-7c0d2668-000a-4b34-b8ba-3c4fc12d6482 tempest-CinderUnicodeTest-1057368418 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b3f56bd5-39b0-4568-bc79-8452688756f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:00:18 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-7c0d2668-000a-4b34-b8ba-3c4fc12d6482 tempest-CinderUnicodeTest-1057368418 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b3f56bd5-39b0-4568-bc79-8452688756f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:00:18 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-7c0d2668-000a-4b34-b8ba-3c4fc12d6482 tempest-CinderUnicodeTest-1057368418 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5f6346c3-483b-42fb-be34-180c9f9f5b02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:00:18 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-7c0d2668-000a-4b34-b8ba-3c4fc12d6482 tempest-CinderUnicodeTest-1057368418 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5f6346c3-483b-42fb-be34-180c9f9f5b02) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '60809320-9ba6-4bae-a662-f2c91ebf6158', 'volume_name': 'volume-60809320-9ba6-4bae-a662-f2c91ebf6158', 'volume_size': 1}' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:00:18 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-7c0d2668-000a-4b34-b8ba-3c4fc12d6482 tempest-CinderUnicodeTest-1057368418 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5d187f9c-f901-48da-a727-44b9a52d8245) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:00:18 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-7c0d2668-000a-4b34-b8ba-3c4fc12d6482 tempest-CinderUnicodeTest-1057368418 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5d187f9c-f901-48da-a727-44b9a52d8245) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:00:18 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-7c0d2668-000a-4b34-b8ba-3c4fc12d6482 tempest-CinderUnicodeTest-1057368418 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b1ba930c-85c9-439c-b679-9f5985ab4d07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:00:18 devstack cinder-volume[92060]: INFO cinder.volume.flows.manager.create_volume [None req-7c0d2668-000a-4b34-b8ba-3c4fc12d6482 tempest-CinderUnicodeTest-1057368418 None] Volume 60809320-9ba6-4bae-a662-f2c91ebf6158: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-60809320-9ba6-4bae-a662-f2c91ebf6158', 'volume_size': 1} Jun 17 05:00:18 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-7c0d2668-000a-4b34-b8ba-3c4fc12d6482 tempest-CinderUnicodeTest-1057368418 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 05:00:18 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-f1e0d302-d4f1-4d91-a1b7-dc78658d24ec tempest-CreateVolumesFromImageTest-705949209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-9577aaf9-3403-4724-9386-70e4d44c62c5 {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:00:18 devstack sudo[111284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-9577aaf9-3403-4724-9386-70e4d44c62c5 Jun 17 05:00:18 devstack sudo[111284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:00:18 devstack sudo[111284]: pam_unix(sudo:session): session closed for user root Jun 17 05:00:18 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-f1e0d302-d4f1-4d91-a1b7-dc78658d24ec tempest-CreateVolumesFromImageTest-705949209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-9577aaf9-3403-4724-9386-70e4d44c62c5" returned: 0 in 0.613s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:00:18 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-f1e0d302-d4f1-4d91-a1b7-dc78658d24ec tempest-CreateVolumesFromImageTest-705949209 None] <== create_volume: return (1543ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588'} {{(pid=92060) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 17 05:00:18 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-f1e0d302-d4f1-4d91-a1b7-dc78658d24ec tempest-CreateVolumesFromImageTest-705949209 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.548s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 05:00:18 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-a833f91c-e01f-4bea-a4da-b57370ff8c21 tempest-CreateVolumesFromImageTest-705949209 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.807s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 05:00:18 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-a833f91c-e01f-4bea-a4da-b57370ff8c21 tempest-CreateVolumesFromImageTest-705949209 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-17T03:00:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-148716515',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=72715447-8624-458f-89ff-2d0660524b63,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0803031093df468c8f644909fc689527',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T03:00:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T03:00:12Z,use_quota=True,user_id='81d5f8781dcb45f0b54c05acd0584493',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aad9ce24-93f9-41a6-baa1-5125964f96d1),volume_type_id=aad9ce24-93f9-41a6-baa1-5125964f96d1)}" {{(pid=92060) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 17 05:00:18 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.remotefs [None req-a833f91c-e01f-4bea-a4da-b57370ff8c21 tempest-CreateVolumesFromImageTest-705949209 None] Creating volume 72715447-8624-458f-89ff-2d0660524b63 {{(pid=92060) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 17 05:00:18 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-a833f91c-e01f-4bea-a4da-b57370ff8c21 tempest-CreateVolumesFromImageTest-705949209 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 05:00:18 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-a833f91c-e01f-4bea-a4da-b57370ff8c21 tempest-CreateVolumesFromImageTest-705949209 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 05:00:18 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-a833f91c-e01f-4bea-a4da-b57370ff8c21 tempest-CreateVolumesFromImageTest-705949209 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588': None} {{(pid=92060) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 17 05:00:18 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-a833f91c-e01f-4bea-a4da-b57370ff8c21 tempest-CreateVolumesFromImageTest-705949209 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588'] {{(pid=92060) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 17 05:00:18 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-a833f91c-e01f-4bea-a4da-b57370ff8c21 tempest-CreateVolumesFromImageTest-705949209 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 05:00:18 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-a833f91c-e01f-4bea-a4da-b57370ff8c21 tempest-CreateVolumesFromImageTest-705949209 None] Selected osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588 as target Quobyte volume. {{(pid=92060) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 17 05:00:18 devstack cinder-volume[92060]: INFO cinder.volume.drivers.remotefs [None req-a833f91c-e01f-4bea-a4da-b57370ff8c21 tempest-CreateVolumesFromImageTest-705949209 None] casted to osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588 Jun 17 05:00:18 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-a833f91c-e01f-4bea-a4da-b57370ff8c21 tempest-CreateVolumesFromImageTest-705949209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-72715447-8624-458f-89ff-2d0660524b63 1073741824 {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:00:19 devstack sudo[111288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-72715447-8624-458f-89ff-2d0660524b63 1073741824 Jun 17 05:00:19 devstack sudo[111288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:00:19 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-f1e0d302-d4f1-4d91-a1b7-dc78658d24ec tempest-CreateVolumesFromImageTest-705949209 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4d0703bc-41e3-4ae8-9876-d88bb09d5edc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9577aaf9-3403-4724-9386-70e4d44c62c5', 'volume_size': 1}' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:00:19 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-f1e0d302-d4f1-4d91-a1b7-dc78658d24ec tempest-CreateVolumesFromImageTest-705949209 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7c2ca1ba-fe56-418c-a443-502e62e3d799) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:00:19 devstack cinder-volume[92060]: INFO cinder.volume.flows.manager.create_volume [None req-f1e0d302-d4f1-4d91-a1b7-dc78658d24ec tempest-CreateVolumesFromImageTest-705949209 None] Volume volume-9577aaf9-3403-4724-9386-70e4d44c62c5 (9577aaf9-3403-4724-9386-70e4d44c62c5): created successfully Jun 17 05:00:19 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-f1e0d302-d4f1-4d91-a1b7-dc78658d24ec tempest-CreateVolumesFromImageTest-705949209 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7c2ca1ba-fe56-418c-a443-502e62e3d799) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:00:19 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-f1e0d302-d4f1-4d91-a1b7-dc78658d24ec tempest-CreateVolumesFromImageTest-705949209 None] Flow 'volume_create_manager' (dabf4ba5-2e78-4fc0-a761-8a075f27be43) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92060) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 17 05:00:19 devstack cinder-volume[92060]: INFO cinder.volume.manager [None req-f1e0d302-d4f1-4d91-a1b7-dc78658d24ec tempest-CreateVolumesFromImageTest-705949209 None] Created volume successfully. Jun 17 05:00:19 devstack sudo[111288]: pam_unix(sudo:session): session closed for user root Jun 17 05:00:19 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-a833f91c-e01f-4bea-a4da-b57370ff8c21 tempest-CreateVolumesFromImageTest-705949209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-72715447-8624-458f-89ff-2d0660524b63 1073741824" returned: 0 in 0.749s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:00:19 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-a833f91c-e01f-4bea-a4da-b57370ff8c21 tempest-CreateVolumesFromImageTest-705949209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-72715447-8624-458f-89ff-2d0660524b63 {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:00:19 devstack sudo[111294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-72715447-8624-458f-89ff-2d0660524b63 Jun 17 05:00:19 devstack sudo[111294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:00:20 devstack sudo[111294]: pam_unix(sudo:session): session closed for user root Jun 17 05:00:20 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-a833f91c-e01f-4bea-a4da-b57370ff8c21 tempest-CreateVolumesFromImageTest-705949209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-72715447-8624-458f-89ff-2d0660524b63" returned: 0 in 0.579s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:00:20 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-a833f91c-e01f-4bea-a4da-b57370ff8c21 tempest-CreateVolumesFromImageTest-705949209 None] <== create_volume: return (1365ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588'} {{(pid=92060) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 17 05:00:20 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-a833f91c-e01f-4bea-a4da-b57370ff8c21 tempest-CreateVolumesFromImageTest-705949209 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.368s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 05:00:20 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-93406fb1-5efb-429b-9c7f-7ae6ae91abe2 tempest-CreateVolumesFromImageTest-705949209 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.803s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 05:00:20 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-93406fb1-5efb-429b-9c7f-7ae6ae91abe2 tempest-CreateVolumesFromImageTest-705949209 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-17T03:00:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-401976990',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bd24ec34-2c53-46e0-b1a1-4c21f35ce1a4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0803031093df468c8f644909fc689527',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T03:00:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T03:00:12Z,use_quota=True,user_id='81d5f8781dcb45f0b54c05acd0584493',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aad9ce24-93f9-41a6-baa1-5125964f96d1),volume_type_id=aad9ce24-93f9-41a6-baa1-5125964f96d1)}" {{(pid=92060) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 17 05:00:20 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.remotefs [None req-93406fb1-5efb-429b-9c7f-7ae6ae91abe2 tempest-CreateVolumesFromImageTest-705949209 None] Creating volume bd24ec34-2c53-46e0-b1a1-4c21f35ce1a4 {{(pid=92060) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 17 05:00:20 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-93406fb1-5efb-429b-9c7f-7ae6ae91abe2 tempest-CreateVolumesFromImageTest-705949209 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 05:00:20 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-93406fb1-5efb-429b-9c7f-7ae6ae91abe2 tempest-CreateVolumesFromImageTest-705949209 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 05:00:20 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-93406fb1-5efb-429b-9c7f-7ae6ae91abe2 tempest-CreateVolumesFromImageTest-705949209 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588': None} {{(pid=92060) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 17 05:00:20 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-93406fb1-5efb-429b-9c7f-7ae6ae91abe2 tempest-CreateVolumesFromImageTest-705949209 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588'] {{(pid=92060) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 17 05:00:20 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-93406fb1-5efb-429b-9c7f-7ae6ae91abe2 tempest-CreateVolumesFromImageTest-705949209 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 05:00:20 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-93406fb1-5efb-429b-9c7f-7ae6ae91abe2 tempest-CreateVolumesFromImageTest-705949209 None] Selected osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588 as target Quobyte volume. {{(pid=92060) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 17 05:00:20 devstack cinder-volume[92060]: INFO cinder.volume.drivers.remotefs [None req-93406fb1-5efb-429b-9c7f-7ae6ae91abe2 tempest-CreateVolumesFromImageTest-705949209 None] casted to osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588 Jun 17 05:00:20 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-93406fb1-5efb-429b-9c7f-7ae6ae91abe2 tempest-CreateVolumesFromImageTest-705949209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-bd24ec34-2c53-46e0-b1a1-4c21f35ce1a4 1073741824 {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:00:20 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-a833f91c-e01f-4bea-a4da-b57370ff8c21 tempest-CreateVolumesFromImageTest-705949209 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8f8e1e68-0f27-4e78-a044-2a6fd97067c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-72715447-8624-458f-89ff-2d0660524b63', 'volume_size': 1}' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:00:20 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-a833f91c-e01f-4bea-a4da-b57370ff8c21 tempest-CreateVolumesFromImageTest-705949209 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a4919675-1049-49e7-a84b-714228382649) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:00:20 devstack sudo[111297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-bd24ec34-2c53-46e0-b1a1-4c21f35ce1a4 1073741824 Jun 17 05:00:20 devstack sudo[111297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:00:20 devstack cinder-volume[92060]: INFO cinder.volume.flows.manager.create_volume [None req-a833f91c-e01f-4bea-a4da-b57370ff8c21 tempest-CreateVolumesFromImageTest-705949209 None] Volume volume-72715447-8624-458f-89ff-2d0660524b63 (72715447-8624-458f-89ff-2d0660524b63): created successfully Jun 17 05:00:20 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-a833f91c-e01f-4bea-a4da-b57370ff8c21 tempest-CreateVolumesFromImageTest-705949209 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a4919675-1049-49e7-a84b-714228382649) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:00:20 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-a833f91c-e01f-4bea-a4da-b57370ff8c21 tempest-CreateVolumesFromImageTest-705949209 None] Flow 'volume_create_manager' (03828845-d4f1-46bf-91c5-1f31e3f8458b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92060) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 17 05:00:20 devstack cinder-volume[92060]: INFO cinder.volume.manager [None req-a833f91c-e01f-4bea-a4da-b57370ff8c21 tempest-CreateVolumesFromImageTest-705949209 None] Created volume successfully. Jun 17 05:00:21 devstack sudo[111297]: pam_unix(sudo:session): session closed for user root Jun 17 05:00:21 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-93406fb1-5efb-429b-9c7f-7ae6ae91abe2 tempest-CreateVolumesFromImageTest-705949209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-bd24ec34-2c53-46e0-b1a1-4c21f35ce1a4 1073741824" returned: 0 in 0.734s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:00:21 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-93406fb1-5efb-429b-9c7f-7ae6ae91abe2 tempest-CreateVolumesFromImageTest-705949209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-bd24ec34-2c53-46e0-b1a1-4c21f35ce1a4 {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:00:21 devstack sudo[111302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-bd24ec34-2c53-46e0-b1a1-4c21f35ce1a4 Jun 17 05:00:21 devstack sudo[111302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:00:21 devstack sudo[111302]: pam_unix(sudo:session): session closed for user root Jun 17 05:00:21 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-93406fb1-5efb-429b-9c7f-7ae6ae91abe2 tempest-CreateVolumesFromImageTest-705949209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-bd24ec34-2c53-46e0-b1a1-4c21f35ce1a4" returned: 0 in 0.602s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:00:21 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-93406fb1-5efb-429b-9c7f-7ae6ae91abe2 tempest-CreateVolumesFromImageTest-705949209 None] <== create_volume: return (1372ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588'} {{(pid=92060) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 17 05:00:21 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-93406fb1-5efb-429b-9c7f-7ae6ae91abe2 tempest-CreateVolumesFromImageTest-705949209 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.376s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 05:00:21 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-794c538b-5268-4ca1-875d-03c9c2c79ae6 tempest-CreateVolumesFromSourceVolumeTest-1564008756 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.440s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 05:00:21 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-794c538b-5268-4ca1-875d-03c9c2c79ae6 tempest-CreateVolumesFromSourceVolumeTest-1564008756 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-17T03:00:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-934048937',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=594828e9-f007-48ea-a750-2ff8bbcf4fc6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3322152864f84a628abc1acba10e4364',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T03:00:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T03:00:14Z,use_quota=True,user_id='0986412f49d24fcc9987a9813fcb2e8b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aad9ce24-93f9-41a6-baa1-5125964f96d1),volume_type_id=aad9ce24-93f9-41a6-baa1-5125964f96d1)}" {{(pid=92060) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 17 05:00:21 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.remotefs [None req-794c538b-5268-4ca1-875d-03c9c2c79ae6 tempest-CreateVolumesFromSourceVolumeTest-1564008756 None] Creating volume 594828e9-f007-48ea-a750-2ff8bbcf4fc6 {{(pid=92060) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 17 05:00:21 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-794c538b-5268-4ca1-875d-03c9c2c79ae6 tempest-CreateVolumesFromSourceVolumeTest-1564008756 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 05:00:21 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-794c538b-5268-4ca1-875d-03c9c2c79ae6 tempest-CreateVolumesFromSourceVolumeTest-1564008756 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 05:00:21 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-794c538b-5268-4ca1-875d-03c9c2c79ae6 tempest-CreateVolumesFromSourceVolumeTest-1564008756 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588': None} {{(pid=92060) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 17 05:00:21 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-794c538b-5268-4ca1-875d-03c9c2c79ae6 tempest-CreateVolumesFromSourceVolumeTest-1564008756 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588'] {{(pid=92060) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 17 05:00:21 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-794c538b-5268-4ca1-875d-03c9c2c79ae6 tempest-CreateVolumesFromSourceVolumeTest-1564008756 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 05:00:21 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-794c538b-5268-4ca1-875d-03c9c2c79ae6 tempest-CreateVolumesFromSourceVolumeTest-1564008756 None] Selected osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588 as target Quobyte volume. {{(pid=92060) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 17 05:00:21 devstack cinder-volume[92060]: INFO cinder.volume.drivers.remotefs [None req-794c538b-5268-4ca1-875d-03c9c2c79ae6 tempest-CreateVolumesFromSourceVolumeTest-1564008756 None] casted to osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588 Jun 17 05:00:21 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-794c538b-5268-4ca1-875d-03c9c2c79ae6 tempest-CreateVolumesFromSourceVolumeTest-1564008756 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-594828e9-f007-48ea-a750-2ff8bbcf4fc6 1073741824 {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:00:21 devstack sudo[111308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-594828e9-f007-48ea-a750-2ff8bbcf4fc6 1073741824 Jun 17 05:00:21 devstack sudo[111308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:00:21 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-93406fb1-5efb-429b-9c7f-7ae6ae91abe2 tempest-CreateVolumesFromImageTest-705949209 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (958b0092-3bc8-4c46-8b68-c045117ecc07) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bd24ec34-2c53-46e0-b1a1-4c21f35ce1a4', 'volume_size': 1}' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:00:21 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-93406fb1-5efb-429b-9c7f-7ae6ae91abe2 tempest-CreateVolumesFromImageTest-705949209 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1040d3c4-7e33-4e7e-acd8-e32de364feef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:00:21 devstack cinder-volume[92060]: INFO cinder.volume.flows.manager.create_volume [None req-93406fb1-5efb-429b-9c7f-7ae6ae91abe2 tempest-CreateVolumesFromImageTest-705949209 None] Volume volume-bd24ec34-2c53-46e0-b1a1-4c21f35ce1a4 (bd24ec34-2c53-46e0-b1a1-4c21f35ce1a4): created successfully Jun 17 05:00:21 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-93406fb1-5efb-429b-9c7f-7ae6ae91abe2 tempest-CreateVolumesFromImageTest-705949209 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1040d3c4-7e33-4e7e-acd8-e32de364feef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:00:21 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-93406fb1-5efb-429b-9c7f-7ae6ae91abe2 tempest-CreateVolumesFromImageTest-705949209 None] Flow 'volume_create_manager' (0f9f4826-d5aa-4e08-b417-8f8ac8b16c74) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92060) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 17 05:00:21 devstack cinder-volume[92060]: INFO cinder.volume.manager [None req-93406fb1-5efb-429b-9c7f-7ae6ae91abe2 tempest-CreateVolumesFromImageTest-705949209 None] Created volume successfully. Jun 17 05:00:22 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-a41a5ba2-2c93-4a57-a4aa-1de2ce564eab tempest-CreateVolumesFromImageTest-705949209 None] Acquiring lock "cinder-bd24ec34-2c53-46e0-b1a1-4c21f35ce1a4-delete_volume" by "delete_volume" {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 05:00:22 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-a41a5ba2-2c93-4a57-a4aa-1de2ce564eab tempest-CreateVolumesFromImageTest-705949209 None] Lock "cinder-bd24ec34-2c53-46e0-b1a1-4c21f35ce1a4-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 05:00:22 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-a41a5ba2-2c93-4a57-a4aa-1de2ce564eab tempest-CreateVolumesFromImageTest-705949209 None] Acquiring lock "cinder-quobyte-bd24ec34-2c53-46e0-b1a1-4c21f35ce1a4" by "delete_volume" {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 05:00:22 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-a41a5ba2-2c93-4a57-a4aa-1de2ce564eab tempest-CreateVolumesFromImageTest-705949209 None] Lock "cinder-quobyte-bd24ec34-2c53-46e0-b1a1-4c21f35ce1a4" acquired by "delete_volume" :: waited 0.018s {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 05:00:22 devstack cinder-volume[92060]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe0f2315-ef56-4d9c-ac74-1bdbc44f0a71]: (4, 'qcow2') {{(pid=93130) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 05:00:22 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-a41a5ba2-2c93-4a57-a4aa-1de2ce564eab tempest-CreateVolumesFromImageTest-705949209 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-bd24ec34-2c53-46e0-b1a1-4c21f35ce1a4 {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:00:22 devstack sudo[111308]: pam_unix(sudo:session): session closed for user root Jun 17 05:00:22 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-794c538b-5268-4ca1-875d-03c9c2c79ae6 tempest-CreateVolumesFromSourceVolumeTest-1564008756 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-594828e9-f007-48ea-a750-2ff8bbcf4fc6 1073741824" returned: 0 in 0.909s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:00:22 devstack sudo[111314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-bd24ec34-2c53-46e0-b1a1-4c21f35ce1a4 Jun 17 05:00:22 devstack sudo[111314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:00:22 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-794c538b-5268-4ca1-875d-03c9c2c79ae6 tempest-CreateVolumesFromSourceVolumeTest-1564008756 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-594828e9-f007-48ea-a750-2ff8bbcf4fc6 {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:00:22 devstack sudo[111316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-594828e9-f007-48ea-a750-2ff8bbcf4fc6 Jun 17 05:00:22 devstack sudo[111316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:00:23 devstack sudo[111314]: pam_unix(sudo:session): session closed for user root Jun 17 05:00:23 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-a41a5ba2-2c93-4a57-a4aa-1de2ce564eab tempest-CreateVolumesFromImageTest-705949209 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-bd24ec34-2c53-46e0-b1a1-4c21f35ce1a4" returned: 0 in 0.730s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:00:23 devstack sudo[111316]: pam_unix(sudo:session): session closed for user root Jun 17 05:00:23 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-a41a5ba2-2c93-4a57-a4aa-1de2ce564eab tempest-CreateVolumesFromImageTest-705949209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-bd24ec34-2c53-46e0-b1a1-4c21f35ce1a4 {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:00:23 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-794c538b-5268-4ca1-875d-03c9c2c79ae6 tempest-CreateVolumesFromSourceVolumeTest-1564008756 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-594828e9-f007-48ea-a750-2ff8bbcf4fc6" returned: 0 in 0.609s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:00:23 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-794c538b-5268-4ca1-875d-03c9c2c79ae6 tempest-CreateVolumesFromSourceVolumeTest-1564008756 None] <== create_volume: return (1563ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588'} {{(pid=92060) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 17 05:00:23 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-794c538b-5268-4ca1-875d-03c9c2c79ae6 tempest-CreateVolumesFromSourceVolumeTest-1564008756 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.566s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 05:00:23 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-367b77af-d6fc-4c23-9bd0-4268499c862b tempest-CreateVolumesFromSourceVolumeTest-1564008756 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.499s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 05:00:23 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-367b77af-d6fc-4c23-9bd0-4268499c862b tempest-CreateVolumesFromSourceVolumeTest-1564008756 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-17T03:00:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-926583073',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8bad494b-7e1f-4eaf-81da-0099fbb31aba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3322152864f84a628abc1acba10e4364',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T03:00:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T03:00:15Z,use_quota=True,user_id='0986412f49d24fcc9987a9813fcb2e8b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aad9ce24-93f9-41a6-baa1-5125964f96d1),volume_type_id=aad9ce24-93f9-41a6-baa1-5125964f96d1)}" {{(pid=92060) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 17 05:00:23 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.remotefs [None req-367b77af-d6fc-4c23-9bd0-4268499c862b tempest-CreateVolumesFromSourceVolumeTest-1564008756 None] Creating volume 8bad494b-7e1f-4eaf-81da-0099fbb31aba {{(pid=92060) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 17 05:00:23 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-367b77af-d6fc-4c23-9bd0-4268499c862b tempest-CreateVolumesFromSourceVolumeTest-1564008756 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 05:00:23 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-367b77af-d6fc-4c23-9bd0-4268499c862b tempest-CreateVolumesFromSourceVolumeTest-1564008756 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 05:00:23 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-367b77af-d6fc-4c23-9bd0-4268499c862b tempest-CreateVolumesFromSourceVolumeTest-1564008756 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588': None} {{(pid=92060) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 17 05:00:23 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-367b77af-d6fc-4c23-9bd0-4268499c862b tempest-CreateVolumesFromSourceVolumeTest-1564008756 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588'] {{(pid=92060) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 17 05:00:23 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-367b77af-d6fc-4c23-9bd0-4268499c862b tempest-CreateVolumesFromSourceVolumeTest-1564008756 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 05:00:23 devstack sudo[111322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-bd24ec34-2c53-46e0-b1a1-4c21f35ce1a4 Jun 17 05:00:23 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-367b77af-d6fc-4c23-9bd0-4268499c862b tempest-CreateVolumesFromSourceVolumeTest-1564008756 None] Selected osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588 as target Quobyte volume. {{(pid=92060) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 17 05:00:23 devstack cinder-volume[92060]: INFO cinder.volume.drivers.remotefs [None req-367b77af-d6fc-4c23-9bd0-4268499c862b tempest-CreateVolumesFromSourceVolumeTest-1564008756 None] casted to osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588 Jun 17 05:00:23 devstack sudo[111322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:00:23 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-367b77af-d6fc-4c23-9bd0-4268499c862b tempest-CreateVolumesFromSourceVolumeTest-1564008756 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-8bad494b-7e1f-4eaf-81da-0099fbb31aba 1073741824 {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:00:23 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-794c538b-5268-4ca1-875d-03c9c2c79ae6 tempest-CreateVolumesFromSourceVolumeTest-1564008756 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (faebecf1-9bfa-4c6d-ac59-3dd97335d80e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-594828e9-f007-48ea-a750-2ff8bbcf4fc6', 'volume_size': 1}' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:00:23 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-794c538b-5268-4ca1-875d-03c9c2c79ae6 tempest-CreateVolumesFromSourceVolumeTest-1564008756 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dc6bff23-2a2f-44d2-a76d-690143525e57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:00:23 devstack sudo[111324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-8bad494b-7e1f-4eaf-81da-0099fbb31aba 1073741824 Jun 17 05:00:23 devstack sudo[111324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:00:23 devstack cinder-volume[92060]: INFO cinder.volume.flows.manager.create_volume [None req-794c538b-5268-4ca1-875d-03c9c2c79ae6 tempest-CreateVolumesFromSourceVolumeTest-1564008756 None] Volume volume-594828e9-f007-48ea-a750-2ff8bbcf4fc6 (594828e9-f007-48ea-a750-2ff8bbcf4fc6): created successfully Jun 17 05:00:23 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-794c538b-5268-4ca1-875d-03c9c2c79ae6 tempest-CreateVolumesFromSourceVolumeTest-1564008756 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dc6bff23-2a2f-44d2-a76d-690143525e57) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:00:23 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-794c538b-5268-4ca1-875d-03c9c2c79ae6 tempest-CreateVolumesFromSourceVolumeTest-1564008756 None] Flow 'volume_create_manager' (f240abbe-c451-4dc4-a7d2-d242a23cd22b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92060) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 17 05:00:23 devstack cinder-volume[92060]: INFO cinder.volume.manager [None req-794c538b-5268-4ca1-875d-03c9c2c79ae6 tempest-CreateVolumesFromSourceVolumeTest-1564008756 None] Created volume successfully. Jun 17 05:00:23 devstack sudo[111322]: pam_unix(sudo:session): session closed for user root Jun 17 05:00:23 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-a41a5ba2-2c93-4a57-a4aa-1de2ce564eab tempest-CreateVolumesFromImageTest-705949209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-bd24ec34-2c53-46e0-b1a1-4c21f35ce1a4" returned: 0 in 0.614s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:00:23 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-a41a5ba2-2c93-4a57-a4aa-1de2ce564eab tempest-CreateVolumesFromImageTest-705949209 None] Lock "cinder-quobyte-bd24ec34-2c53-46e0-b1a1-4c21f35ce1a4" released by "delete_volume" :: held 1.392s {{(pid=92060) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 05:00:23 devstack cinder-volume[92060]: DEBUG cinder.quota [None req-a41a5ba2-2c93-4a57-a4aa-1de2ce564eab tempest-CreateVolumesFromImageTest-705949209 None] Created reservations ['92fb4d92-36b8-49cf-bb83-eb1299fda9f9', 'ae656456-215d-40da-95e3-659fdf415ac8', '86816757-93e8-44fc-81bd-f635d6ac6c05', 'b3bb0189-c7fe-4195-ab91-133b2f1ecd2b'] {{(pid=92060) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 17 05:00:24 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-a41a5ba2-2c93-4a57-a4aa-1de2ce564eab tempest-CreateVolumesFromImageTest-705949209 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 05:00:24 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-a41a5ba2-2c93-4a57-a4aa-1de2ce564eab tempest-CreateVolumesFromImageTest-705949209 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 05:00:24 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-a41a5ba2-2c93-4a57-a4aa-1de2ce564eab tempest-CreateVolumesFromImageTest-705949209 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588': None} {{(pid=92060) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 17 05:00:24 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-a41a5ba2-2c93-4a57-a4aa-1de2ce564eab tempest-CreateVolumesFromImageTest-705949209 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588'] {{(pid=92060) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 17 05:00:24 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-a41a5ba2-2c93-4a57-a4aa-1de2ce564eab tempest-CreateVolumesFromImageTest-705949209 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 05:00:24 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-a41a5ba2-2c93-4a57-a4aa-1de2ce564eab tempest-CreateVolumesFromImageTest-705949209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:00:24 devstack sudo[111331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a Jun 17 05:00:24 devstack sudo[111331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:00:24 devstack sudo[111324]: pam_unix(sudo:session): session closed for user root Jun 17 05:00:24 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-367b77af-d6fc-4c23-9bd0-4268499c862b tempest-CreateVolumesFromSourceVolumeTest-1564008756 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-8bad494b-7e1f-4eaf-81da-0099fbb31aba 1073741824" returned: 0 in 0.822s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:00:24 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-367b77af-d6fc-4c23-9bd0-4268499c862b tempest-CreateVolumesFromSourceVolumeTest-1564008756 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-8bad494b-7e1f-4eaf-81da-0099fbb31aba {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:00:24 devstack sudo[111333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-8bad494b-7e1f-4eaf-81da-0099fbb31aba Jun 17 05:00:24 devstack sudo[111333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:00:24 devstack sudo[111331]: pam_unix(sudo:session): session closed for user root Jun 17 05:00:24 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-a41a5ba2-2c93-4a57-a4aa-1de2ce564eab tempest-CreateVolumesFromImageTest-705949209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a" returned: 0 in 0.602s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:00:24 devstack cinder-volume[92060]: DEBUG cinder.manager [None req-a41a5ba2-2c93-4a57-a4aa-1de2ce564eab tempest-CreateVolumesFromImageTest-705949209 None] Notifying Schedulers of capabilities ... {{(pid=92060) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 17 05:00:24 devstack cinder-volume[92060]: INFO cinder.volume.manager [None req-a41a5ba2-2c93-4a57-a4aa-1de2ce564eab tempest-CreateVolumesFromImageTest-705949209 None] Deleted volume successfully. Jun 17 05:00:24 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-a4a395d9-bce0-487d-8f56-9967ee80c58e tempest-CreateVolumesFromImageTest-705949209 None] Acquiring lock "cinder-72715447-8624-458f-89ff-2d0660524b63-delete_volume" by "delete_volume" {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 05:00:24 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-a41a5ba2-2c93-4a57-a4aa-1de2ce564eab tempest-CreateVolumesFromImageTest-705949209 None] Lock "cinder-bd24ec34-2c53-46e0-b1a1-4c21f35ce1a4-delete_volume" released by "delete_volume" :: held 2.208s {{(pid=92060) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 05:00:24 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-a4a395d9-bce0-487d-8f56-9967ee80c58e tempest-CreateVolumesFromImageTest-705949209 None] Lock "cinder-72715447-8624-458f-89ff-2d0660524b63-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 05:00:24 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-a4a395d9-bce0-487d-8f56-9967ee80c58e tempest-CreateVolumesFromImageTest-705949209 None] Acquiring lock "cinder-quobyte-72715447-8624-458f-89ff-2d0660524b63" by "delete_volume" {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 05:00:24 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-a4a395d9-bce0-487d-8f56-9967ee80c58e tempest-CreateVolumesFromImageTest-705949209 None] Lock "cinder-quobyte-72715447-8624-458f-89ff-2d0660524b63" acquired by "delete_volume" :: waited 0.014s {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 05:00:24 devstack cinder-volume[92060]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f5d5e95-30ed-4b52-a980-4df0d031be25]: (4, 'qcow2') {{(pid=93130) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 05:00:24 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-a4a395d9-bce0-487d-8f56-9967ee80c58e tempest-CreateVolumesFromImageTest-705949209 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-72715447-8624-458f-89ff-2d0660524b63 {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:00:24 devstack sudo[111333]: pam_unix(sudo:session): session closed for user root Jun 17 05:00:24 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-367b77af-d6fc-4c23-9bd0-4268499c862b tempest-CreateVolumesFromSourceVolumeTest-1564008756 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-8bad494b-7e1f-4eaf-81da-0099fbb31aba" returned: 0 in 0.638s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:00:24 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-367b77af-d6fc-4c23-9bd0-4268499c862b tempest-CreateVolumesFromSourceVolumeTest-1564008756 None] <== create_volume: return (1496ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588'} {{(pid=92060) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 17 05:00:24 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-367b77af-d6fc-4c23-9bd0-4268499c862b tempest-CreateVolumesFromSourceVolumeTest-1564008756 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.500s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 05:00:24 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-af026fd9-efc3-45fa-8315-73590690740a tempest-CreateVolumesFromSourceVolumeTest-1564008756 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.656s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 05:00:24 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-af026fd9-efc3-45fa-8315-73590690740a tempest-CreateVolumesFromSourceVolumeTest-1564008756 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-17T03:00:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2099895705',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e1b27c21-6230-4e3d-9a6f-574c5f8ae1ed,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3322152864f84a628abc1acba10e4364',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T03:00:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T03:00:15Z,use_quota=True,user_id='0986412f49d24fcc9987a9813fcb2e8b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aad9ce24-93f9-41a6-baa1-5125964f96d1),volume_type_id=aad9ce24-93f9-41a6-baa1-5125964f96d1)}" {{(pid=92060) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 17 05:00:24 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.remotefs [None req-af026fd9-efc3-45fa-8315-73590690740a tempest-CreateVolumesFromSourceVolumeTest-1564008756 None] Creating volume e1b27c21-6230-4e3d-9a6f-574c5f8ae1ed {{(pid=92060) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 17 05:00:24 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-af026fd9-efc3-45fa-8315-73590690740a tempest-CreateVolumesFromSourceVolumeTest-1564008756 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 05:00:24 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-af026fd9-efc3-45fa-8315-73590690740a tempest-CreateVolumesFromSourceVolumeTest-1564008756 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 05:00:24 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-af026fd9-efc3-45fa-8315-73590690740a tempest-CreateVolumesFromSourceVolumeTest-1564008756 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588': None} {{(pid=92060) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 17 05:00:24 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-af026fd9-efc3-45fa-8315-73590690740a tempest-CreateVolumesFromSourceVolumeTest-1564008756 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588'] {{(pid=92060) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 17 05:00:24 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-af026fd9-efc3-45fa-8315-73590690740a tempest-CreateVolumesFromSourceVolumeTest-1564008756 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 05:00:24 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-af026fd9-efc3-45fa-8315-73590690740a tempest-CreateVolumesFromSourceVolumeTest-1564008756 None] Selected osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588 as target Quobyte volume. {{(pid=92060) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 17 05:00:24 devstack cinder-volume[92060]: INFO cinder.volume.drivers.remotefs [None req-af026fd9-efc3-45fa-8315-73590690740a tempest-CreateVolumesFromSourceVolumeTest-1564008756 None] casted to osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588 Jun 17 05:00:24 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-af026fd9-efc3-45fa-8315-73590690740a tempest-CreateVolumesFromSourceVolumeTest-1564008756 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-e1b27c21-6230-4e3d-9a6f-574c5f8ae1ed 1073741824 {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:00:24 devstack sudo[111338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-e1b27c21-6230-4e3d-9a6f-574c5f8ae1ed 1073741824 Jun 17 05:00:24 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-367b77af-d6fc-4c23-9bd0-4268499c862b tempest-CreateVolumesFromSourceVolumeTest-1564008756 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4e7c137e-2786-4ff4-9080-0e827f06c886) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8bad494b-7e1f-4eaf-81da-0099fbb31aba', 'volume_size': 1}' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:00:24 devstack sudo[111338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:00:24 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-367b77af-d6fc-4c23-9bd0-4268499c862b tempest-CreateVolumesFromSourceVolumeTest-1564008756 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (edbd8f54-3821-4c1f-bbaa-65f52ee04b7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:00:24 devstack sudo[111337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-72715447-8624-458f-89ff-2d0660524b63 Jun 17 05:00:24 devstack sudo[111337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:00:24 devstack cinder-volume[92060]: INFO cinder.volume.flows.manager.create_volume [None req-367b77af-d6fc-4c23-9bd0-4268499c862b tempest-CreateVolumesFromSourceVolumeTest-1564008756 None] Volume volume-8bad494b-7e1f-4eaf-81da-0099fbb31aba (8bad494b-7e1f-4eaf-81da-0099fbb31aba): created successfully Jun 17 05:00:24 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-367b77af-d6fc-4c23-9bd0-4268499c862b tempest-CreateVolumesFromSourceVolumeTest-1564008756 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (edbd8f54-3821-4c1f-bbaa-65f52ee04b7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:00:24 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-367b77af-d6fc-4c23-9bd0-4268499c862b tempest-CreateVolumesFromSourceVolumeTest-1564008756 None] Flow 'volume_create_manager' (b375a849-761e-432e-ad97-983af27f7664) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92060) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 17 05:00:24 devstack cinder-volume[92060]: INFO cinder.volume.manager [None req-367b77af-d6fc-4c23-9bd0-4268499c862b tempest-CreateVolumesFromSourceVolumeTest-1564008756 None] Created volume successfully. Jun 17 05:00:25 devstack sudo[111337]: pam_unix(sudo:session): session closed for user root Jun 17 05:00:25 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-a4a395d9-bce0-487d-8f56-9967ee80c58e tempest-CreateVolumesFromImageTest-705949209 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-72715447-8624-458f-89ff-2d0660524b63" returned: 0 in 0.726s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:00:25 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-a4a395d9-bce0-487d-8f56-9967ee80c58e tempest-CreateVolumesFromImageTest-705949209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-72715447-8624-458f-89ff-2d0660524b63 {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:00:25 devstack sudo[111347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-72715447-8624-458f-89ff-2d0660524b63 Jun 17 05:00:25 devstack sudo[111347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:00:25 devstack sudo[111338]: pam_unix(sudo:session): session closed for user root Jun 17 05:00:25 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-af026fd9-efc3-45fa-8315-73590690740a tempest-CreateVolumesFromSourceVolumeTest-1564008756 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-e1b27c21-6230-4e3d-9a6f-574c5f8ae1ed 1073741824" returned: 0 in 0.814s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:00:25 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-af026fd9-efc3-45fa-8315-73590690740a tempest-CreateVolumesFromSourceVolumeTest-1564008756 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-e1b27c21-6230-4e3d-9a6f-574c5f8ae1ed {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:00:25 devstack sudo[111349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-e1b27c21-6230-4e3d-9a6f-574c5f8ae1ed Jun 17 05:00:25 devstack sudo[111349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:00:26 devstack sudo[111347]: pam_unix(sudo:session): session closed for user root Jun 17 05:00:26 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-a4a395d9-bce0-487d-8f56-9967ee80c58e tempest-CreateVolumesFromImageTest-705949209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-72715447-8624-458f-89ff-2d0660524b63" returned: 0 in 0.591s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:00:26 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-a4a395d9-bce0-487d-8f56-9967ee80c58e tempest-CreateVolumesFromImageTest-705949209 None] Lock "cinder-quobyte-72715447-8624-458f-89ff-2d0660524b63" released by "delete_volume" :: held 1.358s {{(pid=92060) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 05:00:26 devstack cinder-volume[92060]: DEBUG cinder.quota [None req-a4a395d9-bce0-487d-8f56-9967ee80c58e tempest-CreateVolumesFromImageTest-705949209 None] Created reservations ['e2032317-25a9-46c3-9731-8bf7658f9dd8', '54fae7b0-1214-4da7-8677-93f8b3bee253', '5d7cfa3c-5b23-46ec-a610-86fd0ab0e1b8', '4068706e-fa86-4e04-97cf-1c2646929dd8'] {{(pid=92060) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 17 05:00:26 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-a4a395d9-bce0-487d-8f56-9967ee80c58e tempest-CreateVolumesFromImageTest-705949209 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 05:00:26 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-a4a395d9-bce0-487d-8f56-9967ee80c58e tempest-CreateVolumesFromImageTest-705949209 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 05:00:26 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-a4a395d9-bce0-487d-8f56-9967ee80c58e tempest-CreateVolumesFromImageTest-705949209 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588': None} {{(pid=92060) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 17 05:00:26 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-a4a395d9-bce0-487d-8f56-9967ee80c58e tempest-CreateVolumesFromImageTest-705949209 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588'] {{(pid=92060) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 17 05:00:26 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-a4a395d9-bce0-487d-8f56-9967ee80c58e tempest-CreateVolumesFromImageTest-705949209 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 05:00:26 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-a4a395d9-bce0-487d-8f56-9967ee80c58e tempest-CreateVolumesFromImageTest-705949209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:00:26 devstack sudo[111353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a Jun 17 05:00:26 devstack sudo[111353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:00:26 devstack sudo[111349]: pam_unix(sudo:session): session closed for user root Jun 17 05:00:26 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-af026fd9-efc3-45fa-8315-73590690740a tempest-CreateVolumesFromSourceVolumeTest-1564008756 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-e1b27c21-6230-4e3d-9a6f-574c5f8ae1ed" returned: 0 in 0.602s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:00:26 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-af026fd9-efc3-45fa-8315-73590690740a tempest-CreateVolumesFromSourceVolumeTest-1564008756 None] <== create_volume: return (1455ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588'} {{(pid=92060) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 17 05:00:26 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-af026fd9-efc3-45fa-8315-73590690740a tempest-CreateVolumesFromSourceVolumeTest-1564008756 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.459s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 05:00:26 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-f80ce35a-6d23-4bd8-badb-bcba4d6c3177 tempest-CreateVolumesFromSourceVolumeTest-1564008756 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 10.656s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 05:00:26 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-f80ce35a-6d23-4bd8-badb-bcba4d6c3177 tempest-CreateVolumesFromSourceVolumeTest-1564008756 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-17T03:00:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-712959608',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f898195d-a849-4913-8639-b7a748656143,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3322152864f84a628abc1acba10e4364',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T03:00:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T03:00:15Z,use_quota=True,user_id='0986412f49d24fcc9987a9813fcb2e8b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aad9ce24-93f9-41a6-baa1-5125964f96d1),volume_type_id=aad9ce24-93f9-41a6-baa1-5125964f96d1)}" {{(pid=92060) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 17 05:00:26 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.remotefs [None req-f80ce35a-6d23-4bd8-badb-bcba4d6c3177 tempest-CreateVolumesFromSourceVolumeTest-1564008756 None] Creating volume f898195d-a849-4913-8639-b7a748656143 {{(pid=92060) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 17 05:00:26 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-f80ce35a-6d23-4bd8-badb-bcba4d6c3177 tempest-CreateVolumesFromSourceVolumeTest-1564008756 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 05:00:26 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-f80ce35a-6d23-4bd8-badb-bcba4d6c3177 tempest-CreateVolumesFromSourceVolumeTest-1564008756 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 05:00:26 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-f80ce35a-6d23-4bd8-badb-bcba4d6c3177 tempest-CreateVolumesFromSourceVolumeTest-1564008756 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588': None} {{(pid=92060) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 17 05:00:26 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-f80ce35a-6d23-4bd8-badb-bcba4d6c3177 tempest-CreateVolumesFromSourceVolumeTest-1564008756 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588'] {{(pid=92060) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 17 05:00:26 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-f80ce35a-6d23-4bd8-badb-bcba4d6c3177 tempest-CreateVolumesFromSourceVolumeTest-1564008756 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 05:00:26 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-f80ce35a-6d23-4bd8-badb-bcba4d6c3177 tempest-CreateVolumesFromSourceVolumeTest-1564008756 None] Selected osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588 as target Quobyte volume. {{(pid=92060) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 17 05:00:26 devstack cinder-volume[92060]: INFO cinder.volume.drivers.remotefs [None req-f80ce35a-6d23-4bd8-badb-bcba4d6c3177 tempest-CreateVolumesFromSourceVolumeTest-1564008756 None] casted to osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588 Jun 17 05:00:26 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-f80ce35a-6d23-4bd8-badb-bcba4d6c3177 tempest-CreateVolumesFromSourceVolumeTest-1564008756 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-f898195d-a849-4913-8639-b7a748656143 1073741824 {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:00:26 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-af026fd9-efc3-45fa-8315-73590690740a tempest-CreateVolumesFromSourceVolumeTest-1564008756 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f6ddfef9-dbbe-4bbd-81af-6b07853c19a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e1b27c21-6230-4e3d-9a6f-574c5f8ae1ed', 'volume_size': 1}' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:00:26 devstack sudo[111355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-f898195d-a849-4913-8639-b7a748656143 1073741824 Jun 17 05:00:26 devstack sudo[111355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:00:26 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-af026fd9-efc3-45fa-8315-73590690740a tempest-CreateVolumesFromSourceVolumeTest-1564008756 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9affdd7d-c229-4360-af3c-2922e9260ab3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:00:26 devstack cinder-volume[92060]: INFO cinder.volume.flows.manager.create_volume [None req-af026fd9-efc3-45fa-8315-73590690740a tempest-CreateVolumesFromSourceVolumeTest-1564008756 None] Volume volume-e1b27c21-6230-4e3d-9a6f-574c5f8ae1ed (e1b27c21-6230-4e3d-9a6f-574c5f8ae1ed): created successfully Jun 17 05:00:26 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-af026fd9-efc3-45fa-8315-73590690740a tempest-CreateVolumesFromSourceVolumeTest-1564008756 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9affdd7d-c229-4360-af3c-2922e9260ab3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:00:26 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-af026fd9-efc3-45fa-8315-73590690740a tempest-CreateVolumesFromSourceVolumeTest-1564008756 None] Flow 'volume_create_manager' (fdd65a98-4098-47cf-9375-b1bdfa2f49de) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92060) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 17 05:00:26 devstack cinder-volume[92060]: INFO cinder.volume.manager [None req-af026fd9-efc3-45fa-8315-73590690740a tempest-CreateVolumesFromSourceVolumeTest-1564008756 None] Created volume successfully. Jun 17 05:00:26 devstack sudo[111353]: pam_unix(sudo:session): session closed for user root Jun 17 05:00:26 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-a4a395d9-bce0-487d-8f56-9967ee80c58e tempest-CreateVolumesFromImageTest-705949209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a" returned: 0 in 0.616s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:00:26 devstack cinder-volume[92060]: DEBUG cinder.manager [None req-a4a395d9-bce0-487d-8f56-9967ee80c58e tempest-CreateVolumesFromImageTest-705949209 None] Notifying Schedulers of capabilities ... {{(pid=92060) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 17 05:00:26 devstack cinder-volume[92060]: INFO cinder.volume.manager [None req-a4a395d9-bce0-487d-8f56-9967ee80c58e tempest-CreateVolumesFromImageTest-705949209 None] Deleted volume successfully. Jun 17 05:00:26 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-a4a395d9-bce0-487d-8f56-9967ee80c58e tempest-CreateVolumesFromImageTest-705949209 None] Lock "cinder-72715447-8624-458f-89ff-2d0660524b63-delete_volume" released by "delete_volume" :: held 2.169s {{(pid=92060) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 05:00:26 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-479a7c8c-6981-4c98-92bd-001854d9f4ca tempest-CreateVolumesFromImageTest-705949209 None] Acquiring lock "cinder-9577aaf9-3403-4724-9386-70e4d44c62c5-delete_volume" by "delete_volume" {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 05:00:26 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-479a7c8c-6981-4c98-92bd-001854d9f4ca tempest-CreateVolumesFromImageTest-705949209 None] Lock "cinder-9577aaf9-3403-4724-9386-70e4d44c62c5-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 05:00:26 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-479a7c8c-6981-4c98-92bd-001854d9f4ca tempest-CreateVolumesFromImageTest-705949209 None] Acquiring lock "cinder-quobyte-9577aaf9-3403-4724-9386-70e4d44c62c5" by "delete_volume" {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 05:00:26 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-479a7c8c-6981-4c98-92bd-001854d9f4ca tempest-CreateVolumesFromImageTest-705949209 None] Lock "cinder-quobyte-9577aaf9-3403-4724-9386-70e4d44c62c5" acquired by "delete_volume" :: waited 0.020s {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 05:00:26 devstack cinder-volume[92060]: DEBUG oslo.privsep.daemon [-] privsep: reply[31fca21d-ffed-4d6a-91fe-01307d4dcb36]: (4, 'qcow2') {{(pid=93130) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 05:00:26 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-479a7c8c-6981-4c98-92bd-001854d9f4ca tempest-CreateVolumesFromImageTest-705949209 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-9577aaf9-3403-4724-9386-70e4d44c62c5 {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:00:27 devstack sudo[111355]: pam_unix(sudo:session): session closed for user root Jun 17 05:00:27 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-f80ce35a-6d23-4bd8-badb-bcba4d6c3177 tempest-CreateVolumesFromSourceVolumeTest-1564008756 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-f898195d-a849-4913-8639-b7a748656143 1073741824" returned: 0 in 0.798s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:00:27 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-f80ce35a-6d23-4bd8-badb-bcba4d6c3177 tempest-CreateVolumesFromSourceVolumeTest-1564008756 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-f898195d-a849-4913-8639-b7a748656143 {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:00:27 devstack sudo[111362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-9577aaf9-3403-4724-9386-70e4d44c62c5 Jun 17 05:00:27 devstack sudo[111362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:00:27 devstack sudo[111363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-f898195d-a849-4913-8639-b7a748656143 Jun 17 05:00:27 devstack sudo[111363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:00:27 devstack sudo[111363]: pam_unix(sudo:session): session closed for user root Jun 17 05:00:27 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-f80ce35a-6d23-4bd8-badb-bcba4d6c3177 tempest-CreateVolumesFromSourceVolumeTest-1564008756 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-f898195d-a849-4913-8639-b7a748656143" returned: 0 in 0.594s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:00:27 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-f80ce35a-6d23-4bd8-badb-bcba4d6c3177 tempest-CreateVolumesFromSourceVolumeTest-1564008756 None] <== create_volume: return (1432ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588'} {{(pid=92060) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 17 05:00:27 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-f80ce35a-6d23-4bd8-badb-bcba4d6c3177 tempest-CreateVolumesFromSourceVolumeTest-1564008756 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.436s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 05:00:27 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-f3799d34-de77-46f7-8a2e-becb845bad77 tempest-CreateVolumesFromSourceVolumeTest-1564008756 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 11.795s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 05:00:27 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-f3799d34-de77-46f7-8a2e-becb845bad77 tempest-CreateVolumesFromSourceVolumeTest-1564008756 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-17T03:00:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-759789323',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0662b888-5ece-41e2-9104-cf3fd63e6668,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3322152864f84a628abc1acba10e4364',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T03:00:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T03:00:16Z,use_quota=True,user_id='0986412f49d24fcc9987a9813fcb2e8b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aad9ce24-93f9-41a6-baa1-5125964f96d1),volume_type_id=aad9ce24-93f9-41a6-baa1-5125964f96d1)}" {{(pid=92060) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 17 05:00:27 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.remotefs [None req-f3799d34-de77-46f7-8a2e-becb845bad77 tempest-CreateVolumesFromSourceVolumeTest-1564008756 None] Creating volume 0662b888-5ece-41e2-9104-cf3fd63e6668 {{(pid=92060) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 17 05:00:27 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-f3799d34-de77-46f7-8a2e-becb845bad77 tempest-CreateVolumesFromSourceVolumeTest-1564008756 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 05:00:27 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-f3799d34-de77-46f7-8a2e-becb845bad77 tempest-CreateVolumesFromSourceVolumeTest-1564008756 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 05:00:27 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-f3799d34-de77-46f7-8a2e-becb845bad77 tempest-CreateVolumesFromSourceVolumeTest-1564008756 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588': None} {{(pid=92060) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 17 05:00:27 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-f3799d34-de77-46f7-8a2e-becb845bad77 tempest-CreateVolumesFromSourceVolumeTest-1564008756 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588'] {{(pid=92060) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 17 05:00:27 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-f3799d34-de77-46f7-8a2e-becb845bad77 tempest-CreateVolumesFromSourceVolumeTest-1564008756 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 05:00:27 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-f3799d34-de77-46f7-8a2e-becb845bad77 tempest-CreateVolumesFromSourceVolumeTest-1564008756 None] Selected osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588 as target Quobyte volume. {{(pid=92060) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 17 05:00:27 devstack cinder-volume[92060]: INFO cinder.volume.drivers.remotefs [None req-f3799d34-de77-46f7-8a2e-becb845bad77 tempest-CreateVolumesFromSourceVolumeTest-1564008756 None] casted to osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588 Jun 17 05:00:27 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-f3799d34-de77-46f7-8a2e-becb845bad77 tempest-CreateVolumesFromSourceVolumeTest-1564008756 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-0662b888-5ece-41e2-9104-cf3fd63e6668 1073741824 {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:00:27 devstack sudo[111362]: pam_unix(sudo:session): session closed for user root Jun 17 05:00:27 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-479a7c8c-6981-4c98-92bd-001854d9f4ca tempest-CreateVolumesFromImageTest-705949209 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-9577aaf9-3403-4724-9386-70e4d44c62c5" returned: 0 in 0.742s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:00:27 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-479a7c8c-6981-4c98-92bd-001854d9f4ca tempest-CreateVolumesFromImageTest-705949209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-9577aaf9-3403-4724-9386-70e4d44c62c5 {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:00:27 devstack sudo[111370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-0662b888-5ece-41e2-9104-cf3fd63e6668 1073741824 Jun 17 05:00:27 devstack sudo[111370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:00:27 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-f80ce35a-6d23-4bd8-badb-bcba4d6c3177 tempest-CreateVolumesFromSourceVolumeTest-1564008756 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e796e22e-8b5c-4682-881d-c12f0814aba0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f898195d-a849-4913-8639-b7a748656143', 'volume_size': 1}' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:00:27 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-f80ce35a-6d23-4bd8-badb-bcba4d6c3177 tempest-CreateVolumesFromSourceVolumeTest-1564008756 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (258e2700-918a-4f0e-adba-acbe5988ce96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:00:27 devstack sudo[111371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-9577aaf9-3403-4724-9386-70e4d44c62c5 Jun 17 05:00:27 devstack sudo[111371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:00:27 devstack cinder-volume[92060]: INFO cinder.volume.flows.manager.create_volume [None req-f80ce35a-6d23-4bd8-badb-bcba4d6c3177 tempest-CreateVolumesFromSourceVolumeTest-1564008756 None] Volume volume-f898195d-a849-4913-8639-b7a748656143 (f898195d-a849-4913-8639-b7a748656143): created successfully Jun 17 05:00:27 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-f80ce35a-6d23-4bd8-badb-bcba4d6c3177 tempest-CreateVolumesFromSourceVolumeTest-1564008756 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (258e2700-918a-4f0e-adba-acbe5988ce96) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:00:27 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-f80ce35a-6d23-4bd8-badb-bcba4d6c3177 tempest-CreateVolumesFromSourceVolumeTest-1564008756 None] Flow 'volume_create_manager' (6cc35bd0-a364-4fb9-9ecb-9d6c39eb9a24) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92060) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 17 05:00:27 devstack cinder-volume[92060]: INFO cinder.volume.manager [None req-f80ce35a-6d23-4bd8-badb-bcba4d6c3177 tempest-CreateVolumesFromSourceVolumeTest-1564008756 None] Created volume successfully. Jun 17 05:00:28 devstack sudo[111371]: pam_unix(sudo:session): session closed for user root Jun 17 05:00:28 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-479a7c8c-6981-4c98-92bd-001854d9f4ca tempest-CreateVolumesFromImageTest-705949209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-9577aaf9-3403-4724-9386-70e4d44c62c5" returned: 0 in 0.624s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:00:28 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-479a7c8c-6981-4c98-92bd-001854d9f4ca tempest-CreateVolumesFromImageTest-705949209 None] Lock "cinder-quobyte-9577aaf9-3403-4724-9386-70e4d44c62c5" released by "delete_volume" :: held 1.412s {{(pid=92060) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 05:00:28 devstack cinder-volume[92060]: DEBUG cinder.quota [None req-479a7c8c-6981-4c98-92bd-001854d9f4ca tempest-CreateVolumesFromImageTest-705949209 None] Created reservations ['13ab2a58-aa3c-4b5f-92ff-aa1f824858ce', 'a2b81331-ccbf-4fe7-bcae-5b61cbba13ad', '0b8fe999-b943-46c2-bea9-c3a18c9aa233', 'd8c6c158-a9bc-4e80-8db7-9ffca5fcff8a'] {{(pid=92060) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 17 05:00:28 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-479a7c8c-6981-4c98-92bd-001854d9f4ca tempest-CreateVolumesFromImageTest-705949209 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 05:00:28 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-479a7c8c-6981-4c98-92bd-001854d9f4ca tempest-CreateVolumesFromImageTest-705949209 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 05:00:28 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-479a7c8c-6981-4c98-92bd-001854d9f4ca tempest-CreateVolumesFromImageTest-705949209 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588': None} {{(pid=92060) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 17 05:00:28 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-479a7c8c-6981-4c98-92bd-001854d9f4ca tempest-CreateVolumesFromImageTest-705949209 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588'] {{(pid=92060) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 17 05:00:28 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-479a7c8c-6981-4c98-92bd-001854d9f4ca tempest-CreateVolumesFromImageTest-705949209 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 05:00:28 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-479a7c8c-6981-4c98-92bd-001854d9f4ca tempest-CreateVolumesFromImageTest-705949209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:00:28 devstack sudo[111370]: pam_unix(sudo:session): session closed for user root Jun 17 05:00:28 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-f3799d34-de77-46f7-8a2e-becb845bad77 tempest-CreateVolumesFromSourceVolumeTest-1564008756 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-0662b888-5ece-41e2-9104-cf3fd63e6668 1073741824" returned: 0 in 0.793s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:00:28 devstack sudo[111378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a Jun 17 05:00:28 devstack sudo[111378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:00:28 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-f3799d34-de77-46f7-8a2e-becb845bad77 tempest-CreateVolumesFromSourceVolumeTest-1564008756 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-0662b888-5ece-41e2-9104-cf3fd63e6668 {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:00:28 devstack sudo[111380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-0662b888-5ece-41e2-9104-cf3fd63e6668 Jun 17 05:00:28 devstack sudo[111380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:00:29 devstack sudo[111378]: pam_unix(sudo:session): session closed for user root Jun 17 05:00:29 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-479a7c8c-6981-4c98-92bd-001854d9f4ca tempest-CreateVolumesFromImageTest-705949209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a" returned: 0 in 0.606s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:00:29 devstack cinder-volume[92060]: DEBUG cinder.manager [None req-479a7c8c-6981-4c98-92bd-001854d9f4ca tempest-CreateVolumesFromImageTest-705949209 None] Notifying Schedulers of capabilities ... {{(pid=92060) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 17 05:00:29 devstack cinder-volume[92060]: INFO cinder.volume.manager [None req-479a7c8c-6981-4c98-92bd-001854d9f4ca tempest-CreateVolumesFromImageTest-705949209 None] Deleted volume successfully. Jun 17 05:00:29 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-052ac32d-31cf-42fd-8f09-a085237c8581 tempest-CreateVolumesFromImageTest-705949209 None] Acquiring lock "cinder-835a1c49-fe0c-4005-ba84-449fdb1a5a74-delete_volume" by "delete_volume" {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 05:00:29 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-479a7c8c-6981-4c98-92bd-001854d9f4ca tempest-CreateVolumesFromImageTest-705949209 None] Lock "cinder-9577aaf9-3403-4724-9386-70e4d44c62c5-delete_volume" released by "delete_volume" :: held 2.225s {{(pid=92060) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 05:00:29 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-052ac32d-31cf-42fd-8f09-a085237c8581 tempest-CreateVolumesFromImageTest-705949209 None] Lock "cinder-835a1c49-fe0c-4005-ba84-449fdb1a5a74-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 05:00:29 devstack sudo[111380]: pam_unix(sudo:session): session closed for user root Jun 17 05:00:29 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-f3799d34-de77-46f7-8a2e-becb845bad77 tempest-CreateVolumesFromSourceVolumeTest-1564008756 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-0662b888-5ece-41e2-9104-cf3fd63e6668" returned: 0 in 0.631s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:00:29 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-f3799d34-de77-46f7-8a2e-becb845bad77 tempest-CreateVolumesFromSourceVolumeTest-1564008756 None] <== create_volume: return (1463ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588'} {{(pid=92060) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 17 05:00:29 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-f3799d34-de77-46f7-8a2e-becb845bad77 tempest-CreateVolumesFromSourceVolumeTest-1564008756 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.466s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 05:00:29 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-53eaef93-664c-455c-a1d0-8b0d4da9b16c tempest-VolumeAndVolumeTypeFromImageTest-1250188327 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 10.931s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 05:00:29 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-53eaef93-664c-455c-a1d0-8b0d4da9b16c tempest-VolumeAndVolumeTypeFromImageTest-1250188327 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-17T03:00:14Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bd0081a8-1bcf-49d7-8b06-273b0d62dc13,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='47b57bae04f6485e85eede8f4130f4f6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T03:00:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T03:00:14Z,use_quota=True,user_id='bf70ab77178e4c9b91f92f9da516a916',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d5d5937-e41b-4165-b0c2-6efe6a768890),volume_type_id=2d5d5937-e41b-4165-b0c2-6efe6a768890)}" {{(pid=92060) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 17 05:00:29 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.remotefs [None req-53eaef93-664c-455c-a1d0-8b0d4da9b16c tempest-VolumeAndVolumeTypeFromImageTest-1250188327 None] Creating volume bd0081a8-1bcf-49d7-8b06-273b0d62dc13 {{(pid=92060) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 17 05:00:29 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-53eaef93-664c-455c-a1d0-8b0d4da9b16c tempest-VolumeAndVolumeTypeFromImageTest-1250188327 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 05:00:29 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-53eaef93-664c-455c-a1d0-8b0d4da9b16c tempest-VolumeAndVolumeTypeFromImageTest-1250188327 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 05:00:29 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-53eaef93-664c-455c-a1d0-8b0d4da9b16c tempest-VolumeAndVolumeTypeFromImageTest-1250188327 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588': None} {{(pid=92060) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 17 05:00:29 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-53eaef93-664c-455c-a1d0-8b0d4da9b16c tempest-VolumeAndVolumeTypeFromImageTest-1250188327 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588'] {{(pid=92060) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 17 05:00:29 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-53eaef93-664c-455c-a1d0-8b0d4da9b16c tempest-VolumeAndVolumeTypeFromImageTest-1250188327 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 05:00:29 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-53eaef93-664c-455c-a1d0-8b0d4da9b16c tempest-VolumeAndVolumeTypeFromImageTest-1250188327 None] Selected osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588 as target Quobyte volume. {{(pid=92060) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 17 05:00:29 devstack cinder-volume[92060]: INFO cinder.volume.drivers.remotefs [None req-53eaef93-664c-455c-a1d0-8b0d4da9b16c tempest-VolumeAndVolumeTypeFromImageTest-1250188327 None] casted to osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588 Jun 17 05:00:29 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-53eaef93-664c-455c-a1d0-8b0d4da9b16c tempest-VolumeAndVolumeTypeFromImageTest-1250188327 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-bd0081a8-1bcf-49d7-8b06-273b0d62dc13 1073741824 {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:00:29 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-f3799d34-de77-46f7-8a2e-becb845bad77 tempest-CreateVolumesFromSourceVolumeTest-1564008756 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f084b782-ee15-4102-a1e6-ce4dc3b4767a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0662b888-5ece-41e2-9104-cf3fd63e6668', 'volume_size': 1}' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:00:29 devstack sudo[111420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-bd0081a8-1bcf-49d7-8b06-273b0d62dc13 1073741824 Jun 17 05:00:29 devstack sudo[111420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:00:29 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-f3799d34-de77-46f7-8a2e-becb845bad77 tempest-CreateVolumesFromSourceVolumeTest-1564008756 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4052802b-76b3-468e-9279-d9886c90670b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:00:29 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-052ac32d-31cf-42fd-8f09-a085237c8581 tempest-CreateVolumesFromImageTest-705949209 None] Acquiring lock "cinder-quobyte-835a1c49-fe0c-4005-ba84-449fdb1a5a74" by "delete_volume" {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 05:00:29 devstack cinder-volume[92060]: INFO cinder.volume.flows.manager.create_volume [None req-f3799d34-de77-46f7-8a2e-becb845bad77 tempest-CreateVolumesFromSourceVolumeTest-1564008756 None] Volume volume-0662b888-5ece-41e2-9104-cf3fd63e6668 (0662b888-5ece-41e2-9104-cf3fd63e6668): created successfully Jun 17 05:00:29 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-f3799d34-de77-46f7-8a2e-becb845bad77 tempest-CreateVolumesFromSourceVolumeTest-1564008756 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4052802b-76b3-468e-9279-d9886c90670b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:00:29 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-f3799d34-de77-46f7-8a2e-becb845bad77 tempest-CreateVolumesFromSourceVolumeTest-1564008756 None] Flow 'volume_create_manager' (d72aa4be-0b2c-40d9-a31d-5636877fd622) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92060) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 17 05:00:29 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-052ac32d-31cf-42fd-8f09-a085237c8581 tempest-CreateVolumesFromImageTest-705949209 None] Lock "cinder-quobyte-835a1c49-fe0c-4005-ba84-449fdb1a5a74" acquired by "delete_volume" :: waited 0.028s {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 05:00:29 devstack cinder-volume[92060]: INFO cinder.volume.manager [None req-f3799d34-de77-46f7-8a2e-becb845bad77 tempest-CreateVolumesFromSourceVolumeTest-1564008756 None] Created volume successfully. Jun 17 05:00:29 devstack cinder-volume[92060]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef466f0a-57a9-4f66-9a8d-a02867839c17]: (4, 'qcow2') {{(pid=93130) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 05:00:29 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-052ac32d-31cf-42fd-8f09-a085237c8581 tempest-CreateVolumesFromImageTest-705949209 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-835a1c49-fe0c-4005-ba84-449fdb1a5a74 {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:00:29 devstack sudo[111422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-835a1c49-fe0c-4005-ba84-449fdb1a5a74 Jun 17 05:00:29 devstack sudo[111422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:00:29 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-0fdc3840-f7ad-4832-9223-9b906faf3fd1 tempest-CreateVolumesFromSourceVolumeTest-1564008756 None] Acquiring lock "cinder-0662b888-5ece-41e2-9104-cf3fd63e6668-delete_volume" by "delete_volume" {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 05:00:29 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-0fdc3840-f7ad-4832-9223-9b906faf3fd1 tempest-CreateVolumesFromSourceVolumeTest-1564008756 None] Lock "cinder-0662b888-5ece-41e2-9104-cf3fd63e6668-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 05:00:30 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-0fdc3840-f7ad-4832-9223-9b906faf3fd1 tempest-CreateVolumesFromSourceVolumeTest-1564008756 None] Acquiring lock "cinder-quobyte-0662b888-5ece-41e2-9104-cf3fd63e6668" by "delete_volume" {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 05:00:30 devstack sudo[111420]: pam_unix(sudo:session): session closed for user root Jun 17 05:00:30 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-53eaef93-664c-455c-a1d0-8b0d4da9b16c tempest-VolumeAndVolumeTypeFromImageTest-1250188327 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-bd0081a8-1bcf-49d7-8b06-273b0d62dc13 1073741824" returned: 0 in 0.829s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:00:30 devstack sudo[111422]: pam_unix(sudo:session): session closed for user root Jun 17 05:00:30 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-0fdc3840-f7ad-4832-9223-9b906faf3fd1 tempest-CreateVolumesFromSourceVolumeTest-1564008756 None] Lock "cinder-quobyte-0662b888-5ece-41e2-9104-cf3fd63e6668" acquired by "delete_volume" :: waited 0.023s {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 05:00:30 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-052ac32d-31cf-42fd-8f09-a085237c8581 tempest-CreateVolumesFromImageTest-705949209 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-835a1c49-fe0c-4005-ba84-449fdb1a5a74" returned: 0 in 0.762s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:00:30 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-052ac32d-31cf-42fd-8f09-a085237c8581 tempest-CreateVolumesFromImageTest-705949209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-835a1c49-fe0c-4005-ba84-449fdb1a5a74 {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:00:30 devstack cinder-volume[92060]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d329b5b-6d7e-4b70-a553-dd6663fa7fad]: (4, 'qcow2') {{(pid=93130) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 05:00:30 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-0fdc3840-f7ad-4832-9223-9b906faf3fd1 tempest-CreateVolumesFromSourceVolumeTest-1564008756 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-0662b888-5ece-41e2-9104-cf3fd63e6668 {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:00:30 devstack sudo[111431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-835a1c49-fe0c-4005-ba84-449fdb1a5a74 Jun 17 05:00:30 devstack sudo[111431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:00:30 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-53eaef93-664c-455c-a1d0-8b0d4da9b16c tempest-VolumeAndVolumeTypeFromImageTest-1250188327 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-bd0081a8-1bcf-49d7-8b06-273b0d62dc13 {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:00:30 devstack sudo[111434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-bd0081a8-1bcf-49d7-8b06-273b0d62dc13 Jun 17 05:00:30 devstack sudo[111434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:00:30 devstack sudo[111432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-0662b888-5ece-41e2-9104-cf3fd63e6668 Jun 17 05:00:30 devstack sudo[111432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:00:30 devstack sudo[111431]: pam_unix(sudo:session): session closed for user root Jun 17 05:00:30 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-052ac32d-31cf-42fd-8f09-a085237c8581 tempest-CreateVolumesFromImageTest-705949209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-835a1c49-fe0c-4005-ba84-449fdb1a5a74" returned: 0 in 0.619s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:00:30 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-052ac32d-31cf-42fd-8f09-a085237c8581 tempest-CreateVolumesFromImageTest-705949209 None] Lock "cinder-quobyte-835a1c49-fe0c-4005-ba84-449fdb1a5a74" released by "delete_volume" :: held 1.423s {{(pid=92060) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 05:00:30 devstack sudo[111434]: pam_unix(sudo:session): session closed for user root Jun 17 05:00:30 devstack cinder-volume[92060]: DEBUG cinder.quota [None req-052ac32d-31cf-42fd-8f09-a085237c8581 tempest-CreateVolumesFromImageTest-705949209 None] Created reservations ['55fca8fa-594a-434d-877b-5241252a2ff1', '0f140a34-d596-48d8-9a5d-ce7cb2b658d8', '78a15ab2-4e76-4266-96fd-f3e8b030c0b1', '452284d6-7cce-43d3-b832-4649fd6df098'] {{(pid=92060) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 17 05:00:30 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-53eaef93-664c-455c-a1d0-8b0d4da9b16c tempest-VolumeAndVolumeTypeFromImageTest-1250188327 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-bd0081a8-1bcf-49d7-8b06-273b0d62dc13" returned: 0 in 0.634s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:00:30 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-53eaef93-664c-455c-a1d0-8b0d4da9b16c tempest-VolumeAndVolumeTypeFromImageTest-1250188327 None] <== create_volume: return (1554ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588'} {{(pid=92060) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 17 05:00:30 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-53eaef93-664c-455c-a1d0-8b0d4da9b16c tempest-VolumeAndVolumeTypeFromImageTest-1250188327 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.559s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 05:00:30 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-7c0d2668-000a-4b34-b8ba-3c4fc12d6482 tempest-CinderUnicodeTest-1057368418 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 12.410s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 05:00:30 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-7c0d2668-000a-4b34-b8ba-3c4fc12d6482 tempest-CinderUnicodeTest-1057368418 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-17T03:00:18Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1915087236',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=60809320-9ba6-4bae-a662-f2c91ebf6158,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a858f0965a344ab8b18a9a88ee493f83',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T03:00:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T03:00:18Z,use_quota=True,user_id='526beab6b2624db7a81826f50f104e1a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aad9ce24-93f9-41a6-baa1-5125964f96d1),volume_type_id=aad9ce24-93f9-41a6-baa1-5125964f96d1)}" {{(pid=92060) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 17 05:00:30 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.remotefs [None req-7c0d2668-000a-4b34-b8ba-3c4fc12d6482 tempest-CinderUnicodeTest-1057368418 None] Creating volume 60809320-9ba6-4bae-a662-f2c91ebf6158 {{(pid=92060) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 17 05:00:30 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-7c0d2668-000a-4b34-b8ba-3c4fc12d6482 tempest-CinderUnicodeTest-1057368418 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 05:00:30 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-7c0d2668-000a-4b34-b8ba-3c4fc12d6482 tempest-CinderUnicodeTest-1057368418 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 05:00:30 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-7c0d2668-000a-4b34-b8ba-3c4fc12d6482 tempest-CinderUnicodeTest-1057368418 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588': None} {{(pid=92060) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 17 05:00:30 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-7c0d2668-000a-4b34-b8ba-3c4fc12d6482 tempest-CinderUnicodeTest-1057368418 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588'] {{(pid=92060) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 17 05:00:30 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-7c0d2668-000a-4b34-b8ba-3c4fc12d6482 tempest-CinderUnicodeTest-1057368418 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 05:00:30 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-7c0d2668-000a-4b34-b8ba-3c4fc12d6482 tempest-CinderUnicodeTest-1057368418 None] Selected osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588 as target Quobyte volume. {{(pid=92060) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 17 05:00:30 devstack cinder-volume[92060]: INFO cinder.volume.drivers.remotefs [None req-7c0d2668-000a-4b34-b8ba-3c4fc12d6482 tempest-CinderUnicodeTest-1057368418 None] casted to osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588 Jun 17 05:00:30 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-7c0d2668-000a-4b34-b8ba-3c4fc12d6482 tempest-CinderUnicodeTest-1057368418 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-60809320-9ba6-4bae-a662-f2c91ebf6158 1073741824 {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:00:30 devstack sudo[111442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-60809320-9ba6-4bae-a662-f2c91ebf6158 1073741824 Jun 17 05:00:30 devstack sudo[111442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:00:30 devstack cinder-volume[92060]: DEBUG cinder.volume.volume_utils [None req-53eaef93-664c-455c-a1d0-8b0d4da9b16c tempest-VolumeAndVolumeTypeFromImageTest-1250188327 None] Attempting download of dfb60546-63e8-4d51-8faf-a70933c69c67 ((None, [{'url': 'file:///opt/stack/data/glance/images/dfb60546-63e8-4d51-8faf-a70933c69c67', 'metadata': {}}])) to volume bd0081a8-1bcf-49d7-8b06-273b0d62dc13. {{(pid=92060) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jun 17 05:00:30 devstack sudo[111432]: pam_unix(sudo:session): session closed for user root Jun 17 05:00:30 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-0fdc3840-f7ad-4832-9223-9b906faf3fd1 tempest-CreateVolumesFromSourceVolumeTest-1564008756 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-0662b888-5ece-41e2-9104-cf3fd63e6668" returned: 0 in 0.770s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:00:30 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-0fdc3840-f7ad-4832-9223-9b906faf3fd1 tempest-CreateVolumesFromSourceVolumeTest-1564008756 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-0662b888-5ece-41e2-9104-cf3fd63e6668 {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:00:30 devstack cinder-volume[92060]: DEBUG oslo.privsep.daemon [-] privsep: reply[63b63c41-f87a-464d-ac84-89da77b3563f]: (4, 'raw') {{(pid=93130) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 05:00:30 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-53eaef93-664c-455c-a1d0-8b0d4da9b16c tempest-VolumeAndVolumeTypeFromImageTest-1250188327 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_dfb60546-63e8-4d51-8faf-a70933c69c67_b190r2aa {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:00:30 devstack sudo[111444]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-0662b888-5ece-41e2-9104-cf3fd63e6668 Jun 17 05:00:30 devstack sudo[111444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:00:30 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-052ac32d-31cf-42fd-8f09-a085237c8581 tempest-CreateVolumesFromImageTest-705949209 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 05:00:30 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-052ac32d-31cf-42fd-8f09-a085237c8581 tempest-CreateVolumesFromImageTest-705949209 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 05:00:30 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-052ac32d-31cf-42fd-8f09-a085237c8581 tempest-CreateVolumesFromImageTest-705949209 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588': None} {{(pid=92060) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 17 05:00:30 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-052ac32d-31cf-42fd-8f09-a085237c8581 tempest-CreateVolumesFromImageTest-705949209 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588'] {{(pid=92060) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 17 05:00:30 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-052ac32d-31cf-42fd-8f09-a085237c8581 tempest-CreateVolumesFromImageTest-705949209 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 05:00:30 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-052ac32d-31cf-42fd-8f09-a085237c8581 tempest-CreateVolumesFromImageTest-705949209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:00:30 devstack sudo[111447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a Jun 17 05:00:30 devstack sudo[111447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:00:30 devstack sudo[111445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_dfb60546-63e8-4d51-8faf-a70933c69c67_b190r2aa Jun 17 05:00:30 devstack sudo[111445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:00:31 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-4fa3d503-c4da-47c5-a115-79bbf0b350ee tempest-CreateVolumesFromImageTest-705949209 None] Acquiring lock "cinder-cd8454e0-42a0-4717-8c46-926b3ca3fc7e-delete_volume" by "delete_volume" {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 05:00:31 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-4fa3d503-c4da-47c5-a115-79bbf0b350ee tempest-CreateVolumesFromImageTest-705949209 None] Lock "cinder-cd8454e0-42a0-4717-8c46-926b3ca3fc7e-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 05:00:31 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-4fa3d503-c4da-47c5-a115-79bbf0b350ee tempest-CreateVolumesFromImageTest-705949209 None] Acquiring lock "cinder-quobyte-cd8454e0-42a0-4717-8c46-926b3ca3fc7e" by "delete_volume" {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 05:00:31 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-4fa3d503-c4da-47c5-a115-79bbf0b350ee tempest-CreateVolumesFromImageTest-705949209 None] Lock "cinder-quobyte-cd8454e0-42a0-4717-8c46-926b3ca3fc7e" acquired by "delete_volume" :: waited 0.019s {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 05:00:31 devstack cinder-volume[92060]: DEBUG oslo.privsep.daemon [-] privsep: reply[9608f78f-9531-4578-b0c0-95363f6126fe]: (4, 'qcow2') {{(pid=93130) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 05:00:31 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-4fa3d503-c4da-47c5-a115-79bbf0b350ee tempest-CreateVolumesFromImageTest-705949209 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-cd8454e0-42a0-4717-8c46-926b3ca3fc7e {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:00:31 devstack sudo[111444]: pam_unix(sudo:session): session closed for user root Jun 17 05:00:31 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-0fdc3840-f7ad-4832-9223-9b906faf3fd1 tempest-CreateVolumesFromSourceVolumeTest-1564008756 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-0662b888-5ece-41e2-9104-cf3fd63e6668" returned: 0 in 0.860s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:00:31 devstack sudo[111455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-cd8454e0-42a0-4717-8c46-926b3ca3fc7e Jun 17 05:00:31 devstack sudo[111455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:00:31 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-0fdc3840-f7ad-4832-9223-9b906faf3fd1 tempest-CreateVolumesFromSourceVolumeTest-1564008756 None] Lock "cinder-quobyte-0662b888-5ece-41e2-9104-cf3fd63e6668" released by "delete_volume" :: held 1.691s {{(pid=92060) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 05:00:31 devstack sudo[111447]: pam_unix(sudo:session): session closed for user root Jun 17 05:00:31 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-052ac32d-31cf-42fd-8f09-a085237c8581 tempest-CreateVolumesFromImageTest-705949209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a" returned: 0 in 0.856s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:00:31 devstack cinder-volume[92060]: DEBUG cinder.manager [None req-052ac32d-31cf-42fd-8f09-a085237c8581 tempest-CreateVolumesFromImageTest-705949209 None] Notifying Schedulers of capabilities ... {{(pid=92060) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 17 05:00:31 devstack cinder-volume[92060]: INFO cinder.volume.manager [None req-052ac32d-31cf-42fd-8f09-a085237c8581 tempest-CreateVolumesFromImageTest-705949209 None] Deleted volume successfully. Jun 17 05:00:31 devstack sudo[111442]: pam_unix(sudo:session): session closed for user root Jun 17 05:00:31 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-7c0d2668-000a-4b34-b8ba-3c4fc12d6482 tempest-CinderUnicodeTest-1057368418 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-60809320-9ba6-4bae-a662-f2c91ebf6158 1073741824" returned: 0 in 1.024s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:00:31 devstack sudo[111445]: pam_unix(sudo:session): session closed for user root Jun 17 05:00:31 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-53eaef93-664c-455c-a1d0-8b0d4da9b16c tempest-VolumeAndVolumeTypeFromImageTest-1250188327 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_dfb60546-63e8-4d51-8faf-a70933c69c67_b190r2aa" returned: 0 in 0.917s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:00:31 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-53eaef93-664c-455c-a1d0-8b0d4da9b16c tempest-VolumeAndVolumeTypeFromImageTest-1250188327 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_dfb60546-63e8-4d51-8faf-a70933c69c67_b190r2aa {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:00:31 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-052ac32d-31cf-42fd-8f09-a085237c8581 tempest-CreateVolumesFromImageTest-705949209 None] Lock "cinder-835a1c49-fe0c-4005-ba84-449fdb1a5a74-delete_volume" released by "delete_volume" :: held 2.670s {{(pid=92060) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 05:00:31 devstack cinder-volume[92060]: DEBUG cinder.quota [None req-0fdc3840-f7ad-4832-9223-9b906faf3fd1 tempest-CreateVolumesFromSourceVolumeTest-1564008756 None] Created reservations ['c35b773c-d0ae-4cf7-adff-17ce30833dbc', 'da776b86-42ac-4028-a910-a568cb16185e', 'd52c4876-3830-4399-8221-8f7cfaf535b7', 'fa956620-71da-47e7-a644-11ad183d83bf'] {{(pid=92060) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 17 05:00:31 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-7c0d2668-000a-4b34-b8ba-3c4fc12d6482 tempest-CinderUnicodeTest-1057368418 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-60809320-9ba6-4bae-a662-f2c91ebf6158 {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:00:31 devstack sudo[111461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-60809320-9ba6-4bae-a662-f2c91ebf6158 Jun 17 05:00:31 devstack sudo[111461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:00:31 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-0fdc3840-f7ad-4832-9223-9b906faf3fd1 tempest-CreateVolumesFromSourceVolumeTest-1564008756 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 05:00:31 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-0fdc3840-f7ad-4832-9223-9b906faf3fd1 tempest-CreateVolumesFromSourceVolumeTest-1564008756 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 05:00:31 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-0fdc3840-f7ad-4832-9223-9b906faf3fd1 tempest-CreateVolumesFromSourceVolumeTest-1564008756 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588': None} {{(pid=92060) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 17 05:00:31 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-0fdc3840-f7ad-4832-9223-9b906faf3fd1 tempest-CreateVolumesFromSourceVolumeTest-1564008756 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588'] {{(pid=92060) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 17 05:00:31 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-0fdc3840-f7ad-4832-9223-9b906faf3fd1 tempest-CreateVolumesFromSourceVolumeTest-1564008756 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 05:00:31 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-0fdc3840-f7ad-4832-9223-9b906faf3fd1 tempest-CreateVolumesFromSourceVolumeTest-1564008756 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:00:31 devstack sudo[111460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_dfb60546-63e8-4d51-8faf-a70933c69c67_b190r2aa Jun 17 05:00:31 devstack sudo[111460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:00:31 devstack sudo[111464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a Jun 17 05:00:31 devstack sudo[111464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:00:32 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-7aa36f03-b899-421f-b31a-1a4e1f2e1932 tempest-CreateVolumesFromSourceVolumeTest-1564008756 None] Acquiring lock "cinder-f898195d-a849-4913-8639-b7a748656143-delete_volume" by "delete_volume" {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 05:00:32 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-7aa36f03-b899-421f-b31a-1a4e1f2e1932 tempest-CreateVolumesFromSourceVolumeTest-1564008756 None] Lock "cinder-f898195d-a849-4913-8639-b7a748656143-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 05:00:32 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-7aa36f03-b899-421f-b31a-1a4e1f2e1932 tempest-CreateVolumesFromSourceVolumeTest-1564008756 None] Acquiring lock "cinder-quobyte-f898195d-a849-4913-8639-b7a748656143" by "delete_volume" {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 05:00:32 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-7aa36f03-b899-421f-b31a-1a4e1f2e1932 tempest-CreateVolumesFromSourceVolumeTest-1564008756 None] Lock "cinder-quobyte-f898195d-a849-4913-8639-b7a748656143" acquired by "delete_volume" :: waited 0.024s {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 05:00:32 devstack cinder-volume[92060]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff87771a-2bfc-4505-96a6-4c0d526d3e8b]: (4, 'qcow2') {{(pid=93130) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 05:00:32 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-7aa36f03-b899-421f-b31a-1a4e1f2e1932 tempest-CreateVolumesFromSourceVolumeTest-1564008756 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-f898195d-a849-4913-8639-b7a748656143 {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:00:32 devstack sudo[111461]: pam_unix(sudo:session): session closed for user root Jun 17 05:00:32 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-7c0d2668-000a-4b34-b8ba-3c4fc12d6482 tempest-CinderUnicodeTest-1057368418 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-60809320-9ba6-4bae-a662-f2c91ebf6158" returned: 0 in 0.690s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:00:32 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-7c0d2668-000a-4b34-b8ba-3c4fc12d6482 tempest-CinderUnicodeTest-1057368418 None] <== create_volume: return (1792ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588'} {{(pid=92060) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 17 05:00:32 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-7c0d2668-000a-4b34-b8ba-3c4fc12d6482 tempest-CinderUnicodeTest-1057368418 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.796s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 05:00:32 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-7c0d2668-000a-4b34-b8ba-3c4fc12d6482 tempest-CinderUnicodeTest-1057368418 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b1ba930c-85c9-439c-b679-9f5985ab4d07) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-60809320-9ba6-4bae-a662-f2c91ebf6158', 'volume_size': 1}' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:00:32 devstack sudo[111455]: pam_unix(sudo:session): session closed for user root Jun 17 05:00:32 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-7c0d2668-000a-4b34-b8ba-3c4fc12d6482 tempest-CinderUnicodeTest-1057368418 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3964789b-ad58-43cc-858f-c1722eb89f88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:00:32 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-4fa3d503-c4da-47c5-a115-79bbf0b350ee tempest-CreateVolumesFromImageTest-705949209 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-cd8454e0-42a0-4717-8c46-926b3ca3fc7e" returned: 0 in 0.981s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:00:32 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-4fa3d503-c4da-47c5-a115-79bbf0b350ee tempest-CreateVolumesFromImageTest-705949209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-cd8454e0-42a0-4717-8c46-926b3ca3fc7e {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:00:32 devstack sudo[111470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-f898195d-a849-4913-8639-b7a748656143 Jun 17 05:00:32 devstack sudo[111470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:00:32 devstack cinder-volume[92060]: INFO cinder.volume.flows.manager.create_volume [None req-7c0d2668-000a-4b34-b8ba-3c4fc12d6482 tempest-CinderUnicodeTest-1057368418 None] Volume volume-60809320-9ba6-4bae-a662-f2c91ebf6158 (60809320-9ba6-4bae-a662-f2c91ebf6158): created successfully Jun 17 05:00:32 devstack sudo[111473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-cd8454e0-42a0-4717-8c46-926b3ca3fc7e Jun 17 05:00:32 devstack sudo[111473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:00:32 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-7c0d2668-000a-4b34-b8ba-3c4fc12d6482 tempest-CinderUnicodeTest-1057368418 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3964789b-ad58-43cc-858f-c1722eb89f88) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:00:32 devstack sudo[111460]: pam_unix(sudo:session): session closed for user root Jun 17 05:00:32 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-7c0d2668-000a-4b34-b8ba-3c4fc12d6482 tempest-CinderUnicodeTest-1057368418 None] Flow 'volume_create_manager' (016ab532-020f-4630-8aee-115494c56e30) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92060) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 17 05:00:32 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-53eaef93-664c-455c-a1d0-8b0d4da9b16c tempest-VolumeAndVolumeTypeFromImageTest-1250188327 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_dfb60546-63e8-4d51-8faf-a70933c69c67_b190r2aa" returned: 1 in 0.858s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:00:32 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-53eaef93-664c-455c-a1d0-8b0d4da9b16c tempest-VolumeAndVolumeTypeFromImageTest-1250188327 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_dfb60546-63e8-4d51-8faf-a70933c69c67_b190r2aa' failed. Not Retrying. {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 17 05:00:32 devstack cinder-volume[92060]: DEBUG oslo.privsep.daemon [-] privsep: reply[08a34264-fed4-46c7-8324-eb76d133cb4e]: (4, 'raw') {{(pid=93130) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 05:00:32 devstack cinder-volume[92060]: INFO cinder.volume.manager [None req-7c0d2668-000a-4b34-b8ba-3c4fc12d6482 tempest-CinderUnicodeTest-1057368418 None] Created volume successfully. Jun 17 05:00:32 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-53eaef93-664c-455c-a1d0-8b0d4da9b16c tempest-VolumeAndVolumeTypeFromImageTest-1250188327 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_dfb60546-63e8-4d51-8faf-a70933c69c67_vf_fwdqddevstack@QuobyteHD {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:00:32 devstack sudo[111476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_dfb60546-63e8-4d51-8faf-a70933c69c67_vf_fwdqddevstack@QuobyteHD Jun 17 05:00:32 devstack sudo[111476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:00:32 devstack sudo[111464]: pam_unix(sudo:session): session closed for user root Jun 17 05:00:32 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-0fdc3840-f7ad-4832-9223-9b906faf3fd1 tempest-CreateVolumesFromSourceVolumeTest-1564008756 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a" returned: 0 in 0.902s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:00:32 devstack cinder-volume[92060]: DEBUG cinder.manager [None req-0fdc3840-f7ad-4832-9223-9b906faf3fd1 tempest-CreateVolumesFromSourceVolumeTest-1564008756 None] Notifying Schedulers of capabilities ... {{(pid=92060) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 17 05:00:32 devstack cinder-volume[92060]: INFO cinder.volume.manager [None req-0fdc3840-f7ad-4832-9223-9b906faf3fd1 tempest-CreateVolumesFromSourceVolumeTest-1564008756 None] Deleted volume successfully. Jun 17 05:00:32 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-0fdc3840-f7ad-4832-9223-9b906faf3fd1 tempest-CreateVolumesFromSourceVolumeTest-1564008756 None] Lock "cinder-0662b888-5ece-41e2-9104-cf3fd63e6668-delete_volume" released by "delete_volume" :: held 2.878s {{(pid=92060) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 05:00:33 devstack sudo[111473]: pam_unix(sudo:session): session closed for user root Jun 17 05:00:33 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-4fa3d503-c4da-47c5-a115-79bbf0b350ee tempest-CreateVolumesFromImageTest-705949209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-cd8454e0-42a0-4717-8c46-926b3ca3fc7e" returned: 0 in 0.700s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:00:33 devstack sudo[111470]: pam_unix(sudo:session): session closed for user root Jun 17 05:00:33 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-4fa3d503-c4da-47c5-a115-79bbf0b350ee tempest-CreateVolumesFromImageTest-705949209 None] Lock "cinder-quobyte-cd8454e0-42a0-4717-8c46-926b3ca3fc7e" released by "delete_volume" :: held 1.733s {{(pid=92060) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 05:00:33 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-7aa36f03-b899-421f-b31a-1a4e1f2e1932 tempest-CreateVolumesFromSourceVolumeTest-1564008756 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-f898195d-a849-4913-8639-b7a748656143" returned: 0 in 0.865s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:00:33 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-7aa36f03-b899-421f-b31a-1a4e1f2e1932 tempest-CreateVolumesFromSourceVolumeTest-1564008756 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-f898195d-a849-4913-8639-b7a748656143 {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:00:33 devstack sudo[111486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-f898195d-a849-4913-8639-b7a748656143 Jun 17 05:00:33 devstack sudo[111486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:00:33 devstack sudo[111476]: pam_unix(sudo:session): session closed for user root Jun 17 05:00:33 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-53eaef93-664c-455c-a1d0-8b0d4da9b16c tempest-VolumeAndVolumeTypeFromImageTest-1250188327 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_dfb60546-63e8-4d51-8faf-a70933c69c67_vf_fwdqddevstack@QuobyteHD" returned: 0 in 0.709s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:00:33 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-53eaef93-664c-455c-a1d0-8b0d4da9b16c tempest-VolumeAndVolumeTypeFromImageTest-1250188327 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_dfb60546-63e8-4d51-8faf-a70933c69c67_vf_fwdqddevstack@QuobyteHD {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:00:33 devstack cinder-volume[92060]: DEBUG cinder.quota [None req-4fa3d503-c4da-47c5-a115-79bbf0b350ee tempest-CreateVolumesFromImageTest-705949209 None] Created reservations ['252e4012-f7f5-45de-982d-fc0010d85be6', '9d54945c-b923-4a07-9a50-928557b51826', '30c0c145-5a0d-4239-905c-6b0ab5cb3548', '95148676-b8b4-4fdc-9574-149799e27c86'] {{(pid=92060) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 17 05:00:33 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-b36bdefc-837a-448c-8c5d-4e7fe10aece3 tempest-CinderUnicodeTest-1057368418 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 05:00:33 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-b36bdefc-837a-448c-8c5d-4e7fe10aece3 tempest-CinderUnicodeTest-1057368418 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 05:00:33 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.remotefs [None req-b36bdefc-837a-448c-8c5d-4e7fe10aece3 tempest-CinderUnicodeTest-1057368418 None] Creating offline snapshot ada6342c-57c0-4d19-8b90-e0850efee2fe of volume 60809320-9ba6-4bae-a662-f2c91ebf6158 {{(pid=92060) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 17 05:00:33 devstack sudo[111488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_dfb60546-63e8-4d51-8faf-a70933c69c67_vf_fwdqddevstack@QuobyteHD Jun 17 05:00:33 devstack sudo[111488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:00:33 devstack cinder-volume[92060]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4779b7b-6de0-4798-acec-4173a27ad85c]: (4, 'qcow2') {{(pid=93130) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 05:00:33 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-b36bdefc-837a-448c-8c5d-4e7fe10aece3 tempest-CinderUnicodeTest-1057368418 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-60809320-9ba6-4bae-a662-f2c91ebf6158 {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:00:33 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-4fa3d503-c4da-47c5-a115-79bbf0b350ee tempest-CreateVolumesFromImageTest-705949209 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 05:00:33 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-4fa3d503-c4da-47c5-a115-79bbf0b350ee tempest-CreateVolumesFromImageTest-705949209 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 05:00:33 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-4fa3d503-c4da-47c5-a115-79bbf0b350ee tempest-CreateVolumesFromImageTest-705949209 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588': None} {{(pid=92060) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 17 05:00:33 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-4fa3d503-c4da-47c5-a115-79bbf0b350ee tempest-CreateVolumesFromImageTest-705949209 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588'] {{(pid=92060) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 17 05:00:33 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-4fa3d503-c4da-47c5-a115-79bbf0b350ee tempest-CreateVolumesFromImageTest-705949209 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 05:00:33 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-4fa3d503-c4da-47c5-a115-79bbf0b350ee tempest-CreateVolumesFromImageTest-705949209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:00:33 devstack sudo[111491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a Jun 17 05:00:33 devstack sudo[111491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:00:33 devstack sudo[111490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-60809320-9ba6-4bae-a662-f2c91ebf6158 Jun 17 05:00:33 devstack sudo[111490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:00:33 devstack sudo[111486]: pam_unix(sudo:session): session closed for user root Jun 17 05:00:33 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-7aa36f03-b899-421f-b31a-1a4e1f2e1932 tempest-CreateVolumesFromSourceVolumeTest-1564008756 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-f898195d-a849-4913-8639-b7a748656143" returned: 0 in 0.669s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:00:33 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-7aa36f03-b899-421f-b31a-1a4e1f2e1932 tempest-CreateVolumesFromSourceVolumeTest-1564008756 None] Lock "cinder-quobyte-f898195d-a849-4913-8639-b7a748656143" released by "delete_volume" :: held 1.578s {{(pid=92060) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 05:00:34 devstack cinder-volume[92060]: DEBUG cinder.quota [None req-7aa36f03-b899-421f-b31a-1a4e1f2e1932 tempest-CreateVolumesFromSourceVolumeTest-1564008756 None] Created reservations ['c6723fec-36ac-4fc4-ba37-7d7ac9e02a4a', 'f4105556-8c91-4a56-810c-9a6e056482c1', '1ab7b3ec-a17e-458e-90c0-34c787444589', '82bb626d-7822-4ca5-91e2-bbb9e9fbcc18'] {{(pid=92060) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 17 05:00:34 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-7aa36f03-b899-421f-b31a-1a4e1f2e1932 tempest-CreateVolumesFromSourceVolumeTest-1564008756 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 05:00:34 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-7aa36f03-b899-421f-b31a-1a4e1f2e1932 tempest-CreateVolumesFromSourceVolumeTest-1564008756 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 05:00:34 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-7aa36f03-b899-421f-b31a-1a4e1f2e1932 tempest-CreateVolumesFromSourceVolumeTest-1564008756 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588': None} {{(pid=92060) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 17 05:00:34 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-7aa36f03-b899-421f-b31a-1a4e1f2e1932 tempest-CreateVolumesFromSourceVolumeTest-1564008756 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588'] {{(pid=92060) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 17 05:00:34 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-7aa36f03-b899-421f-b31a-1a4e1f2e1932 tempest-CreateVolumesFromSourceVolumeTest-1564008756 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 05:00:34 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-7aa36f03-b899-421f-b31a-1a4e1f2e1932 tempest-CreateVolumesFromSourceVolumeTest-1564008756 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:00:34 devstack sudo[111498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a Jun 17 05:00:34 devstack sudo[111498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:00:34 devstack sudo[111488]: pam_unix(sudo:session): session closed for user root Jun 17 05:00:34 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-53eaef93-664c-455c-a1d0-8b0d4da9b16c tempest-VolumeAndVolumeTypeFromImageTest-1250188327 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_dfb60546-63e8-4d51-8faf-a70933c69c67_vf_fwdqddevstack@QuobyteHD" returned: 1 in 0.920s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:00:34 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-53eaef93-664c-455c-a1d0-8b0d4da9b16c tempest-VolumeAndVolumeTypeFromImageTest-1250188327 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_dfb60546-63e8-4d51-8faf-a70933c69c67_vf_fwdqddevstack@QuobyteHD' failed. Not Retrying. {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 17 05:00:34 devstack cinder-volume[92060]: DEBUG cinder.image.image_utils [None req-53eaef93-664c-455c-a1d0-8b0d4da9b16c tempest-VolumeAndVolumeTypeFromImageTest-1250188327 None] dfb60546-63e8-4d51-8faf-a70933c69c67 was raw, converting to raw {{(pid=92060) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jun 17 05:00:34 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-53eaef93-664c-455c-a1d0-8b0d4da9b16c tempest-VolumeAndVolumeTypeFromImageTest-1250188327 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_dfb60546-63e8-4d51-8faf-a70933c69c67_vf_fwdqddevstack@QuobyteHD /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-bd0081a8-1bcf-49d7-8b06-273b0d62dc13 {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:00:34 devstack sudo[111504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_dfb60546-63e8-4d51-8faf-a70933c69c67_vf_fwdqddevstack@QuobyteHD /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-bd0081a8-1bcf-49d7-8b06-273b0d62dc13 Jun 17 05:00:34 devstack sudo[111504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:00:34 devstack sudo[111491]: pam_unix(sudo:session): session closed for user root Jun 17 05:00:34 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-4fa3d503-c4da-47c5-a115-79bbf0b350ee tempest-CreateVolumesFromImageTest-705949209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a" returned: 0 in 0.834s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:00:34 devstack cinder-volume[92060]: DEBUG cinder.manager [None req-4fa3d503-c4da-47c5-a115-79bbf0b350ee tempest-CreateVolumesFromImageTest-705949209 None] Notifying Schedulers of capabilities ... {{(pid=92060) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 17 05:00:34 devstack cinder-volume[92060]: INFO cinder.volume.manager [None req-4fa3d503-c4da-47c5-a115-79bbf0b350ee tempest-CreateVolumesFromImageTest-705949209 None] Deleted volume successfully. Jun 17 05:00:34 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-4fa3d503-c4da-47c5-a115-79bbf0b350ee tempest-CreateVolumesFromImageTest-705949209 None] Lock "cinder-cd8454e0-42a0-4717-8c46-926b3ca3fc7e-delete_volume" released by "delete_volume" :: held 2.979s {{(pid=92060) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 05:00:34 devstack sudo[111490]: pam_unix(sudo:session): session closed for user root Jun 17 05:00:34 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-b36bdefc-837a-448c-8c5d-4e7fe10aece3 tempest-CinderUnicodeTest-1057368418 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-60809320-9ba6-4bae-a662-f2c91ebf6158" returned: 0 in 0.956s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:00:34 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-b36bdefc-837a-448c-8c5d-4e7fe10aece3 tempest-CinderUnicodeTest-1057368418 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-60809320-9ba6-4bae-a662-f2c91ebf6158,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-60809320-9ba6-4bae-a662-f2c91ebf6158.ada6342c-57c0-4d19-8b90-e0850efee2fe 1G {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:00:34 devstack sudo[111506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-60809320-9ba6-4bae-a662-f2c91ebf6158,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-60809320-9ba6-4bae-a662-f2c91ebf6158.ada6342c-57c0-4d19-8b90-e0850efee2fe 1G Jun 17 05:00:34 devstack sudo[111506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:00:34 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-5c97e6be-8bcf-4436-91f2-f0f7aafff39a tempest-CreateVolumesFromSourceVolumeTest-1564008756 None] Acquiring lock "cinder-e1b27c21-6230-4e3d-9a6f-574c5f8ae1ed-delete_volume" by "delete_volume" {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 05:00:34 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-5c97e6be-8bcf-4436-91f2-f0f7aafff39a tempest-CreateVolumesFromSourceVolumeTest-1564008756 None] Lock "cinder-e1b27c21-6230-4e3d-9a6f-574c5f8ae1ed-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 05:00:34 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-5c97e6be-8bcf-4436-91f2-f0f7aafff39a tempest-CreateVolumesFromSourceVolumeTest-1564008756 None] Acquiring lock "cinder-quobyte-e1b27c21-6230-4e3d-9a6f-574c5f8ae1ed" by "delete_volume" {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 05:00:34 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-5c97e6be-8bcf-4436-91f2-f0f7aafff39a tempest-CreateVolumesFromSourceVolumeTest-1564008756 None] Lock "cinder-quobyte-e1b27c21-6230-4e3d-9a6f-574c5f8ae1ed" acquired by "delete_volume" :: waited 0.017s {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 05:00:34 devstack cinder-volume[92060]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7ea7797-4304-4810-bec7-1dadf86b52ff]: (4, 'qcow2') {{(pid=93130) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 05:00:34 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-5c97e6be-8bcf-4436-91f2-f0f7aafff39a tempest-CreateVolumesFromSourceVolumeTest-1564008756 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-e1b27c21-6230-4e3d-9a6f-574c5f8ae1ed {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:00:34 devstack sudo[111508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-e1b27c21-6230-4e3d-9a6f-574c5f8ae1ed Jun 17 05:00:34 devstack sudo[111508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:00:35 devstack sudo[111498]: pam_unix(sudo:session): session closed for user root Jun 17 05:00:35 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-7aa36f03-b899-421f-b31a-1a4e1f2e1932 tempest-CreateVolumesFromSourceVolumeTest-1564008756 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a" returned: 0 in 0.855s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:00:35 devstack cinder-volume[92060]: DEBUG cinder.manager [None req-7aa36f03-b899-421f-b31a-1a4e1f2e1932 tempest-CreateVolumesFromSourceVolumeTest-1564008756 None] Notifying Schedulers of capabilities ... {{(pid=92060) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 17 05:00:35 devstack cinder-volume[92060]: INFO cinder.volume.manager [None req-7aa36f03-b899-421f-b31a-1a4e1f2e1932 tempest-CreateVolumesFromSourceVolumeTest-1564008756 None] Deleted volume successfully. Jun 17 05:00:35 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-7aa36f03-b899-421f-b31a-1a4e1f2e1932 tempest-CreateVolumesFromSourceVolumeTest-1564008756 None] Lock "cinder-f898195d-a849-4913-8639-b7a748656143-delete_volume" released by "delete_volume" :: held 2.737s {{(pid=92060) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 05:00:35 devstack sudo[111504]: pam_unix(sudo:session): session closed for user root Jun 17 05:00:35 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-53eaef93-664c-455c-a1d0-8b0d4da9b16c tempest-VolumeAndVolumeTypeFromImageTest-1250188327 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_dfb60546-63e8-4d51-8faf-a70933c69c67_vf_fwdqddevstack@QuobyteHD /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-bd0081a8-1bcf-49d7-8b06-273b0d62dc13" returned: 0 in 1.019s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:00:35 devstack cinder-volume[92060]: DEBUG cinder.image.image_utils [None req-53eaef93-664c-455c-a1d0-8b0d4da9b16c tempest-VolumeAndVolumeTypeFromImageTest-1250188327 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_dfb60546-63e8-4d51-8faf-a70933c69c67_vf_fwdqddevstack@QuobyteHD, size 0.00 MB, duration 1.02 sec, destination /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-bd0081a8-1bcf-49d7-8b06-273b0d62dc13 {{(pid=92060) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 17 05:00:35 devstack cinder-volume[92060]: INFO cinder.image.image_utils [None req-53eaef93-664c-455c-a1d0-8b0d4da9b16c tempest-VolumeAndVolumeTypeFromImageTest-1250188327 None] Converted 0.00 MB image at 0.00 MB/s Jun 17 05:00:35 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-53eaef93-664c-455c-a1d0-8b0d4da9b16c tempest-VolumeAndVolumeTypeFromImageTest-1250188327 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-bd0081a8-1bcf-49d7-8b06-273b0d62dc13 1G {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:00:35 devstack sudo[111517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-bd0081a8-1bcf-49d7-8b06-273b0d62dc13 1G Jun 17 05:00:35 devstack sudo[111517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:00:35 devstack sudo[111506]: pam_unix(sudo:session): session closed for user root Jun 17 05:00:35 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-b36bdefc-837a-448c-8c5d-4e7fe10aece3 tempest-CinderUnicodeTest-1057368418 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-60809320-9ba6-4bae-a662-f2c91ebf6158,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-60809320-9ba6-4bae-a662-f2c91ebf6158.ada6342c-57c0-4d19-8b90-e0850efee2fe 1G" returned: 0 in 1.205s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:00:35 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-b36bdefc-837a-448c-8c5d-4e7fe10aece3 tempest-CinderUnicodeTest-1057368418 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-60809320-9ba6-4bae-a662-f2c91ebf6158 -F qcow2 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-60809320-9ba6-4bae-a662-f2c91ebf6158.ada6342c-57c0-4d19-8b90-e0850efee2fe {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:00:35 devstack sudo[111508]: pam_unix(sudo:session): session closed for user root Jun 17 05:00:35 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-5c97e6be-8bcf-4436-91f2-f0f7aafff39a tempest-CreateVolumesFromSourceVolumeTest-1564008756 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-e1b27c21-6230-4e3d-9a6f-574c5f8ae1ed" returned: 0 in 0.926s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:00:35 devstack sudo[111523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-60809320-9ba6-4bae-a662-f2c91ebf6158 -F qcow2 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-60809320-9ba6-4bae-a662-f2c91ebf6158.ada6342c-57c0-4d19-8b90-e0850efee2fe Jun 17 05:00:35 devstack sudo[111523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:00:35 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-5c97e6be-8bcf-4436-91f2-f0f7aafff39a tempest-CreateVolumesFromSourceVolumeTest-1564008756 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-e1b27c21-6230-4e3d-9a6f-574c5f8ae1ed {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:00:35 devstack sudo[111525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-e1b27c21-6230-4e3d-9a6f-574c5f8ae1ed Jun 17 05:00:35 devstack sudo[111525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:00:36 devstack sudo[111517]: pam_unix(sudo:session): session closed for user root Jun 17 05:00:36 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-53eaef93-664c-455c-a1d0-8b0d4da9b16c tempest-VolumeAndVolumeTypeFromImageTest-1250188327 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-bd0081a8-1bcf-49d7-8b06-273b0d62dc13 1G" returned: 0 in 0.747s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:00:36 devstack cinder-volume[92060]: DEBUG oslo.privsep.daemon [-] privsep: reply[343df2cb-1020-4ff0-bc94-0f3325ffec2c]: (4, 'raw') {{(pid=93130) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 05:00:36 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-53eaef93-664c-455c-a1d0-8b0d4da9b16c tempest-VolumeAndVolumeTypeFromImageTest-1250188327 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-bd0081a8-1bcf-49d7-8b06-273b0d62dc13 {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:00:36 devstack sudo[111530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-bd0081a8-1bcf-49d7-8b06-273b0d62dc13 Jun 17 05:00:36 devstack sudo[111530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:00:36 devstack sudo[111525]: pam_unix(sudo:session): session closed for user root Jun 17 05:00:36 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-5c97e6be-8bcf-4436-91f2-f0f7aafff39a tempest-CreateVolumesFromSourceVolumeTest-1564008756 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-e1b27c21-6230-4e3d-9a6f-574c5f8ae1ed" returned: 0 in 0.692s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:00:36 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-5c97e6be-8bcf-4436-91f2-f0f7aafff39a tempest-CreateVolumesFromSourceVolumeTest-1564008756 None] Lock "cinder-quobyte-e1b27c21-6230-4e3d-9a6f-574c5f8ae1ed" released by "delete_volume" :: held 1.682s {{(pid=92060) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 05:00:36 devstack sudo[111523]: pam_unix(sudo:session): session closed for user root Jun 17 05:00:36 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-b36bdefc-837a-448c-8c5d-4e7fe10aece3 tempest-CinderUnicodeTest-1057368418 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-60809320-9ba6-4bae-a662-f2c91ebf6158 -F qcow2 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-60809320-9ba6-4bae-a662-f2c91ebf6158.ada6342c-57c0-4d19-8b90-e0850efee2fe" returned: 0 in 0.781s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:00:36 devstack cinder-volume[92060]: WARNING cinder.volume.drivers.remotefs [None req-b36bdefc-837a-448c-8c5d-4e7fe10aece3 tempest-CinderUnicodeTest-1057368418 None] /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-60809320-9ba6-4bae-a662-f2c91ebf6158.ada6342c-57c0-4d19-8b90-e0850efee2fe is being set with open permissions: ugo+rw Jun 17 05:00:36 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-b36bdefc-837a-448c-8c5d-4e7fe10aece3 tempest-CinderUnicodeTest-1057368418 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-60809320-9ba6-4bae-a662-f2c91ebf6158.ada6342c-57c0-4d19-8b90-e0850efee2fe {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:00:36 devstack sudo[111538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-60809320-9ba6-4bae-a662-f2c91ebf6158.ada6342c-57c0-4d19-8b90-e0850efee2fe Jun 17 05:00:36 devstack sudo[111538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:00:36 devstack cinder-volume[92060]: DEBUG cinder.quota [None req-5c97e6be-8bcf-4436-91f2-f0f7aafff39a tempest-CreateVolumesFromSourceVolumeTest-1564008756 None] Created reservations ['856d0d63-ec88-4cad-bd97-882a4377d1f4', '52becf3f-a8b2-48ae-942b-0b61c5690ea3', '30c54ab2-99dd-4034-bc86-d2cbb9f37824', '90f3b6f1-d586-4f76-bee3-1f4958a3d4d2'] {{(pid=92060) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 17 05:00:36 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-5c97e6be-8bcf-4436-91f2-f0f7aafff39a tempest-CreateVolumesFromSourceVolumeTest-1564008756 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 05:00:36 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-5c97e6be-8bcf-4436-91f2-f0f7aafff39a tempest-CreateVolumesFromSourceVolumeTest-1564008756 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 05:00:36 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-5c97e6be-8bcf-4436-91f2-f0f7aafff39a tempest-CreateVolumesFromSourceVolumeTest-1564008756 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588': None} {{(pid=92060) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 17 05:00:36 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-5c97e6be-8bcf-4436-91f2-f0f7aafff39a tempest-CreateVolumesFromSourceVolumeTest-1564008756 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588'] {{(pid=92060) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 17 05:00:36 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-5c97e6be-8bcf-4436-91f2-f0f7aafff39a tempest-CreateVolumesFromSourceVolumeTest-1564008756 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 05:00:36 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-5c97e6be-8bcf-4436-91f2-f0f7aafff39a tempest-CreateVolumesFromSourceVolumeTest-1564008756 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:00:36 devstack sudo[111540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a Jun 17 05:00:36 devstack sudo[111540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:00:36 devstack sudo[111530]: pam_unix(sudo:session): session closed for user root Jun 17 05:00:36 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-53eaef93-664c-455c-a1d0-8b0d4da9b16c tempest-VolumeAndVolumeTypeFromImageTest-1250188327 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-bd0081a8-1bcf-49d7-8b06-273b0d62dc13" returned: 0 in 0.851s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:00:36 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-53eaef93-664c-455c-a1d0-8b0d4da9b16c tempest-VolumeAndVolumeTypeFromImageTest-1250188327 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-bd0081a8-1bcf-49d7-8b06-273b0d62dc13 {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:00:37 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-10a7b473-feef-48d7-a5e6-1ebade72b07e tempest-CreateVolumesFromSourceVolumeTest-1564008756 None] Acquiring lock "cinder-8bad494b-7e1f-4eaf-81da-0099fbb31aba-delete_volume" by "delete_volume" {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 05:00:37 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-10a7b473-feef-48d7-a5e6-1ebade72b07e tempest-CreateVolumesFromSourceVolumeTest-1564008756 None] Lock "cinder-8bad494b-7e1f-4eaf-81da-0099fbb31aba-delete_volume" acquired by "delete_volume" :: waited 0.052s {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 05:00:37 devstack sudo[111544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-bd0081a8-1bcf-49d7-8b06-273b0d62dc13 Jun 17 05:00:37 devstack sudo[111544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:00:37 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-10a7b473-feef-48d7-a5e6-1ebade72b07e tempest-CreateVolumesFromSourceVolumeTest-1564008756 None] Acquiring lock "cinder-quobyte-8bad494b-7e1f-4eaf-81da-0099fbb31aba" by "delete_volume" {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 05:00:37 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-10a7b473-feef-48d7-a5e6-1ebade72b07e tempest-CreateVolumesFromSourceVolumeTest-1564008756 None] Lock "cinder-quobyte-8bad494b-7e1f-4eaf-81da-0099fbb31aba" acquired by "delete_volume" :: waited 0.038s {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 05:00:37 devstack cinder-volume[92060]: DEBUG oslo.privsep.daemon [-] privsep: reply[482cb027-dffc-438a-a8c2-74d8da03aa0c]: (4, 'qcow2') {{(pid=93130) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 05:00:37 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-10a7b473-feef-48d7-a5e6-1ebade72b07e tempest-CreateVolumesFromSourceVolumeTest-1564008756 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-8bad494b-7e1f-4eaf-81da-0099fbb31aba {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:00:37 devstack sudo[111538]: pam_unix(sudo:session): session closed for user root Jun 17 05:00:37 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-b36bdefc-837a-448c-8c5d-4e7fe10aece3 tempest-CinderUnicodeTest-1057368418 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-60809320-9ba6-4bae-a662-f2c91ebf6158.ada6342c-57c0-4d19-8b90-e0850efee2fe" returned: 0 in 0.921s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:00:37 devstack cinder-volume[92060]: DEBUG cinder.volume.flows.manager.create_volume [None req-fa08977b-fa88-48b8-8470-68ddd88dcc2e tempest-VolumeDependencyTests-1771129830 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92060) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 17 05:00:37 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-fa08977b-fa88-48b8-8470-68ddd88dcc2e tempest-VolumeDependencyTests-1771129830 None] Flow 'volume_create_manager' (0d249489-bc56-4e76-b36b-dd43cba2fb41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 17 05:00:37 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-fa08977b-fa88-48b8-8470-68ddd88dcc2e tempest-VolumeDependencyTests-1771129830 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3c5f5cc5-8f83-48da-8989-3f4123923735) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:00:37 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-fa08977b-fa88-48b8-8470-68ddd88dcc2e tempest-VolumeDependencyTests-1771129830 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3c5f5cc5-8f83-48da-8989-3f4123923735) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-17T03:00:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1342379742',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cff360d3-eb46-418a-80af-d7fb08ca9fe4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='96314890d51e4c09bb6f363732b7f164',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T03:00:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T03:00:37Z,use_quota=True,user_id='9c7c1810d14749d6b82126fc23f2ea8d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aad9ce24-93f9-41a6-baa1-5125964f96d1),volume_type_id=aad9ce24-93f9-41a6-baa1-5125964f96d1)' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:00:37 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-fa08977b-fa88-48b8-8470-68ddd88dcc2e tempest-VolumeDependencyTests-1771129830 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bb061404-9408-4c37-8048-09754ae48afa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:00:37 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-fa08977b-fa88-48b8-8470-68ddd88dcc2e tempest-VolumeDependencyTests-1771129830 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bb061404-9408-4c37-8048-09754ae48afa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:00:37 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-fa08977b-fa88-48b8-8470-68ddd88dcc2e tempest-VolumeDependencyTests-1771129830 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7c9b8e5f-8651-4fa2-b49e-4ae5022bcab4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:00:37 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-fa08977b-fa88-48b8-8470-68ddd88dcc2e tempest-VolumeDependencyTests-1771129830 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7c9b8e5f-8651-4fa2-b49e-4ae5022bcab4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cff360d3-eb46-418a-80af-d7fb08ca9fe4', 'volume_name': 'volume-cff360d3-eb46-418a-80af-d7fb08ca9fe4', 'volume_size': 1}' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:00:37 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-fa08977b-fa88-48b8-8470-68ddd88dcc2e tempest-VolumeDependencyTests-1771129830 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8db86bd5-55b5-4dc6-a866-8e6f4046f322) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:00:37 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-fa08977b-fa88-48b8-8470-68ddd88dcc2e tempest-VolumeDependencyTests-1771129830 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8db86bd5-55b5-4dc6-a866-8e6f4046f322) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:00:37 devstack sudo[111548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-8bad494b-7e1f-4eaf-81da-0099fbb31aba Jun 17 05:00:37 devstack sudo[111548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:00:37 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-fa08977b-fa88-48b8-8470-68ddd88dcc2e tempest-VolumeDependencyTests-1771129830 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (17a746ee-4176-47fc-bf86-e7a307981aa2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:00:37 devstack cinder-volume[92060]: INFO cinder.volume.flows.manager.create_volume [None req-fa08977b-fa88-48b8-8470-68ddd88dcc2e tempest-VolumeDependencyTests-1771129830 None] Volume cff360d3-eb46-418a-80af-d7fb08ca9fe4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cff360d3-eb46-418a-80af-d7fb08ca9fe4', 'volume_size': 1} Jun 17 05:00:37 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-fa08977b-fa88-48b8-8470-68ddd88dcc2e tempest-VolumeDependencyTests-1771129830 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 05:00:37 devstack sudo[111540]: pam_unix(sudo:session): session closed for user root Jun 17 05:00:37 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-b36bdefc-837a-448c-8c5d-4e7fe10aece3 tempest-CinderUnicodeTest-1057368418 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-60809320-9ba6-4bae-a662-f2c91ebf6158.info {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:00:37 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-5c97e6be-8bcf-4436-91f2-f0f7aafff39a tempest-CreateVolumesFromSourceVolumeTest-1564008756 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a" returned: 0 in 0.876s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:00:37 devstack cinder-volume[92060]: DEBUG cinder.manager [None req-5c97e6be-8bcf-4436-91f2-f0f7aafff39a tempest-CreateVolumesFromSourceVolumeTest-1564008756 None] Notifying Schedulers of capabilities ... {{(pid=92060) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 17 05:00:37 devstack cinder-volume[92060]: INFO cinder.volume.manager [None req-5c97e6be-8bcf-4436-91f2-f0f7aafff39a tempest-CreateVolumesFromSourceVolumeTest-1564008756 None] Deleted volume successfully. Jun 17 05:00:37 devstack sudo[111550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-60809320-9ba6-4bae-a662-f2c91ebf6158.info Jun 17 05:00:37 devstack sudo[111550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:00:37 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-5c97e6be-8bcf-4436-91f2-f0f7aafff39a tempest-CreateVolumesFromSourceVolumeTest-1564008756 None] Lock "cinder-e1b27c21-6230-4e3d-9a6f-574c5f8ae1ed-delete_volume" released by "delete_volume" :: held 2.879s {{(pid=92060) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 05:00:37 devstack sudo[111544]: pam_unix(sudo:session): session closed for user root Jun 17 05:00:37 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-53eaef93-664c-455c-a1d0-8b0d4da9b16c tempest-VolumeAndVolumeTypeFromImageTest-1250188327 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-bd0081a8-1bcf-49d7-8b06-273b0d62dc13" returned: 1 in 0.886s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:00:37 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-53eaef93-664c-455c-a1d0-8b0d4da9b16c tempest-VolumeAndVolumeTypeFromImageTest-1250188327 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-bd0081a8-1bcf-49d7-8b06-273b0d62dc13' failed. Not Retrying. {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 17 05:00:37 devstack cinder-volume[92060]: DEBUG cinder.volume.volume_utils [None req-53eaef93-664c-455c-a1d0-8b0d4da9b16c tempest-VolumeAndVolumeTypeFromImageTest-1250188327 None] Downloaded image dfb60546-63e8-4d51-8faf-a70933c69c67 ((None, [{'url': 'file:///opt/stack/data/glance/images/dfb60546-63e8-4d51-8faf-a70933c69c67', 'metadata': {}}])) to volume bd0081a8-1bcf-49d7-8b06-273b0d62dc13 successfully. {{(pid=92060) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jun 17 05:00:37 devstack cinder-volume[92060]: DEBUG cinder.image.image_utils [None req-53eaef93-664c-455c-a1d0-8b0d4da9b16c tempest-VolumeAndVolumeTypeFromImageTest-1250188327 None] Temporary image dfb60546-63e8-4d51-8faf-a70933c69c67 for user bf70ab77178e4c9b91f92f9da516a916 is deleted. {{(pid=92060) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jun 17 05:00:37 devstack cinder-volume[92060]: DEBUG cinder.volume.volume_utils [None req-53eaef93-664c-455c-a1d0-8b0d4da9b16c tempest-VolumeAndVolumeTypeFromImageTest-1250188327 None] Marking volume bd0081a8-1bcf-49d7-8b06-273b0d62dc13 as bootable. {{(pid=92060) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jun 17 05:00:37 devstack cinder-volume[92060]: DEBUG cinder.volume.flows.manager.create_volume [None req-53eaef93-664c-455c-a1d0-8b0d4da9b16c tempest-VolumeAndVolumeTypeFromImageTest-1250188327 None] Copying metadata from image dfb60546-63e8-4d51-8faf-a70933c69c67 to bd0081a8-1bcf-49d7-8b06-273b0d62dc13. {{(pid=92060) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jun 17 05:00:37 devstack cinder-volume[92060]: DEBUG cinder.volume.flows.manager.create_volume [None req-53eaef93-664c-455c-a1d0-8b0d4da9b16c tempest-VolumeAndVolumeTypeFromImageTest-1250188327 None] Creating volume glance metadata for volume bd0081a8-1bcf-49d7-8b06-273b0d62dc13 backed by image dfb60546-63e8-4d51-8faf-a70933c69c67 with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': 'dfb60546-63e8-4d51-8faf-a70933c69c67', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': '071234d8ee1e3b20a7aeb4e84b1fbdaf', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=92060) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jun 17 05:00:37 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-53eaef93-664c-455c-a1d0-8b0d4da9b16c tempest-VolumeAndVolumeTypeFromImageTest-1250188327 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (da2e0189-ec56-44cd-81f6-f09003c84ecd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bd0081a8-1bcf-49d7-8b06-273b0d62dc13', 'volume_size': 1, 'image_id': 'dfb60546-63e8-4d51-8faf-a70933c69c67', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/dfb60546-63e8-4d51-8faf-a70933c69c67', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '071234d8ee1e3b20a7aeb4e84b1fbdaf', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '47b57bae04f6485e85eede8f4130f4f6', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '91c73fc7ce2a8d9a79d785349c9b9bccf63e99edf8feb9b1f8166b3ffdffb2637c0e58d770318488a63368a1f94e3a35176a4c1778dae1e54e0c3f9f13228fca', 'id': 'dfb60546-63e8-4d51-8faf-a70933c69c67', 'created_at': datetime.datetime(2026, 6, 17, 3, 0, 12, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 17, 3, 0, 13, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/dfb60546-63e8-4d51-8faf-a70933c69c67/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:00:37 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-53eaef93-664c-455c-a1d0-8b0d4da9b16c tempest-VolumeAndVolumeTypeFromImageTest-1250188327 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c81f701b-7884-4718-bb61-c476d347600d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:00:37 devstack cinder-volume[92060]: INFO cinder.volume.flows.manager.create_volume [None req-53eaef93-664c-455c-a1d0-8b0d4da9b16c tempest-VolumeAndVolumeTypeFromImageTest-1250188327 None] Volume volume-bd0081a8-1bcf-49d7-8b06-273b0d62dc13 (bd0081a8-1bcf-49d7-8b06-273b0d62dc13): created successfully Jun 17 05:00:37 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-53eaef93-664c-455c-a1d0-8b0d4da9b16c tempest-VolumeAndVolumeTypeFromImageTest-1250188327 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c81f701b-7884-4718-bb61-c476d347600d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:00:37 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-53eaef93-664c-455c-a1d0-8b0d4da9b16c tempest-VolumeAndVolumeTypeFromImageTest-1250188327 None] Flow 'volume_create_manager' (3a248069-474d-4255-89e9-9bab7d239de8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92060) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 17 05:00:38 devstack cinder-volume[92060]: INFO cinder.volume.manager [None req-53eaef93-664c-455c-a1d0-8b0d4da9b16c tempest-VolumeAndVolumeTypeFromImageTest-1250188327 None] Created volume successfully. Jun 17 05:00:38 devstack sudo[111548]: pam_unix(sudo:session): session closed for user root Jun 17 05:00:38 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-10a7b473-feef-48d7-a5e6-1ebade72b07e tempest-CreateVolumesFromSourceVolumeTest-1564008756 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-8bad494b-7e1f-4eaf-81da-0099fbb31aba" returned: 0 in 0.825s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:00:38 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-10a7b473-feef-48d7-a5e6-1ebade72b07e tempest-CreateVolumesFromSourceVolumeTest-1564008756 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-8bad494b-7e1f-4eaf-81da-0099fbb31aba {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:00:38 devstack sudo[111559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-8bad494b-7e1f-4eaf-81da-0099fbb31aba Jun 17 05:00:38 devstack sudo[111559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:00:38 devstack sudo[111550]: pam_unix(sudo:session): session closed for user root Jun 17 05:00:38 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-b36bdefc-837a-448c-8c5d-4e7fe10aece3 tempest-CinderUnicodeTest-1057368418 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-60809320-9ba6-4bae-a662-f2c91ebf6158.info" returned: 0 in 0.646s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:00:38 devstack cinder-volume[92060]: WARNING cinder.volume.drivers.remotefs [None req-b36bdefc-837a-448c-8c5d-4e7fe10aece3 tempest-CinderUnicodeTest-1057368418 None] /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-60809320-9ba6-4bae-a662-f2c91ebf6158.info is being set with open permissions: ugo+rw Jun 17 05:00:38 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-b36bdefc-837a-448c-8c5d-4e7fe10aece3 tempest-CinderUnicodeTest-1057368418 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-60809320-9ba6-4bae-a662-f2c91ebf6158.info {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:00:38 devstack sudo[111561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-60809320-9ba6-4bae-a662-f2c91ebf6158.info Jun 17 05:00:38 devstack sudo[111561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:00:38 devstack sudo[111559]: pam_unix(sudo:session): session closed for user root Jun 17 05:00:38 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-10a7b473-feef-48d7-a5e6-1ebade72b07e tempest-CreateVolumesFromSourceVolumeTest-1564008756 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-8bad494b-7e1f-4eaf-81da-0099fbb31aba" returned: 0 in 0.640s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:00:38 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-10a7b473-feef-48d7-a5e6-1ebade72b07e tempest-CreateVolumesFromSourceVolumeTest-1564008756 None] Lock "cinder-quobyte-8bad494b-7e1f-4eaf-81da-0099fbb31aba" released by "delete_volume" :: held 1.543s {{(pid=92060) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 05:00:38 devstack sudo[111561]: pam_unix(sudo:session): session closed for user root Jun 17 05:00:38 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-b36bdefc-837a-448c-8c5d-4e7fe10aece3 tempest-CinderUnicodeTest-1057368418 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-60809320-9ba6-4bae-a662-f2c91ebf6158.info" returned: 0 in 0.632s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:00:38 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-b36bdefc-837a-448c-8c5d-4e7fe10aece3 tempest-CinderUnicodeTest-1057368418 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.350s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 05:00:38 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-fa08977b-fa88-48b8-8470-68ddd88dcc2e tempest-VolumeDependencyTests-1771129830 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.303s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 05:00:38 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-fa08977b-fa88-48b8-8470-68ddd88dcc2e tempest-VolumeDependencyTests-1771129830 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-17T03:00:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1342379742',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cff360d3-eb46-418a-80af-d7fb08ca9fe4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='96314890d51e4c09bb6f363732b7f164',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T03:00:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T03:00:37Z,use_quota=True,user_id='9c7c1810d14749d6b82126fc23f2ea8d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aad9ce24-93f9-41a6-baa1-5125964f96d1),volume_type_id=aad9ce24-93f9-41a6-baa1-5125964f96d1)}" {{(pid=92060) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 17 05:00:38 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.remotefs [None req-fa08977b-fa88-48b8-8470-68ddd88dcc2e tempest-VolumeDependencyTests-1771129830 None] Creating volume cff360d3-eb46-418a-80af-d7fb08ca9fe4 {{(pid=92060) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 17 05:00:38 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-fa08977b-fa88-48b8-8470-68ddd88dcc2e tempest-VolumeDependencyTests-1771129830 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 05:00:38 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-fa08977b-fa88-48b8-8470-68ddd88dcc2e tempest-VolumeDependencyTests-1771129830 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 05:00:38 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-fa08977b-fa88-48b8-8470-68ddd88dcc2e tempest-VolumeDependencyTests-1771129830 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588': None} {{(pid=92060) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 17 05:00:38 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-fa08977b-fa88-48b8-8470-68ddd88dcc2e tempest-VolumeDependencyTests-1771129830 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588'] {{(pid=92060) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 17 05:00:38 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-fa08977b-fa88-48b8-8470-68ddd88dcc2e tempest-VolumeDependencyTests-1771129830 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 05:00:38 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-fa08977b-fa88-48b8-8470-68ddd88dcc2e tempest-VolumeDependencyTests-1771129830 None] Selected osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588 as target Quobyte volume. {{(pid=92060) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 17 05:00:38 devstack cinder-volume[92060]: INFO cinder.volume.drivers.remotefs [None req-fa08977b-fa88-48b8-8470-68ddd88dcc2e tempest-VolumeDependencyTests-1771129830 None] casted to osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588 Jun 17 05:00:38 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-fa08977b-fa88-48b8-8470-68ddd88dcc2e tempest-VolumeDependencyTests-1771129830 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-cff360d3-eb46-418a-80af-d7fb08ca9fe4 1073741824 {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:00:38 devstack sudo[111565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-cff360d3-eb46-418a-80af-d7fb08ca9fe4 1073741824 Jun 17 05:00:38 devstack sudo[111565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:00:38 devstack cinder-volume[92060]: INFO cinder.volume.manager [None req-b36bdefc-837a-448c-8c5d-4e7fe10aece3 tempest-CinderUnicodeTest-1057368418 None] Create snapshot completed successfully Jun 17 05:00:38 devstack cinder-volume[92060]: DEBUG cinder.quota [None req-10a7b473-feef-48d7-a5e6-1ebade72b07e tempest-CreateVolumesFromSourceVolumeTest-1564008756 None] Created reservations ['53937cd5-45e0-4a54-a5a9-87d2ed6ed8b9', 'f3e9e162-18d1-4c1e-941e-f93886d18fb0', '934cd9f9-6662-4e3f-a7f3-433e1935bf8e', '3474c6b1-4862-4ad5-b352-2c64a5b50fde'] {{(pid=92060) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 17 05:00:38 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-10a7b473-feef-48d7-a5e6-1ebade72b07e tempest-CreateVolumesFromSourceVolumeTest-1564008756 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 05:00:38 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-10a7b473-feef-48d7-a5e6-1ebade72b07e tempest-CreateVolumesFromSourceVolumeTest-1564008756 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 05:00:38 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-10a7b473-feef-48d7-a5e6-1ebade72b07e tempest-CreateVolumesFromSourceVolumeTest-1564008756 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588': None} {{(pid=92060) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 17 05:00:38 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-10a7b473-feef-48d7-a5e6-1ebade72b07e tempest-CreateVolumesFromSourceVolumeTest-1564008756 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588'] {{(pid=92060) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 17 05:00:38 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-10a7b473-feef-48d7-a5e6-1ebade72b07e tempest-CreateVolumesFromSourceVolumeTest-1564008756 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 05:00:38 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-10a7b473-feef-48d7-a5e6-1ebade72b07e tempest-CreateVolumesFromSourceVolumeTest-1564008756 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:00:39 devstack sudo[111567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a Jun 17 05:00:39 devstack sudo[111567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:00:39 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-117791c0-2575-4e2a-9ae4-393a77741cd3 tempest-VolumeAndVolumeTypeFromImageTest-1250188327 None] Acquiring lock "cinder-bd0081a8-1bcf-49d7-8b06-273b0d62dc13-delete_volume" by "delete_volume" {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 05:00:39 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-117791c0-2575-4e2a-9ae4-393a77741cd3 tempest-VolumeAndVolumeTypeFromImageTest-1250188327 None] Lock "cinder-bd0081a8-1bcf-49d7-8b06-273b0d62dc13-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 05:00:39 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-117791c0-2575-4e2a-9ae4-393a77741cd3 tempest-VolumeAndVolumeTypeFromImageTest-1250188327 None] Acquiring lock "cinder-quobyte-bd0081a8-1bcf-49d7-8b06-273b0d62dc13" by "delete_volume" {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 05:00:39 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-117791c0-2575-4e2a-9ae4-393a77741cd3 tempest-VolumeAndVolumeTypeFromImageTest-1250188327 None] Lock "cinder-quobyte-bd0081a8-1bcf-49d7-8b06-273b0d62dc13" acquired by "delete_volume" :: waited 0.019s {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 05:00:39 devstack cinder-volume[92060]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4ddcbe0-3226-433b-af9e-1c4d27252a1a]: (4, 'raw') {{(pid=93130) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 05:00:39 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-117791c0-2575-4e2a-9ae4-393a77741cd3 tempest-VolumeAndVolumeTypeFromImageTest-1250188327 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-bd0081a8-1bcf-49d7-8b06-273b0d62dc13 {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:00:39 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-f60ab3c1-9125-4718-89bc-babdf84fee23 tempest-CreateVolumesFromSourceVolumeTest-1564008756 None] Acquiring lock "cinder-594828e9-f007-48ea-a750-2ff8bbcf4fc6-delete_volume" by "delete_volume" {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 05:00:39 devstack sudo[111569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-bd0081a8-1bcf-49d7-8b06-273b0d62dc13 Jun 17 05:00:39 devstack sudo[111569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:00:39 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-f60ab3c1-9125-4718-89bc-babdf84fee23 tempest-CreateVolumesFromSourceVolumeTest-1564008756 None] Lock "cinder-594828e9-f007-48ea-a750-2ff8bbcf4fc6-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 05:00:39 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-f60ab3c1-9125-4718-89bc-babdf84fee23 tempest-CreateVolumesFromSourceVolumeTest-1564008756 None] Acquiring lock "cinder-quobyte-594828e9-f007-48ea-a750-2ff8bbcf4fc6" by "delete_volume" {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 05:00:39 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-f60ab3c1-9125-4718-89bc-babdf84fee23 tempest-CreateVolumesFromSourceVolumeTest-1564008756 None] Lock "cinder-quobyte-594828e9-f007-48ea-a750-2ff8bbcf4fc6" acquired by "delete_volume" :: waited 0.018s {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 05:00:39 devstack cinder-volume[92060]: DEBUG oslo.privsep.daemon [-] privsep: reply[47e7f2b4-fcf8-40e4-b374-9759f626941f]: (4, 'qcow2') {{(pid=93130) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 05:00:39 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-f60ab3c1-9125-4718-89bc-babdf84fee23 tempest-CreateVolumesFromSourceVolumeTest-1564008756 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-594828e9-f007-48ea-a750-2ff8bbcf4fc6 {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:00:39 devstack sudo[111574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-594828e9-f007-48ea-a750-2ff8bbcf4fc6 Jun 17 05:00:39 devstack sudo[111574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:00:39 devstack sudo[111567]: pam_unix(sudo:session): session closed for user root Jun 17 05:00:39 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-10a7b473-feef-48d7-a5e6-1ebade72b07e tempest-CreateVolumesFromSourceVolumeTest-1564008756 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a" returned: 0 in 0.690s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:00:39 devstack cinder-volume[92060]: DEBUG cinder.manager [None req-10a7b473-feef-48d7-a5e6-1ebade72b07e tempest-CreateVolumesFromSourceVolumeTest-1564008756 None] Notifying Schedulers of capabilities ... {{(pid=92060) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 17 05:00:39 devstack cinder-volume[92060]: INFO cinder.volume.manager [None req-10a7b473-feef-48d7-a5e6-1ebade72b07e tempest-CreateVolumesFromSourceVolumeTest-1564008756 None] Deleted volume successfully. Jun 17 05:00:39 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-10a7b473-feef-48d7-a5e6-1ebade72b07e tempest-CreateVolumesFromSourceVolumeTest-1564008756 None] Lock "cinder-8bad494b-7e1f-4eaf-81da-0099fbb31aba-delete_volume" released by "delete_volume" :: held 2.580s {{(pid=92060) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 05:00:39 devstack sudo[111565]: pam_unix(sudo:session): session closed for user root Jun 17 05:00:39 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-fa08977b-fa88-48b8-8470-68ddd88dcc2e tempest-VolumeDependencyTests-1771129830 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-cff360d3-eb46-418a-80af-d7fb08ca9fe4 1073741824" returned: 0 in 0.906s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:00:39 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-fa08977b-fa88-48b8-8470-68ddd88dcc2e tempest-VolumeDependencyTests-1771129830 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-cff360d3-eb46-418a-80af-d7fb08ca9fe4 {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:00:39 devstack sudo[111578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-cff360d3-eb46-418a-80af-d7fb08ca9fe4 Jun 17 05:00:39 devstack sudo[111578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:00:39 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-b0dedfaf-9f20-4807-8312-7e2cf9a668d0 tempest-CinderUnicodeTest-1057368418 None] Acquiring lock "cinder-ada6342c-57c0-4d19-8b90-e0850efee2fe-delete_snapshot" by "delete_snapshot" {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 05:00:39 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-b0dedfaf-9f20-4807-8312-7e2cf9a668d0 tempest-CinderUnicodeTest-1057368418 None] Lock "cinder-ada6342c-57c0-4d19-8b90-e0850efee2fe-delete_snapshot" acquired by "delete_snapshot" :: waited 0.035s {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 05:00:39 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-b0dedfaf-9f20-4807-8312-7e2cf9a668d0 tempest-CinderUnicodeTest-1057368418 None] Acquiring lock "cinder-quobyte-60809320-9ba6-4bae-a662-f2c91ebf6158" by "delete_snapshot" {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 05:00:39 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-b0dedfaf-9f20-4807-8312-7e2cf9a668d0 tempest-CinderUnicodeTest-1057368418 None] Lock "cinder-quobyte-60809320-9ba6-4bae-a662-f2c91ebf6158" acquired by "delete_snapshot" :: waited 0.019s {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 05:00:39 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-b0dedfaf-9f20-4807-8312-7e2cf9a668d0 tempest-CinderUnicodeTest-1057368418 None] Acquiring lock "cinder-quobyte-ada6342c-57c0-4d19-8b90-e0850efee2fe" by "_delete_snapshot" {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 05:00:39 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-b0dedfaf-9f20-4807-8312-7e2cf9a668d0 tempest-CinderUnicodeTest-1057368418 None] Lock "cinder-quobyte-ada6342c-57c0-4d19-8b90-e0850efee2fe" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 05:00:39 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.remotefs [None req-b0dedfaf-9f20-4807-8312-7e2cf9a668d0 tempest-CinderUnicodeTest-1057368418 None] Deleting offline snapshot ada6342c-57c0-4d19-8b90-e0850efee2fe of volume 60809320-9ba6-4bae-a662-f2c91ebf6158 {{(pid=92060) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 17 05:00:39 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.remotefs [None req-b0dedfaf-9f20-4807-8312-7e2cf9a668d0 tempest-CinderUnicodeTest-1057368418 None] snapshot_file for this snap is: volume-60809320-9ba6-4bae-a662-f2c91ebf6158.ada6342c-57c0-4d19-8b90-e0850efee2fe {{(pid=92060) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 17 05:00:39 devstack cinder-volume[92060]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1a5db77-e214-4f6d-bf57-41d2b8eaacb7]: (4, 'qcow2') {{(pid=93130) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 05:00:39 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-b0dedfaf-9f20-4807-8312-7e2cf9a668d0 tempest-CinderUnicodeTest-1057368418 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-60809320-9ba6-4bae-a662-f2c91ebf6158.ada6342c-57c0-4d19-8b90-e0850efee2fe {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:00:40 devstack sudo[111569]: pam_unix(sudo:session): session closed for user root Jun 17 05:00:40 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-117791c0-2575-4e2a-9ae4-393a77741cd3 tempest-VolumeAndVolumeTypeFromImageTest-1250188327 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-bd0081a8-1bcf-49d7-8b06-273b0d62dc13" returned: 0 in 0.834s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:00:40 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-117791c0-2575-4e2a-9ae4-393a77741cd3 tempest-VolumeAndVolumeTypeFromImageTest-1250188327 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-bd0081a8-1bcf-49d7-8b06-273b0d62dc13 {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:00:40 devstack sudo[111582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-60809320-9ba6-4bae-a662-f2c91ebf6158.ada6342c-57c0-4d19-8b90-e0850efee2fe Jun 17 05:00:40 devstack sudo[111582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:00:40 devstack sudo[111583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-bd0081a8-1bcf-49d7-8b06-273b0d62dc13 Jun 17 05:00:40 devstack sudo[111583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:00:40 devstack sudo[111574]: pam_unix(sudo:session): session closed for user root Jun 17 05:00:40 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-f60ab3c1-9125-4718-89bc-babdf84fee23 tempest-CreateVolumesFromSourceVolumeTest-1564008756 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-594828e9-f007-48ea-a750-2ff8bbcf4fc6" returned: 0 in 0.858s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:00:40 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-f60ab3c1-9125-4718-89bc-babdf84fee23 tempest-CreateVolumesFromSourceVolumeTest-1564008756 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-594828e9-f007-48ea-a750-2ff8bbcf4fc6 {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:00:40 devstack sudo[111590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-594828e9-f007-48ea-a750-2ff8bbcf4fc6 Jun 17 05:00:40 devstack sudo[111590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:00:40 devstack sudo[111578]: pam_unix(sudo:session): session closed for user root Jun 17 05:00:40 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-fa08977b-fa88-48b8-8470-68ddd88dcc2e tempest-VolumeDependencyTests-1771129830 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-cff360d3-eb46-418a-80af-d7fb08ca9fe4" returned: 0 in 0.682s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:00:40 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-fa08977b-fa88-48b8-8470-68ddd88dcc2e tempest-VolumeDependencyTests-1771129830 None] <== create_volume: return (1633ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588'} {{(pid=92060) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 17 05:00:40 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-fa08977b-fa88-48b8-8470-68ddd88dcc2e tempest-VolumeDependencyTests-1771129830 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.636s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 05:00:40 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-fa08977b-fa88-48b8-8470-68ddd88dcc2e tempest-VolumeDependencyTests-1771129830 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (17a746ee-4176-47fc-bf86-e7a307981aa2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cff360d3-eb46-418a-80af-d7fb08ca9fe4', 'volume_size': 1}' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:00:40 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-fa08977b-fa88-48b8-8470-68ddd88dcc2e tempest-VolumeDependencyTests-1771129830 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1430245b-eb21-4683-9b3f-deabce3ae0b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:00:40 devstack cinder-volume[92060]: INFO cinder.volume.flows.manager.create_volume [None req-fa08977b-fa88-48b8-8470-68ddd88dcc2e tempest-VolumeDependencyTests-1771129830 None] Volume volume-cff360d3-eb46-418a-80af-d7fb08ca9fe4 (cff360d3-eb46-418a-80af-d7fb08ca9fe4): created successfully Jun 17 05:00:40 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-fa08977b-fa88-48b8-8470-68ddd88dcc2e tempest-VolumeDependencyTests-1771129830 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1430245b-eb21-4683-9b3f-deabce3ae0b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:00:40 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-fa08977b-fa88-48b8-8470-68ddd88dcc2e tempest-VolumeDependencyTests-1771129830 None] Flow 'volume_create_manager' (0d249489-bc56-4e76-b36b-dd43cba2fb41) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92060) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 17 05:00:40 devstack cinder-volume[92060]: INFO cinder.volume.manager [None req-fa08977b-fa88-48b8-8470-68ddd88dcc2e tempest-VolumeDependencyTests-1771129830 None] Created volume successfully. Jun 17 05:00:40 devstack sudo[111582]: pam_unix(sudo:session): session closed for user root Jun 17 05:00:40 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-b0dedfaf-9f20-4807-8312-7e2cf9a668d0 tempest-CinderUnicodeTest-1057368418 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-60809320-9ba6-4bae-a662-f2c91ebf6158.ada6342c-57c0-4d19-8b90-e0850efee2fe" returned: 0 in 0.873s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:00:40 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.remotefs [None req-b0dedfaf-9f20-4807-8312-7e2cf9a668d0 tempest-CinderUnicodeTest-1057368418 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-60809320-9ba6-4bae-a662-f2c91ebf6158(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=92060) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 17 05:00:40 devstack sudo[111583]: pam_unix(sudo:session): session closed for user root Jun 17 05:00:40 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-117791c0-2575-4e2a-9ae4-393a77741cd3 tempest-VolumeAndVolumeTypeFromImageTest-1250188327 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-bd0081a8-1bcf-49d7-8b06-273b0d62dc13" returned: 1 in 0.806s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:00:40 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-117791c0-2575-4e2a-9ae4-393a77741cd3 tempest-VolumeAndVolumeTypeFromImageTest-1250188327 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-bd0081a8-1bcf-49d7-8b06-273b0d62dc13' failed. Not Retrying. {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 17 05:00:40 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-117791c0-2575-4e2a-9ae4-393a77741cd3 tempest-VolumeAndVolumeTypeFromImageTest-1250188327 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-bd0081a8-1bcf-49d7-8b06-273b0d62dc13 {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:00:40 devstack cinder-volume[92060]: DEBUG oslo.privsep.daemon [-] privsep: reply[22c73ff2-c683-484d-93c8-05f14da45b4f]: (4, 'qcow2') {{(pid=93130) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 05:00:40 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-b0dedfaf-9f20-4807-8312-7e2cf9a668d0 tempest-CinderUnicodeTest-1057368418 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-60809320-9ba6-4bae-a662-f2c91ebf6158 {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:00:40 devstack sudo[111598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-bd0081a8-1bcf-49d7-8b06-273b0d62dc13 Jun 17 05:00:40 devstack sudo[111598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:00:40 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-ceee76c2-c136-4a35-ba7f-3349d7c72efd tempest-VolumeDependencyTests-1771129830 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 05:00:40 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-ceee76c2-c136-4a35-ba7f-3349d7c72efd tempest-VolumeDependencyTests-1771129830 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 05:00:40 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.remotefs [None req-ceee76c2-c136-4a35-ba7f-3349d7c72efd tempest-VolumeDependencyTests-1771129830 None] Creating offline snapshot a8b43a60-58be-4897-8514-e9d7b9ce119b of volume cff360d3-eb46-418a-80af-d7fb08ca9fe4 {{(pid=92060) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 17 05:00:40 devstack cinder-volume[92060]: DEBUG oslo.privsep.daemon [-] privsep: reply[311f839f-9491-4070-8546-f0d3616fe1c1]: (4, 'qcow2') {{(pid=93130) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 05:00:40 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-ceee76c2-c136-4a35-ba7f-3349d7c72efd tempest-VolumeDependencyTests-1771129830 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-cff360d3-eb46-418a-80af-d7fb08ca9fe4 {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:00:41 devstack sudo[111599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-60809320-9ba6-4bae-a662-f2c91ebf6158 Jun 17 05:00:41 devstack sudo[111599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:00:41 devstack sudo[111590]: pam_unix(sudo:session): session closed for user root Jun 17 05:00:41 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-f60ab3c1-9125-4718-89bc-babdf84fee23 tempest-CreateVolumesFromSourceVolumeTest-1564008756 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-594828e9-f007-48ea-a750-2ff8bbcf4fc6" returned: 0 in 0.736s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:00:41 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-f60ab3c1-9125-4718-89bc-babdf84fee23 tempest-CreateVolumesFromSourceVolumeTest-1564008756 None] Lock "cinder-quobyte-594828e9-f007-48ea-a750-2ff8bbcf4fc6" released by "delete_volume" :: held 1.652s {{(pid=92060) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 05:00:41 devstack sudo[111602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-cff360d3-eb46-418a-80af-d7fb08ca9fe4 Jun 17 05:00:41 devstack sudo[111602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:00:41 devstack cinder-volume[92060]: DEBUG cinder.quota [None req-f60ab3c1-9125-4718-89bc-babdf84fee23 tempest-CreateVolumesFromSourceVolumeTest-1564008756 None] Created reservations ['682c1353-964b-44be-98fc-c776ff9b2a78', 'c794d66c-82ee-4353-876f-ffe0f3185892', 'cfe9f0b5-4fe2-4c1f-a6e0-1cef46248903', '8839dc82-beeb-486f-a4ab-8cac39647f68'] {{(pid=92060) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 17 05:00:41 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-f60ab3c1-9125-4718-89bc-babdf84fee23 tempest-CreateVolumesFromSourceVolumeTest-1564008756 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 05:00:41 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-f60ab3c1-9125-4718-89bc-babdf84fee23 tempest-CreateVolumesFromSourceVolumeTest-1564008756 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 05:00:41 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-f60ab3c1-9125-4718-89bc-babdf84fee23 tempest-CreateVolumesFromSourceVolumeTest-1564008756 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588': None} {{(pid=92060) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 17 05:00:41 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-f60ab3c1-9125-4718-89bc-babdf84fee23 tempest-CreateVolumesFromSourceVolumeTest-1564008756 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588'] {{(pid=92060) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 17 05:00:41 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-f60ab3c1-9125-4718-89bc-babdf84fee23 tempest-CreateVolumesFromSourceVolumeTest-1564008756 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 05:00:41 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-f60ab3c1-9125-4718-89bc-babdf84fee23 tempest-CreateVolumesFromSourceVolumeTest-1564008756 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:00:41 devstack sudo[111605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a Jun 17 05:00:41 devstack sudo[111605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:00:41 devstack sudo[111598]: pam_unix(sudo:session): session closed for user root Jun 17 05:00:41 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-117791c0-2575-4e2a-9ae4-393a77741cd3 tempest-VolumeAndVolumeTypeFromImageTest-1250188327 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-bd0081a8-1bcf-49d7-8b06-273b0d62dc13" returned: 0 in 0.637s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:00:41 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-117791c0-2575-4e2a-9ae4-393a77741cd3 tempest-VolumeAndVolumeTypeFromImageTest-1250188327 None] Lock "cinder-quobyte-bd0081a8-1bcf-49d7-8b06-273b0d62dc13" released by "delete_volume" :: held 2.360s {{(pid=92060) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 05:00:41 devstack cinder-volume[92060]: DEBUG cinder.quota [None req-117791c0-2575-4e2a-9ae4-393a77741cd3 tempest-VolumeAndVolumeTypeFromImageTest-1250188327 None] Created reservations ['ca49cb24-33d8-4061-b2a7-09a7a153ef02', '2c2400f8-841f-484a-9ca4-77855433f9f7', '3858318e-87f0-4789-abf7-25202e5befa7', '81a33065-7e1b-4b7a-a3c0-ea046c3dd7d4'] {{(pid=92060) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 17 05:00:41 devstack sudo[111599]: pam_unix(sudo:session): session closed for user root Jun 17 05:00:41 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-b0dedfaf-9f20-4807-8312-7e2cf9a668d0 tempest-CinderUnicodeTest-1057368418 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-60809320-9ba6-4bae-a662-f2c91ebf6158" returned: 0 in 0.828s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:00:41 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-b0dedfaf-9f20-4807-8312-7e2cf9a668d0 tempest-CinderUnicodeTest-1057368418 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-60809320-9ba6-4bae-a662-f2c91ebf6158.ada6342c-57c0-4d19-8b90-e0850efee2fe {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:00:41 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-117791c0-2575-4e2a-9ae4-393a77741cd3 tempest-VolumeAndVolumeTypeFromImageTest-1250188327 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 05:00:41 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-117791c0-2575-4e2a-9ae4-393a77741cd3 tempest-VolumeAndVolumeTypeFromImageTest-1250188327 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 05:00:41 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-117791c0-2575-4e2a-9ae4-393a77741cd3 tempest-VolumeAndVolumeTypeFromImageTest-1250188327 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588': None} {{(pid=92060) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 17 05:00:41 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-117791c0-2575-4e2a-9ae4-393a77741cd3 tempest-VolumeAndVolumeTypeFromImageTest-1250188327 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588'] {{(pid=92060) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 17 05:00:41 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-117791c0-2575-4e2a-9ae4-393a77741cd3 tempest-VolumeAndVolumeTypeFromImageTest-1250188327 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 05:00:41 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-117791c0-2575-4e2a-9ae4-393a77741cd3 tempest-VolumeAndVolumeTypeFromImageTest-1250188327 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:00:41 devstack sudo[111616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-60809320-9ba6-4bae-a662-f2c91ebf6158.ada6342c-57c0-4d19-8b90-e0850efee2fe Jun 17 05:00:41 devstack sudo[111616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:00:41 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-ece1f61b-7c50-4379-b526-298394c1cb85 tempest-CreateVolumesFromSourceVolumeTest-1564008756 None] Acquiring lock "cinder-ad522341-9908-4746-836a-01ce61603302-delete_volume" by "delete_volume" {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 05:00:41 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-ece1f61b-7c50-4379-b526-298394c1cb85 tempest-CreateVolumesFromSourceVolumeTest-1564008756 None] Lock "cinder-ad522341-9908-4746-836a-01ce61603302-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 05:00:41 devstack sudo[111617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a Jun 17 05:00:41 devstack sudo[111617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:00:41 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-ece1f61b-7c50-4379-b526-298394c1cb85 tempest-CreateVolumesFromSourceVolumeTest-1564008756 None] Acquiring lock "cinder-quobyte-ad522341-9908-4746-836a-01ce61603302" by "delete_volume" {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 05:00:41 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-ece1f61b-7c50-4379-b526-298394c1cb85 tempest-CreateVolumesFromSourceVolumeTest-1564008756 None] Lock "cinder-quobyte-ad522341-9908-4746-836a-01ce61603302" acquired by "delete_volume" :: waited 0.021s {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 05:00:41 devstack sudo[111602]: pam_unix(sudo:session): session closed for user root Jun 17 05:00:41 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-ceee76c2-c136-4a35-ba7f-3349d7c72efd tempest-VolumeDependencyTests-1771129830 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-cff360d3-eb46-418a-80af-d7fb08ca9fe4" returned: 0 in 0.928s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:00:41 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-ceee76c2-c136-4a35-ba7f-3349d7c72efd tempest-VolumeDependencyTests-1771129830 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-cff360d3-eb46-418a-80af-d7fb08ca9fe4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-cff360d3-eb46-418a-80af-d7fb08ca9fe4.a8b43a60-58be-4897-8514-e9d7b9ce119b 1G {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:00:41 devstack cinder-volume[92060]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7d42fa7-83ff-4a9f-8d66-a600df3a5bb6]: (4, 'qcow2') {{(pid=93130) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 05:00:41 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-ece1f61b-7c50-4379-b526-298394c1cb85 tempest-CreateVolumesFromSourceVolumeTest-1564008756 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-ad522341-9908-4746-836a-01ce61603302 {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:00:41 devstack sudo[111621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-cff360d3-eb46-418a-80af-d7fb08ca9fe4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-cff360d3-eb46-418a-80af-d7fb08ca9fe4.a8b43a60-58be-4897-8514-e9d7b9ce119b 1G Jun 17 05:00:41 devstack sudo[111621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:00:42 devstack sudo[111622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-ad522341-9908-4746-836a-01ce61603302 Jun 17 05:00:42 devstack sudo[111622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:00:42 devstack sudo[111605]: pam_unix(sudo:session): session closed for user root Jun 17 05:00:42 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-f60ab3c1-9125-4718-89bc-babdf84fee23 tempest-CreateVolumesFromSourceVolumeTest-1564008756 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a" returned: 0 in 0.953s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:00:42 devstack cinder-volume[92060]: DEBUG cinder.manager [None req-f60ab3c1-9125-4718-89bc-babdf84fee23 tempest-CreateVolumesFromSourceVolumeTest-1564008756 None] Notifying Schedulers of capabilities ... {{(pid=92060) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 17 05:00:42 devstack cinder-volume[92060]: INFO cinder.volume.manager [None req-f60ab3c1-9125-4718-89bc-babdf84fee23 tempest-CreateVolumesFromSourceVolumeTest-1564008756 None] Deleted volume successfully. Jun 17 05:00:42 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-f60ab3c1-9125-4718-89bc-babdf84fee23 tempest-CreateVolumesFromSourceVolumeTest-1564008756 None] Lock "cinder-594828e9-f007-48ea-a750-2ff8bbcf4fc6-delete_volume" released by "delete_volume" :: held 2.872s {{(pid=92060) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 05:00:42 devstack sudo[111617]: pam_unix(sudo:session): session closed for user root Jun 17 05:00:42 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-117791c0-2575-4e2a-9ae4-393a77741cd3 tempest-VolumeAndVolumeTypeFromImageTest-1250188327 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a" returned: 0 in 0.846s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:00:42 devstack cinder-volume[92060]: DEBUG cinder.manager [None req-117791c0-2575-4e2a-9ae4-393a77741cd3 tempest-VolumeAndVolumeTypeFromImageTest-1250188327 None] Notifying Schedulers of capabilities ... {{(pid=92060) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 17 05:00:42 devstack cinder-volume[92060]: INFO cinder.volume.manager [None req-117791c0-2575-4e2a-9ae4-393a77741cd3 tempest-VolumeAndVolumeTypeFromImageTest-1250188327 None] Deleted volume successfully. Jun 17 05:00:42 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-117791c0-2575-4e2a-9ae4-393a77741cd3 tempest-VolumeAndVolumeTypeFromImageTest-1250188327 None] Lock "cinder-bd0081a8-1bcf-49d7-8b06-273b0d62dc13-delete_volume" released by "delete_volume" :: held 3.544s {{(pid=92060) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 05:00:42 devstack sudo[111616]: pam_unix(sudo:session): session closed for user root Jun 17 05:00:42 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-b0dedfaf-9f20-4807-8312-7e2cf9a668d0 tempest-CinderUnicodeTest-1057368418 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-60809320-9ba6-4bae-a662-f2c91ebf6158.ada6342c-57c0-4d19-8b90-e0850efee2fe" returned: 0 in 1.140s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:00:42 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-b0dedfaf-9f20-4807-8312-7e2cf9a668d0 tempest-CinderUnicodeTest-1057368418 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-60809320-9ba6-4bae-a662-f2c91ebf6158.ada6342c-57c0-4d19-8b90-e0850efee2fe {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:00:42 devstack sudo[111637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-60809320-9ba6-4bae-a662-f2c91ebf6158.ada6342c-57c0-4d19-8b90-e0850efee2fe Jun 17 05:00:42 devstack sudo[111637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:00:43 devstack sudo[111622]: pam_unix(sudo:session): session closed for user root Jun 17 05:00:43 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-ece1f61b-7c50-4379-b526-298394c1cb85 tempest-CreateVolumesFromSourceVolumeTest-1564008756 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-ad522341-9908-4746-836a-01ce61603302" returned: 0 in 1.125s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:00:43 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-ece1f61b-7c50-4379-b526-298394c1cb85 tempest-CreateVolumesFromSourceVolumeTest-1564008756 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-ad522341-9908-4746-836a-01ce61603302 {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:00:43 devstack sudo[111621]: pam_unix(sudo:session): session closed for user root Jun 17 05:00:43 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-ceee76c2-c136-4a35-ba7f-3349d7c72efd tempest-VolumeDependencyTests-1771129830 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-cff360d3-eb46-418a-80af-d7fb08ca9fe4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-cff360d3-eb46-418a-80af-d7fb08ca9fe4.a8b43a60-58be-4897-8514-e9d7b9ce119b 1G" returned: 0 in 1.165s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:00:43 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-ceee76c2-c136-4a35-ba7f-3349d7c72efd tempest-VolumeDependencyTests-1771129830 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cff360d3-eb46-418a-80af-d7fb08ca9fe4 -F qcow2 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-cff360d3-eb46-418a-80af-d7fb08ca9fe4.a8b43a60-58be-4897-8514-e9d7b9ce119b {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:00:43 devstack sudo[111639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-ad522341-9908-4746-836a-01ce61603302 Jun 17 05:00:43 devstack sudo[111639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:00:43 devstack sudo[111640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cff360d3-eb46-418a-80af-d7fb08ca9fe4 -F qcow2 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-cff360d3-eb46-418a-80af-d7fb08ca9fe4.a8b43a60-58be-4897-8514-e9d7b9ce119b Jun 17 05:00:43 devstack sudo[111640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:00:43 devstack sudo[111637]: pam_unix(sudo:session): session closed for user root Jun 17 05:00:43 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-b0dedfaf-9f20-4807-8312-7e2cf9a668d0 tempest-CinderUnicodeTest-1057368418 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-60809320-9ba6-4bae-a662-f2c91ebf6158.ada6342c-57c0-4d19-8b90-e0850efee2fe" returned: 0 in 0.720s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:00:43 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-b0dedfaf-9f20-4807-8312-7e2cf9a668d0 tempest-CinderUnicodeTest-1057368418 None] Lock "cinder-quobyte-ada6342c-57c0-4d19-8b90-e0850efee2fe" released by "_delete_snapshot" :: held 3.710s {{(pid=92060) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 05:00:43 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-b0dedfaf-9f20-4807-8312-7e2cf9a668d0 tempest-CinderUnicodeTest-1057368418 None] Lock "cinder-quobyte-60809320-9ba6-4bae-a662-f2c91ebf6158" released by "delete_snapshot" :: held 3.740s {{(pid=92060) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 05:00:43 devstack cinder-volume[92060]: DEBUG cinder.quota [None req-b0dedfaf-9f20-4807-8312-7e2cf9a668d0 tempest-CinderUnicodeTest-1057368418 None] Created reservations ['97457818-9654-488f-a98b-11294a037827', '49c19b43-d4a3-4dc3-a0ad-0c82a6725f64', '1f63cfba-1637-4ca8-9640-86dbf3889071', 'e3160e35-cf8d-4434-a5ea-c920cc9edf30'] {{(pid=92060) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 17 05:00:43 devstack sudo[111639]: pam_unix(sudo:session): session closed for user root Jun 17 05:00:43 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-ece1f61b-7c50-4379-b526-298394c1cb85 tempest-CreateVolumesFromSourceVolumeTest-1564008756 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-ad522341-9908-4746-836a-01ce61603302" returned: 0 in 0.739s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:00:43 devstack cinder-volume[92060]: INFO cinder.volume.manager [None req-b0dedfaf-9f20-4807-8312-7e2cf9a668d0 tempest-CinderUnicodeTest-1057368418 None] Delete snapshot completed successfully. Jun 17 05:00:43 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-ece1f61b-7c50-4379-b526-298394c1cb85 tempest-CreateVolumesFromSourceVolumeTest-1564008756 None] Lock "cinder-quobyte-ad522341-9908-4746-836a-01ce61603302" released by "delete_volume" :: held 1.938s {{(pid=92060) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 05:00:43 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-b0dedfaf-9f20-4807-8312-7e2cf9a668d0 tempest-CinderUnicodeTest-1057368418 None] Lock "cinder-ada6342c-57c0-4d19-8b90-e0850efee2fe-delete_snapshot" released by "delete_snapshot" :: held 3.941s {{(pid=92060) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 05:00:43 devstack cinder-volume[92060]: DEBUG cinder.quota [None req-ece1f61b-7c50-4379-b526-298394c1cb85 tempest-CreateVolumesFromSourceVolumeTest-1564008756 None] Created reservations ['601693bf-25ce-466f-a5b0-baaf9f4e37c0', '0fac5d46-223e-4714-b0c7-1e24a475d9c0', '6a6ed3da-c01a-4695-8615-63e560689a58', 'ba21f0a5-d846-4dc2-a762-4a28a31a082d'] {{(pid=92060) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 17 05:00:43 devstack sudo[111640]: pam_unix(sudo:session): session closed for user root Jun 17 05:00:43 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-ceee76c2-c136-4a35-ba7f-3349d7c72efd tempest-VolumeDependencyTests-1771129830 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cff360d3-eb46-418a-80af-d7fb08ca9fe4 -F qcow2 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-cff360d3-eb46-418a-80af-d7fb08ca9fe4.a8b43a60-58be-4897-8514-e9d7b9ce119b" returned: 0 in 0.811s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:00:43 devstack cinder-volume[92060]: WARNING cinder.volume.drivers.remotefs [None req-ceee76c2-c136-4a35-ba7f-3349d7c72efd tempest-VolumeDependencyTests-1771129830 None] /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-cff360d3-eb46-418a-80af-d7fb08ca9fe4.a8b43a60-58be-4897-8514-e9d7b9ce119b is being set with open permissions: ugo+rw Jun 17 05:00:43 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-ceee76c2-c136-4a35-ba7f-3349d7c72efd tempest-VolumeDependencyTests-1771129830 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-cff360d3-eb46-418a-80af-d7fb08ca9fe4.a8b43a60-58be-4897-8514-e9d7b9ce119b {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:00:43 devstack sudo[111650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-cff360d3-eb46-418a-80af-d7fb08ca9fe4.a8b43a60-58be-4897-8514-e9d7b9ce119b Jun 17 05:00:43 devstack sudo[111650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:00:43 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-ece1f61b-7c50-4379-b526-298394c1cb85 tempest-CreateVolumesFromSourceVolumeTest-1564008756 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 05:00:43 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-ece1f61b-7c50-4379-b526-298394c1cb85 tempest-CreateVolumesFromSourceVolumeTest-1564008756 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 05:00:43 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-ece1f61b-7c50-4379-b526-298394c1cb85 tempest-CreateVolumesFromSourceVolumeTest-1564008756 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588': None} {{(pid=92060) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 17 05:00:43 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-ece1f61b-7c50-4379-b526-298394c1cb85 tempest-CreateVolumesFromSourceVolumeTest-1564008756 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588'] {{(pid=92060) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 17 05:00:43 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-ece1f61b-7c50-4379-b526-298394c1cb85 tempest-CreateVolumesFromSourceVolumeTest-1564008756 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 05:00:43 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-ece1f61b-7c50-4379-b526-298394c1cb85 tempest-CreateVolumesFromSourceVolumeTest-1564008756 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:00:44 devstack sudo[111652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a Jun 17 05:00:44 devstack sudo[111652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:00:44 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-b1c4a66f-f21c-4911-a622-5d183f927f1e tempest-CinderUnicodeTest-1057368418 None] Acquiring lock "cinder-60809320-9ba6-4bae-a662-f2c91ebf6158-delete_volume" by "delete_volume" {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 05:00:44 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-b1c4a66f-f21c-4911-a622-5d183f927f1e tempest-CinderUnicodeTest-1057368418 None] Lock "cinder-60809320-9ba6-4bae-a662-f2c91ebf6158-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 05:00:44 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-b1c4a66f-f21c-4911-a622-5d183f927f1e tempest-CinderUnicodeTest-1057368418 None] Acquiring lock "cinder-quobyte-60809320-9ba6-4bae-a662-f2c91ebf6158" by "delete_volume" {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 05:00:44 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-b1c4a66f-f21c-4911-a622-5d183f927f1e tempest-CinderUnicodeTest-1057368418 None] Lock "cinder-quobyte-60809320-9ba6-4bae-a662-f2c91ebf6158" acquired by "delete_volume" :: waited 0.023s {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 05:00:44 devstack cinder-volume[92060]: DEBUG oslo.privsep.daemon [-] privsep: reply[568a80d0-a313-4cb5-ab79-60339c97b0e3]: (4, 'qcow2') {{(pid=93130) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 05:00:44 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-b1c4a66f-f21c-4911-a622-5d183f927f1e tempest-CinderUnicodeTest-1057368418 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-60809320-9ba6-4bae-a662-f2c91ebf6158 {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:00:44 devstack sudo[111654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-60809320-9ba6-4bae-a662-f2c91ebf6158 Jun 17 05:00:44 devstack sudo[111654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:00:44 devstack sudo[111652]: pam_unix(sudo:session): session closed for user root Jun 17 05:00:44 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-ece1f61b-7c50-4379-b526-298394c1cb85 tempest-CreateVolumesFromSourceVolumeTest-1564008756 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a" returned: 0 in 0.982s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:00:44 devstack cinder-volume[92060]: DEBUG cinder.manager [None req-ece1f61b-7c50-4379-b526-298394c1cb85 tempest-CreateVolumesFromSourceVolumeTest-1564008756 None] Notifying Schedulers of capabilities ... {{(pid=92060) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 17 05:00:44 devstack cinder-volume[92060]: INFO cinder.volume.manager [None req-ece1f61b-7c50-4379-b526-298394c1cb85 tempest-CreateVolumesFromSourceVolumeTest-1564008756 None] Deleted volume successfully. Jun 17 05:00:44 devstack sudo[111650]: pam_unix(sudo:session): session closed for user root Jun 17 05:00:44 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-ceee76c2-c136-4a35-ba7f-3349d7c72efd tempest-VolumeDependencyTests-1771129830 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-cff360d3-eb46-418a-80af-d7fb08ca9fe4.a8b43a60-58be-4897-8514-e9d7b9ce119b" returned: 0 in 1.082s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:00:44 devstack cinder-volume[92060]: DEBUG oslo_service.periodic_task [None req-60d279ad-ad8c-4d36-a4b8-f593e74fb922 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=92060) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 17 05:00:44 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-60d279ad-ad8c-4d36-a4b8-f593e74fb922 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 05:00:44 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-60d279ad-ad8c-4d36-a4b8-f593e74fb922 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 05:00:44 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-60d279ad-ad8c-4d36-a4b8-f593e74fb922 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588': None} {{(pid=92060) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 17 05:00:44 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-60d279ad-ad8c-4d36-a4b8-f593e74fb922 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588'] {{(pid=92060) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 17 05:00:44 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-60d279ad-ad8c-4d36-a4b8-f593e74fb922 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 05:00:44 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-60d279ad-ad8c-4d36-a4b8-f593e74fb922 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:00:45 devstack sudo[111658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a Jun 17 05:00:45 devstack sudo[111658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:00:45 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-ece1f61b-7c50-4379-b526-298394c1cb85 tempest-CreateVolumesFromSourceVolumeTest-1564008756 None] Lock "cinder-ad522341-9908-4746-836a-01ce61603302-delete_volume" released by "delete_volume" :: held 3.263s {{(pid=92060) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 05:00:45 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-ceee76c2-c136-4a35-ba7f-3349d7c72efd tempest-VolumeDependencyTests-1771129830 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-cff360d3-eb46-418a-80af-d7fb08ca9fe4.info {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:00:45 devstack sudo[111660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-cff360d3-eb46-418a-80af-d7fb08ca9fe4.info Jun 17 05:00:45 devstack sudo[111660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:00:45 devstack sudo[111654]: pam_unix(sudo:session): session closed for user root Jun 17 05:00:45 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-b1c4a66f-f21c-4911-a622-5d183f927f1e tempest-CinderUnicodeTest-1057368418 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-60809320-9ba6-4bae-a662-f2c91ebf6158" returned: 0 in 1.082s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:00:45 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-b1c4a66f-f21c-4911-a622-5d183f927f1e tempest-CinderUnicodeTest-1057368418 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-60809320-9ba6-4bae-a662-f2c91ebf6158 {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:00:45 devstack sudo[111665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-60809320-9ba6-4bae-a662-f2c91ebf6158 Jun 17 05:00:45 devstack sudo[111665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:00:45 devstack sudo[111658]: pam_unix(sudo:session): session closed for user root Jun 17 05:00:45 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-60d279ad-ad8c-4d36-a4b8-f593e74fb922 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a" returned: 0 in 0.978s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:00:45 devstack cinder-volume[92060]: DEBUG cinder.manager [None req-60d279ad-ad8c-4d36-a4b8-f593e74fb922 None None] Notifying Schedulers of capabilities ... {{(pid=92060) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 17 05:00:45 devstack cinder-volume[92060]: DEBUG oslo_service.periodic_task [None req-60d279ad-ad8c-4d36-a4b8-f593e74fb922 None None] Running periodic task VolumeManager._thread_info {{(pid=92060) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 17 05:00:45 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-60d279ad-ad8c-4d36-a4b8-f593e74fb922 None None] thread count: 28 {{(pid=92060) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 17 05:00:45 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-60d279ad-ad8c-4d36-a4b8-f593e74fb922 None None] thread info: [<_MainThread(MainThread, started 130061806440576)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=92060) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 17 05:00:45 devstack sudo[111660]: pam_unix(sudo:session): session closed for user root Jun 17 05:00:45 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-ceee76c2-c136-4a35-ba7f-3349d7c72efd tempest-VolumeDependencyTests-1771129830 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-cff360d3-eb46-418a-80af-d7fb08ca9fe4.info" returned: 0 in 0.894s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:00:45 devstack cinder-volume[92060]: WARNING cinder.volume.drivers.remotefs [None req-ceee76c2-c136-4a35-ba7f-3349d7c72efd tempest-VolumeDependencyTests-1771129830 None] /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-cff360d3-eb46-418a-80af-d7fb08ca9fe4.info is being set with open permissions: ugo+rw Jun 17 05:00:45 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-ceee76c2-c136-4a35-ba7f-3349d7c72efd tempest-VolumeDependencyTests-1771129830 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-cff360d3-eb46-418a-80af-d7fb08ca9fe4.info {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:00:46 devstack sudo[111669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-cff360d3-eb46-418a-80af-d7fb08ca9fe4.info Jun 17 05:00:46 devstack sudo[111669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:00:46 devstack sudo[111665]: pam_unix(sudo:session): session closed for user root Jun 17 05:00:46 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-b1c4a66f-f21c-4911-a622-5d183f927f1e tempest-CinderUnicodeTest-1057368418 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-60809320-9ba6-4bae-a662-f2c91ebf6158" returned: 0 in 0.741s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:00:46 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-b1c4a66f-f21c-4911-a622-5d183f927f1e tempest-CinderUnicodeTest-1057368418 None] Lock "cinder-quobyte-60809320-9ba6-4bae-a662-f2c91ebf6158" released by "delete_volume" :: held 1.919s {{(pid=92060) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 05:00:46 devstack cinder-volume[92060]: DEBUG cinder.quota [None req-b1c4a66f-f21c-4911-a622-5d183f927f1e tempest-CinderUnicodeTest-1057368418 None] Created reservations ['35be65e6-8918-4974-8611-598995fb757c', '9cb6845b-17ef-430d-9b5e-191e40d82ef6', 'ac7de89c-7e35-4af6-b079-cc3c4eb4cf0e', 'b68a4945-cc7a-41fe-90bc-e21b1f48e3d6'] {{(pid=92060) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 17 05:00:46 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-b1c4a66f-f21c-4911-a622-5d183f927f1e tempest-CinderUnicodeTest-1057368418 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 05:00:46 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-b1c4a66f-f21c-4911-a622-5d183f927f1e tempest-CinderUnicodeTest-1057368418 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 05:00:46 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-b1c4a66f-f21c-4911-a622-5d183f927f1e tempest-CinderUnicodeTest-1057368418 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588': None} {{(pid=92060) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 17 05:00:46 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-b1c4a66f-f21c-4911-a622-5d183f927f1e tempest-CinderUnicodeTest-1057368418 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588'] {{(pid=92060) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 17 05:00:46 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-b1c4a66f-f21c-4911-a622-5d183f927f1e tempest-CinderUnicodeTest-1057368418 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 05:00:46 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-b1c4a66f-f21c-4911-a622-5d183f927f1e tempest-CinderUnicodeTest-1057368418 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:00:46 devstack sudo[111672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a Jun 17 05:00:46 devstack sudo[111672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:00:46 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-9b4da57b-ce99-4978-acda-a5525e7d8614 tempest-CinderUnicodeTest-1057368418 None] Acquiring lock "cinder-751528c8-62bf-4dd6-8857-b9136f21fae6-delete_volume" by "delete_volume" {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 05:00:46 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-9b4da57b-ce99-4978-acda-a5525e7d8614 tempest-CinderUnicodeTest-1057368418 None] Lock "cinder-751528c8-62bf-4dd6-8857-b9136f21fae6-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 05:00:46 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-9b4da57b-ce99-4978-acda-a5525e7d8614 tempest-CinderUnicodeTest-1057368418 None] Acquiring lock "cinder-quobyte-751528c8-62bf-4dd6-8857-b9136f21fae6" by "delete_volume" {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 05:00:46 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-9b4da57b-ce99-4978-acda-a5525e7d8614 tempest-CinderUnicodeTest-1057368418 None] Lock "cinder-quobyte-751528c8-62bf-4dd6-8857-b9136f21fae6" acquired by "delete_volume" :: waited 0.021s {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 05:00:46 devstack cinder-volume[92060]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3411514-cc3f-47b3-9efc-fed3919c0928]: (4, 'qcow2') {{(pid=93130) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 05:00:46 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-9b4da57b-ce99-4978-acda-a5525e7d8614 tempest-CinderUnicodeTest-1057368418 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-751528c8-62bf-4dd6-8857-b9136f21fae6 {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:00:46 devstack sudo[111669]: pam_unix(sudo:session): session closed for user root Jun 17 05:00:46 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-ceee76c2-c136-4a35-ba7f-3349d7c72efd tempest-VolumeDependencyTests-1771129830 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-cff360d3-eb46-418a-80af-d7fb08ca9fe4.info" returned: 0 in 0.798s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:00:46 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-ceee76c2-c136-4a35-ba7f-3349d7c72efd tempest-VolumeDependencyTests-1771129830 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.877s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 05:00:46 devstack cinder-volume[92060]: INFO cinder.volume.manager [None req-ceee76c2-c136-4a35-ba7f-3349d7c72efd tempest-VolumeDependencyTests-1771129830 None] Create snapshot completed successfully Jun 17 05:00:46 devstack sudo[111675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-751528c8-62bf-4dd6-8857-b9136f21fae6 Jun 17 05:00:46 devstack sudo[111675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:00:47 devstack sudo[111672]: pam_unix(sudo:session): session closed for user root Jun 17 05:00:47 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-b1c4a66f-f21c-4911-a622-5d183f927f1e tempest-CinderUnicodeTest-1057368418 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a" returned: 0 in 0.826s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:00:47 devstack cinder-volume[92060]: DEBUG cinder.manager [None req-b1c4a66f-f21c-4911-a622-5d183f927f1e tempest-CinderUnicodeTest-1057368418 None] Notifying Schedulers of capabilities ... {{(pid=92060) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 17 05:00:47 devstack cinder-volume[92060]: INFO cinder.volume.manager [None req-b1c4a66f-f21c-4911-a622-5d183f927f1e tempest-CinderUnicodeTest-1057368418 None] Deleted volume successfully. Jun 17 05:00:47 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-b1c4a66f-f21c-4911-a622-5d183f927f1e tempest-CinderUnicodeTest-1057368418 None] Lock "cinder-60809320-9ba6-4bae-a662-f2c91ebf6158-delete_volume" released by "delete_volume" :: held 3.065s {{(pid=92060) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 05:00:47 devstack sudo[111675]: pam_unix(sudo:session): session closed for user root Jun 17 05:00:47 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-9b4da57b-ce99-4978-acda-a5525e7d8614 tempest-CinderUnicodeTest-1057368418 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-751528c8-62bf-4dd6-8857-b9136f21fae6" returned: 0 in 0.882s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:00:47 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-9b4da57b-ce99-4978-acda-a5525e7d8614 tempest-CinderUnicodeTest-1057368418 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-751528c8-62bf-4dd6-8857-b9136f21fae6 {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:00:47 devstack sudo[111681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-751528c8-62bf-4dd6-8857-b9136f21fae6 Jun 17 05:00:47 devstack sudo[111681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:00:47 devstack cinder-volume[92060]: DEBUG cinder.volume.flows.manager.create_volume [None req-16bfa564-c667-446e-9924-58fbbae2e9c9 tempest-VolumeDependencyTests-1771129830 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92060) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 17 05:00:47 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-16bfa564-c667-446e-9924-58fbbae2e9c9 tempest-VolumeDependencyTests-1771129830 None] Flow 'volume_create_manager' (80ceb94f-36d6-4db7-8e60-cfacc806c149) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 17 05:00:47 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-16bfa564-c667-446e-9924-58fbbae2e9c9 tempest-VolumeDependencyTests-1771129830 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (987a78c6-1d0b-4e43-9d3f-be9f26193e1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:00:47 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-16bfa564-c667-446e-9924-58fbbae2e9c9 tempest-VolumeDependencyTests-1771129830 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (987a78c6-1d0b-4e43-9d3f-be9f26193e1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-17T03:00:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-2066188838',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0c3a9c90-84c5-4c9d-bab8-7fa233696a53,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='96314890d51e4c09bb6f363732b7f164',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T03:00:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=a8b43a60-58be-4897-8514-e9d7b9ce119b,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T03:00:48Z,use_quota=True,user_id='9c7c1810d14749d6b82126fc23f2ea8d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aad9ce24-93f9-41a6-baa1-5125964f96d1),volume_type_id=aad9ce24-93f9-41a6-baa1-5125964f96d1)' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:00:47 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-16bfa564-c667-446e-9924-58fbbae2e9c9 tempest-VolumeDependencyTests-1771129830 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6d5e2d79-46e8-4d56-9398-59fd5f5f031e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:00:47 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-16bfa564-c667-446e-9924-58fbbae2e9c9 tempest-VolumeDependencyTests-1771129830 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6d5e2d79-46e8-4d56-9398-59fd5f5f031e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:00:47 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-16bfa564-c667-446e-9924-58fbbae2e9c9 tempest-VolumeDependencyTests-1771129830 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (75885535-7ff7-444a-87b1-195c2c9e4178) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:00:47 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-16bfa564-c667-446e-9924-58fbbae2e9c9 tempest-VolumeDependencyTests-1771129830 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (75885535-7ff7-444a-87b1-195c2c9e4178) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '0c3a9c90-84c5-4c9d-bab8-7fa233696a53', 'volume_name': 'volume-0c3a9c90-84c5-4c9d-bab8-7fa233696a53', 'volume_size': 1, 'snapshot_id': 'a8b43a60-58be-4897-8514-e9d7b9ce119b'}' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:00:47 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-16bfa564-c667-446e-9924-58fbbae2e9c9 tempest-VolumeDependencyTests-1771129830 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d59c91a1-5deb-4ff0-8cd1-9af5e85ee57d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:00:47 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-16bfa564-c667-446e-9924-58fbbae2e9c9 tempest-VolumeDependencyTests-1771129830 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d59c91a1-5deb-4ff0-8cd1-9af5e85ee57d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:00:47 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-16bfa564-c667-446e-9924-58fbbae2e9c9 tempest-VolumeDependencyTests-1771129830 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7b2c9b6a-7314-4962-a051-b080c5c235bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:00:47 devstack cinder-volume[92060]: INFO cinder.volume.flows.manager.create_volume [None req-16bfa564-c667-446e-9924-58fbbae2e9c9 tempest-VolumeDependencyTests-1771129830 None] Volume 0c3a9c90-84c5-4c9d-bab8-7fa233696a53: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-0c3a9c90-84c5-4c9d-bab8-7fa233696a53', 'volume_size': 1, 'snapshot_id': 'a8b43a60-58be-4897-8514-e9d7b9ce119b'} Jun 17 05:00:47 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-16bfa564-c667-446e-9924-58fbbae2e9c9 tempest-VolumeDependencyTests-1771129830 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 05:00:47 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-16bfa564-c667-446e-9924-58fbbae2e9c9 tempest-VolumeDependencyTests-1771129830 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 05:00:47 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-16bfa564-c667-446e-9924-58fbbae2e9c9 tempest-VolumeDependencyTests-1771129830 None] Acquiring lock "cinder-quobyte-a8b43a60-58be-4897-8514-e9d7b9ce119b-0c3a9c90-84c5-4c9d-bab8-7fa233696a53" by "_create_volume_from_snapshot" {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 05:00:47 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-16bfa564-c667-446e-9924-58fbbae2e9c9 tempest-VolumeDependencyTests-1771129830 None] Lock "cinder-quobyte-a8b43a60-58be-4897-8514-e9d7b9ce119b-0c3a9c90-84c5-4c9d-bab8-7fa233696a53" acquired by "_create_volume_from_snapshot" :: waited 0.017s {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 05:00:47 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-16bfa564-c667-446e-9924-58fbbae2e9c9 tempest-VolumeDependencyTests-1771129830 None] Creating volume 0c3a9c90-84c5-4c9d-bab8-7fa233696a53 from snapshot a8b43a60-58be-4897-8514-e9d7b9ce119b {{(pid=92060) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jun 17 05:00:48 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-16bfa564-c667-446e-9924-58fbbae2e9c9 tempest-VolumeDependencyTests-1771129830 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 05:00:48 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-16bfa564-c667-446e-9924-58fbbae2e9c9 tempest-VolumeDependencyTests-1771129830 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.007s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 05:00:48 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-16bfa564-c667-446e-9924-58fbbae2e9c9 tempest-VolumeDependencyTests-1771129830 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588': None} {{(pid=92060) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 17 05:00:48 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-16bfa564-c667-446e-9924-58fbbae2e9c9 tempest-VolumeDependencyTests-1771129830 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588'] {{(pid=92060) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 17 05:00:48 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-16bfa564-c667-446e-9924-58fbbae2e9c9 tempest-VolumeDependencyTests-1771129830 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 05:00:48 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-16bfa564-c667-446e-9924-58fbbae2e9c9 tempest-VolumeDependencyTests-1771129830 None] Selected osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588 as target Quobyte volume. {{(pid=92060) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 17 05:00:48 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-16bfa564-c667-446e-9924-58fbbae2e9c9 tempest-VolumeDependencyTests-1771129830 None] Acquiring lock "cinder-quobyte-0c3a9c90-84c5-4c9d-bab8-7fa233696a53" by "_copy_volume_from_snapshot" {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 05:00:48 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-16bfa564-c667-446e-9924-58fbbae2e9c9 tempest-VolumeDependencyTests-1771129830 None] Lock "cinder-quobyte-0c3a9c90-84c5-4c9d-bab8-7fa233696a53" acquired by "_copy_volume_from_snapshot" :: waited 0.018s {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 05:00:48 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-16bfa564-c667-446e-9924-58fbbae2e9c9 tempest-VolumeDependencyTests-1771129830 None] snapshot: a8b43a60-58be-4897-8514-e9d7b9ce119b, volume: 0c3a9c90-84c5-4c9d-bab8-7fa233696a53, {{(pid=92060) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jun 17 05:00:48 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-16bfa564-c667-446e-9924-58fbbae2e9c9 tempest-VolumeDependencyTests-1771129830 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 05:00:48 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-16bfa564-c667-446e-9924-58fbbae2e9c9 tempest-VolumeDependencyTests-1771129830 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 05:00:48 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-16bfa564-c667-446e-9924-58fbbae2e9c9 tempest-VolumeDependencyTests-1771129830 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588': None} {{(pid=92060) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 17 05:00:48 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-16bfa564-c667-446e-9924-58fbbae2e9c9 tempest-VolumeDependencyTests-1771129830 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588'] {{(pid=92060) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 17 05:00:48 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-16bfa564-c667-446e-9924-58fbbae2e9c9 tempest-VolumeDependencyTests-1771129830 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 05:00:48 devstack cinder-volume[92060]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba4bbd53-f14a-4d58-a6e9-ad20ada50d99]: (4, 'qcow2') {{(pid=93130) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 05:00:48 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-16bfa564-c667-446e-9924-58fbbae2e9c9 tempest-VolumeDependencyTests-1771129830 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-cff360d3-eb46-418a-80af-d7fb08ca9fe4.a8b43a60-58be-4897-8514-e9d7b9ce119b {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:00:48 devstack sudo[111683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-cff360d3-eb46-418a-80af-d7fb08ca9fe4.a8b43a60-58be-4897-8514-e9d7b9ce119b Jun 17 05:00:48 devstack sudo[111683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:00:48 devstack sudo[111681]: pam_unix(sudo:session): session closed for user root Jun 17 05:00:48 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-9b4da57b-ce99-4978-acda-a5525e7d8614 tempest-CinderUnicodeTest-1057368418 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-751528c8-62bf-4dd6-8857-b9136f21fae6" returned: 0 in 0.777s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:00:48 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-9b4da57b-ce99-4978-acda-a5525e7d8614 tempest-CinderUnicodeTest-1057368418 None] Lock "cinder-quobyte-751528c8-62bf-4dd6-8857-b9136f21fae6" released by "delete_volume" :: held 1.712s {{(pid=92060) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 05:00:48 devstack cinder-volume[92060]: DEBUG cinder.quota [None req-9b4da57b-ce99-4978-acda-a5525e7d8614 tempest-CinderUnicodeTest-1057368418 None] Created reservations ['5a79a53b-5da2-4c7a-8f1c-0c5470d931e9', '8042f266-cfc4-4f8e-9a3a-0637211c45d3', '02a69a79-af45-48c7-a252-84decb81e234', '31b7f6a2-10e4-43f5-b868-3fe430121784'] {{(pid=92060) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 17 05:00:48 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-9b4da57b-ce99-4978-acda-a5525e7d8614 tempest-CinderUnicodeTest-1057368418 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 05:00:48 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-9b4da57b-ce99-4978-acda-a5525e7d8614 tempest-CinderUnicodeTest-1057368418 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 05:00:48 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-9b4da57b-ce99-4978-acda-a5525e7d8614 tempest-CinderUnicodeTest-1057368418 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588': None} {{(pid=92060) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 17 05:00:48 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-9b4da57b-ce99-4978-acda-a5525e7d8614 tempest-CinderUnicodeTest-1057368418 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588'] {{(pid=92060) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 17 05:00:48 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-9b4da57b-ce99-4978-acda-a5525e7d8614 tempest-CinderUnicodeTest-1057368418 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 05:00:48 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-9b4da57b-ce99-4978-acda-a5525e7d8614 tempest-CinderUnicodeTest-1057368418 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:00:48 devstack sudo[111686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a Jun 17 05:00:48 devstack sudo[111686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:00:48 devstack cinder-volume[92060]: DEBUG cinder.volume.flows.manager.create_volume [None req-d8818396-10bb-4f2d-bfdc-476d25bfdec9 tempest-CreateVolumesFromSnapshotTest-393697735 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92060) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 17 05:00:48 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-d8818396-10bb-4f2d-bfdc-476d25bfdec9 tempest-CreateVolumesFromSnapshotTest-393697735 None] Flow 'volume_create_manager' (f359a739-ddeb-4f66-b1f8-fb00d15dcdd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 17 05:00:48 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-d8818396-10bb-4f2d-bfdc-476d25bfdec9 tempest-CreateVolumesFromSnapshotTest-393697735 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4bd8f6d6-945e-4fa5-aa7b-c9d335144154) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:00:48 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-d8818396-10bb-4f2d-bfdc-476d25bfdec9 tempest-CreateVolumesFromSnapshotTest-393697735 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4bd8f6d6-945e-4fa5-aa7b-c9d335144154) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-17T03:00:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-185320887',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2e021f8d-2755-45ac-becc-c4fd16820102,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2d762ee5566b4bd49583fbd277b6ac45',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T03:00:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T03:00:49Z,use_quota=True,user_id='ee60c55e2c884578be289313c0eb57b4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aad9ce24-93f9-41a6-baa1-5125964f96d1),volume_type_id=aad9ce24-93f9-41a6-baa1-5125964f96d1)' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:00:48 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-d8818396-10bb-4f2d-bfdc-476d25bfdec9 tempest-CreateVolumesFromSnapshotTest-393697735 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c8a7f6d6-440a-4e9a-af03-875aef764570) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:00:48 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-d8818396-10bb-4f2d-bfdc-476d25bfdec9 tempest-CreateVolumesFromSnapshotTest-393697735 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c8a7f6d6-440a-4e9a-af03-875aef764570) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:00:48 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-d8818396-10bb-4f2d-bfdc-476d25bfdec9 tempest-CreateVolumesFromSnapshotTest-393697735 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6f5a75c5-aa70-4686-aedf-8f692aa06cb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:00:48 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-d8818396-10bb-4f2d-bfdc-476d25bfdec9 tempest-CreateVolumesFromSnapshotTest-393697735 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6f5a75c5-aa70-4686-aedf-8f692aa06cb1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2e021f8d-2755-45ac-becc-c4fd16820102', 'volume_name': 'volume-2e021f8d-2755-45ac-becc-c4fd16820102', 'volume_size': 1}' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:00:48 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-d8818396-10bb-4f2d-bfdc-476d25bfdec9 tempest-CreateVolumesFromSnapshotTest-393697735 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bb39ef8c-e387-45b3-8201-98653d30524a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:00:48 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-d8818396-10bb-4f2d-bfdc-476d25bfdec9 tempest-CreateVolumesFromSnapshotTest-393697735 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bb39ef8c-e387-45b3-8201-98653d30524a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:00:48 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-d8818396-10bb-4f2d-bfdc-476d25bfdec9 tempest-CreateVolumesFromSnapshotTest-393697735 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (84fc5a23-497c-48fe-94e8-1749b363e175) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:00:48 devstack cinder-volume[92060]: INFO cinder.volume.flows.manager.create_volume [None req-d8818396-10bb-4f2d-bfdc-476d25bfdec9 tempest-CreateVolumesFromSnapshotTest-393697735 None] Volume 2e021f8d-2755-45ac-becc-c4fd16820102: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2e021f8d-2755-45ac-becc-c4fd16820102', 'volume_size': 1} Jun 17 05:00:48 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-d8818396-10bb-4f2d-bfdc-476d25bfdec9 tempest-CreateVolumesFromSnapshotTest-393697735 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 05:00:48 devstack sudo[111683]: pam_unix(sudo:session): session closed for user root Jun 17 05:00:48 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-16bfa564-c667-446e-9924-58fbbae2e9c9 tempest-VolumeDependencyTests-1771129830 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-cff360d3-eb46-418a-80af-d7fb08ca9fe4.a8b43a60-58be-4897-8514-e9d7b9ce119b" returned: 0 in 0.880s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:00:48 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.remotefs [None req-16bfa564-c667-446e-9924-58fbbae2e9c9 tempest-VolumeDependencyTests-1771129830 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cff360d3-eb46-418a-80af-d7fb08ca9fe4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=92060) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 17 05:00:48 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-16bfa564-c667-446e-9924-58fbbae2e9c9 tempest-VolumeDependencyTests-1771129830 None] will copy from snapshot at /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-cff360d3-eb46-418a-80af-d7fb08ca9fe4 {{(pid=92060) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jun 17 05:00:48 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-16bfa564-c667-446e-9924-58fbbae2e9c9 tempest-VolumeDependencyTests-1771129830 None] Creating direct copy from snapshot {{(pid=92060) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jun 17 05:00:48 devstack cinder-volume[92060]: DEBUG oslo.privsep.daemon [-] privsep: reply[abde3370-527a-4a3a-9c55-40c1baa5ddc1]: (4, 'qcow2') {{(pid=93130) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 05:00:48 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-16bfa564-c667-446e-9924-58fbbae2e9c9 tempest-VolumeDependencyTests-1771129830 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-cff360d3-eb46-418a-80af-d7fb08ca9fe4 {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:00:49 devstack sudo[111692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-cff360d3-eb46-418a-80af-d7fb08ca9fe4 Jun 17 05:00:49 devstack sudo[111692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:00:49 devstack sudo[111686]: pam_unix(sudo:session): session closed for user root Jun 17 05:00:49 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-9b4da57b-ce99-4978-acda-a5525e7d8614 tempest-CinderUnicodeTest-1057368418 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a" returned: 0 in 0.686s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:00:49 devstack cinder-volume[92060]: DEBUG cinder.manager [None req-9b4da57b-ce99-4978-acda-a5525e7d8614 tempest-CinderUnicodeTest-1057368418 None] Notifying Schedulers of capabilities ... {{(pid=92060) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 17 05:00:49 devstack cinder-volume[92060]: INFO cinder.volume.manager [None req-9b4da57b-ce99-4978-acda-a5525e7d8614 tempest-CinderUnicodeTest-1057368418 None] Deleted volume successfully. Jun 17 05:00:49 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-9b4da57b-ce99-4978-acda-a5525e7d8614 tempest-CinderUnicodeTest-1057368418 None] Lock "cinder-751528c8-62bf-4dd6-8857-b9136f21fae6-delete_volume" released by "delete_volume" :: held 2.680s {{(pid=92060) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 05:00:49 devstack sudo[111692]: pam_unix(sudo:session): session closed for user root Jun 17 05:00:49 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-16bfa564-c667-446e-9924-58fbbae2e9c9 tempest-VolumeDependencyTests-1771129830 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-cff360d3-eb46-418a-80af-d7fb08ca9fe4" returned: 0 in 0.800s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:00:49 devstack cinder-volume[92060]: DEBUG cinder.utils [None req-16bfa564-c667-446e-9924-58fbbae2e9c9 tempest-VolumeDependencyTests-1771129830 None] Path /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-0c3a9c90-84c5-4c9d-bab8-7fa233696a53 not found in is_blk_device check {{(pid=92060) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jun 17 05:00:49 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-16bfa564-c667-446e-9924-58fbbae2e9c9 tempest-VolumeDependencyTests-1771129830 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-cff360d3-eb46-418a-80af-d7fb08ca9fe4 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-0c3a9c90-84c5-4c9d-bab8-7fa233696a53 {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:00:49 devstack sudo[111699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-cff360d3-eb46-418a-80af-d7fb08ca9fe4 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-0c3a9c90-84c5-4c9d-bab8-7fa233696a53 Jun 17 05:00:49 devstack sudo[111699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:00:52 devstack cinder-volume[92060]: DEBUG cinder.volume.flows.manager.create_volume [None req-b0cb9aff-118e-495e-8dbd-167d5e13f1ac tempest-VolumeImageDependencyTests-718285973 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92060) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 17 05:00:52 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-b0cb9aff-118e-495e-8dbd-167d5e13f1ac tempest-VolumeImageDependencyTests-718285973 None] Flow 'volume_create_manager' (bb0dd529-c482-45f6-ba72-1a945e8da61f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 17 05:00:52 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-b0cb9aff-118e-495e-8dbd-167d5e13f1ac tempest-VolumeImageDependencyTests-718285973 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bcd12187-7bac-41f7-b9c5-739671ed6f59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:00:52 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-b0cb9aff-118e-495e-8dbd-167d5e13f1ac tempest-VolumeImageDependencyTests-718285973 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bcd12187-7bac-41f7-b9c5-739671ed6f59) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-17T03:00:52Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dc973c6e-1918-4c9a-97e7-76c385669ed6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d93d5c043a9141bca86279887cbcf684',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T03:00:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T03:00:52Z,use_quota=True,user_id='0205bebf1b234d5782ba5006b580192c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aad9ce24-93f9-41a6-baa1-5125964f96d1),volume_type_id=aad9ce24-93f9-41a6-baa1-5125964f96d1)' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:00:52 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-b0cb9aff-118e-495e-8dbd-167d5e13f1ac tempest-VolumeImageDependencyTests-718285973 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8e7a1d10-9d46-46ea-8d60-1b8bf79e7558) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:00:52 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-b0cb9aff-118e-495e-8dbd-167d5e13f1ac tempest-VolumeImageDependencyTests-718285973 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8e7a1d10-9d46-46ea-8d60-1b8bf79e7558) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:00:52 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-b0cb9aff-118e-495e-8dbd-167d5e13f1ac tempest-VolumeImageDependencyTests-718285973 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (617c8886-e767-47ca-a794-85dfd0704494) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:00:52 devstack cinder-volume[92060]: DEBUG cinder.image.glance [None req-b0cb9aff-118e-495e-8dbd-167d5e13f1ac tempest-VolumeImageDependencyTests-718285973 None] Creating Keystone auth plugin from conf {{(pid=92060) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jun 17 05:00:52 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-b0cb9aff-118e-495e-8dbd-167d5e13f1ac tempest-VolumeImageDependencyTests-718285973 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (617c8886-e767-47ca-a794-85dfd0704494) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'dc973c6e-1918-4c9a-97e7-76c385669ed6', 'volume_name': 'volume-dc973c6e-1918-4c9a-97e7-76c385669ed6', 'volume_size': 1, 'image_id': 'd0a6d6dc-c27b-4f93-a63d-d9d375d24c5c', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d0a6d6dc-c27b-4f93-a63d-d9d375d24c5c', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'f7b8e4a2a9c5a40b81c3f4737bc68ff2', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'd93d5c043a9141bca86279887cbcf684', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '10a4286b35d5e1e8a71496276c07ae62d0bcc8542ee7d705381076963e16ddb3c6a32aaecae778ee8aea98a1a62b7c35a571b649616b2ebab78df0e3b46dd9d0', 'id': 'd0a6d6dc-c27b-4f93-a63d-d9d375d24c5c', 'created_at': datetime.datetime(2026, 6, 17, 3, 0, 49, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 17, 3, 0, 51, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d0a6d6dc-c27b-4f93-a63d-d9d375d24c5c/file', 'properties': {}}, 'image_service': }' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:00:52 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-b0cb9aff-118e-495e-8dbd-167d5e13f1ac tempest-VolumeImageDependencyTests-718285973 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b827de50-139c-4fda-89bb-590dc0918f15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:00:52 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-b0cb9aff-118e-495e-8dbd-167d5e13f1ac tempest-VolumeImageDependencyTests-718285973 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b827de50-139c-4fda-89bb-590dc0918f15) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:00:52 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-b0cb9aff-118e-495e-8dbd-167d5e13f1ac tempest-VolumeImageDependencyTests-718285973 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (644ddd90-150b-46cc-bffb-43317cb48473) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:00:52 devstack cinder-volume[92060]: INFO cinder.volume.flows.manager.create_volume [None req-b0cb9aff-118e-495e-8dbd-167d5e13f1ac tempest-VolumeImageDependencyTests-718285973 None] Volume dc973c6e-1918-4c9a-97e7-76c385669ed6: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-dc973c6e-1918-4c9a-97e7-76c385669ed6', 'volume_size': 1, 'image_id': 'd0a6d6dc-c27b-4f93-a63d-d9d375d24c5c', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d0a6d6dc-c27b-4f93-a63d-d9d375d24c5c', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'f7b8e4a2a9c5a40b81c3f4737bc68ff2', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'd93d5c043a9141bca86279887cbcf684', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '10a4286b35d5e1e8a71496276c07ae62d0bcc8542ee7d705381076963e16ddb3c6a32aaecae778ee8aea98a1a62b7c35a571b649616b2ebab78df0e3b46dd9d0', 'id': 'd0a6d6dc-c27b-4f93-a63d-d9d375d24c5c', 'created_at': datetime.datetime(2026, 6, 17, 3, 0, 49, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 17, 3, 0, 51, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d0a6d6dc-c27b-4f93-a63d-d9d375d24c5c/file', 'properties': {}}, 'image_service': } Jun 17 05:00:52 devstack cinder-volume[92060]: DEBUG cinder.volume.flows.manager.create_volume [None req-b0cb9aff-118e-495e-8dbd-167d5e13f1ac tempest-VolumeImageDependencyTests-718285973 None] Trying to clone dc973c6e-1918-4c9a-97e7-76c385669ed6 from image d0a6d6dc-c27b-4f93-a63d-d9d375d24c5c at location (None, [{'url': 'file:///opt/stack/data/glance/images/d0a6d6dc-c27b-4f93-a63d-d9d375d24c5c', 'metadata': {}}]). {{(pid=92060) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jun 17 05:00:52 devstack cinder-volume[92060]: DEBUG cinder.image.image_utils [None req-b0cb9aff-118e-495e-8dbd-167d5e13f1ac tempest-VolumeImageDependencyTests-718285973 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_d0a6d6dc-c27b-4f93-a63d-d9d375d24c5c_8a4aun8jdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=92060) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jun 17 05:00:52 devstack cinder-volume[92060]: INFO cinder.image.image_utils [None req-b0cb9aff-118e-495e-8dbd-167d5e13f1ac tempest-VolumeImageDependencyTests-718285973 None] Image download 0.00 MB at 0.00 MB/s Jun 17 05:00:53 devstack cinder-volume[92060]: DEBUG oslo.privsep.daemon [-] privsep: reply[7249e192-6bc6-4755-bba8-435ee2a69d2d]: (4, 'raw') {{(pid=93130) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 05:00:53 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-b0cb9aff-118e-495e-8dbd-167d5e13f1ac tempest-VolumeImageDependencyTests-718285973 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_d0a6d6dc-c27b-4f93-a63d-d9d375d24c5c_8a4aun8jdevstack@QuobyteHD {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:00:53 devstack sudo[111713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_d0a6d6dc-c27b-4f93-a63d-d9d375d24c5c_8a4aun8jdevstack@QuobyteHD Jun 17 05:00:53 devstack sudo[111713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:00:54 devstack sudo[111713]: pam_unix(sudo:session): session closed for user root Jun 17 05:00:54 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-b0cb9aff-118e-495e-8dbd-167d5e13f1ac tempest-VolumeImageDependencyTests-718285973 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_d0a6d6dc-c27b-4f93-a63d-d9d375d24c5c_8a4aun8jdevstack@QuobyteHD" returned: 0 in 1.620s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:00:54 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-b0cb9aff-118e-495e-8dbd-167d5e13f1ac tempest-VolumeImageDependencyTests-718285973 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d0a6d6dc-c27b-4f93-a63d-d9d375d24c5c_8a4aun8jdevstack@QuobyteHD {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:00:54 devstack sudo[111717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d0a6d6dc-c27b-4f93-a63d-d9d375d24c5c_8a4aun8jdevstack@QuobyteHD Jun 17 05:00:54 devstack sudo[111717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:00:55 devstack sudo[111717]: pam_unix(sudo:session): session closed for user root Jun 17 05:00:55 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-b0cb9aff-118e-495e-8dbd-167d5e13f1ac tempest-VolumeImageDependencyTests-718285973 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d0a6d6dc-c27b-4f93-a63d-d9d375d24c5c_8a4aun8jdevstack@QuobyteHD" returned: 1 in 1.043s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:00:55 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-b0cb9aff-118e-495e-8dbd-167d5e13f1ac tempest-VolumeImageDependencyTests-718285973 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d0a6d6dc-c27b-4f93-a63d-d9d375d24c5c_8a4aun8jdevstack@QuobyteHD' failed. Not Retrying. {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 17 05:00:55 devstack cinder-volume[92060]: DEBUG cinder.image.image_utils [None req-b0cb9aff-118e-495e-8dbd-167d5e13f1ac tempest-VolumeImageDependencyTests-718285973 None] Temporary image d0a6d6dc-c27b-4f93-a63d-d9d375d24c5c is fetched for user 0205bebf1b234d5782ba5006b580192c. {{(pid=92060) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jun 17 05:00:55 devstack sudo[111699]: pam_unix(sudo:session): session closed for user root Jun 17 05:00:55 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-16bfa564-c667-446e-9924-58fbbae2e9c9 tempest-VolumeDependencyTests-1771129830 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-cff360d3-eb46-418a-80af-d7fb08ca9fe4 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-0c3a9c90-84c5-4c9d-bab8-7fa233696a53" returned: 0 in 5.998s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:00:55 devstack cinder-volume[92060]: DEBUG oslo.privsep.daemon [-] privsep: reply[2be1f22a-c711-4950-b0b8-5f5399864699]: (4, 'qcow2') {{(pid=93130) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 05:00:55 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-16bfa564-c667-446e-9924-58fbbae2e9c9 tempest-VolumeDependencyTests-1771129830 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-cff360d3-eb46-418a-80af-d7fb08ca9fe4 {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:00:55 devstack cinder-volume[92060]: DEBUG oslo.privsep.daemon [-] privsep: reply[1dabf705-82f5-4f92-9311-74cb93368ae7]: (4, 'raw') {{(pid=93130) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 05:00:55 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-b0cb9aff-118e-495e-8dbd-167d5e13f1ac tempest-VolumeImageDependencyTests-718285973 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_d0a6d6dc-c27b-4f93-a63d-d9d375d24c5c_8a4aun8jdevstack@QuobyteHD {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:00:55 devstack sudo[111722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-cff360d3-eb46-418a-80af-d7fb08ca9fe4 Jun 17 05:00:55 devstack sudo[111722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:00:55 devstack sudo[111723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_d0a6d6dc-c27b-4f93-a63d-d9d375d24c5c_8a4aun8jdevstack@QuobyteHD Jun 17 05:00:55 devstack sudo[111723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:00:56 devstack sudo[111723]: pam_unix(sudo:session): session closed for user root Jun 17 05:00:56 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-b0cb9aff-118e-495e-8dbd-167d5e13f1ac tempest-VolumeImageDependencyTests-718285973 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_d0a6d6dc-c27b-4f93-a63d-d9d375d24c5c_8a4aun8jdevstack@QuobyteHD" returned: 0 in 0.681s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:00:56 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-b0cb9aff-118e-495e-8dbd-167d5e13f1ac tempest-VolumeImageDependencyTests-718285973 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d0a6d6dc-c27b-4f93-a63d-d9d375d24c5c_8a4aun8jdevstack@QuobyteHD {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:00:56 devstack sudo[111730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d0a6d6dc-c27b-4f93-a63d-d9d375d24c5c_8a4aun8jdevstack@QuobyteHD Jun 17 05:00:56 devstack sudo[111730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:00:56 devstack sudo[111722]: pam_unix(sudo:session): session closed for user root Jun 17 05:00:56 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-16bfa564-c667-446e-9924-58fbbae2e9c9 tempest-VolumeDependencyTests-1771129830 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-cff360d3-eb46-418a-80af-d7fb08ca9fe4" returned: 0 in 0.955s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:00:56 devstack cinder-volume[92060]: DEBUG cinder.image.image_utils [None req-16bfa564-c667-446e-9924-58fbbae2e9c9 tempest-VolumeDependencyTests-1771129830 None] Image conversion details: src /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-cff360d3-eb46-418a-80af-d7fb08ca9fe4, size 1024.00 MB, duration 6.00 sec, destination /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-0c3a9c90-84c5-4c9d-bab8-7fa233696a53 {{(pid=92060) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 17 05:00:56 devstack cinder-volume[92060]: INFO cinder.image.image_utils [None req-16bfa564-c667-446e-9924-58fbbae2e9c9 tempest-VolumeDependencyTests-1771129830 None] Converted 1024.00 MB image at 170.69 MB/s Jun 17 05:00:56 devstack cinder-volume[92060]: WARNING cinder.volume.drivers.remotefs [None req-16bfa564-c667-446e-9924-58fbbae2e9c9 tempest-VolumeDependencyTests-1771129830 None] /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-0c3a9c90-84c5-4c9d-bab8-7fa233696a53 is being set with open permissions: ugo+rw Jun 17 05:00:56 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-16bfa564-c667-446e-9924-58fbbae2e9c9 tempest-VolumeDependencyTests-1771129830 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-0c3a9c90-84c5-4c9d-bab8-7fa233696a53 {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:00:56 devstack sudo[111733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-0c3a9c90-84c5-4c9d-bab8-7fa233696a53 Jun 17 05:00:56 devstack sudo[111733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:00:57 devstack sudo[111730]: pam_unix(sudo:session): session closed for user root Jun 17 05:00:57 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-b0cb9aff-118e-495e-8dbd-167d5e13f1ac tempest-VolumeImageDependencyTests-718285973 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d0a6d6dc-c27b-4f93-a63d-d9d375d24c5c_8a4aun8jdevstack@QuobyteHD" returned: 1 in 0.742s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:00:57 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-b0cb9aff-118e-495e-8dbd-167d5e13f1ac tempest-VolumeImageDependencyTests-718285973 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d0a6d6dc-c27b-4f93-a63d-d9d375d24c5c_8a4aun8jdevstack@QuobyteHD' failed. Not Retrying. {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 17 05:00:57 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-b0cb9aff-118e-495e-8dbd-167d5e13f1ac tempest-VolumeImageDependencyTests-718285973 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 05:00:57 devstack sudo[111733]: pam_unix(sudo:session): session closed for user root Jun 17 05:00:57 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-16bfa564-c667-446e-9924-58fbbae2e9c9 tempest-VolumeDependencyTests-1771129830 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-0c3a9c90-84c5-4c9d-bab8-7fa233696a53" returned: 0 in 0.664s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:00:57 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-16bfa564-c667-446e-9924-58fbbae2e9c9 tempest-VolumeDependencyTests-1771129830 None] Lock "cinder-quobyte-0c3a9c90-84c5-4c9d-bab8-7fa233696a53" released by "_copy_volume_from_snapshot" :: held 9.409s {{(pid=92060) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 05:00:57 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-16bfa564-c667-446e-9924-58fbbae2e9c9 tempest-VolumeDependencyTests-1771129830 None] Lock "cinder-quobyte-a8b43a60-58be-4897-8514-e9d7b9ce119b-0c3a9c90-84c5-4c9d-bab8-7fa233696a53" released by "_create_volume_from_snapshot" :: held 9.452s {{(pid=92060) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 05:00:57 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-16bfa564-c667-446e-9924-58fbbae2e9c9 tempest-VolumeDependencyTests-1771129830 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.470s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 05:00:57 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-d8818396-10bb-4f2d-bfdc-476d25bfdec9 tempest-CreateVolumesFromSnapshotTest-393697735 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.592s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 05:00:57 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-d8818396-10bb-4f2d-bfdc-476d25bfdec9 tempest-CreateVolumesFromSnapshotTest-393697735 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-17T03:00:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-185320887',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2e021f8d-2755-45ac-becc-c4fd16820102,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2d762ee5566b4bd49583fbd277b6ac45',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T03:00:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T03:00:49Z,use_quota=True,user_id='ee60c55e2c884578be289313c0eb57b4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aad9ce24-93f9-41a6-baa1-5125964f96d1),volume_type_id=aad9ce24-93f9-41a6-baa1-5125964f96d1)}" {{(pid=92060) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 17 05:00:57 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.remotefs [None req-d8818396-10bb-4f2d-bfdc-476d25bfdec9 tempest-CreateVolumesFromSnapshotTest-393697735 None] Creating volume 2e021f8d-2755-45ac-becc-c4fd16820102 {{(pid=92060) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 17 05:00:57 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-d8818396-10bb-4f2d-bfdc-476d25bfdec9 tempest-CreateVolumesFromSnapshotTest-393697735 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 05:00:57 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-d8818396-10bb-4f2d-bfdc-476d25bfdec9 tempest-CreateVolumesFromSnapshotTest-393697735 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 05:00:57 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-d8818396-10bb-4f2d-bfdc-476d25bfdec9 tempest-CreateVolumesFromSnapshotTest-393697735 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588': None} {{(pid=92060) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 17 05:00:57 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-d8818396-10bb-4f2d-bfdc-476d25bfdec9 tempest-CreateVolumesFromSnapshotTest-393697735 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588'] {{(pid=92060) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 17 05:00:57 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-d8818396-10bb-4f2d-bfdc-476d25bfdec9 tempest-CreateVolumesFromSnapshotTest-393697735 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 05:00:57 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-d8818396-10bb-4f2d-bfdc-476d25bfdec9 tempest-CreateVolumesFromSnapshotTest-393697735 None] Selected osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588 as target Quobyte volume. {{(pid=92060) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 17 05:00:57 devstack cinder-volume[92060]: INFO cinder.volume.drivers.remotefs [None req-d8818396-10bb-4f2d-bfdc-476d25bfdec9 tempest-CreateVolumesFromSnapshotTest-393697735 None] casted to osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588 Jun 17 05:00:57 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-d8818396-10bb-4f2d-bfdc-476d25bfdec9 tempest-CreateVolumesFromSnapshotTest-393697735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-2e021f8d-2755-45ac-becc-c4fd16820102 1073741824 {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:00:57 devstack sudo[111739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-2e021f8d-2755-45ac-becc-c4fd16820102 1073741824 Jun 17 05:00:57 devstack sudo[111739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:00:57 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-16bfa564-c667-446e-9924-58fbbae2e9c9 tempest-VolumeDependencyTests-1771129830 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7b2c9b6a-7314-4962-a051-b080c5c235bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0c3a9c90-84c5-4c9d-bab8-7fa233696a53', 'volume_size': 1, 'snapshot_id': 'a8b43a60-58be-4897-8514-e9d7b9ce119b'}' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:00:57 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-16bfa564-c667-446e-9924-58fbbae2e9c9 tempest-VolumeDependencyTests-1771129830 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ea315e5e-5b67-403c-bb6e-b5c575041220) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:00:57 devstack cinder-volume[92060]: INFO cinder.volume.flows.manager.create_volume [None req-16bfa564-c667-446e-9924-58fbbae2e9c9 tempest-VolumeDependencyTests-1771129830 None] Volume volume-0c3a9c90-84c5-4c9d-bab8-7fa233696a53 (0c3a9c90-84c5-4c9d-bab8-7fa233696a53): created successfully Jun 17 05:00:57 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-16bfa564-c667-446e-9924-58fbbae2e9c9 tempest-VolumeDependencyTests-1771129830 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ea315e5e-5b67-403c-bb6e-b5c575041220) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:00:57 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-16bfa564-c667-446e-9924-58fbbae2e9c9 tempest-VolumeDependencyTests-1771129830 None] Flow 'volume_create_manager' (80ceb94f-36d6-4db7-8e60-cfacc806c149) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92060) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 17 05:00:57 devstack cinder-volume[92060]: INFO cinder.volume.manager [None req-16bfa564-c667-446e-9924-58fbbae2e9c9 tempest-VolumeDependencyTests-1771129830 None] Created volume successfully. Jun 17 05:00:58 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-f35b6fef-ca0f-4461-a149-fdaf009b5061 tempest-VolumeDependencyTests-1771129830 None] Acquiring lock "cinder-a8b43a60-58be-4897-8514-e9d7b9ce119b-delete_snapshot" by "delete_snapshot" {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 05:00:58 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-f35b6fef-ca0f-4461-a149-fdaf009b5061 tempest-VolumeDependencyTests-1771129830 None] Lock "cinder-a8b43a60-58be-4897-8514-e9d7b9ce119b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 05:00:58 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-f35b6fef-ca0f-4461-a149-fdaf009b5061 tempest-VolumeDependencyTests-1771129830 None] Acquiring lock "cinder-quobyte-cff360d3-eb46-418a-80af-d7fb08ca9fe4" by "delete_snapshot" {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 05:00:58 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-f35b6fef-ca0f-4461-a149-fdaf009b5061 tempest-VolumeDependencyTests-1771129830 None] Lock "cinder-quobyte-cff360d3-eb46-418a-80af-d7fb08ca9fe4" acquired by "delete_snapshot" :: waited 0.019s {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 05:00:58 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-f35b6fef-ca0f-4461-a149-fdaf009b5061 tempest-VolumeDependencyTests-1771129830 None] Acquiring lock "cinder-quobyte-a8b43a60-58be-4897-8514-e9d7b9ce119b" by "_delete_snapshot" {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 05:00:58 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-f35b6fef-ca0f-4461-a149-fdaf009b5061 tempest-VolumeDependencyTests-1771129830 None] Lock "cinder-quobyte-a8b43a60-58be-4897-8514-e9d7b9ce119b" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 05:00:58 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.remotefs [None req-f35b6fef-ca0f-4461-a149-fdaf009b5061 tempest-VolumeDependencyTests-1771129830 None] Deleting offline snapshot a8b43a60-58be-4897-8514-e9d7b9ce119b of volume cff360d3-eb46-418a-80af-d7fb08ca9fe4 {{(pid=92060) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 17 05:00:58 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.remotefs [None req-f35b6fef-ca0f-4461-a149-fdaf009b5061 tempest-VolumeDependencyTests-1771129830 None] snapshot_file for this snap is: volume-cff360d3-eb46-418a-80af-d7fb08ca9fe4.a8b43a60-58be-4897-8514-e9d7b9ce119b {{(pid=92060) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 17 05:00:58 devstack cinder-volume[92060]: DEBUG oslo.privsep.daemon [-] privsep: reply[5770ee34-2c6b-4997-a9e8-c83b463bce57]: (4, 'qcow2') {{(pid=93130) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 05:00:58 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-f35b6fef-ca0f-4461-a149-fdaf009b5061 tempest-VolumeDependencyTests-1771129830 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-cff360d3-eb46-418a-80af-d7fb08ca9fe4.a8b43a60-58be-4897-8514-e9d7b9ce119b {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:00:58 devstack sudo[111744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-cff360d3-eb46-418a-80af-d7fb08ca9fe4.a8b43a60-58be-4897-8514-e9d7b9ce119b Jun 17 05:00:58 devstack sudo[111744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:00:58 devstack sudo[111739]: pam_unix(sudo:session): session closed for user root Jun 17 05:00:58 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-d8818396-10bb-4f2d-bfdc-476d25bfdec9 tempest-CreateVolumesFromSnapshotTest-393697735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-2e021f8d-2755-45ac-becc-c4fd16820102 1073741824" returned: 0 in 0.908s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:00:58 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-d8818396-10bb-4f2d-bfdc-476d25bfdec9 tempest-CreateVolumesFromSnapshotTest-393697735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-2e021f8d-2755-45ac-becc-c4fd16820102 {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:00:58 devstack sudo[111747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-2e021f8d-2755-45ac-becc-c4fd16820102 Jun 17 05:00:58 devstack sudo[111747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:00:58 devstack sudo[111744]: pam_unix(sudo:session): session closed for user root Jun 17 05:00:58 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-f35b6fef-ca0f-4461-a149-fdaf009b5061 tempest-VolumeDependencyTests-1771129830 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-cff360d3-eb46-418a-80af-d7fb08ca9fe4.a8b43a60-58be-4897-8514-e9d7b9ce119b" returned: 0 in 0.755s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:00:58 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.remotefs [None req-f35b6fef-ca0f-4461-a149-fdaf009b5061 tempest-VolumeDependencyTests-1771129830 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cff360d3-eb46-418a-80af-d7fb08ca9fe4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=92060) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 17 05:00:58 devstack cinder-volume[92060]: DEBUG oslo.privsep.daemon [-] privsep: reply[f28761c8-8684-4d4c-919d-67c6e531ed55]: (4, 'qcow2') {{(pid=93130) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 05:00:58 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-f35b6fef-ca0f-4461-a149-fdaf009b5061 tempest-VolumeDependencyTests-1771129830 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-cff360d3-eb46-418a-80af-d7fb08ca9fe4 {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:00:59 devstack sudo[111752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-cff360d3-eb46-418a-80af-d7fb08ca9fe4 Jun 17 05:00:59 devstack sudo[111752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:00:59 devstack sudo[111747]: pam_unix(sudo:session): session closed for user root Jun 17 05:00:59 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-d8818396-10bb-4f2d-bfdc-476d25bfdec9 tempest-CreateVolumesFromSnapshotTest-393697735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-2e021f8d-2755-45ac-becc-c4fd16820102" returned: 0 in 0.656s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:00:59 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-d8818396-10bb-4f2d-bfdc-476d25bfdec9 tempest-CreateVolumesFromSnapshotTest-393697735 None] <== create_volume: return (1614ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588'} {{(pid=92060) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 17 05:00:59 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-d8818396-10bb-4f2d-bfdc-476d25bfdec9 tempest-CreateVolumesFromSnapshotTest-393697735 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.616s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 05:00:59 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-b0cb9aff-118e-495e-8dbd-167d5e13f1ac tempest-VolumeImageDependencyTests-718285973 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.802s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 05:00:59 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-b0cb9aff-118e-495e-8dbd-167d5e13f1ac tempest-VolumeImageDependencyTests-718285973 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-17T03:00:52Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dc973c6e-1918-4c9a-97e7-76c385669ed6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d93d5c043a9141bca86279887cbcf684',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T03:00:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T03:00:52Z,use_quota=True,user_id='0205bebf1b234d5782ba5006b580192c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aad9ce24-93f9-41a6-baa1-5125964f96d1),volume_type_id=aad9ce24-93f9-41a6-baa1-5125964f96d1)}" {{(pid=92060) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 17 05:00:59 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.remotefs [None req-b0cb9aff-118e-495e-8dbd-167d5e13f1ac tempest-VolumeImageDependencyTests-718285973 None] Creating volume dc973c6e-1918-4c9a-97e7-76c385669ed6 {{(pid=92060) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 17 05:00:59 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-b0cb9aff-118e-495e-8dbd-167d5e13f1ac tempest-VolumeImageDependencyTests-718285973 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 05:00:59 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-b0cb9aff-118e-495e-8dbd-167d5e13f1ac tempest-VolumeImageDependencyTests-718285973 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 05:00:59 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-b0cb9aff-118e-495e-8dbd-167d5e13f1ac tempest-VolumeImageDependencyTests-718285973 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588': None} {{(pid=92060) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 17 05:00:59 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-b0cb9aff-118e-495e-8dbd-167d5e13f1ac tempest-VolumeImageDependencyTests-718285973 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588'] {{(pid=92060) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 17 05:00:59 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-b0cb9aff-118e-495e-8dbd-167d5e13f1ac tempest-VolumeImageDependencyTests-718285973 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 05:00:59 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-b0cb9aff-118e-495e-8dbd-167d5e13f1ac tempest-VolumeImageDependencyTests-718285973 None] Selected osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588 as target Quobyte volume. {{(pid=92060) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 17 05:00:59 devstack cinder-volume[92060]: INFO cinder.volume.drivers.remotefs [None req-b0cb9aff-118e-495e-8dbd-167d5e13f1ac tempest-VolumeImageDependencyTests-718285973 None] casted to osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588 Jun 17 05:00:59 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-b0cb9aff-118e-495e-8dbd-167d5e13f1ac tempest-VolumeImageDependencyTests-718285973 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-dc973c6e-1918-4c9a-97e7-76c385669ed6 1073741824 {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:00:59 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-d8818396-10bb-4f2d-bfdc-476d25bfdec9 tempest-CreateVolumesFromSnapshotTest-393697735 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (84fc5a23-497c-48fe-94e8-1749b363e175) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2e021f8d-2755-45ac-becc-c4fd16820102', 'volume_size': 1}' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:00:59 devstack sudo[111755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-dc973c6e-1918-4c9a-97e7-76c385669ed6 1073741824 Jun 17 05:00:59 devstack sudo[111755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:00:59 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-d8818396-10bb-4f2d-bfdc-476d25bfdec9 tempest-CreateVolumesFromSnapshotTest-393697735 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4dc90680-42d5-4c06-afb0-4b60110f0023) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:00:59 devstack cinder-volume[92060]: INFO cinder.volume.flows.manager.create_volume [None req-d8818396-10bb-4f2d-bfdc-476d25bfdec9 tempest-CreateVolumesFromSnapshotTest-393697735 None] Volume volume-2e021f8d-2755-45ac-becc-c4fd16820102 (2e021f8d-2755-45ac-becc-c4fd16820102): created successfully Jun 17 05:00:59 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-d8818396-10bb-4f2d-bfdc-476d25bfdec9 tempest-CreateVolumesFromSnapshotTest-393697735 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4dc90680-42d5-4c06-afb0-4b60110f0023) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:00:59 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-d8818396-10bb-4f2d-bfdc-476d25bfdec9 tempest-CreateVolumesFromSnapshotTest-393697735 None] Flow 'volume_create_manager' (f359a739-ddeb-4f66-b1f8-fb00d15dcdd1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92060) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 17 05:00:59 devstack cinder-volume[92060]: INFO cinder.volume.manager [None req-d8818396-10bb-4f2d-bfdc-476d25bfdec9 tempest-CreateVolumesFromSnapshotTest-393697735 None] Created volume successfully. Jun 17 05:00:59 devstack sudo[111752]: pam_unix(sudo:session): session closed for user root Jun 17 05:00:59 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-f35b6fef-ca0f-4461-a149-fdaf009b5061 tempest-VolumeDependencyTests-1771129830 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-cff360d3-eb46-418a-80af-d7fb08ca9fe4" returned: 0 in 0.891s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:00:59 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-f35b6fef-ca0f-4461-a149-fdaf009b5061 tempest-VolumeDependencyTests-1771129830 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-cff360d3-eb46-418a-80af-d7fb08ca9fe4.a8b43a60-58be-4897-8514-e9d7b9ce119b {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:00:59 devstack sudo[111763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-cff360d3-eb46-418a-80af-d7fb08ca9fe4.a8b43a60-58be-4897-8514-e9d7b9ce119b Jun 17 05:00:59 devstack sudo[111763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:01:00 devstack sudo[111755]: pam_unix(sudo:session): session closed for user root Jun 17 05:01:00 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-b0cb9aff-118e-495e-8dbd-167d5e13f1ac tempest-VolumeImageDependencyTests-718285973 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-dc973c6e-1918-4c9a-97e7-76c385669ed6 1073741824" returned: 0 in 1.041s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:01:00 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-b0cb9aff-118e-495e-8dbd-167d5e13f1ac tempest-VolumeImageDependencyTests-718285973 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-dc973c6e-1918-4c9a-97e7-76c385669ed6 {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:01:00 devstack sudo[111766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-dc973c6e-1918-4c9a-97e7-76c385669ed6 Jun 17 05:01:00 devstack sudo[111766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:01:00 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-2ce00be9-425f-408a-92e7-ee5cad11dcc3 tempest-CreateVolumesFromSnapshotTest-393697735 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 05:01:00 devstack sudo[111763]: pam_unix(sudo:session): session closed for user root Jun 17 05:01:00 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-f35b6fef-ca0f-4461-a149-fdaf009b5061 tempest-VolumeDependencyTests-1771129830 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-cff360d3-eb46-418a-80af-d7fb08ca9fe4.a8b43a60-58be-4897-8514-e9d7b9ce119b" returned: 0 in 0.837s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:01:00 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-f35b6fef-ca0f-4461-a149-fdaf009b5061 tempest-VolumeDependencyTests-1771129830 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-cff360d3-eb46-418a-80af-d7fb08ca9fe4.a8b43a60-58be-4897-8514-e9d7b9ce119b {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:01:00 devstack sudo[111772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-cff360d3-eb46-418a-80af-d7fb08ca9fe4.a8b43a60-58be-4897-8514-e9d7b9ce119b Jun 17 05:01:00 devstack sudo[111772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:01:00 devstack sudo[111766]: pam_unix(sudo:session): session closed for user root Jun 17 05:01:00 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-b0cb9aff-118e-495e-8dbd-167d5e13f1ac tempest-VolumeImageDependencyTests-718285973 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-dc973c6e-1918-4c9a-97e7-76c385669ed6" returned: 0 in 0.746s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:01:00 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-b0cb9aff-118e-495e-8dbd-167d5e13f1ac tempest-VolumeImageDependencyTests-718285973 None] <== create_volume: return (1858ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588'} {{(pid=92060) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 17 05:01:00 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-b0cb9aff-118e-495e-8dbd-167d5e13f1ac tempest-VolumeImageDependencyTests-718285973 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.865s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 05:01:00 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-2ce00be9-425f-408a-92e7-ee5cad11dcc3 tempest-CreateVolumesFromSnapshotTest-393697735 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.570s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 05:01:00 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.remotefs [None req-2ce00be9-425f-408a-92e7-ee5cad11dcc3 tempest-CreateVolumesFromSnapshotTest-393697735 None] Creating offline snapshot 76c9266e-4e7e-46ae-a1d4-1859dbc9d0fe of volume 2e021f8d-2755-45ac-becc-c4fd16820102 {{(pid=92060) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 17 05:01:01 devstack cinder-volume[92060]: DEBUG oslo.privsep.daemon [-] privsep: reply[9562be63-28ed-4cb1-b7e5-3c8b45fcabf6]: (4, 'qcow2') {{(pid=93130) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 05:01:01 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-2ce00be9-425f-408a-92e7-ee5cad11dcc3 tempest-CreateVolumesFromSnapshotTest-393697735 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-2e021f8d-2755-45ac-becc-c4fd16820102 {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:01:01 devstack cinder-volume[92060]: DEBUG cinder.volume.volume_utils [None req-b0cb9aff-118e-495e-8dbd-167d5e13f1ac tempest-VolumeImageDependencyTests-718285973 None] Attempting download of d0a6d6dc-c27b-4f93-a63d-d9d375d24c5c ((None, [{'url': 'file:///opt/stack/data/glance/images/d0a6d6dc-c27b-4f93-a63d-d9d375d24c5c', 'metadata': {}}])) to volume dc973c6e-1918-4c9a-97e7-76c385669ed6. {{(pid=92060) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jun 17 05:01:01 devstack cinder-volume[92060]: DEBUG oslo.privsep.daemon [-] privsep: reply[52f52178-2cb1-4886-bb02-3f4419d0e872]: (4, 'raw') {{(pid=93130) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 05:01:01 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-b0cb9aff-118e-495e-8dbd-167d5e13f1ac tempest-VolumeImageDependencyTests-718285973 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d0a6d6dc-c27b-4f93-a63d-d9d375d24c5c_q5570vi1 {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:01:01 devstack sudo[111775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-2e021f8d-2755-45ac-becc-c4fd16820102 Jun 17 05:01:01 devstack sudo[111775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:01:01 devstack sudo[111776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d0a6d6dc-c27b-4f93-a63d-d9d375d24c5c_q5570vi1 Jun 17 05:01:01 devstack sudo[111776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:01:01 devstack sudo[111772]: pam_unix(sudo:session): session closed for user root Jun 17 05:01:01 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-f35b6fef-ca0f-4461-a149-fdaf009b5061 tempest-VolumeDependencyTests-1771129830 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-cff360d3-eb46-418a-80af-d7fb08ca9fe4.a8b43a60-58be-4897-8514-e9d7b9ce119b" returned: 0 in 0.720s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:01:01 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-f35b6fef-ca0f-4461-a149-fdaf009b5061 tempest-VolumeDependencyTests-1771129830 None] Lock "cinder-quobyte-a8b43a60-58be-4897-8514-e9d7b9ce119b" released by "_delete_snapshot" :: held 3.373s {{(pid=92060) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 05:01:01 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-f35b6fef-ca0f-4461-a149-fdaf009b5061 tempest-VolumeDependencyTests-1771129830 None] Lock "cinder-quobyte-cff360d3-eb46-418a-80af-d7fb08ca9fe4" released by "delete_snapshot" :: held 3.398s {{(pid=92060) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 05:01:01 devstack cinder-volume[92060]: DEBUG dbcounter [-] [92060] Writing DB stats cinder:SELECT=135,cinder:UPDATE=166,cinder:INSERT=50,cinder:DELETE=17 {{(pid=92060) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 17 05:01:01 devstack cinder-volume[92060]: DEBUG cinder.quota [None req-f35b6fef-ca0f-4461-a149-fdaf009b5061 tempest-VolumeDependencyTests-1771129830 None] Created reservations ['144464c1-ea41-49ec-ae68-c32123eea292', 'e8cb1cc2-4d50-4db9-b75d-7fd06834fb67', '0f4e08dc-0d69-4d12-944c-b5bd9e3ca338', '7cf566e2-7fa8-4c97-a60f-6ab59156683d'] {{(pid=92060) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 17 05:01:01 devstack cinder-volume[92060]: INFO cinder.volume.manager [None req-f35b6fef-ca0f-4461-a149-fdaf009b5061 tempest-VolumeDependencyTests-1771129830 None] Delete snapshot completed successfully. Jun 17 05:01:01 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-f35b6fef-ca0f-4461-a149-fdaf009b5061 tempest-VolumeDependencyTests-1771129830 None] Lock "cinder-a8b43a60-58be-4897-8514-e9d7b9ce119b-delete_snapshot" released by "delete_snapshot" :: held 3.605s {{(pid=92060) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 05:01:01 devstack sudo[111775]: pam_unix(sudo:session): session closed for user root Jun 17 05:01:01 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-2ce00be9-425f-408a-92e7-ee5cad11dcc3 tempest-CreateVolumesFromSnapshotTest-393697735 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-2e021f8d-2755-45ac-becc-c4fd16820102" returned: 0 in 0.822s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:01:01 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-2ce00be9-425f-408a-92e7-ee5cad11dcc3 tempest-CreateVolumesFromSnapshotTest-393697735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-2e021f8d-2755-45ac-becc-c4fd16820102,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-2e021f8d-2755-45ac-becc-c4fd16820102.76c9266e-4e7e-46ae-a1d4-1859dbc9d0fe 1G {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:01:01 devstack sudo[111784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-2e021f8d-2755-45ac-becc-c4fd16820102,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-2e021f8d-2755-45ac-becc-c4fd16820102.76c9266e-4e7e-46ae-a1d4-1859dbc9d0fe 1G Jun 17 05:01:01 devstack sudo[111784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:01:01 devstack sudo[111776]: pam_unix(sudo:session): session closed for user root Jun 17 05:01:01 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-b0cb9aff-118e-495e-8dbd-167d5e13f1ac tempest-VolumeImageDependencyTests-718285973 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d0a6d6dc-c27b-4f93-a63d-d9d375d24c5c_q5570vi1" returned: 0 in 0.886s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:01:01 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-b0cb9aff-118e-495e-8dbd-167d5e13f1ac tempest-VolumeImageDependencyTests-718285973 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d0a6d6dc-c27b-4f93-a63d-d9d375d24c5c_q5570vi1 {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:01:02 devstack sudo[111788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d0a6d6dc-c27b-4f93-a63d-d9d375d24c5c_q5570vi1 Jun 17 05:01:02 devstack sudo[111788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:01:02 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-0a3be709-05d1-4a40-94c2-f78b4a2e7949 tempest-VolumeDependencyTests-1771129830 None] Acquiring lock "cinder-cff360d3-eb46-418a-80af-d7fb08ca9fe4-delete_volume" by "delete_volume" {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 05:01:02 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-0a3be709-05d1-4a40-94c2-f78b4a2e7949 tempest-VolumeDependencyTests-1771129830 None] Lock "cinder-cff360d3-eb46-418a-80af-d7fb08ca9fe4-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 05:01:02 devstack cinder-volume[92060]: DEBUG dbcounter [-] [92060] Writing DB stats cinder:UPDATE=189,cinder:SELECT=129,cinder:DELETE=16,cinder:INSERT=43 {{(pid=92060) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 17 05:01:02 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-0a3be709-05d1-4a40-94c2-f78b4a2e7949 tempest-VolumeDependencyTests-1771129830 None] Acquiring lock "cinder-quobyte-cff360d3-eb46-418a-80af-d7fb08ca9fe4" by "delete_volume" {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 05:01:02 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-0a3be709-05d1-4a40-94c2-f78b4a2e7949 tempest-VolumeDependencyTests-1771129830 None] Lock "cinder-quobyte-cff360d3-eb46-418a-80af-d7fb08ca9fe4" acquired by "delete_volume" :: waited 0.035s {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 05:01:02 devstack cinder-volume[92060]: DEBUG oslo.privsep.daemon [-] privsep: reply[004d5d06-eeb7-47fa-b0b4-941c45601a05]: (4, 'qcow2') {{(pid=93130) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 05:01:02 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-0a3be709-05d1-4a40-94c2-f78b4a2e7949 tempest-VolumeDependencyTests-1771129830 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-cff360d3-eb46-418a-80af-d7fb08ca9fe4 {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:01:02 devstack sudo[111793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-cff360d3-eb46-418a-80af-d7fb08ca9fe4 Jun 17 05:01:02 devstack sudo[111793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:01:02 devstack sudo[111784]: pam_unix(sudo:session): session closed for user root Jun 17 05:01:02 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-2ce00be9-425f-408a-92e7-ee5cad11dcc3 tempest-CreateVolumesFromSnapshotTest-393697735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-2e021f8d-2755-45ac-becc-c4fd16820102,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-2e021f8d-2755-45ac-becc-c4fd16820102.76c9266e-4e7e-46ae-a1d4-1859dbc9d0fe 1G" returned: 0 in 0.963s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:01:02 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-2ce00be9-425f-408a-92e7-ee5cad11dcc3 tempest-CreateVolumesFromSnapshotTest-393697735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2e021f8d-2755-45ac-becc-c4fd16820102 -F qcow2 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-2e021f8d-2755-45ac-becc-c4fd16820102.76c9266e-4e7e-46ae-a1d4-1859dbc9d0fe {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:01:02 devstack sudo[111796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2e021f8d-2755-45ac-becc-c4fd16820102 -F qcow2 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-2e021f8d-2755-45ac-becc-c4fd16820102.76c9266e-4e7e-46ae-a1d4-1859dbc9d0fe Jun 17 05:01:02 devstack sudo[111796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:01:03 devstack sudo[111788]: pam_unix(sudo:session): session closed for user root Jun 17 05:01:03 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-b0cb9aff-118e-495e-8dbd-167d5e13f1ac tempest-VolumeImageDependencyTests-718285973 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d0a6d6dc-c27b-4f93-a63d-d9d375d24c5c_q5570vi1" returned: 1 in 1.013s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:01:03 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-b0cb9aff-118e-495e-8dbd-167d5e13f1ac tempest-VolumeImageDependencyTests-718285973 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d0a6d6dc-c27b-4f93-a63d-d9d375d24c5c_q5570vi1' failed. Not Retrying. {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 17 05:01:03 devstack cinder-volume[92060]: DEBUG oslo.privsep.daemon [-] privsep: reply[f67e18d2-922b-4860-bc3d-3320c4b5ba09]: (4, 'raw') {{(pid=93130) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 05:01:03 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-b0cb9aff-118e-495e-8dbd-167d5e13f1ac tempest-VolumeImageDependencyTests-718285973 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_d0a6d6dc-c27b-4f93-a63d-d9d375d24c5c_8a4aun8jdevstack@QuobyteHD {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:01:03 devstack sudo[111800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_d0a6d6dc-c27b-4f93-a63d-d9d375d24c5c_8a4aun8jdevstack@QuobyteHD Jun 17 05:01:03 devstack sudo[111800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:01:03 devstack sudo[111793]: pam_unix(sudo:session): session closed for user root Jun 17 05:01:03 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-0a3be709-05d1-4a40-94c2-f78b4a2e7949 tempest-VolumeDependencyTests-1771129830 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-cff360d3-eb46-418a-80af-d7fb08ca9fe4" returned: 0 in 0.851s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:01:03 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-0a3be709-05d1-4a40-94c2-f78b4a2e7949 tempest-VolumeDependencyTests-1771129830 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-cff360d3-eb46-418a-80af-d7fb08ca9fe4 {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:01:03 devstack sudo[111805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-cff360d3-eb46-418a-80af-d7fb08ca9fe4 Jun 17 05:01:03 devstack sudo[111805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:01:03 devstack sudo[111796]: pam_unix(sudo:session): session closed for user root Jun 17 05:01:03 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-2ce00be9-425f-408a-92e7-ee5cad11dcc3 tempest-CreateVolumesFromSnapshotTest-393697735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2e021f8d-2755-45ac-becc-c4fd16820102 -F qcow2 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-2e021f8d-2755-45ac-becc-c4fd16820102.76c9266e-4e7e-46ae-a1d4-1859dbc9d0fe" returned: 0 in 0.862s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:01:03 devstack cinder-volume[92060]: WARNING cinder.volume.drivers.remotefs [None req-2ce00be9-425f-408a-92e7-ee5cad11dcc3 tempest-CreateVolumesFromSnapshotTest-393697735 None] /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-2e021f8d-2755-45ac-becc-c4fd16820102.76c9266e-4e7e-46ae-a1d4-1859dbc9d0fe is being set with open permissions: ugo+rw Jun 17 05:01:03 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-2ce00be9-425f-408a-92e7-ee5cad11dcc3 tempest-CreateVolumesFromSnapshotTest-393697735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-2e021f8d-2755-45ac-becc-c4fd16820102.76c9266e-4e7e-46ae-a1d4-1859dbc9d0fe {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:01:03 devstack sudo[111810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-2e021f8d-2755-45ac-becc-c4fd16820102.76c9266e-4e7e-46ae-a1d4-1859dbc9d0fe Jun 17 05:01:03 devstack sudo[111810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:01:03 devstack sudo[111800]: pam_unix(sudo:session): session closed for user root Jun 17 05:01:03 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-b0cb9aff-118e-495e-8dbd-167d5e13f1ac tempest-VolumeImageDependencyTests-718285973 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_d0a6d6dc-c27b-4f93-a63d-d9d375d24c5c_8a4aun8jdevstack@QuobyteHD" returned: 0 in 0.804s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:01:03 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-b0cb9aff-118e-495e-8dbd-167d5e13f1ac tempest-VolumeImageDependencyTests-718285973 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d0a6d6dc-c27b-4f93-a63d-d9d375d24c5c_8a4aun8jdevstack@QuobyteHD {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:01:03 devstack sudo[111814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d0a6d6dc-c27b-4f93-a63d-d9d375d24c5c_8a4aun8jdevstack@QuobyteHD Jun 17 05:01:03 devstack sudo[111814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:01:04 devstack sudo[111805]: pam_unix(sudo:session): session closed for user root Jun 17 05:01:04 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-0a3be709-05d1-4a40-94c2-f78b4a2e7949 tempest-VolumeDependencyTests-1771129830 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-cff360d3-eb46-418a-80af-d7fb08ca9fe4" returned: 0 in 0.702s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:01:04 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-0a3be709-05d1-4a40-94c2-f78b4a2e7949 tempest-VolumeDependencyTests-1771129830 None] Lock "cinder-quobyte-cff360d3-eb46-418a-80af-d7fb08ca9fe4" released by "delete_volume" :: held 1.643s {{(pid=92060) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 05:01:04 devstack cinder-volume[92060]: DEBUG cinder.quota [None req-0a3be709-05d1-4a40-94c2-f78b4a2e7949 tempest-VolumeDependencyTests-1771129830 None] Created reservations ['4f7ff423-a773-498f-94f4-5e11f2a74940', '29e2098e-d37b-4854-952c-ef0f2c0631ff', 'f059d2ec-3bbc-4265-a984-5d29528e974c', 'f967ba19-5aee-49a4-a395-732e4bb3f95b'] {{(pid=92060) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 17 05:01:04 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-0a3be709-05d1-4a40-94c2-f78b4a2e7949 tempest-VolumeDependencyTests-1771129830 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 05:01:04 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-0a3be709-05d1-4a40-94c2-f78b4a2e7949 tempest-VolumeDependencyTests-1771129830 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 05:01:04 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-0a3be709-05d1-4a40-94c2-f78b4a2e7949 tempest-VolumeDependencyTests-1771129830 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588': None} {{(pid=92060) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 17 05:01:04 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-0a3be709-05d1-4a40-94c2-f78b4a2e7949 tempest-VolumeDependencyTests-1771129830 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588'] {{(pid=92060) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 17 05:01:04 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-0a3be709-05d1-4a40-94c2-f78b4a2e7949 tempest-VolumeDependencyTests-1771129830 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 05:01:04 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-0a3be709-05d1-4a40-94c2-f78b4a2e7949 tempest-VolumeDependencyTests-1771129830 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:01:04 devstack sudo[111818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a Jun 17 05:01:04 devstack sudo[111818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:01:04 devstack sudo[111810]: pam_unix(sudo:session): session closed for user root Jun 17 05:01:04 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-2ce00be9-425f-408a-92e7-ee5cad11dcc3 tempest-CreateVolumesFromSnapshotTest-393697735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-2e021f8d-2755-45ac-becc-c4fd16820102.76c9266e-4e7e-46ae-a1d4-1859dbc9d0fe" returned: 0 in 1.110s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:01:04 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-8fbb307a-9cc4-4607-b497-ccd54141ff76 tempest-VolumeDependencyTests-1771129830 None] Acquiring lock "cinder-0c3a9c90-84c5-4c9d-bab8-7fa233696a53-delete_volume" by "delete_volume" {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 05:01:04 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-8fbb307a-9cc4-4607-b497-ccd54141ff76 tempest-VolumeDependencyTests-1771129830 None] Lock "cinder-0c3a9c90-84c5-4c9d-bab8-7fa233696a53-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 05:01:04 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-2ce00be9-425f-408a-92e7-ee5cad11dcc3 tempest-CreateVolumesFromSnapshotTest-393697735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-2e021f8d-2755-45ac-becc-c4fd16820102.info {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:01:04 devstack sudo[111814]: pam_unix(sudo:session): session closed for user root Jun 17 05:01:04 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-b0cb9aff-118e-495e-8dbd-167d5e13f1ac tempest-VolumeImageDependencyTests-718285973 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d0a6d6dc-c27b-4f93-a63d-d9d375d24c5c_8a4aun8jdevstack@QuobyteHD" returned: 1 in 1.057s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:01:04 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-b0cb9aff-118e-495e-8dbd-167d5e13f1ac tempest-VolumeImageDependencyTests-718285973 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d0a6d6dc-c27b-4f93-a63d-d9d375d24c5c_8a4aun8jdevstack@QuobyteHD' failed. Not Retrying. {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 17 05:01:04 devstack cinder-volume[92060]: DEBUG cinder.image.image_utils [None req-b0cb9aff-118e-495e-8dbd-167d5e13f1ac tempest-VolumeImageDependencyTests-718285973 None] d0a6d6dc-c27b-4f93-a63d-d9d375d24c5c was raw, converting to raw {{(pid=92060) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jun 17 05:01:04 devstack sudo[111824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-2e021f8d-2755-45ac-becc-c4fd16820102.info Jun 17 05:01:04 devstack sudo[111824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:01:04 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-b0cb9aff-118e-495e-8dbd-167d5e13f1ac tempest-VolumeImageDependencyTests-718285973 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_d0a6d6dc-c27b-4f93-a63d-d9d375d24c5c_8a4aun8jdevstack@QuobyteHD /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-dc973c6e-1918-4c9a-97e7-76c385669ed6 {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:01:05 devstack sudo[111826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_d0a6d6dc-c27b-4f93-a63d-d9d375d24c5c_8a4aun8jdevstack@QuobyteHD /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-dc973c6e-1918-4c9a-97e7-76c385669ed6 Jun 17 05:01:05 devstack sudo[111826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:01:05 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-8fbb307a-9cc4-4607-b497-ccd54141ff76 tempest-VolumeDependencyTests-1771129830 None] Acquiring lock "cinder-quobyte-0c3a9c90-84c5-4c9d-bab8-7fa233696a53" by "delete_volume" {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 05:01:05 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-8fbb307a-9cc4-4607-b497-ccd54141ff76 tempest-VolumeDependencyTests-1771129830 None] Lock "cinder-quobyte-0c3a9c90-84c5-4c9d-bab8-7fa233696a53" acquired by "delete_volume" :: waited 0.029s {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 05:01:05 devstack cinder-volume[92060]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c54b658-f615-44eb-acf9-2f8ca0d1ab2f]: (4, 'qcow2') {{(pid=93130) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 05:01:05 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-8fbb307a-9cc4-4607-b497-ccd54141ff76 tempest-VolumeDependencyTests-1771129830 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-0c3a9c90-84c5-4c9d-bab8-7fa233696a53 {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:01:05 devstack sudo[111818]: pam_unix(sudo:session): session closed for user root Jun 17 05:01:05 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-0a3be709-05d1-4a40-94c2-f78b4a2e7949 tempest-VolumeDependencyTests-1771129830 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a" returned: 0 in 0.938s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:01:05 devstack cinder-volume[92060]: DEBUG cinder.manager [None req-0a3be709-05d1-4a40-94c2-f78b4a2e7949 tempest-VolumeDependencyTests-1771129830 None] Notifying Schedulers of capabilities ... {{(pid=92060) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 17 05:01:05 devstack cinder-volume[92060]: INFO cinder.volume.manager [None req-0a3be709-05d1-4a40-94c2-f78b4a2e7949 tempest-VolumeDependencyTests-1771129830 None] Deleted volume successfully. Jun 17 05:01:05 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-0a3be709-05d1-4a40-94c2-f78b4a2e7949 tempest-VolumeDependencyTests-1771129830 None] Lock "cinder-cff360d3-eb46-418a-80af-d7fb08ca9fe4-delete_volume" released by "delete_volume" :: held 2.927s {{(pid=92060) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 05:01:05 devstack sudo[111829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-0c3a9c90-84c5-4c9d-bab8-7fa233696a53 Jun 17 05:01:05 devstack sudo[111829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:01:05 devstack sudo[111824]: pam_unix(sudo:session): session closed for user root Jun 17 05:01:05 devstack sudo[111826]: pam_unix(sudo:session): session closed for user root Jun 17 05:01:05 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-2ce00be9-425f-408a-92e7-ee5cad11dcc3 tempest-CreateVolumesFromSnapshotTest-393697735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-2e021f8d-2755-45ac-becc-c4fd16820102.info" returned: 0 in 0.994s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:01:05 devstack cinder-volume[92060]: WARNING cinder.volume.drivers.remotefs [None req-2ce00be9-425f-408a-92e7-ee5cad11dcc3 tempest-CreateVolumesFromSnapshotTest-393697735 None] /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-2e021f8d-2755-45ac-becc-c4fd16820102.info is being set with open permissions: ugo+rw Jun 17 05:01:05 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-2ce00be9-425f-408a-92e7-ee5cad11dcc3 tempest-CreateVolumesFromSnapshotTest-393697735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-2e021f8d-2755-45ac-becc-c4fd16820102.info {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:01:05 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-b0cb9aff-118e-495e-8dbd-167d5e13f1ac tempest-VolumeImageDependencyTests-718285973 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_d0a6d6dc-c27b-4f93-a63d-d9d375d24c5c_8a4aun8jdevstack@QuobyteHD /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-dc973c6e-1918-4c9a-97e7-76c385669ed6" returned: 0 in 0.949s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:01:05 devstack cinder-volume[92060]: DEBUG cinder.image.image_utils [None req-b0cb9aff-118e-495e-8dbd-167d5e13f1ac tempest-VolumeImageDependencyTests-718285973 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_d0a6d6dc-c27b-4f93-a63d-d9d375d24c5c_8a4aun8jdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-dc973c6e-1918-4c9a-97e7-76c385669ed6 {{(pid=92060) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 17 05:01:05 devstack cinder-volume[92060]: INFO cinder.image.image_utils [None req-b0cb9aff-118e-495e-8dbd-167d5e13f1ac tempest-VolumeImageDependencyTests-718285973 None] Converted 0.00 MB image at 0.00 MB/s Jun 17 05:01:05 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-b0cb9aff-118e-495e-8dbd-167d5e13f1ac tempest-VolumeImageDependencyTests-718285973 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-dc973c6e-1918-4c9a-97e7-76c385669ed6 1G {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:01:05 devstack sudo[111835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-2e021f8d-2755-45ac-becc-c4fd16820102.info Jun 17 05:01:05 devstack sudo[111835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:01:05 devstack sudo[111836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-dc973c6e-1918-4c9a-97e7-76c385669ed6 1G Jun 17 05:01:05 devstack sudo[111836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:01:06 devstack sudo[111829]: pam_unix(sudo:session): session closed for user root Jun 17 05:01:06 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-8fbb307a-9cc4-4607-b497-ccd54141ff76 tempest-VolumeDependencyTests-1771129830 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-0c3a9c90-84c5-4c9d-bab8-7fa233696a53" returned: 0 in 1.014s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:01:06 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-8fbb307a-9cc4-4607-b497-ccd54141ff76 tempest-VolumeDependencyTests-1771129830 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-0c3a9c90-84c5-4c9d-bab8-7fa233696a53 {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:01:06 devstack sudo[111842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-0c3a9c90-84c5-4c9d-bab8-7fa233696a53 Jun 17 05:01:06 devstack sudo[111842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:01:06 devstack sudo[111836]: pam_unix(sudo:session): session closed for user root Jun 17 05:01:06 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-b0cb9aff-118e-495e-8dbd-167d5e13f1ac tempest-VolumeImageDependencyTests-718285973 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-dc973c6e-1918-4c9a-97e7-76c385669ed6 1G" returned: 0 in 0.757s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:01:06 devstack sudo[111835]: pam_unix(sudo:session): session closed for user root Jun 17 05:01:06 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-2ce00be9-425f-408a-92e7-ee5cad11dcc3 tempest-CreateVolumesFromSnapshotTest-393697735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-2e021f8d-2755-45ac-becc-c4fd16820102.info" returned: 0 in 0.815s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:01:06 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-2ce00be9-425f-408a-92e7-ee5cad11dcc3 tempest-CreateVolumesFromSnapshotTest-393697735 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.732s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 05:01:06 devstack cinder-volume[92060]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e5a8c38-346f-4597-8db1-c9d435a6f717]: (4, 'raw') {{(pid=93130) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 05:01:06 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-b0cb9aff-118e-495e-8dbd-167d5e13f1ac tempest-VolumeImageDependencyTests-718285973 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-dc973c6e-1918-4c9a-97e7-76c385669ed6 {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:01:06 devstack cinder-volume[92060]: INFO cinder.volume.manager [None req-2ce00be9-425f-408a-92e7-ee5cad11dcc3 tempest-CreateVolumesFromSnapshotTest-393697735 None] Create snapshot completed successfully Jun 17 05:01:06 devstack sudo[111848]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-dc973c6e-1918-4c9a-97e7-76c385669ed6 Jun 17 05:01:06 devstack sudo[111848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:01:06 devstack sudo[111842]: pam_unix(sudo:session): session closed for user root Jun 17 05:01:06 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-8fbb307a-9cc4-4607-b497-ccd54141ff76 tempest-VolumeDependencyTests-1771129830 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-0c3a9c90-84c5-4c9d-bab8-7fa233696a53" returned: 0 in 0.734s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:01:06 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-8fbb307a-9cc4-4607-b497-ccd54141ff76 tempest-VolumeDependencyTests-1771129830 None] Lock "cinder-quobyte-0c3a9c90-84c5-4c9d-bab8-7fa233696a53" released by "delete_volume" :: held 1.814s {{(pid=92060) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 05:01:06 devstack cinder-volume[92060]: DEBUG cinder.quota [None req-8fbb307a-9cc4-4607-b497-ccd54141ff76 tempest-VolumeDependencyTests-1771129830 None] Created reservations ['a2e527a4-fb64-45ea-b161-92c5e624b964', '9ee1a59a-94b6-453c-b5b0-6996ac14c1f4', '00e14015-8a88-4389-9190-23aa11eceef4', '5661923b-79e8-4cc9-bf0d-93325b1652f0'] {{(pid=92060) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 17 05:01:06 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-8fbb307a-9cc4-4607-b497-ccd54141ff76 tempest-VolumeDependencyTests-1771129830 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 05:01:06 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-8fbb307a-9cc4-4607-b497-ccd54141ff76 tempest-VolumeDependencyTests-1771129830 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 05:01:06 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-8fbb307a-9cc4-4607-b497-ccd54141ff76 tempest-VolumeDependencyTests-1771129830 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588': None} {{(pid=92060) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 17 05:01:07 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-8fbb307a-9cc4-4607-b497-ccd54141ff76 tempest-VolumeDependencyTests-1771129830 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588'] {{(pid=92060) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 17 05:01:07 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-8fbb307a-9cc4-4607-b497-ccd54141ff76 tempest-VolumeDependencyTests-1771129830 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 05:01:07 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-8fbb307a-9cc4-4607-b497-ccd54141ff76 tempest-VolumeDependencyTests-1771129830 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:01:07 devstack sudo[111851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a Jun 17 05:01:07 devstack sudo[111851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:01:07 devstack sudo[111848]: pam_unix(sudo:session): session closed for user root Jun 17 05:01:07 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-b0cb9aff-118e-495e-8dbd-167d5e13f1ac tempest-VolumeImageDependencyTests-718285973 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-dc973c6e-1918-4c9a-97e7-76c385669ed6" returned: 0 in 1.021s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:01:07 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-b0cb9aff-118e-495e-8dbd-167d5e13f1ac tempest-VolumeImageDependencyTests-718285973 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-dc973c6e-1918-4c9a-97e7-76c385669ed6 {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:01:07 devstack sudo[111851]: pam_unix(sudo:session): session closed for user root Jun 17 05:01:07 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-8fbb307a-9cc4-4607-b497-ccd54141ff76 tempest-VolumeDependencyTests-1771129830 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a" returned: 0 in 0.796s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:01:07 devstack cinder-volume[92060]: DEBUG cinder.manager [None req-8fbb307a-9cc4-4607-b497-ccd54141ff76 tempest-VolumeDependencyTests-1771129830 None] Notifying Schedulers of capabilities ... {{(pid=92060) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 17 05:01:07 devstack cinder-volume[92060]: INFO cinder.volume.manager [None req-8fbb307a-9cc4-4607-b497-ccd54141ff76 tempest-VolumeDependencyTests-1771129830 None] Deleted volume successfully. Jun 17 05:01:07 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-8fbb307a-9cc4-4607-b497-ccd54141ff76 tempest-VolumeDependencyTests-1771129830 None] Lock "cinder-0c3a9c90-84c5-4c9d-bab8-7fa233696a53-delete_volume" released by "delete_volume" :: held 3.024s {{(pid=92060) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 05:01:07 devstack sudo[111856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-dc973c6e-1918-4c9a-97e7-76c385669ed6 Jun 17 05:01:07 devstack sudo[111856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:01:08 devstack cinder-volume[92060]: DEBUG cinder.volume.flows.manager.create_volume [None req-575da14a-97a8-4730-868f-980388ced750 tempest-CreateVolumesFromSnapshotTest-393697735 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92060) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 17 05:01:08 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-575da14a-97a8-4730-868f-980388ced750 tempest-CreateVolumesFromSnapshotTest-393697735 None] Flow 'volume_create_manager' (2751d6a5-d77e-49c6-8899-448422234689) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 17 05:01:08 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-575da14a-97a8-4730-868f-980388ced750 tempest-CreateVolumesFromSnapshotTest-393697735 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cedf6280-d649-451e-b3a7-073a95d40e89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:01:08 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-575da14a-97a8-4730-868f-980388ced750 tempest-CreateVolumesFromSnapshotTest-393697735 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cedf6280-d649-451e-b3a7-073a95d40e89) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-17T03:01:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1627610190',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=72e76a05-c3fb-44e5-af2b-246663135f4d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2d762ee5566b4bd49583fbd277b6ac45',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T03:01:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T03:01:08Z,use_quota=True,user_id='ee60c55e2c884578be289313c0eb57b4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aad9ce24-93f9-41a6-baa1-5125964f96d1),volume_type_id=aad9ce24-93f9-41a6-baa1-5125964f96d1)' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:01:08 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-575da14a-97a8-4730-868f-980388ced750 tempest-CreateVolumesFromSnapshotTest-393697735 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (adda340b-e0fb-44db-bd2c-61169dbe05a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:01:08 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-575da14a-97a8-4730-868f-980388ced750 tempest-CreateVolumesFromSnapshotTest-393697735 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (adda340b-e0fb-44db-bd2c-61169dbe05a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:01:08 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-575da14a-97a8-4730-868f-980388ced750 tempest-CreateVolumesFromSnapshotTest-393697735 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6ec12244-e5d7-4bca-b5a5-27af12c18b89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:01:08 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-575da14a-97a8-4730-868f-980388ced750 tempest-CreateVolumesFromSnapshotTest-393697735 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6ec12244-e5d7-4bca-b5a5-27af12c18b89) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '72e76a05-c3fb-44e5-af2b-246663135f4d', 'volume_name': 'volume-72e76a05-c3fb-44e5-af2b-246663135f4d', 'volume_size': 1}' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:01:08 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-575da14a-97a8-4730-868f-980388ced750 tempest-CreateVolumesFromSnapshotTest-393697735 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3b857f07-e213-4d03-95c1-ea5d5ac0c6ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:01:08 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-575da14a-97a8-4730-868f-980388ced750 tempest-CreateVolumesFromSnapshotTest-393697735 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3b857f07-e213-4d03-95c1-ea5d5ac0c6ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:01:08 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-575da14a-97a8-4730-868f-980388ced750 tempest-CreateVolumesFromSnapshotTest-393697735 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (264ae72b-5199-4ce2-8094-25063798ffcc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:01:08 devstack cinder-volume[92060]: INFO cinder.volume.flows.manager.create_volume [None req-575da14a-97a8-4730-868f-980388ced750 tempest-CreateVolumesFromSnapshotTest-393697735 None] Volume 72e76a05-c3fb-44e5-af2b-246663135f4d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-72e76a05-c3fb-44e5-af2b-246663135f4d', 'volume_size': 1} Jun 17 05:01:08 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-575da14a-97a8-4730-868f-980388ced750 tempest-CreateVolumesFromSnapshotTest-393697735 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 05:01:08 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-575da14a-97a8-4730-868f-980388ced750 tempest-CreateVolumesFromSnapshotTest-393697735 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 05:01:08 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-575da14a-97a8-4730-868f-980388ced750 tempest-CreateVolumesFromSnapshotTest-393697735 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-17T03:01:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1627610190',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=72e76a05-c3fb-44e5-af2b-246663135f4d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2d762ee5566b4bd49583fbd277b6ac45',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T03:01:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T03:01:08Z,use_quota=True,user_id='ee60c55e2c884578be289313c0eb57b4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aad9ce24-93f9-41a6-baa1-5125964f96d1),volume_type_id=aad9ce24-93f9-41a6-baa1-5125964f96d1)}" {{(pid=92060) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 17 05:01:08 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.remotefs [None req-575da14a-97a8-4730-868f-980388ced750 tempest-CreateVolumesFromSnapshotTest-393697735 None] Creating volume 72e76a05-c3fb-44e5-af2b-246663135f4d {{(pid=92060) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 17 05:01:08 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-575da14a-97a8-4730-868f-980388ced750 tempest-CreateVolumesFromSnapshotTest-393697735 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 05:01:08 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-575da14a-97a8-4730-868f-980388ced750 tempest-CreateVolumesFromSnapshotTest-393697735 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 05:01:08 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-575da14a-97a8-4730-868f-980388ced750 tempest-CreateVolumesFromSnapshotTest-393697735 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588': None} {{(pid=92060) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 17 05:01:08 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-575da14a-97a8-4730-868f-980388ced750 tempest-CreateVolumesFromSnapshotTest-393697735 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588'] {{(pid=92060) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 17 05:01:08 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-575da14a-97a8-4730-868f-980388ced750 tempest-CreateVolumesFromSnapshotTest-393697735 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 05:01:08 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-575da14a-97a8-4730-868f-980388ced750 tempest-CreateVolumesFromSnapshotTest-393697735 None] Selected osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588 as target Quobyte volume. {{(pid=92060) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 17 05:01:08 devstack cinder-volume[92060]: INFO cinder.volume.drivers.remotefs [None req-575da14a-97a8-4730-868f-980388ced750 tempest-CreateVolumesFromSnapshotTest-393697735 None] casted to osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588 Jun 17 05:01:08 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-575da14a-97a8-4730-868f-980388ced750 tempest-CreateVolumesFromSnapshotTest-393697735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-72e76a05-c3fb-44e5-af2b-246663135f4d 1073741824 {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:01:08 devstack sudo[111858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-72e76a05-c3fb-44e5-af2b-246663135f4d 1073741824 Jun 17 05:01:08 devstack sudo[111858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:01:08 devstack sudo[111856]: pam_unix(sudo:session): session closed for user root Jun 17 05:01:08 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-b0cb9aff-118e-495e-8dbd-167d5e13f1ac tempest-VolumeImageDependencyTests-718285973 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-dc973c6e-1918-4c9a-97e7-76c385669ed6" returned: 1 in 1.104s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:01:08 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-b0cb9aff-118e-495e-8dbd-167d5e13f1ac tempest-VolumeImageDependencyTests-718285973 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-dc973c6e-1918-4c9a-97e7-76c385669ed6' failed. Not Retrying. {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 17 05:01:08 devstack cinder-volume[92060]: DEBUG cinder.volume.volume_utils [None req-b0cb9aff-118e-495e-8dbd-167d5e13f1ac tempest-VolumeImageDependencyTests-718285973 None] Downloaded image d0a6d6dc-c27b-4f93-a63d-d9d375d24c5c ((None, [{'url': 'file:///opt/stack/data/glance/images/d0a6d6dc-c27b-4f93-a63d-d9d375d24c5c', 'metadata': {}}])) to volume dc973c6e-1918-4c9a-97e7-76c385669ed6 successfully. {{(pid=92060) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jun 17 05:01:08 devstack cinder-volume[92060]: DEBUG cinder.image.image_utils [None req-b0cb9aff-118e-495e-8dbd-167d5e13f1ac tempest-VolumeImageDependencyTests-718285973 None] Temporary image d0a6d6dc-c27b-4f93-a63d-d9d375d24c5c for user 0205bebf1b234d5782ba5006b580192c is deleted. {{(pid=92060) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jun 17 05:01:08 devstack cinder-volume[92060]: DEBUG cinder.volume.volume_utils [None req-b0cb9aff-118e-495e-8dbd-167d5e13f1ac tempest-VolumeImageDependencyTests-718285973 None] Marking volume dc973c6e-1918-4c9a-97e7-76c385669ed6 as bootable. {{(pid=92060) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jun 17 05:01:08 devstack cinder-volume[92060]: DEBUG cinder.volume.flows.manager.create_volume [None req-b0cb9aff-118e-495e-8dbd-167d5e13f1ac tempest-VolumeImageDependencyTests-718285973 None] Copying metadata from image d0a6d6dc-c27b-4f93-a63d-d9d375d24c5c to dc973c6e-1918-4c9a-97e7-76c385669ed6. {{(pid=92060) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jun 17 05:01:08 devstack cinder-volume[92060]: DEBUG cinder.volume.flows.manager.create_volume [None req-b0cb9aff-118e-495e-8dbd-167d5e13f1ac tempest-VolumeImageDependencyTests-718285973 None] Creating volume glance metadata for volume dc973c6e-1918-4c9a-97e7-76c385669ed6 backed by image d0a6d6dc-c27b-4f93-a63d-d9d375d24c5c with: {'image_id': 'd0a6d6dc-c27b-4f93-a63d-d9d375d24c5c', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': 'f7b8e4a2a9c5a40b81c3f4737bc68ff2', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=92060) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jun 17 05:01:08 devstack cinder-volume[92060]: DEBUG cinder.volume.flows.manager.create_volume [None req-fd25d7b3-b70e-4bd6-8ca6-4e739e611704 tempest-CreateVolumesFromSnapshotTest-393697735 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92060) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 17 05:01:08 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-fd25d7b3-b70e-4bd6-8ca6-4e739e611704 tempest-CreateVolumesFromSnapshotTest-393697735 None] Flow 'volume_create_manager' (6e081e53-9379-43d8-9f8c-a70a7c42bd66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 17 05:01:08 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-fd25d7b3-b70e-4bd6-8ca6-4e739e611704 tempest-CreateVolumesFromSnapshotTest-393697735 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (353ec506-6eff-4cf9-9779-6540886bb2b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:01:08 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-fd25d7b3-b70e-4bd6-8ca6-4e739e611704 tempest-CreateVolumesFromSnapshotTest-393697735 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (353ec506-6eff-4cf9-9779-6540886bb2b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-17T03:01:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-22683673',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b491bb4d-48fe-4883-b72c-5d874d578030,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2d762ee5566b4bd49583fbd277b6ac45',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T03:01:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T03:01:09Z,use_quota=True,user_id='ee60c55e2c884578be289313c0eb57b4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aad9ce24-93f9-41a6-baa1-5125964f96d1),volume_type_id=aad9ce24-93f9-41a6-baa1-5125964f96d1)' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:01:08 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-fd25d7b3-b70e-4bd6-8ca6-4e739e611704 tempest-CreateVolumesFromSnapshotTest-393697735 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c5b56868-a725-4c24-b200-e5b8d907cc98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:01:08 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-fd25d7b3-b70e-4bd6-8ca6-4e739e611704 tempest-CreateVolumesFromSnapshotTest-393697735 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c5b56868-a725-4c24-b200-e5b8d907cc98) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:01:08 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-fd25d7b3-b70e-4bd6-8ca6-4e739e611704 tempest-CreateVolumesFromSnapshotTest-393697735 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (63e44d8c-1083-4ba7-b188-9831a3af2801) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:01:08 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-fd25d7b3-b70e-4bd6-8ca6-4e739e611704 tempest-CreateVolumesFromSnapshotTest-393697735 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (63e44d8c-1083-4ba7-b188-9831a3af2801) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b491bb4d-48fe-4883-b72c-5d874d578030', 'volume_name': 'volume-b491bb4d-48fe-4883-b72c-5d874d578030', 'volume_size': 1}' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:01:08 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-fd25d7b3-b70e-4bd6-8ca6-4e739e611704 tempest-CreateVolumesFromSnapshotTest-393697735 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e488f0b7-92d4-4e4e-91b8-555691354281) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:01:08 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-fd25d7b3-b70e-4bd6-8ca6-4e739e611704 tempest-CreateVolumesFromSnapshotTest-393697735 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e488f0b7-92d4-4e4e-91b8-555691354281) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:01:08 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-fd25d7b3-b70e-4bd6-8ca6-4e739e611704 tempest-CreateVolumesFromSnapshotTest-393697735 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fd06e187-cfdf-463d-afc9-fcd76f1532f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:01:08 devstack cinder-volume[92060]: INFO cinder.volume.flows.manager.create_volume [None req-fd25d7b3-b70e-4bd6-8ca6-4e739e611704 tempest-CreateVolumesFromSnapshotTest-393697735 None] Volume b491bb4d-48fe-4883-b72c-5d874d578030: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b491bb4d-48fe-4883-b72c-5d874d578030', 'volume_size': 1} Jun 17 05:01:08 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-fd25d7b3-b70e-4bd6-8ca6-4e739e611704 tempest-CreateVolumesFromSnapshotTest-393697735 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 05:01:09 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-b0cb9aff-118e-495e-8dbd-167d5e13f1ac tempest-VolumeImageDependencyTests-718285973 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (644ddd90-150b-46cc-bffb-43317cb48473) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dc973c6e-1918-4c9a-97e7-76c385669ed6', 'volume_size': 1, 'image_id': 'd0a6d6dc-c27b-4f93-a63d-d9d375d24c5c', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d0a6d6dc-c27b-4f93-a63d-d9d375d24c5c', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'f7b8e4a2a9c5a40b81c3f4737bc68ff2', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'd93d5c043a9141bca86279887cbcf684', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '10a4286b35d5e1e8a71496276c07ae62d0bcc8542ee7d705381076963e16ddb3c6a32aaecae778ee8aea98a1a62b7c35a571b649616b2ebab78df0e3b46dd9d0', 'id': 'd0a6d6dc-c27b-4f93-a63d-d9d375d24c5c', 'created_at': datetime.datetime(2026, 6, 17, 3, 0, 49, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 17, 3, 0, 51, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d0a6d6dc-c27b-4f93-a63d-d9d375d24c5c/file', 'properties': {}}, 'image_service': }' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:01:09 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-b0cb9aff-118e-495e-8dbd-167d5e13f1ac tempest-VolumeImageDependencyTests-718285973 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8f7e3c15-b1c3-48f6-9517-76f4b2c24d33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:01:09 devstack cinder-volume[92060]: INFO cinder.volume.flows.manager.create_volume [None req-b0cb9aff-118e-495e-8dbd-167d5e13f1ac tempest-VolumeImageDependencyTests-718285973 None] Volume volume-dc973c6e-1918-4c9a-97e7-76c385669ed6 (dc973c6e-1918-4c9a-97e7-76c385669ed6): created successfully Jun 17 05:01:09 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-b0cb9aff-118e-495e-8dbd-167d5e13f1ac tempest-VolumeImageDependencyTests-718285973 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8f7e3c15-b1c3-48f6-9517-76f4b2c24d33) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:01:09 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-b0cb9aff-118e-495e-8dbd-167d5e13f1ac tempest-VolumeImageDependencyTests-718285973 None] Flow 'volume_create_manager' (bb0dd529-c482-45f6-ba72-1a945e8da61f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92060) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 17 05:01:09 devstack cinder-volume[92060]: INFO cinder.volume.manager [None req-b0cb9aff-118e-495e-8dbd-167d5e13f1ac tempest-VolumeImageDependencyTests-718285973 None] Created volume successfully. Jun 17 05:01:09 devstack cinder-volume[92060]: DEBUG cinder.volume.flows.manager.create_volume [None req-16bbb193-4232-4740-9792-5c4dc44171e1 tempest-CreateVolumesFromSnapshotTest-393697735 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92060) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 17 05:01:09 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-16bbb193-4232-4740-9792-5c4dc44171e1 tempest-CreateVolumesFromSnapshotTest-393697735 None] Flow 'volume_create_manager' (417355b9-d91a-46e6-8801-49ad5dd47530) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 17 05:01:09 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-16bbb193-4232-4740-9792-5c4dc44171e1 tempest-CreateVolumesFromSnapshotTest-393697735 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4aef1b06-00d8-47ab-9d41-68af6ae48ef1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:01:09 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-16bbb193-4232-4740-9792-5c4dc44171e1 tempest-CreateVolumesFromSnapshotTest-393697735 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4aef1b06-00d8-47ab-9d41-68af6ae48ef1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-17T03:01:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1014259551',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9dfa83f2-63ab-40ca-a390-f9ab87ce8c5f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2d762ee5566b4bd49583fbd277b6ac45',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T03:01:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T03:01:09Z,use_quota=True,user_id='ee60c55e2c884578be289313c0eb57b4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aad9ce24-93f9-41a6-baa1-5125964f96d1),volume_type_id=aad9ce24-93f9-41a6-baa1-5125964f96d1)' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:01:09 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-16bbb193-4232-4740-9792-5c4dc44171e1 tempest-CreateVolumesFromSnapshotTest-393697735 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6f86cee2-322f-492f-8dc8-b12b5c09aea1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:01:09 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-16bbb193-4232-4740-9792-5c4dc44171e1 tempest-CreateVolumesFromSnapshotTest-393697735 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6f86cee2-322f-492f-8dc8-b12b5c09aea1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:01:09 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-16bbb193-4232-4740-9792-5c4dc44171e1 tempest-CreateVolumesFromSnapshotTest-393697735 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0aff1cc7-f528-4c2f-8ee7-790bc45714d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:01:09 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-16bbb193-4232-4740-9792-5c4dc44171e1 tempest-CreateVolumesFromSnapshotTest-393697735 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0aff1cc7-f528-4c2f-8ee7-790bc45714d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9dfa83f2-63ab-40ca-a390-f9ab87ce8c5f', 'volume_name': 'volume-9dfa83f2-63ab-40ca-a390-f9ab87ce8c5f', 'volume_size': 1}' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:01:09 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-16bbb193-4232-4740-9792-5c4dc44171e1 tempest-CreateVolumesFromSnapshotTest-393697735 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e4f15aac-bc45-444d-af54-19c8dff0374d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:01:09 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-16bbb193-4232-4740-9792-5c4dc44171e1 tempest-CreateVolumesFromSnapshotTest-393697735 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e4f15aac-bc45-444d-af54-19c8dff0374d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:01:09 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-16bbb193-4232-4740-9792-5c4dc44171e1 tempest-CreateVolumesFromSnapshotTest-393697735 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (64ec69db-f25c-4cb9-93d2-acf75e801e34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:01:09 devstack cinder-volume[92060]: INFO cinder.volume.flows.manager.create_volume [None req-16bbb193-4232-4740-9792-5c4dc44171e1 tempest-CreateVolumesFromSnapshotTest-393697735 None] Volume 9dfa83f2-63ab-40ca-a390-f9ab87ce8c5f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9dfa83f2-63ab-40ca-a390-f9ab87ce8c5f', 'volume_size': 1} Jun 17 05:01:09 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-16bbb193-4232-4740-9792-5c4dc44171e1 tempest-CreateVolumesFromSnapshotTest-393697735 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 05:01:09 devstack sudo[111858]: pam_unix(sudo:session): session closed for user root Jun 17 05:01:09 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-575da14a-97a8-4730-868f-980388ced750 tempest-CreateVolumesFromSnapshotTest-393697735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-72e76a05-c3fb-44e5-af2b-246663135f4d 1073741824" returned: 0 in 1.357s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:01:09 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-575da14a-97a8-4730-868f-980388ced750 tempest-CreateVolumesFromSnapshotTest-393697735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-72e76a05-c3fb-44e5-af2b-246663135f4d {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:01:09 devstack cinder-volume[92060]: DEBUG cinder.volume.flows.manager.create_volume [None req-7abf9c6e-8296-40c4-83e7-7783ea521e39 tempest-CreateVolumesFromSnapshotTest-393697735 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92060) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 17 05:01:10 devstack sudo[111873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-72e76a05-c3fb-44e5-af2b-246663135f4d Jun 17 05:01:10 devstack sudo[111873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:01:10 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-7abf9c6e-8296-40c4-83e7-7783ea521e39 tempest-CreateVolumesFromSnapshotTest-393697735 None] Flow 'volume_create_manager' (c746b07e-e1f4-4c47-84fa-f9e72f0c7d1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 17 05:01:10 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-7abf9c6e-8296-40c4-83e7-7783ea521e39 tempest-CreateVolumesFromSnapshotTest-393697735 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fa95cac6-9e55-4330-b32f-0c49c330d6bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:01:10 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-9ab25780-add5-45ab-820e-6cc1eaa8f0eb tempest-VolumeImageDependencyTests-718285973 None] Acquiring lock "cinder-dc973c6e-1918-4c9a-97e7-76c385669ed6-delete_volume" by "delete_volume" {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 05:01:10 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-7abf9c6e-8296-40c4-83e7-7783ea521e39 tempest-CreateVolumesFromSnapshotTest-393697735 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fa95cac6-9e55-4330-b32f-0c49c330d6bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-17T03:01:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-344750925',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c32da37e-a2c4-4c5e-af6b-42bd3706af65,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2d762ee5566b4bd49583fbd277b6ac45',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T03:01:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T03:01:10Z,use_quota=True,user_id='ee60c55e2c884578be289313c0eb57b4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aad9ce24-93f9-41a6-baa1-5125964f96d1),volume_type_id=aad9ce24-93f9-41a6-baa1-5125964f96d1)' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:01:10 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-7abf9c6e-8296-40c4-83e7-7783ea521e39 tempest-CreateVolumesFromSnapshotTest-393697735 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0c3dc9cf-1111-43d9-a00b-e58a4a378718) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:01:10 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-7abf9c6e-8296-40c4-83e7-7783ea521e39 tempest-CreateVolumesFromSnapshotTest-393697735 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0c3dc9cf-1111-43d9-a00b-e58a4a378718) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:01:10 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-7abf9c6e-8296-40c4-83e7-7783ea521e39 tempest-CreateVolumesFromSnapshotTest-393697735 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ae0ce9c3-3e99-4390-a15e-613dba0532c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:01:10 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-7abf9c6e-8296-40c4-83e7-7783ea521e39 tempest-CreateVolumesFromSnapshotTest-393697735 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ae0ce9c3-3e99-4390-a15e-613dba0532c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c32da37e-a2c4-4c5e-af6b-42bd3706af65', 'volume_name': 'volume-c32da37e-a2c4-4c5e-af6b-42bd3706af65', 'volume_size': 1}' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:01:10 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-7abf9c6e-8296-40c4-83e7-7783ea521e39 tempest-CreateVolumesFromSnapshotTest-393697735 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (889c95a3-da3e-4ac7-9564-e0723e135442) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:01:10 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-7abf9c6e-8296-40c4-83e7-7783ea521e39 tempest-CreateVolumesFromSnapshotTest-393697735 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (889c95a3-da3e-4ac7-9564-e0723e135442) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:01:10 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-7abf9c6e-8296-40c4-83e7-7783ea521e39 tempest-CreateVolumesFromSnapshotTest-393697735 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1b3bc853-935b-4da8-aadc-d8723cfd999b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:01:10 devstack cinder-volume[92060]: INFO cinder.volume.flows.manager.create_volume [None req-7abf9c6e-8296-40c4-83e7-7783ea521e39 tempest-CreateVolumesFromSnapshotTest-393697735 None] Volume c32da37e-a2c4-4c5e-af6b-42bd3706af65: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c32da37e-a2c4-4c5e-af6b-42bd3706af65', 'volume_size': 1} Jun 17 05:01:10 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-7abf9c6e-8296-40c4-83e7-7783ea521e39 tempest-CreateVolumesFromSnapshotTest-393697735 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 05:01:10 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-9ab25780-add5-45ab-820e-6cc1eaa8f0eb tempest-VolumeImageDependencyTests-718285973 None] Lock "cinder-dc973c6e-1918-4c9a-97e7-76c385669ed6-delete_volume" acquired by "delete_volume" :: waited 0.089s {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 05:01:10 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-9ab25780-add5-45ab-820e-6cc1eaa8f0eb tempest-VolumeImageDependencyTests-718285973 None] Acquiring lock "cinder-quobyte-dc973c6e-1918-4c9a-97e7-76c385669ed6" by "delete_volume" {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 05:01:10 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-9ab25780-add5-45ab-820e-6cc1eaa8f0eb tempest-VolumeImageDependencyTests-718285973 None] Lock "cinder-quobyte-dc973c6e-1918-4c9a-97e7-76c385669ed6" acquired by "delete_volume" :: waited 0.022s {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 05:01:10 devstack cinder-volume[92060]: DEBUG oslo.privsep.daemon [-] privsep: reply[3085f109-099a-47c1-afb6-5eb189a68b92]: (4, 'raw') {{(pid=93130) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 05:01:10 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-9ab25780-add5-45ab-820e-6cc1eaa8f0eb tempest-VolumeImageDependencyTests-718285973 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-dc973c6e-1918-4c9a-97e7-76c385669ed6 {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:01:10 devstack sudo[111875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-dc973c6e-1918-4c9a-97e7-76c385669ed6 Jun 17 05:01:10 devstack sudo[111875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:01:10 devstack cinder-volume[92060]: DEBUG cinder.volume.flows.manager.create_volume [None req-f6e154e2-d488-44a1-a45c-bd825f48a7ca tempest-CreateVolumesFromSnapshotTest-393697735 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92060) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 17 05:01:10 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-f6e154e2-d488-44a1-a45c-bd825f48a7ca tempest-CreateVolumesFromSnapshotTest-393697735 None] Flow 'volume_create_manager' (44902661-623e-468f-b16c-b6c03a8a1316) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 17 05:01:10 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-f6e154e2-d488-44a1-a45c-bd825f48a7ca tempest-CreateVolumesFromSnapshotTest-393697735 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ff627297-97f5-494a-8d1a-a149205d23d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:01:10 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-f6e154e2-d488-44a1-a45c-bd825f48a7ca tempest-CreateVolumesFromSnapshotTest-393697735 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ff627297-97f5-494a-8d1a-a149205d23d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-17T03:01:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1029986760',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ba272386-aeae-4d0e-944b-91ab6d605255,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2d762ee5566b4bd49583fbd277b6ac45',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T03:01:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T03:01:10Z,use_quota=True,user_id='ee60c55e2c884578be289313c0eb57b4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aad9ce24-93f9-41a6-baa1-5125964f96d1),volume_type_id=aad9ce24-93f9-41a6-baa1-5125964f96d1)' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:01:10 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-f6e154e2-d488-44a1-a45c-bd825f48a7ca tempest-CreateVolumesFromSnapshotTest-393697735 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (51132fac-fce0-4994-866f-356a9d1638a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:01:10 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-f6e154e2-d488-44a1-a45c-bd825f48a7ca tempest-CreateVolumesFromSnapshotTest-393697735 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (51132fac-fce0-4994-866f-356a9d1638a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:01:10 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-f6e154e2-d488-44a1-a45c-bd825f48a7ca tempest-CreateVolumesFromSnapshotTest-393697735 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1f67176e-184d-4a7a-8014-8d7a82ea4f4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:01:10 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-f6e154e2-d488-44a1-a45c-bd825f48a7ca tempest-CreateVolumesFromSnapshotTest-393697735 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1f67176e-184d-4a7a-8014-8d7a82ea4f4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ba272386-aeae-4d0e-944b-91ab6d605255', 'volume_name': 'volume-ba272386-aeae-4d0e-944b-91ab6d605255', 'volume_size': 1}' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:01:10 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-f6e154e2-d488-44a1-a45c-bd825f48a7ca tempest-CreateVolumesFromSnapshotTest-393697735 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4ff7c5d9-67cf-4429-a5c1-c5d4c9cfac47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:01:10 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-f6e154e2-d488-44a1-a45c-bd825f48a7ca tempest-CreateVolumesFromSnapshotTest-393697735 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4ff7c5d9-67cf-4429-a5c1-c5d4c9cfac47) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:01:10 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-f6e154e2-d488-44a1-a45c-bd825f48a7ca tempest-CreateVolumesFromSnapshotTest-393697735 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d94c3188-3352-477b-baf0-2ce423ec4f0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:01:10 devstack cinder-volume[92060]: INFO cinder.volume.flows.manager.create_volume [None req-f6e154e2-d488-44a1-a45c-bd825f48a7ca tempest-CreateVolumesFromSnapshotTest-393697735 None] Volume ba272386-aeae-4d0e-944b-91ab6d605255: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ba272386-aeae-4d0e-944b-91ab6d605255', 'volume_size': 1} Jun 17 05:01:10 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-f6e154e2-d488-44a1-a45c-bd825f48a7ca tempest-CreateVolumesFromSnapshotTest-393697735 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 05:01:10 devstack sudo[111873]: pam_unix(sudo:session): session closed for user root Jun 17 05:01:10 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-575da14a-97a8-4730-868f-980388ced750 tempest-CreateVolumesFromSnapshotTest-393697735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-72e76a05-c3fb-44e5-af2b-246663135f4d" returned: 0 in 0.885s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:01:10 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-575da14a-97a8-4730-868f-980388ced750 tempest-CreateVolumesFromSnapshotTest-393697735 None] <== create_volume: return (2329ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588'} {{(pid=92060) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 17 05:01:10 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-575da14a-97a8-4730-868f-980388ced750 tempest-CreateVolumesFromSnapshotTest-393697735 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.334s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 05:01:10 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-fd25d7b3-b70e-4bd6-8ca6-4e739e611704 tempest-CreateVolumesFromSnapshotTest-393697735 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.850s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 05:01:10 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-fd25d7b3-b70e-4bd6-8ca6-4e739e611704 tempest-CreateVolumesFromSnapshotTest-393697735 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-17T03:01:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-22683673',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b491bb4d-48fe-4883-b72c-5d874d578030,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2d762ee5566b4bd49583fbd277b6ac45',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T03:01:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T03:01:09Z,use_quota=True,user_id='ee60c55e2c884578be289313c0eb57b4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aad9ce24-93f9-41a6-baa1-5125964f96d1),volume_type_id=aad9ce24-93f9-41a6-baa1-5125964f96d1)}" {{(pid=92060) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 17 05:01:10 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.remotefs [None req-fd25d7b3-b70e-4bd6-8ca6-4e739e611704 tempest-CreateVolumesFromSnapshotTest-393697735 None] Creating volume b491bb4d-48fe-4883-b72c-5d874d578030 {{(pid=92060) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 17 05:01:10 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-fd25d7b3-b70e-4bd6-8ca6-4e739e611704 tempest-CreateVolumesFromSnapshotTest-393697735 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 05:01:10 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-fd25d7b3-b70e-4bd6-8ca6-4e739e611704 tempest-CreateVolumesFromSnapshotTest-393697735 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 05:01:10 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-fd25d7b3-b70e-4bd6-8ca6-4e739e611704 tempest-CreateVolumesFromSnapshotTest-393697735 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588': None} {{(pid=92060) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 17 05:01:10 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-fd25d7b3-b70e-4bd6-8ca6-4e739e611704 tempest-CreateVolumesFromSnapshotTest-393697735 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588'] {{(pid=92060) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 17 05:01:10 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-fd25d7b3-b70e-4bd6-8ca6-4e739e611704 tempest-CreateVolumesFromSnapshotTest-393697735 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 05:01:10 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-fd25d7b3-b70e-4bd6-8ca6-4e739e611704 tempest-CreateVolumesFromSnapshotTest-393697735 None] Selected osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588 as target Quobyte volume. {{(pid=92060) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 17 05:01:10 devstack cinder-volume[92060]: INFO cinder.volume.drivers.remotefs [None req-fd25d7b3-b70e-4bd6-8ca6-4e739e611704 tempest-CreateVolumesFromSnapshotTest-393697735 None] casted to osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588 Jun 17 05:01:10 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-fd25d7b3-b70e-4bd6-8ca6-4e739e611704 tempest-CreateVolumesFromSnapshotTest-393697735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-b491bb4d-48fe-4883-b72c-5d874d578030 1073741824 {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:01:10 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-575da14a-97a8-4730-868f-980388ced750 tempest-CreateVolumesFromSnapshotTest-393697735 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (264ae72b-5199-4ce2-8094-25063798ffcc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-72e76a05-c3fb-44e5-af2b-246663135f4d', 'volume_size': 1}' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:01:10 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-575da14a-97a8-4730-868f-980388ced750 tempest-CreateVolumesFromSnapshotTest-393697735 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (56b2f45e-5cc3-4b3b-b804-a189581da516) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:01:10 devstack sudo[111878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-b491bb4d-48fe-4883-b72c-5d874d578030 1073741824 Jun 17 05:01:10 devstack sudo[111878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:01:10 devstack cinder-volume[92060]: INFO cinder.volume.flows.manager.create_volume [None req-575da14a-97a8-4730-868f-980388ced750 tempest-CreateVolumesFromSnapshotTest-393697735 None] Volume volume-72e76a05-c3fb-44e5-af2b-246663135f4d (72e76a05-c3fb-44e5-af2b-246663135f4d): created successfully Jun 17 05:01:10 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-575da14a-97a8-4730-868f-980388ced750 tempest-CreateVolumesFromSnapshotTest-393697735 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (56b2f45e-5cc3-4b3b-b804-a189581da516) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:01:10 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-575da14a-97a8-4730-868f-980388ced750 tempest-CreateVolumesFromSnapshotTest-393697735 None] Flow 'volume_create_manager' (2751d6a5-d77e-49c6-8899-448422234689) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92060) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 17 05:01:10 devstack cinder-volume[92060]: INFO cinder.volume.manager [None req-575da14a-97a8-4730-868f-980388ced750 tempest-CreateVolumesFromSnapshotTest-393697735 None] Created volume successfully. Jun 17 05:01:11 devstack sudo[111875]: pam_unix(sudo:session): session closed for user root Jun 17 05:01:11 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-9ab25780-add5-45ab-820e-6cc1eaa8f0eb tempest-VolumeImageDependencyTests-718285973 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-dc973c6e-1918-4c9a-97e7-76c385669ed6" returned: 0 in 0.780s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:01:11 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-9ab25780-add5-45ab-820e-6cc1eaa8f0eb tempest-VolumeImageDependencyTests-718285973 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-dc973c6e-1918-4c9a-97e7-76c385669ed6 {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:01:11 devstack sudo[111882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-dc973c6e-1918-4c9a-97e7-76c385669ed6 Jun 17 05:01:11 devstack sudo[111882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:01:11 devstack sudo[111878]: pam_unix(sudo:session): session closed for user root Jun 17 05:01:11 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-fd25d7b3-b70e-4bd6-8ca6-4e739e611704 tempest-CreateVolumesFromSnapshotTest-393697735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-b491bb4d-48fe-4883-b72c-5d874d578030 1073741824" returned: 0 in 0.887s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:01:11 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-fd25d7b3-b70e-4bd6-8ca6-4e739e611704 tempest-CreateVolumesFromSnapshotTest-393697735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-b491bb4d-48fe-4883-b72c-5d874d578030 {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:01:11 devstack sudo[111889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-b491bb4d-48fe-4883-b72c-5d874d578030 Jun 17 05:01:11 devstack sudo[111889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:01:11 devstack sudo[111882]: pam_unix(sudo:session): session closed for user root Jun 17 05:01:11 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-9ab25780-add5-45ab-820e-6cc1eaa8f0eb tempest-VolumeImageDependencyTests-718285973 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-dc973c6e-1918-4c9a-97e7-76c385669ed6" returned: 1 in 0.852s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:01:11 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-9ab25780-add5-45ab-820e-6cc1eaa8f0eb tempest-VolumeImageDependencyTests-718285973 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-dc973c6e-1918-4c9a-97e7-76c385669ed6' failed. Not Retrying. {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 17 05:01:11 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-9ab25780-add5-45ab-820e-6cc1eaa8f0eb tempest-VolumeImageDependencyTests-718285973 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-dc973c6e-1918-4c9a-97e7-76c385669ed6 {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:01:11 devstack sudo[111894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-dc973c6e-1918-4c9a-97e7-76c385669ed6 Jun 17 05:01:11 devstack sudo[111894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:01:12 devstack sudo[111889]: pam_unix(sudo:session): session closed for user root Jun 17 05:01:12 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-fd25d7b3-b70e-4bd6-8ca6-4e739e611704 tempest-CreateVolumesFromSnapshotTest-393697735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-b491bb4d-48fe-4883-b72c-5d874d578030" returned: 0 in 0.646s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:01:12 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-fd25d7b3-b70e-4bd6-8ca6-4e739e611704 tempest-CreateVolumesFromSnapshotTest-393697735 None] <== create_volume: return (1574ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588'} {{(pid=92060) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 17 05:01:12 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-fd25d7b3-b70e-4bd6-8ca6-4e739e611704 tempest-CreateVolumesFromSnapshotTest-393697735 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.576s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 05:01:12 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-16bbb193-4232-4740-9792-5c4dc44171e1 tempest-CreateVolumesFromSnapshotTest-393697735 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.795s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 05:01:12 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-16bbb193-4232-4740-9792-5c4dc44171e1 tempest-CreateVolumesFromSnapshotTest-393697735 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-17T03:01:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1014259551',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9dfa83f2-63ab-40ca-a390-f9ab87ce8c5f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2d762ee5566b4bd49583fbd277b6ac45',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T03:01:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T03:01:09Z,use_quota=True,user_id='ee60c55e2c884578be289313c0eb57b4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aad9ce24-93f9-41a6-baa1-5125964f96d1),volume_type_id=aad9ce24-93f9-41a6-baa1-5125964f96d1)}" {{(pid=92060) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 17 05:01:12 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.remotefs [None req-16bbb193-4232-4740-9792-5c4dc44171e1 tempest-CreateVolumesFromSnapshotTest-393697735 None] Creating volume 9dfa83f2-63ab-40ca-a390-f9ab87ce8c5f {{(pid=92060) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 17 05:01:12 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-16bbb193-4232-4740-9792-5c4dc44171e1 tempest-CreateVolumesFromSnapshotTest-393697735 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 05:01:12 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-16bbb193-4232-4740-9792-5c4dc44171e1 tempest-CreateVolumesFromSnapshotTest-393697735 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 05:01:12 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-16bbb193-4232-4740-9792-5c4dc44171e1 tempest-CreateVolumesFromSnapshotTest-393697735 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588': None} {{(pid=92060) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 17 05:01:12 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-16bbb193-4232-4740-9792-5c4dc44171e1 tempest-CreateVolumesFromSnapshotTest-393697735 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588'] {{(pid=92060) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 17 05:01:12 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-16bbb193-4232-4740-9792-5c4dc44171e1 tempest-CreateVolumesFromSnapshotTest-393697735 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 05:01:12 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-16bbb193-4232-4740-9792-5c4dc44171e1 tempest-CreateVolumesFromSnapshotTest-393697735 None] Selected osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588 as target Quobyte volume. {{(pid=92060) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 17 05:01:12 devstack cinder-volume[92060]: INFO cinder.volume.drivers.remotefs [None req-16bbb193-4232-4740-9792-5c4dc44171e1 tempest-CreateVolumesFromSnapshotTest-393697735 None] casted to osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588 Jun 17 05:01:12 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-16bbb193-4232-4740-9792-5c4dc44171e1 tempest-CreateVolumesFromSnapshotTest-393697735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-9dfa83f2-63ab-40ca-a390-f9ab87ce8c5f 1073741824 {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:01:12 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-fd25d7b3-b70e-4bd6-8ca6-4e739e611704 tempest-CreateVolumesFromSnapshotTest-393697735 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fd06e187-cfdf-463d-afc9-fcd76f1532f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b491bb4d-48fe-4883-b72c-5d874d578030', 'volume_size': 1}' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:01:12 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-fd25d7b3-b70e-4bd6-8ca6-4e739e611704 tempest-CreateVolumesFromSnapshotTest-393697735 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3272289a-0ed1-4e4d-a1c1-63c46af05f71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:01:12 devstack sudo[111898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-9dfa83f2-63ab-40ca-a390-f9ab87ce8c5f 1073741824 Jun 17 05:01:12 devstack sudo[111898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:01:12 devstack cinder-volume[92060]: INFO cinder.volume.flows.manager.create_volume [None req-fd25d7b3-b70e-4bd6-8ca6-4e739e611704 tempest-CreateVolumesFromSnapshotTest-393697735 None] Volume volume-b491bb4d-48fe-4883-b72c-5d874d578030 (b491bb4d-48fe-4883-b72c-5d874d578030): created successfully Jun 17 05:01:12 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-fd25d7b3-b70e-4bd6-8ca6-4e739e611704 tempest-CreateVolumesFromSnapshotTest-393697735 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3272289a-0ed1-4e4d-a1c1-63c46af05f71) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:01:12 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-fd25d7b3-b70e-4bd6-8ca6-4e739e611704 tempest-CreateVolumesFromSnapshotTest-393697735 None] Flow 'volume_create_manager' (6e081e53-9379-43d8-9f8c-a70a7c42bd66) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92060) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 17 05:01:12 devstack cinder-volume[92060]: INFO cinder.volume.manager [None req-fd25d7b3-b70e-4bd6-8ca6-4e739e611704 tempest-CreateVolumesFromSnapshotTest-393697735 None] Created volume successfully. Jun 17 05:01:12 devstack sudo[111894]: pam_unix(sudo:session): session closed for user root Jun 17 05:01:12 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-9ab25780-add5-45ab-820e-6cc1eaa8f0eb tempest-VolumeImageDependencyTests-718285973 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-dc973c6e-1918-4c9a-97e7-76c385669ed6" returned: 0 in 0.626s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:01:12 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-9ab25780-add5-45ab-820e-6cc1eaa8f0eb tempest-VolumeImageDependencyTests-718285973 None] Lock "cinder-quobyte-dc973c6e-1918-4c9a-97e7-76c385669ed6" released by "delete_volume" :: held 2.366s {{(pid=92060) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 05:01:12 devstack cinder-volume[92060]: DEBUG cinder.quota [None req-9ab25780-add5-45ab-820e-6cc1eaa8f0eb tempest-VolumeImageDependencyTests-718285973 None] Created reservations ['5b8a5e97-b7cf-4210-91b5-84e49ae78c01', 'a9d68d4f-7656-4ff9-8e04-263206b7716e', 'ebeea175-059b-4837-b2fe-42891349e902', '9e881664-f9cd-4120-9baf-673f10002e87'] {{(pid=92060) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 17 05:01:12 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-9ab25780-add5-45ab-820e-6cc1eaa8f0eb tempest-VolumeImageDependencyTests-718285973 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 05:01:12 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-9ab25780-add5-45ab-820e-6cc1eaa8f0eb tempest-VolumeImageDependencyTests-718285973 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 05:01:12 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-9ab25780-add5-45ab-820e-6cc1eaa8f0eb tempest-VolumeImageDependencyTests-718285973 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588': None} {{(pid=92060) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 17 05:01:12 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-9ab25780-add5-45ab-820e-6cc1eaa8f0eb tempest-VolumeImageDependencyTests-718285973 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588'] {{(pid=92060) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 17 05:01:12 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-9ab25780-add5-45ab-820e-6cc1eaa8f0eb tempest-VolumeImageDependencyTests-718285973 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 05:01:12 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-9ab25780-add5-45ab-820e-6cc1eaa8f0eb tempest-VolumeImageDependencyTests-718285973 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:01:12 devstack sudo[111900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a Jun 17 05:01:12 devstack sudo[111900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:01:13 devstack sudo[111898]: pam_unix(sudo:session): session closed for user root Jun 17 05:01:13 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-16bbb193-4232-4740-9792-5c4dc44171e1 tempest-CreateVolumesFromSnapshotTest-393697735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-9dfa83f2-63ab-40ca-a390-f9ab87ce8c5f 1073741824" returned: 0 in 0.930s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:01:13 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-16bbb193-4232-4740-9792-5c4dc44171e1 tempest-CreateVolumesFromSnapshotTest-393697735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-9dfa83f2-63ab-40ca-a390-f9ab87ce8c5f {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:01:13 devstack sudo[111907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-9dfa83f2-63ab-40ca-a390-f9ab87ce8c5f Jun 17 05:01:13 devstack sudo[111907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:01:13 devstack sudo[111900]: pam_unix(sudo:session): session closed for user root Jun 17 05:01:13 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-9ab25780-add5-45ab-820e-6cc1eaa8f0eb tempest-VolumeImageDependencyTests-718285973 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a" returned: 0 in 0.727s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:01:13 devstack cinder-volume[92060]: DEBUG cinder.manager [None req-9ab25780-add5-45ab-820e-6cc1eaa8f0eb tempest-VolumeImageDependencyTests-718285973 None] Notifying Schedulers of capabilities ... {{(pid=92060) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 17 05:01:13 devstack cinder-volume[92060]: INFO cinder.volume.manager [None req-9ab25780-add5-45ab-820e-6cc1eaa8f0eb tempest-VolumeImageDependencyTests-718285973 None] Deleted volume successfully. Jun 17 05:01:13 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-9ab25780-add5-45ab-820e-6cc1eaa8f0eb tempest-VolumeImageDependencyTests-718285973 None] Lock "cinder-dc973c6e-1918-4c9a-97e7-76c385669ed6-delete_volume" released by "delete_volume" :: held 3.472s {{(pid=92060) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 05:01:14 devstack sudo[111907]: pam_unix(sudo:session): session closed for user root Jun 17 05:01:14 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-16bbb193-4232-4740-9792-5c4dc44171e1 tempest-CreateVolumesFromSnapshotTest-393697735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-9dfa83f2-63ab-40ca-a390-f9ab87ce8c5f" returned: 0 in 0.650s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:01:14 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-16bbb193-4232-4740-9792-5c4dc44171e1 tempest-CreateVolumesFromSnapshotTest-393697735 None] <== create_volume: return (1645ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588'} {{(pid=92060) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 17 05:01:14 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-16bbb193-4232-4740-9792-5c4dc44171e1 tempest-CreateVolumesFromSnapshotTest-393697735 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.649s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 05:01:14 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-7abf9c6e-8296-40c4-83e7-7783ea521e39 tempest-CreateVolumesFromSnapshotTest-393697735 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.973s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 05:01:14 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-7abf9c6e-8296-40c4-83e7-7783ea521e39 tempest-CreateVolumesFromSnapshotTest-393697735 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-17T03:01:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-344750925',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c32da37e-a2c4-4c5e-af6b-42bd3706af65,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2d762ee5566b4bd49583fbd277b6ac45',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T03:01:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T03:01:10Z,use_quota=True,user_id='ee60c55e2c884578be289313c0eb57b4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aad9ce24-93f9-41a6-baa1-5125964f96d1),volume_type_id=aad9ce24-93f9-41a6-baa1-5125964f96d1)}" {{(pid=92060) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 17 05:01:14 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.remotefs [None req-7abf9c6e-8296-40c4-83e7-7783ea521e39 tempest-CreateVolumesFromSnapshotTest-393697735 None] Creating volume c32da37e-a2c4-4c5e-af6b-42bd3706af65 {{(pid=92060) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 17 05:01:14 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-7abf9c6e-8296-40c4-83e7-7783ea521e39 tempest-CreateVolumesFromSnapshotTest-393697735 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 05:01:14 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-7abf9c6e-8296-40c4-83e7-7783ea521e39 tempest-CreateVolumesFromSnapshotTest-393697735 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 05:01:14 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-7abf9c6e-8296-40c4-83e7-7783ea521e39 tempest-CreateVolumesFromSnapshotTest-393697735 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588': None} {{(pid=92060) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 17 05:01:14 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-7abf9c6e-8296-40c4-83e7-7783ea521e39 tempest-CreateVolumesFromSnapshotTest-393697735 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588'] {{(pid=92060) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 17 05:01:14 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-7abf9c6e-8296-40c4-83e7-7783ea521e39 tempest-CreateVolumesFromSnapshotTest-393697735 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 05:01:14 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-7abf9c6e-8296-40c4-83e7-7783ea521e39 tempest-CreateVolumesFromSnapshotTest-393697735 None] Selected osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588 as target Quobyte volume. {{(pid=92060) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 17 05:01:14 devstack cinder-volume[92060]: INFO cinder.volume.drivers.remotefs [None req-7abf9c6e-8296-40c4-83e7-7783ea521e39 tempest-CreateVolumesFromSnapshotTest-393697735 None] casted to osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588 Jun 17 05:01:14 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-7abf9c6e-8296-40c4-83e7-7783ea521e39 tempest-CreateVolumesFromSnapshotTest-393697735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-c32da37e-a2c4-4c5e-af6b-42bd3706af65 1073741824 {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:01:14 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-16bbb193-4232-4740-9792-5c4dc44171e1 tempest-CreateVolumesFromSnapshotTest-393697735 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (64ec69db-f25c-4cb9-93d2-acf75e801e34) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9dfa83f2-63ab-40ca-a390-f9ab87ce8c5f', 'volume_size': 1}' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:01:14 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-16bbb193-4232-4740-9792-5c4dc44171e1 tempest-CreateVolumesFromSnapshotTest-393697735 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fd2ccc25-29c5-4841-81a0-cde78ef4dd71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:01:14 devstack sudo[111910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-c32da37e-a2c4-4c5e-af6b-42bd3706af65 1073741824 Jun 17 05:01:14 devstack sudo[111910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:01:14 devstack cinder-volume[92060]: INFO cinder.volume.flows.manager.create_volume [None req-16bbb193-4232-4740-9792-5c4dc44171e1 tempest-CreateVolumesFromSnapshotTest-393697735 None] Volume volume-9dfa83f2-63ab-40ca-a390-f9ab87ce8c5f (9dfa83f2-63ab-40ca-a390-f9ab87ce8c5f): created successfully Jun 17 05:01:14 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-16bbb193-4232-4740-9792-5c4dc44171e1 tempest-CreateVolumesFromSnapshotTest-393697735 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fd2ccc25-29c5-4841-81a0-cde78ef4dd71) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:01:14 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-16bbb193-4232-4740-9792-5c4dc44171e1 tempest-CreateVolumesFromSnapshotTest-393697735 None] Flow 'volume_create_manager' (417355b9-d91a-46e6-8801-49ad5dd47530) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92060) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 17 05:01:14 devstack cinder-volume[92060]: INFO cinder.volume.manager [None req-16bbb193-4232-4740-9792-5c4dc44171e1 tempest-CreateVolumesFromSnapshotTest-393697735 None] Created volume successfully. Jun 17 05:01:15 devstack sudo[111910]: pam_unix(sudo:session): session closed for user root Jun 17 05:01:15 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-7abf9c6e-8296-40c4-83e7-7783ea521e39 tempest-CreateVolumesFromSnapshotTest-393697735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-c32da37e-a2c4-4c5e-af6b-42bd3706af65 1073741824" returned: 0 in 0.954s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:01:15 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-7abf9c6e-8296-40c4-83e7-7783ea521e39 tempest-CreateVolumesFromSnapshotTest-393697735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-c32da37e-a2c4-4c5e-af6b-42bd3706af65 {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:01:15 devstack sudo[111916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-c32da37e-a2c4-4c5e-af6b-42bd3706af65 Jun 17 05:01:15 devstack sudo[111916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:01:15 devstack sudo[111916]: pam_unix(sudo:session): session closed for user root Jun 17 05:01:15 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-7abf9c6e-8296-40c4-83e7-7783ea521e39 tempest-CreateVolumesFromSnapshotTest-393697735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-c32da37e-a2c4-4c5e-af6b-42bd3706af65" returned: 0 in 0.721s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:01:15 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-7abf9c6e-8296-40c4-83e7-7783ea521e39 tempest-CreateVolumesFromSnapshotTest-393697735 None] <== create_volume: return (1733ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588'} {{(pid=92060) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 17 05:01:15 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-7abf9c6e-8296-40c4-83e7-7783ea521e39 tempest-CreateVolumesFromSnapshotTest-393697735 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.736s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 05:01:15 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-f6e154e2-d488-44a1-a45c-bd825f48a7ca tempest-CreateVolumesFromSnapshotTest-393697735 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.145s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 05:01:15 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-f6e154e2-d488-44a1-a45c-bd825f48a7ca tempest-CreateVolumesFromSnapshotTest-393697735 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-17T03:01:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1029986760',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ba272386-aeae-4d0e-944b-91ab6d605255,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2d762ee5566b4bd49583fbd277b6ac45',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T03:01:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T03:01:10Z,use_quota=True,user_id='ee60c55e2c884578be289313c0eb57b4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aad9ce24-93f9-41a6-baa1-5125964f96d1),volume_type_id=aad9ce24-93f9-41a6-baa1-5125964f96d1)}" {{(pid=92060) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 17 05:01:15 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.remotefs [None req-f6e154e2-d488-44a1-a45c-bd825f48a7ca tempest-CreateVolumesFromSnapshotTest-393697735 None] Creating volume ba272386-aeae-4d0e-944b-91ab6d605255 {{(pid=92060) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 17 05:01:15 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-f6e154e2-d488-44a1-a45c-bd825f48a7ca tempest-CreateVolumesFromSnapshotTest-393697735 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 05:01:15 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-f6e154e2-d488-44a1-a45c-bd825f48a7ca tempest-CreateVolumesFromSnapshotTest-393697735 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 05:01:15 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-f6e154e2-d488-44a1-a45c-bd825f48a7ca tempest-CreateVolumesFromSnapshotTest-393697735 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588': None} {{(pid=92060) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 17 05:01:15 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-f6e154e2-d488-44a1-a45c-bd825f48a7ca tempest-CreateVolumesFromSnapshotTest-393697735 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588'] {{(pid=92060) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 17 05:01:15 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-f6e154e2-d488-44a1-a45c-bd825f48a7ca tempest-CreateVolumesFromSnapshotTest-393697735 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 05:01:15 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-f6e154e2-d488-44a1-a45c-bd825f48a7ca tempest-CreateVolumesFromSnapshotTest-393697735 None] Selected osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588 as target Quobyte volume. {{(pid=92060) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 17 05:01:15 devstack cinder-volume[92060]: INFO cinder.volume.drivers.remotefs [None req-f6e154e2-d488-44a1-a45c-bd825f48a7ca tempest-CreateVolumesFromSnapshotTest-393697735 None] casted to osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588 Jun 17 05:01:15 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-f6e154e2-d488-44a1-a45c-bd825f48a7ca tempest-CreateVolumesFromSnapshotTest-393697735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-ba272386-aeae-4d0e-944b-91ab6d605255 1073741824 {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:01:15 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-7abf9c6e-8296-40c4-83e7-7783ea521e39 tempest-CreateVolumesFromSnapshotTest-393697735 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1b3bc853-935b-4da8-aadc-d8723cfd999b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c32da37e-a2c4-4c5e-af6b-42bd3706af65', 'volume_size': 1}' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:01:15 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-7abf9c6e-8296-40c4-83e7-7783ea521e39 tempest-CreateVolumesFromSnapshotTest-393697735 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8b981a22-f5cb-409b-8632-97778608b29f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:01:15 devstack sudo[111919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-ba272386-aeae-4d0e-944b-91ab6d605255 1073741824 Jun 17 05:01:15 devstack sudo[111919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:01:15 devstack cinder-volume[92060]: INFO cinder.volume.flows.manager.create_volume [None req-7abf9c6e-8296-40c4-83e7-7783ea521e39 tempest-CreateVolumesFromSnapshotTest-393697735 None] Volume volume-c32da37e-a2c4-4c5e-af6b-42bd3706af65 (c32da37e-a2c4-4c5e-af6b-42bd3706af65): created successfully Jun 17 05:01:15 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-7abf9c6e-8296-40c4-83e7-7783ea521e39 tempest-CreateVolumesFromSnapshotTest-393697735 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8b981a22-f5cb-409b-8632-97778608b29f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:01:15 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-7abf9c6e-8296-40c4-83e7-7783ea521e39 tempest-CreateVolumesFromSnapshotTest-393697735 None] Flow 'volume_create_manager' (c746b07e-e1f4-4c47-84fa-f9e72f0c7d1b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92060) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 17 05:01:15 devstack cinder-volume[92060]: INFO cinder.volume.manager [None req-7abf9c6e-8296-40c4-83e7-7783ea521e39 tempest-CreateVolumesFromSnapshotTest-393697735 None] Created volume successfully. Jun 17 05:01:16 devstack sudo[111919]: pam_unix(sudo:session): session closed for user root Jun 17 05:01:16 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-f6e154e2-d488-44a1-a45c-bd825f48a7ca tempest-CreateVolumesFromSnapshotTest-393697735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-ba272386-aeae-4d0e-944b-91ab6d605255 1073741824" returned: 0 in 0.868s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:01:16 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-f6e154e2-d488-44a1-a45c-bd825f48a7ca tempest-CreateVolumesFromSnapshotTest-393697735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-ba272386-aeae-4d0e-944b-91ab6d605255 {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:01:16 devstack sudo[111925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-ba272386-aeae-4d0e-944b-91ab6d605255 Jun 17 05:01:16 devstack sudo[111925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:01:17 devstack sudo[111925]: pam_unix(sudo:session): session closed for user root Jun 17 05:01:17 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-f6e154e2-d488-44a1-a45c-bd825f48a7ca tempest-CreateVolumesFromSnapshotTest-393697735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-ba272386-aeae-4d0e-944b-91ab6d605255" returned: 0 in 0.630s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:01:17 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-f6e154e2-d488-44a1-a45c-bd825f48a7ca tempest-CreateVolumesFromSnapshotTest-393697735 None] <== create_volume: return (1547ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588'} {{(pid=92060) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 17 05:01:17 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-f6e154e2-d488-44a1-a45c-bd825f48a7ca tempest-CreateVolumesFromSnapshotTest-393697735 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.550s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 05:01:17 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-f6e154e2-d488-44a1-a45c-bd825f48a7ca tempest-CreateVolumesFromSnapshotTest-393697735 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d94c3188-3352-477b-baf0-2ce423ec4f0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ba272386-aeae-4d0e-944b-91ab6d605255', 'volume_size': 1}' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:01:17 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-f6e154e2-d488-44a1-a45c-bd825f48a7ca tempest-CreateVolumesFromSnapshotTest-393697735 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9cf5d330-9e59-4a6a-a1f3-4f3bb80119a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:01:17 devstack cinder-volume[92060]: INFO cinder.volume.flows.manager.create_volume [None req-f6e154e2-d488-44a1-a45c-bd825f48a7ca tempest-CreateVolumesFromSnapshotTest-393697735 None] Volume volume-ba272386-aeae-4d0e-944b-91ab6d605255 (ba272386-aeae-4d0e-944b-91ab6d605255): created successfully Jun 17 05:01:17 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-f6e154e2-d488-44a1-a45c-bd825f48a7ca tempest-CreateVolumesFromSnapshotTest-393697735 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9cf5d330-9e59-4a6a-a1f3-4f3bb80119a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:01:17 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-f6e154e2-d488-44a1-a45c-bd825f48a7ca tempest-CreateVolumesFromSnapshotTest-393697735 None] Flow 'volume_create_manager' (44902661-623e-468f-b16c-b6c03a8a1316) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92060) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 17 05:01:17 devstack cinder-volume[92060]: INFO cinder.volume.manager [None req-f6e154e2-d488-44a1-a45c-bd825f48a7ca tempest-CreateVolumesFromSnapshotTest-393697735 None] Created volume successfully. Jun 17 05:01:18 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-bb58cbeb-bb01-40f6-9667-1703590b77a8 tempest-CreateVolumesFromSnapshotTest-393697735 None] Acquiring lock "cinder-ba272386-aeae-4d0e-944b-91ab6d605255-delete_volume" by "delete_volume" {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 05:01:18 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-bb58cbeb-bb01-40f6-9667-1703590b77a8 tempest-CreateVolumesFromSnapshotTest-393697735 None] Lock "cinder-ba272386-aeae-4d0e-944b-91ab6d605255-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 05:01:18 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-bb58cbeb-bb01-40f6-9667-1703590b77a8 tempest-CreateVolumesFromSnapshotTest-393697735 None] Acquiring lock "cinder-quobyte-ba272386-aeae-4d0e-944b-91ab6d605255" by "delete_volume" {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 05:01:18 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-bb58cbeb-bb01-40f6-9667-1703590b77a8 tempest-CreateVolumesFromSnapshotTest-393697735 None] Lock "cinder-quobyte-ba272386-aeae-4d0e-944b-91ab6d605255" acquired by "delete_volume" :: waited 0.024s {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 05:01:18 devstack cinder-volume[92060]: DEBUG oslo.privsep.daemon [-] privsep: reply[8434b56a-1940-4752-bfe1-92235c75bb80]: (4, 'qcow2') {{(pid=93130) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 05:01:18 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-bb58cbeb-bb01-40f6-9667-1703590b77a8 tempest-CreateVolumesFromSnapshotTest-393697735 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-ba272386-aeae-4d0e-944b-91ab6d605255 {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:01:18 devstack sudo[111928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-ba272386-aeae-4d0e-944b-91ab6d605255 Jun 17 05:01:18 devstack sudo[111928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:01:19 devstack cinder-volume[92060]: DEBUG cinder.volume.flows.manager.create_volume [None req-52e2ce46-9760-490a-a533-6913d1c3b27d tempest-SnapshotDependencyTests-543619335 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92060) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 17 05:01:19 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-52e2ce46-9760-490a-a533-6913d1c3b27d tempest-SnapshotDependencyTests-543619335 None] Flow 'volume_create_manager' (a78a2aaf-a716-417f-bea1-094f203f040b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 17 05:01:19 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-52e2ce46-9760-490a-a533-6913d1c3b27d tempest-SnapshotDependencyTests-543619335 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1fa99b0e-9041-4edc-a3f1-a03950504bbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:01:19 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-52e2ce46-9760-490a-a533-6913d1c3b27d tempest-SnapshotDependencyTests-543619335 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1fa99b0e-9041-4edc-a3f1-a03950504bbb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-17T03:01:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-453596335',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a5b80256-2315-44e4-9e8a-92c2f9bef566,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4a3239f11dcb4da79a42026150cb8308',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T03:01:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T03:01:19Z,use_quota=True,user_id='c88855ab1b2c42aeb201163e53a22d8a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aad9ce24-93f9-41a6-baa1-5125964f96d1),volume_type_id=aad9ce24-93f9-41a6-baa1-5125964f96d1)' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:01:19 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-52e2ce46-9760-490a-a533-6913d1c3b27d tempest-SnapshotDependencyTests-543619335 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c1399b63-1e91-4382-8d29-3d22b2a9708a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:01:19 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-52e2ce46-9760-490a-a533-6913d1c3b27d tempest-SnapshotDependencyTests-543619335 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c1399b63-1e91-4382-8d29-3d22b2a9708a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:01:19 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-52e2ce46-9760-490a-a533-6913d1c3b27d tempest-SnapshotDependencyTests-543619335 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c00547e5-4cff-496a-aeee-44b86bf8e1c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:01:19 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-52e2ce46-9760-490a-a533-6913d1c3b27d tempest-SnapshotDependencyTests-543619335 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c00547e5-4cff-496a-aeee-44b86bf8e1c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a5b80256-2315-44e4-9e8a-92c2f9bef566', 'volume_name': 'volume-a5b80256-2315-44e4-9e8a-92c2f9bef566', 'volume_size': 1}' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:01:19 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-52e2ce46-9760-490a-a533-6913d1c3b27d tempest-SnapshotDependencyTests-543619335 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fffe0b39-010b-4fdb-9940-e7d727f1bb4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:01:19 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-52e2ce46-9760-490a-a533-6913d1c3b27d tempest-SnapshotDependencyTests-543619335 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fffe0b39-010b-4fdb-9940-e7d727f1bb4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:01:19 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-52e2ce46-9760-490a-a533-6913d1c3b27d tempest-SnapshotDependencyTests-543619335 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (42ebe22b-7fbf-4308-887c-a22db6bcc65d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:01:19 devstack cinder-volume[92060]: INFO cinder.volume.flows.manager.create_volume [None req-52e2ce46-9760-490a-a533-6913d1c3b27d tempest-SnapshotDependencyTests-543619335 None] Volume a5b80256-2315-44e4-9e8a-92c2f9bef566: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a5b80256-2315-44e4-9e8a-92c2f9bef566', 'volume_size': 1} Jun 17 05:01:19 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-52e2ce46-9760-490a-a533-6913d1c3b27d tempest-SnapshotDependencyTests-543619335 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 05:01:19 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-52e2ce46-9760-490a-a533-6913d1c3b27d tempest-SnapshotDependencyTests-543619335 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 05:01:19 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-52e2ce46-9760-490a-a533-6913d1c3b27d tempest-SnapshotDependencyTests-543619335 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-17T03:01:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-453596335',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a5b80256-2315-44e4-9e8a-92c2f9bef566,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4a3239f11dcb4da79a42026150cb8308',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T03:01:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T03:01:19Z,use_quota=True,user_id='c88855ab1b2c42aeb201163e53a22d8a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aad9ce24-93f9-41a6-baa1-5125964f96d1),volume_type_id=aad9ce24-93f9-41a6-baa1-5125964f96d1)}" {{(pid=92060) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 17 05:01:19 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.remotefs [None req-52e2ce46-9760-490a-a533-6913d1c3b27d tempest-SnapshotDependencyTests-543619335 None] Creating volume a5b80256-2315-44e4-9e8a-92c2f9bef566 {{(pid=92060) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 17 05:01:19 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-52e2ce46-9760-490a-a533-6913d1c3b27d tempest-SnapshotDependencyTests-543619335 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 05:01:19 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-52e2ce46-9760-490a-a533-6913d1c3b27d tempest-SnapshotDependencyTests-543619335 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 05:01:19 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-52e2ce46-9760-490a-a533-6913d1c3b27d tempest-SnapshotDependencyTests-543619335 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588': None} {{(pid=92060) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 17 05:01:19 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-52e2ce46-9760-490a-a533-6913d1c3b27d tempest-SnapshotDependencyTests-543619335 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588'] {{(pid=92060) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 17 05:01:19 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-52e2ce46-9760-490a-a533-6913d1c3b27d tempest-SnapshotDependencyTests-543619335 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 05:01:19 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-52e2ce46-9760-490a-a533-6913d1c3b27d tempest-SnapshotDependencyTests-543619335 None] Selected osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588 as target Quobyte volume. {{(pid=92060) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 17 05:01:19 devstack cinder-volume[92060]: INFO cinder.volume.drivers.remotefs [None req-52e2ce46-9760-490a-a533-6913d1c3b27d tempest-SnapshotDependencyTests-543619335 None] casted to osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588 Jun 17 05:01:19 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-52e2ce46-9760-490a-a533-6913d1c3b27d tempest-SnapshotDependencyTests-543619335 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-a5b80256-2315-44e4-9e8a-92c2f9bef566 1073741824 {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:01:19 devstack sudo[111934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-a5b80256-2315-44e4-9e8a-92c2f9bef566 1073741824 Jun 17 05:01:19 devstack sudo[111934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:01:19 devstack sudo[111928]: pam_unix(sudo:session): session closed for user root Jun 17 05:01:19 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-bb58cbeb-bb01-40f6-9667-1703590b77a8 tempest-CreateVolumesFromSnapshotTest-393697735 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-ba272386-aeae-4d0e-944b-91ab6d605255" returned: 0 in 0.730s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:01:19 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-bb58cbeb-bb01-40f6-9667-1703590b77a8 tempest-CreateVolumesFromSnapshotTest-393697735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-ba272386-aeae-4d0e-944b-91ab6d605255 {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:01:19 devstack sudo[111936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-ba272386-aeae-4d0e-944b-91ab6d605255 Jun 17 05:01:19 devstack sudo[111936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:01:19 devstack sudo[111936]: pam_unix(sudo:session): session closed for user root Jun 17 05:01:19 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-bb58cbeb-bb01-40f6-9667-1703590b77a8 tempest-CreateVolumesFromSnapshotTest-393697735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-ba272386-aeae-4d0e-944b-91ab6d605255" returned: 0 in 0.622s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:01:19 devstack sudo[111934]: pam_unix(sudo:session): session closed for user root Jun 17 05:01:19 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-52e2ce46-9760-490a-a533-6913d1c3b27d tempest-SnapshotDependencyTests-543619335 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-a5b80256-2315-44e4-9e8a-92c2f9bef566 1073741824" returned: 0 in 0.747s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:01:19 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-bb58cbeb-bb01-40f6-9667-1703590b77a8 tempest-CreateVolumesFromSnapshotTest-393697735 None] Lock "cinder-quobyte-ba272386-aeae-4d0e-944b-91ab6d605255" released by "delete_volume" :: held 1.402s {{(pid=92060) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 05:01:19 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-52e2ce46-9760-490a-a533-6913d1c3b27d tempest-SnapshotDependencyTests-543619335 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-a5b80256-2315-44e4-9e8a-92c2f9bef566 {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:01:19 devstack sudo[111942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-a5b80256-2315-44e4-9e8a-92c2f9bef566 Jun 17 05:01:19 devstack sudo[111942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:01:19 devstack cinder-volume[92060]: DEBUG cinder.quota [None req-bb58cbeb-bb01-40f6-9667-1703590b77a8 tempest-CreateVolumesFromSnapshotTest-393697735 None] Created reservations ['71725cb8-b7ea-4a7f-aec9-30a70e45b8ff', 'fdb4c2c5-b09d-47de-ba44-10c732aeef02', '44dfa7ee-7481-4e76-b6a0-49f197de65d9', 'af62d93e-7881-457d-af5c-f9dec826f9aa'] {{(pid=92060) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 17 05:01:20 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-bb58cbeb-bb01-40f6-9667-1703590b77a8 tempest-CreateVolumesFromSnapshotTest-393697735 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 05:01:20 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-bb58cbeb-bb01-40f6-9667-1703590b77a8 tempest-CreateVolumesFromSnapshotTest-393697735 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 05:01:20 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-bb58cbeb-bb01-40f6-9667-1703590b77a8 tempest-CreateVolumesFromSnapshotTest-393697735 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588': None} {{(pid=92060) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 17 05:01:20 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-bb58cbeb-bb01-40f6-9667-1703590b77a8 tempest-CreateVolumesFromSnapshotTest-393697735 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588'] {{(pid=92060) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 17 05:01:20 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-bb58cbeb-bb01-40f6-9667-1703590b77a8 tempest-CreateVolumesFromSnapshotTest-393697735 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 05:01:20 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-bb58cbeb-bb01-40f6-9667-1703590b77a8 tempest-CreateVolumesFromSnapshotTest-393697735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:01:20 devstack sudo[111944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a Jun 17 05:01:20 devstack sudo[111944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:01:20 devstack sudo[111942]: pam_unix(sudo:session): session closed for user root Jun 17 05:01:20 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-52e2ce46-9760-490a-a533-6913d1c3b27d tempest-SnapshotDependencyTests-543619335 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-a5b80256-2315-44e4-9e8a-92c2f9bef566" returned: 0 in 0.580s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:01:20 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-52e2ce46-9760-490a-a533-6913d1c3b27d tempest-SnapshotDependencyTests-543619335 None] <== create_volume: return (1371ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588'} {{(pid=92060) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 17 05:01:20 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-52e2ce46-9760-490a-a533-6913d1c3b27d tempest-SnapshotDependencyTests-543619335 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.374s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 05:01:20 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-52e2ce46-9760-490a-a533-6913d1c3b27d tempest-SnapshotDependencyTests-543619335 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (42ebe22b-7fbf-4308-887c-a22db6bcc65d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a5b80256-2315-44e4-9e8a-92c2f9bef566', 'volume_size': 1}' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:01:20 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-52e2ce46-9760-490a-a533-6913d1c3b27d tempest-SnapshotDependencyTests-543619335 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (63ef36f6-c6ac-4c69-b9de-96b5ff93203a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:01:20 devstack cinder-volume[92060]: INFO cinder.volume.flows.manager.create_volume [None req-52e2ce46-9760-490a-a533-6913d1c3b27d tempest-SnapshotDependencyTests-543619335 None] Volume volume-a5b80256-2315-44e4-9e8a-92c2f9bef566 (a5b80256-2315-44e4-9e8a-92c2f9bef566): created successfully Jun 17 05:01:20 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-52e2ce46-9760-490a-a533-6913d1c3b27d tempest-SnapshotDependencyTests-543619335 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (63ef36f6-c6ac-4c69-b9de-96b5ff93203a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:01:20 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-52e2ce46-9760-490a-a533-6913d1c3b27d tempest-SnapshotDependencyTests-543619335 None] Flow 'volume_create_manager' (a78a2aaf-a716-417f-bea1-094f203f040b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92060) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 17 05:01:20 devstack cinder-volume[92060]: INFO cinder.volume.manager [None req-52e2ce46-9760-490a-a533-6913d1c3b27d tempest-SnapshotDependencyTests-543619335 None] Created volume successfully. Jun 17 05:01:20 devstack sudo[111944]: pam_unix(sudo:session): session closed for user root Jun 17 05:01:20 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-bb58cbeb-bb01-40f6-9667-1703590b77a8 tempest-CreateVolumesFromSnapshotTest-393697735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a" returned: 0 in 0.595s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:01:20 devstack cinder-volume[92060]: DEBUG cinder.manager [None req-bb58cbeb-bb01-40f6-9667-1703590b77a8 tempest-CreateVolumesFromSnapshotTest-393697735 None] Notifying Schedulers of capabilities ... {{(pid=92060) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 17 05:01:20 devstack cinder-volume[92060]: INFO cinder.volume.manager [None req-bb58cbeb-bb01-40f6-9667-1703590b77a8 tempest-CreateVolumesFromSnapshotTest-393697735 None] Deleted volume successfully. Jun 17 05:01:20 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-2153de23-9138-4c9d-9064-69666b0c149d tempest-CreateVolumesFromSnapshotTest-393697735 None] Acquiring lock "cinder-c32da37e-a2c4-4c5e-af6b-42bd3706af65-delete_volume" by "delete_volume" {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 05:01:20 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-bb58cbeb-bb01-40f6-9667-1703590b77a8 tempest-CreateVolumesFromSnapshotTest-393697735 None] Lock "cinder-ba272386-aeae-4d0e-944b-91ab6d605255-delete_volume" released by "delete_volume" :: held 2.233s {{(pid=92060) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 05:01:20 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-2153de23-9138-4c9d-9064-69666b0c149d tempest-CreateVolumesFromSnapshotTest-393697735 None] Lock "cinder-c32da37e-a2c4-4c5e-af6b-42bd3706af65-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 05:01:20 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-2153de23-9138-4c9d-9064-69666b0c149d tempest-CreateVolumesFromSnapshotTest-393697735 None] Acquiring lock "cinder-quobyte-c32da37e-a2c4-4c5e-af6b-42bd3706af65" by "delete_volume" {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 05:01:20 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-2153de23-9138-4c9d-9064-69666b0c149d tempest-CreateVolumesFromSnapshotTest-393697735 None] Lock "cinder-quobyte-c32da37e-a2c4-4c5e-af6b-42bd3706af65" acquired by "delete_volume" :: waited 0.016s {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 05:01:20 devstack cinder-volume[92060]: DEBUG oslo.privsep.daemon [-] privsep: reply[b87b9819-4bdd-461c-81fc-2e8c0a388ae9]: (4, 'qcow2') {{(pid=93130) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 05:01:20 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-2153de23-9138-4c9d-9064-69666b0c149d tempest-CreateVolumesFromSnapshotTest-393697735 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-c32da37e-a2c4-4c5e-af6b-42bd3706af65 {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:01:20 devstack sudo[111948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-c32da37e-a2c4-4c5e-af6b-42bd3706af65 Jun 17 05:01:20 devstack sudo[111948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:01:21 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-0a6b8fa6-1595-4898-b9d3-837b377e98ce tempest-SnapshotDependencyTests-543619335 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 05:01:21 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-0a6b8fa6-1595-4898-b9d3-837b377e98ce tempest-SnapshotDependencyTests-543619335 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 05:01:21 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.remotefs [None req-0a6b8fa6-1595-4898-b9d3-837b377e98ce tempest-SnapshotDependencyTests-543619335 None] Creating offline snapshot 2fa3a771-54b4-49de-87b6-2e81bd0b1e72 of volume a5b80256-2315-44e4-9e8a-92c2f9bef566 {{(pid=92060) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 17 05:01:21 devstack cinder-volume[92060]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc03c6b2-c5cf-4d51-9e37-b6463f5835c5]: (4, 'qcow2') {{(pid=93130) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 05:01:21 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-0a6b8fa6-1595-4898-b9d3-837b377e98ce tempest-SnapshotDependencyTests-543619335 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-a5b80256-2315-44e4-9e8a-92c2f9bef566 {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:01:21 devstack sudo[111948]: pam_unix(sudo:session): session closed for user root Jun 17 05:01:21 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-2153de23-9138-4c9d-9064-69666b0c149d tempest-CreateVolumesFromSnapshotTest-393697735 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-c32da37e-a2c4-4c5e-af6b-42bd3706af65" returned: 0 in 0.732s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:01:21 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-2153de23-9138-4c9d-9064-69666b0c149d tempest-CreateVolumesFromSnapshotTest-393697735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-c32da37e-a2c4-4c5e-af6b-42bd3706af65 {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:01:21 devstack sudo[111954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-c32da37e-a2c4-4c5e-af6b-42bd3706af65 Jun 17 05:01:21 devstack sudo[111954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:01:21 devstack sudo[111953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-a5b80256-2315-44e4-9e8a-92c2f9bef566 Jun 17 05:01:21 devstack sudo[111953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:01:22 devstack sudo[111954]: pam_unix(sudo:session): session closed for user root Jun 17 05:01:22 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-2153de23-9138-4c9d-9064-69666b0c149d tempest-CreateVolumesFromSnapshotTest-393697735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-c32da37e-a2c4-4c5e-af6b-42bd3706af65" returned: 0 in 0.611s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:01:22 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-2153de23-9138-4c9d-9064-69666b0c149d tempest-CreateVolumesFromSnapshotTest-393697735 None] Lock "cinder-quobyte-c32da37e-a2c4-4c5e-af6b-42bd3706af65" released by "delete_volume" :: held 1.381s {{(pid=92060) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 05:01:22 devstack sudo[111953]: pam_unix(sudo:session): session closed for user root Jun 17 05:01:22 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-0a6b8fa6-1595-4898-b9d3-837b377e98ce tempest-SnapshotDependencyTests-543619335 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-a5b80256-2315-44e4-9e8a-92c2f9bef566" returned: 0 in 0.699s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:01:22 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-0a6b8fa6-1595-4898-b9d3-837b377e98ce tempest-SnapshotDependencyTests-543619335 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-a5b80256-2315-44e4-9e8a-92c2f9bef566,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-a5b80256-2315-44e4-9e8a-92c2f9bef566.2fa3a771-54b4-49de-87b6-2e81bd0b1e72 1G {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:01:22 devstack sudo[111964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-a5b80256-2315-44e4-9e8a-92c2f9bef566,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-a5b80256-2315-44e4-9e8a-92c2f9bef566.2fa3a771-54b4-49de-87b6-2e81bd0b1e72 1G Jun 17 05:01:22 devstack sudo[111964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:01:22 devstack cinder-volume[92060]: DEBUG cinder.quota [None req-2153de23-9138-4c9d-9064-69666b0c149d tempest-CreateVolumesFromSnapshotTest-393697735 None] Created reservations ['16dcd4e0-d0df-4684-96d1-41f1762eaaec', '99b5089d-449c-4fc4-9a5b-d4ce210a500b', 'b936bb0e-dedb-4e19-9a57-39445b031073', '23f17145-6c87-433a-b555-80c9d064b893'] {{(pid=92060) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 17 05:01:22 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-2153de23-9138-4c9d-9064-69666b0c149d tempest-CreateVolumesFromSnapshotTest-393697735 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 05:01:22 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-2153de23-9138-4c9d-9064-69666b0c149d tempest-CreateVolumesFromSnapshotTest-393697735 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 05:01:22 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-2153de23-9138-4c9d-9064-69666b0c149d tempest-CreateVolumesFromSnapshotTest-393697735 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588': None} {{(pid=92060) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 17 05:01:22 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-2153de23-9138-4c9d-9064-69666b0c149d tempest-CreateVolumesFromSnapshotTest-393697735 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588'] {{(pid=92060) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 17 05:01:22 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-2153de23-9138-4c9d-9064-69666b0c149d tempest-CreateVolumesFromSnapshotTest-393697735 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 05:01:22 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-2153de23-9138-4c9d-9064-69666b0c149d tempest-CreateVolumesFromSnapshotTest-393697735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:01:22 devstack sudo[111966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a Jun 17 05:01:22 devstack sudo[111966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:01:22 devstack sudo[111966]: pam_unix(sudo:session): session closed for user root Jun 17 05:01:22 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-2153de23-9138-4c9d-9064-69666b0c149d tempest-CreateVolumesFromSnapshotTest-393697735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a" returned: 0 in 0.644s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:01:22 devstack cinder-volume[92060]: DEBUG cinder.manager [None req-2153de23-9138-4c9d-9064-69666b0c149d tempest-CreateVolumesFromSnapshotTest-393697735 None] Notifying Schedulers of capabilities ... {{(pid=92060) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 17 05:01:22 devstack cinder-volume[92060]: INFO cinder.volume.manager [None req-2153de23-9138-4c9d-9064-69666b0c149d tempest-CreateVolumesFromSnapshotTest-393697735 None] Deleted volume successfully. Jun 17 05:01:22 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-fcd11a0f-ccb1-47da-991d-e2f6a4d1f638 tempest-CreateVolumesFromSnapshotTest-393697735 None] Acquiring lock "cinder-9dfa83f2-63ab-40ca-a390-f9ab87ce8c5f-delete_volume" by "delete_volume" {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 05:01:22 devstack sudo[111964]: pam_unix(sudo:session): session closed for user root Jun 17 05:01:22 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-0a6b8fa6-1595-4898-b9d3-837b377e98ce tempest-SnapshotDependencyTests-543619335 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-a5b80256-2315-44e4-9e8a-92c2f9bef566,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-a5b80256-2315-44e4-9e8a-92c2f9bef566.2fa3a771-54b4-49de-87b6-2e81bd0b1e72 1G" returned: 0 in 0.795s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:01:22 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-0a6b8fa6-1595-4898-b9d3-837b377e98ce tempest-SnapshotDependencyTests-543619335 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a5b80256-2315-44e4-9e8a-92c2f9bef566 -F qcow2 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-a5b80256-2315-44e4-9e8a-92c2f9bef566.2fa3a771-54b4-49de-87b6-2e81bd0b1e72 {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:01:22 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-fcd11a0f-ccb1-47da-991d-e2f6a4d1f638 tempest-CreateVolumesFromSnapshotTest-393697735 None] Lock "cinder-9dfa83f2-63ab-40ca-a390-f9ab87ce8c5f-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 05:01:22 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-2153de23-9138-4c9d-9064-69666b0c149d tempest-CreateVolumesFromSnapshotTest-393697735 None] Lock "cinder-c32da37e-a2c4-4c5e-af6b-42bd3706af65-delete_volume" released by "delete_volume" :: held 2.275s {{(pid=92060) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 05:01:22 devstack sudo[111972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a5b80256-2315-44e4-9e8a-92c2f9bef566 -F qcow2 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-a5b80256-2315-44e4-9e8a-92c2f9bef566.2fa3a771-54b4-49de-87b6-2e81bd0b1e72 Jun 17 05:01:22 devstack sudo[111972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:01:22 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-fcd11a0f-ccb1-47da-991d-e2f6a4d1f638 tempest-CreateVolumesFromSnapshotTest-393697735 None] Acquiring lock "cinder-quobyte-9dfa83f2-63ab-40ca-a390-f9ab87ce8c5f" by "delete_volume" {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 05:01:22 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-fcd11a0f-ccb1-47da-991d-e2f6a4d1f638 tempest-CreateVolumesFromSnapshotTest-393697735 None] Lock "cinder-quobyte-9dfa83f2-63ab-40ca-a390-f9ab87ce8c5f" acquired by "delete_volume" :: waited 0.015s {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 05:01:22 devstack cinder-volume[92060]: DEBUG oslo.privsep.daemon [-] privsep: reply[c284825d-ee8f-4b4d-86d5-514f6fdda456]: (4, 'qcow2') {{(pid=93130) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 05:01:22 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-fcd11a0f-ccb1-47da-991d-e2f6a4d1f638 tempest-CreateVolumesFromSnapshotTest-393697735 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-9dfa83f2-63ab-40ca-a390-f9ab87ce8c5f {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:01:23 devstack sudo[111974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-9dfa83f2-63ab-40ca-a390-f9ab87ce8c5f Jun 17 05:01:23 devstack sudo[111974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:01:23 devstack sudo[111972]: pam_unix(sudo:session): session closed for user root Jun 17 05:01:23 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-0a6b8fa6-1595-4898-b9d3-837b377e98ce tempest-SnapshotDependencyTests-543619335 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a5b80256-2315-44e4-9e8a-92c2f9bef566 -F qcow2 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-a5b80256-2315-44e4-9e8a-92c2f9bef566.2fa3a771-54b4-49de-87b6-2e81bd0b1e72" returned: 0 in 0.648s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:01:23 devstack cinder-volume[92060]: WARNING cinder.volume.drivers.remotefs [None req-0a6b8fa6-1595-4898-b9d3-837b377e98ce tempest-SnapshotDependencyTests-543619335 None] /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-a5b80256-2315-44e4-9e8a-92c2f9bef566.2fa3a771-54b4-49de-87b6-2e81bd0b1e72 is being set with open permissions: ugo+rw Jun 17 05:01:23 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-0a6b8fa6-1595-4898-b9d3-837b377e98ce tempest-SnapshotDependencyTests-543619335 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-a5b80256-2315-44e4-9e8a-92c2f9bef566.2fa3a771-54b4-49de-87b6-2e81bd0b1e72 {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:01:23 devstack sudo[111979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-a5b80256-2315-44e4-9e8a-92c2f9bef566.2fa3a771-54b4-49de-87b6-2e81bd0b1e72 Jun 17 05:01:23 devstack sudo[111979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:01:23 devstack sudo[111974]: pam_unix(sudo:session): session closed for user root Jun 17 05:01:23 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-fcd11a0f-ccb1-47da-991d-e2f6a4d1f638 tempest-CreateVolumesFromSnapshotTest-393697735 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-9dfa83f2-63ab-40ca-a390-f9ab87ce8c5f" returned: 0 in 0.697s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:01:23 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-fcd11a0f-ccb1-47da-991d-e2f6a4d1f638 tempest-CreateVolumesFromSnapshotTest-393697735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-9dfa83f2-63ab-40ca-a390-f9ab87ce8c5f {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:01:23 devstack sudo[111984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-9dfa83f2-63ab-40ca-a390-f9ab87ce8c5f Jun 17 05:01:23 devstack sudo[111984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:01:24 devstack sudo[111979]: pam_unix(sudo:session): session closed for user root Jun 17 05:01:24 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-0a6b8fa6-1595-4898-b9d3-837b377e98ce tempest-SnapshotDependencyTests-543619335 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-a5b80256-2315-44e4-9e8a-92c2f9bef566.2fa3a771-54b4-49de-87b6-2e81bd0b1e72" returned: 0 in 0.573s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:01:24 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-0a6b8fa6-1595-4898-b9d3-837b377e98ce tempest-SnapshotDependencyTests-543619335 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-a5b80256-2315-44e4-9e8a-92c2f9bef566.info {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:01:24 devstack sudo[111987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-a5b80256-2315-44e4-9e8a-92c2f9bef566.info Jun 17 05:01:24 devstack sudo[111987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:01:24 devstack sudo[111984]: pam_unix(sudo:session): session closed for user root Jun 17 05:01:24 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-fcd11a0f-ccb1-47da-991d-e2f6a4d1f638 tempest-CreateVolumesFromSnapshotTest-393697735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-9dfa83f2-63ab-40ca-a390-f9ab87ce8c5f" returned: 0 in 0.585s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:01:24 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-fcd11a0f-ccb1-47da-991d-e2f6a4d1f638 tempest-CreateVolumesFromSnapshotTest-393697735 None] Lock "cinder-quobyte-9dfa83f2-63ab-40ca-a390-f9ab87ce8c5f" released by "delete_volume" :: held 1.321s {{(pid=92060) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 05:01:24 devstack cinder-volume[92060]: DEBUG cinder.quota [None req-fcd11a0f-ccb1-47da-991d-e2f6a4d1f638 tempest-CreateVolumesFromSnapshotTest-393697735 None] Created reservations ['1fdbb68b-d729-4f0b-82d7-6a67b32a0d37', 'e2ef05ea-1ace-4190-a79c-172760287b5b', '9d9ed829-5956-40af-81a3-217a52ad82c3', '1bc05159-234f-435e-804f-081e1396782e'] {{(pid=92060) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 17 05:01:24 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-fcd11a0f-ccb1-47da-991d-e2f6a4d1f638 tempest-CreateVolumesFromSnapshotTest-393697735 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 05:01:24 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-fcd11a0f-ccb1-47da-991d-e2f6a4d1f638 tempest-CreateVolumesFromSnapshotTest-393697735 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 05:01:24 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-fcd11a0f-ccb1-47da-991d-e2f6a4d1f638 tempest-CreateVolumesFromSnapshotTest-393697735 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588': None} {{(pid=92060) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 17 05:01:24 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-fcd11a0f-ccb1-47da-991d-e2f6a4d1f638 tempest-CreateVolumesFromSnapshotTest-393697735 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588'] {{(pid=92060) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 17 05:01:24 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-fcd11a0f-ccb1-47da-991d-e2f6a4d1f638 tempest-CreateVolumesFromSnapshotTest-393697735 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 05:01:24 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-fcd11a0f-ccb1-47da-991d-e2f6a4d1f638 tempest-CreateVolumesFromSnapshotTest-393697735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:01:24 devstack sudo[111990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a Jun 17 05:01:24 devstack sudo[111990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:01:24 devstack sudo[111987]: pam_unix(sudo:session): session closed for user root Jun 17 05:01:24 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-0a6b8fa6-1595-4898-b9d3-837b377e98ce tempest-SnapshotDependencyTests-543619335 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-a5b80256-2315-44e4-9e8a-92c2f9bef566.info" returned: 0 in 0.583s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:01:24 devstack cinder-volume[92060]: WARNING cinder.volume.drivers.remotefs [None req-0a6b8fa6-1595-4898-b9d3-837b377e98ce tempest-SnapshotDependencyTests-543619335 None] /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-a5b80256-2315-44e4-9e8a-92c2f9bef566.info is being set with open permissions: ugo+rw Jun 17 05:01:24 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-0a6b8fa6-1595-4898-b9d3-837b377e98ce tempest-SnapshotDependencyTests-543619335 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-a5b80256-2315-44e4-9e8a-92c2f9bef566.info {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:01:24 devstack sudo[111993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-a5b80256-2315-44e4-9e8a-92c2f9bef566.info Jun 17 05:01:24 devstack sudo[111993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:01:24 devstack sudo[111990]: pam_unix(sudo:session): session closed for user root Jun 17 05:01:24 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-fcd11a0f-ccb1-47da-991d-e2f6a4d1f638 tempest-CreateVolumesFromSnapshotTest-393697735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a" returned: 0 in 0.594s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:01:24 devstack cinder-volume[92060]: DEBUG cinder.manager [None req-fcd11a0f-ccb1-47da-991d-e2f6a4d1f638 tempest-CreateVolumesFromSnapshotTest-393697735 None] Notifying Schedulers of capabilities ... {{(pid=92060) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 17 05:01:25 devstack cinder-volume[92060]: INFO cinder.volume.manager [None req-fcd11a0f-ccb1-47da-991d-e2f6a4d1f638 tempest-CreateVolumesFromSnapshotTest-393697735 None] Deleted volume successfully. Jun 17 05:01:25 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-fcd11a0f-ccb1-47da-991d-e2f6a4d1f638 tempest-CreateVolumesFromSnapshotTest-393697735 None] Lock "cinder-9dfa83f2-63ab-40ca-a390-f9ab87ce8c5f-delete_volume" released by "delete_volume" :: held 2.116s {{(pid=92060) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 05:01:25 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-8758c480-4732-454a-a642-7670c1b384ea tempest-CreateVolumesFromSnapshotTest-393697735 None] Acquiring lock "cinder-b491bb4d-48fe-4883-b72c-5d874d578030-delete_volume" by "delete_volume" {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 05:01:25 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-8758c480-4732-454a-a642-7670c1b384ea tempest-CreateVolumesFromSnapshotTest-393697735 None] Lock "cinder-b491bb4d-48fe-4883-b72c-5d874d578030-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 05:01:25 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-8758c480-4732-454a-a642-7670c1b384ea tempest-CreateVolumesFromSnapshotTest-393697735 None] Acquiring lock "cinder-quobyte-b491bb4d-48fe-4883-b72c-5d874d578030" by "delete_volume" {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 05:01:25 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-8758c480-4732-454a-a642-7670c1b384ea tempest-CreateVolumesFromSnapshotTest-393697735 None] Lock "cinder-quobyte-b491bb4d-48fe-4883-b72c-5d874d578030" acquired by "delete_volume" :: waited 0.015s {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 05:01:25 devstack cinder-volume[92060]: DEBUG oslo.privsep.daemon [-] privsep: reply[00878638-f456-4746-b670-4dbc82cd155a]: (4, 'qcow2') {{(pid=93130) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 05:01:25 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-8758c480-4732-454a-a642-7670c1b384ea tempest-CreateVolumesFromSnapshotTest-393697735 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-b491bb4d-48fe-4883-b72c-5d874d578030 {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:01:25 devstack sudo[111996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-b491bb4d-48fe-4883-b72c-5d874d578030 Jun 17 05:01:25 devstack sudo[111996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:01:25 devstack sudo[111993]: pam_unix(sudo:session): session closed for user root Jun 17 05:01:25 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-0a6b8fa6-1595-4898-b9d3-837b377e98ce tempest-SnapshotDependencyTests-543619335 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-a5b80256-2315-44e4-9e8a-92c2f9bef566.info" returned: 0 in 0.587s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:01:25 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-0a6b8fa6-1595-4898-b9d3-837b377e98ce tempest-SnapshotDependencyTests-543619335 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.974s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 05:01:25 devstack cinder-volume[92060]: INFO cinder.volume.manager [None req-0a6b8fa6-1595-4898-b9d3-837b377e98ce tempest-SnapshotDependencyTests-543619335 None] Create snapshot completed successfully Jun 17 05:01:25 devstack sudo[111996]: pam_unix(sudo:session): session closed for user root Jun 17 05:01:25 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-8758c480-4732-454a-a642-7670c1b384ea tempest-CreateVolumesFromSnapshotTest-393697735 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-b491bb4d-48fe-4883-b72c-5d874d578030" returned: 0 in 0.701s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:01:25 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-8758c480-4732-454a-a642-7670c1b384ea tempest-CreateVolumesFromSnapshotTest-393697735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-b491bb4d-48fe-4883-b72c-5d874d578030 {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:01:25 devstack sudo[112002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-b491bb4d-48fe-4883-b72c-5d874d578030 Jun 17 05:01:25 devstack sudo[112002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:01:26 devstack cinder-volume[92060]: DEBUG cinder.volume.flows.manager.create_volume [None req-f17ca52f-70bc-484f-b4ad-3abd84eb7bbb tempest-SnapshotDependencyTests-543619335 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=92060) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 17 05:01:26 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-f17ca52f-70bc-484f-b4ad-3abd84eb7bbb tempest-SnapshotDependencyTests-543619335 None] Flow 'volume_create_manager' (4a159531-acb4-4981-b91a-1f5816c6c921) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 17 05:01:26 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-f17ca52f-70bc-484f-b4ad-3abd84eb7bbb tempest-SnapshotDependencyTests-543619335 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ac86f7d4-f90a-41d5-9a83-6756515a067a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:01:26 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-f17ca52f-70bc-484f-b4ad-3abd84eb7bbb tempest-SnapshotDependencyTests-543619335 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ac86f7d4-f90a-41d5-9a83-6756515a067a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-17T03:01:26Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=94a97622-a41b-4051-b780-0dbeb551e592,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4a3239f11dcb4da79a42026150cb8308',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-17T03:01:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=2fa3a771-54b4-49de-87b6-2e81bd0b1e72,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-17T03:01:26Z,use_quota=True,user_id='c88855ab1b2c42aeb201163e53a22d8a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aad9ce24-93f9-41a6-baa1-5125964f96d1),volume_type_id=aad9ce24-93f9-41a6-baa1-5125964f96d1)' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:01:26 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-f17ca52f-70bc-484f-b4ad-3abd84eb7bbb tempest-SnapshotDependencyTests-543619335 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (43aac950-c73d-437e-902f-460f83a271c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:01:26 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-f17ca52f-70bc-484f-b4ad-3abd84eb7bbb tempest-SnapshotDependencyTests-543619335 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (43aac950-c73d-437e-902f-460f83a271c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:01:26 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-f17ca52f-70bc-484f-b4ad-3abd84eb7bbb tempest-SnapshotDependencyTests-543619335 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8482fdd3-b152-4c9e-ad95-1c37761d6f01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:01:26 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-f17ca52f-70bc-484f-b4ad-3abd84eb7bbb tempest-SnapshotDependencyTests-543619335 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8482fdd3-b152-4c9e-ad95-1c37761d6f01) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '94a97622-a41b-4051-b780-0dbeb551e592', 'volume_name': 'volume-94a97622-a41b-4051-b780-0dbeb551e592', 'volume_size': 1, 'snapshot_id': '2fa3a771-54b4-49de-87b6-2e81bd0b1e72'}' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:01:26 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-f17ca52f-70bc-484f-b4ad-3abd84eb7bbb tempest-SnapshotDependencyTests-543619335 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e9ea2b9c-f6bc-49e6-a614-e0112c239277) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:01:26 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-f17ca52f-70bc-484f-b4ad-3abd84eb7bbb tempest-SnapshotDependencyTests-543619335 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e9ea2b9c-f6bc-49e6-a614-e0112c239277) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:01:26 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-f17ca52f-70bc-484f-b4ad-3abd84eb7bbb tempest-SnapshotDependencyTests-543619335 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a614d65b-1aad-45d9-a797-2b7eedd25182) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:01:26 devstack cinder-volume[92060]: INFO cinder.volume.flows.manager.create_volume [None req-f17ca52f-70bc-484f-b4ad-3abd84eb7bbb tempest-SnapshotDependencyTests-543619335 None] Volume 94a97622-a41b-4051-b780-0dbeb551e592: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-94a97622-a41b-4051-b780-0dbeb551e592', 'volume_size': 1, 'snapshot_id': '2fa3a771-54b4-49de-87b6-2e81bd0b1e72'} Jun 17 05:01:26 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-f17ca52f-70bc-484f-b4ad-3abd84eb7bbb tempest-SnapshotDependencyTests-543619335 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 05:01:26 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-f17ca52f-70bc-484f-b4ad-3abd84eb7bbb tempest-SnapshotDependencyTests-543619335 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 05:01:26 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-f17ca52f-70bc-484f-b4ad-3abd84eb7bbb tempest-SnapshotDependencyTests-543619335 None] Acquiring lock "cinder-quobyte-2fa3a771-54b4-49de-87b6-2e81bd0b1e72-94a97622-a41b-4051-b780-0dbeb551e592" by "_create_volume_from_snapshot" {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 05:01:26 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-f17ca52f-70bc-484f-b4ad-3abd84eb7bbb tempest-SnapshotDependencyTests-543619335 None] Lock "cinder-quobyte-2fa3a771-54b4-49de-87b6-2e81bd0b1e72-94a97622-a41b-4051-b780-0dbeb551e592" acquired by "_create_volume_from_snapshot" :: waited 0.014s {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 05:01:26 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-f17ca52f-70bc-484f-b4ad-3abd84eb7bbb tempest-SnapshotDependencyTests-543619335 None] Creating volume 94a97622-a41b-4051-b780-0dbeb551e592 from snapshot 2fa3a771-54b4-49de-87b6-2e81bd0b1e72 {{(pid=92060) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jun 17 05:01:26 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-f17ca52f-70bc-484f-b4ad-3abd84eb7bbb tempest-SnapshotDependencyTests-543619335 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 05:01:26 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-f17ca52f-70bc-484f-b4ad-3abd84eb7bbb tempest-SnapshotDependencyTests-543619335 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 05:01:26 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-f17ca52f-70bc-484f-b4ad-3abd84eb7bbb tempest-SnapshotDependencyTests-543619335 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588': None} {{(pid=92060) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 17 05:01:26 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-f17ca52f-70bc-484f-b4ad-3abd84eb7bbb tempest-SnapshotDependencyTests-543619335 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588'] {{(pid=92060) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 17 05:01:26 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-f17ca52f-70bc-484f-b4ad-3abd84eb7bbb tempest-SnapshotDependencyTests-543619335 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 05:01:26 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-f17ca52f-70bc-484f-b4ad-3abd84eb7bbb tempest-SnapshotDependencyTests-543619335 None] Selected osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588 as target Quobyte volume. {{(pid=92060) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 17 05:01:26 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-f17ca52f-70bc-484f-b4ad-3abd84eb7bbb tempest-SnapshotDependencyTests-543619335 None] Acquiring lock "cinder-quobyte-94a97622-a41b-4051-b780-0dbeb551e592" by "_copy_volume_from_snapshot" {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 05:01:26 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-f17ca52f-70bc-484f-b4ad-3abd84eb7bbb tempest-SnapshotDependencyTests-543619335 None] Lock "cinder-quobyte-94a97622-a41b-4051-b780-0dbeb551e592" acquired by "_copy_volume_from_snapshot" :: waited 0.012s {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 05:01:26 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-f17ca52f-70bc-484f-b4ad-3abd84eb7bbb tempest-SnapshotDependencyTests-543619335 None] snapshot: 2fa3a771-54b4-49de-87b6-2e81bd0b1e72, volume: 94a97622-a41b-4051-b780-0dbeb551e592, {{(pid=92060) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jun 17 05:01:26 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-f17ca52f-70bc-484f-b4ad-3abd84eb7bbb tempest-SnapshotDependencyTests-543619335 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 05:01:26 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-f17ca52f-70bc-484f-b4ad-3abd84eb7bbb tempest-SnapshotDependencyTests-543619335 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 05:01:26 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-f17ca52f-70bc-484f-b4ad-3abd84eb7bbb tempest-SnapshotDependencyTests-543619335 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588': None} {{(pid=92060) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 17 05:01:26 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-f17ca52f-70bc-484f-b4ad-3abd84eb7bbb tempest-SnapshotDependencyTests-543619335 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588'] {{(pid=92060) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 17 05:01:26 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-f17ca52f-70bc-484f-b4ad-3abd84eb7bbb tempest-SnapshotDependencyTests-543619335 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 05:01:26 devstack cinder-volume[92060]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d795782-9e62-4df9-864d-14ab36c32cf8]: (4, 'qcow2') {{(pid=93130) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 05:01:26 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-f17ca52f-70bc-484f-b4ad-3abd84eb7bbb tempest-SnapshotDependencyTests-543619335 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-a5b80256-2315-44e4-9e8a-92c2f9bef566.2fa3a771-54b4-49de-87b6-2e81bd0b1e72 {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:01:26 devstack sudo[112004]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-a5b80256-2315-44e4-9e8a-92c2f9bef566.2fa3a771-54b4-49de-87b6-2e81bd0b1e72 Jun 17 05:01:26 devstack sudo[112004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:01:26 devstack sudo[112002]: pam_unix(sudo:session): session closed for user root Jun 17 05:01:26 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-8758c480-4732-454a-a642-7670c1b384ea tempest-CreateVolumesFromSnapshotTest-393697735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-b491bb4d-48fe-4883-b72c-5d874d578030" returned: 0 in 0.596s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:01:26 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-8758c480-4732-454a-a642-7670c1b384ea tempest-CreateVolumesFromSnapshotTest-393697735 None] Lock "cinder-quobyte-b491bb4d-48fe-4883-b72c-5d874d578030" released by "delete_volume" :: held 1.337s {{(pid=92060) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 05:01:26 devstack cinder-volume[92060]: DEBUG cinder.quota [None req-8758c480-4732-454a-a642-7670c1b384ea tempest-CreateVolumesFromSnapshotTest-393697735 None] Created reservations ['56ec6d48-b654-4e9a-be54-38930c03ec26', '2d9eb9c1-3024-4a11-b2b6-70e2b9f6d364', '4ec9695c-0ada-44d2-8ef4-cc648b504ac0', 'b24b61d2-11c2-4be2-a5b9-452d721020b8'] {{(pid=92060) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 17 05:01:26 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-8758c480-4732-454a-a642-7670c1b384ea tempest-CreateVolumesFromSnapshotTest-393697735 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 05:01:26 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-8758c480-4732-454a-a642-7670c1b384ea tempest-CreateVolumesFromSnapshotTest-393697735 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 05:01:26 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-8758c480-4732-454a-a642-7670c1b384ea tempest-CreateVolumesFromSnapshotTest-393697735 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588': None} {{(pid=92060) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 17 05:01:26 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-8758c480-4732-454a-a642-7670c1b384ea tempest-CreateVolumesFromSnapshotTest-393697735 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588'] {{(pid=92060) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 17 05:01:26 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-8758c480-4732-454a-a642-7670c1b384ea tempest-CreateVolumesFromSnapshotTest-393697735 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 05:01:26 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-8758c480-4732-454a-a642-7670c1b384ea tempest-CreateVolumesFromSnapshotTest-393697735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:01:26 devstack sudo[112007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a Jun 17 05:01:26 devstack sudo[112007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:01:26 devstack sudo[112004]: pam_unix(sudo:session): session closed for user root Jun 17 05:01:26 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-f17ca52f-70bc-484f-b4ad-3abd84eb7bbb tempest-SnapshotDependencyTests-543619335 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-a5b80256-2315-44e4-9e8a-92c2f9bef566.2fa3a771-54b4-49de-87b6-2e81bd0b1e72" returned: 0 in 0.706s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:01:26 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.remotefs [None req-f17ca52f-70bc-484f-b4ad-3abd84eb7bbb tempest-SnapshotDependencyTests-543619335 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a5b80256-2315-44e4-9e8a-92c2f9bef566(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=92060) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 17 05:01:26 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-f17ca52f-70bc-484f-b4ad-3abd84eb7bbb tempest-SnapshotDependencyTests-543619335 None] will copy from snapshot at /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-a5b80256-2315-44e4-9e8a-92c2f9bef566 {{(pid=92060) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jun 17 05:01:26 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-f17ca52f-70bc-484f-b4ad-3abd84eb7bbb tempest-SnapshotDependencyTests-543619335 None] Creating direct copy from snapshot {{(pid=92060) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jun 17 05:01:26 devstack cinder-volume[92060]: DEBUG oslo.privsep.daemon [-] privsep: reply[d992c6c4-8073-48d7-bc04-464e71296b9c]: (4, 'qcow2') {{(pid=93130) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 05:01:26 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-f17ca52f-70bc-484f-b4ad-3abd84eb7bbb tempest-SnapshotDependencyTests-543619335 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-a5b80256-2315-44e4-9e8a-92c2f9bef566 {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:01:27 devstack sudo[112012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-a5b80256-2315-44e4-9e8a-92c2f9bef566 Jun 17 05:01:27 devstack sudo[112012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:01:27 devstack sudo[112007]: pam_unix(sudo:session): session closed for user root Jun 17 05:01:27 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-8758c480-4732-454a-a642-7670c1b384ea tempest-CreateVolumesFromSnapshotTest-393697735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a" returned: 0 in 0.610s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:01:27 devstack cinder-volume[92060]: DEBUG cinder.manager [None req-8758c480-4732-454a-a642-7670c1b384ea tempest-CreateVolumesFromSnapshotTest-393697735 None] Notifying Schedulers of capabilities ... {{(pid=92060) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 17 05:01:27 devstack cinder-volume[92060]: INFO cinder.volume.manager [None req-8758c480-4732-454a-a642-7670c1b384ea tempest-CreateVolumesFromSnapshotTest-393697735 None] Deleted volume successfully. Jun 17 05:01:27 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-8758c480-4732-454a-a642-7670c1b384ea tempest-CreateVolumesFromSnapshotTest-393697735 None] Lock "cinder-b491bb4d-48fe-4883-b72c-5d874d578030-delete_volume" released by "delete_volume" :: held 2.155s {{(pid=92060) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 05:01:27 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-82580cd3-ea72-492e-be9f-61bab3783c1a tempest-CreateVolumesFromSnapshotTest-393697735 None] Acquiring lock "cinder-72e76a05-c3fb-44e5-af2b-246663135f4d-delete_volume" by "delete_volume" {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 05:01:27 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-82580cd3-ea72-492e-be9f-61bab3783c1a tempest-CreateVolumesFromSnapshotTest-393697735 None] Lock "cinder-72e76a05-c3fb-44e5-af2b-246663135f4d-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 05:01:27 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-82580cd3-ea72-492e-be9f-61bab3783c1a tempest-CreateVolumesFromSnapshotTest-393697735 None] Acquiring lock "cinder-quobyte-72e76a05-c3fb-44e5-af2b-246663135f4d" by "delete_volume" {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 05:01:27 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-82580cd3-ea72-492e-be9f-61bab3783c1a tempest-CreateVolumesFromSnapshotTest-393697735 None] Lock "cinder-quobyte-72e76a05-c3fb-44e5-af2b-246663135f4d" acquired by "delete_volume" :: waited 0.020s {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 05:01:27 devstack cinder-volume[92060]: DEBUG oslo.privsep.daemon [-] privsep: reply[63e4baab-90c7-4ddc-9d65-9bf57c6a215b]: (4, 'qcow2') {{(pid=93130) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 05:01:27 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-82580cd3-ea72-492e-be9f-61bab3783c1a tempest-CreateVolumesFromSnapshotTest-393697735 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-72e76a05-c3fb-44e5-af2b-246663135f4d {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:01:27 devstack sudo[112015]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-72e76a05-c3fb-44e5-af2b-246663135f4d Jun 17 05:01:27 devstack sudo[112015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:01:27 devstack sudo[112012]: pam_unix(sudo:session): session closed for user root Jun 17 05:01:27 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-f17ca52f-70bc-484f-b4ad-3abd84eb7bbb tempest-SnapshotDependencyTests-543619335 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-a5b80256-2315-44e4-9e8a-92c2f9bef566" returned: 0 in 0.695s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:01:27 devstack cinder-volume[92060]: DEBUG cinder.utils [None req-f17ca52f-70bc-484f-b4ad-3abd84eb7bbb tempest-SnapshotDependencyTests-543619335 None] Path /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-94a97622-a41b-4051-b780-0dbeb551e592 not found in is_blk_device check {{(pid=92060) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jun 17 05:01:27 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-f17ca52f-70bc-484f-b4ad-3abd84eb7bbb tempest-SnapshotDependencyTests-543619335 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-a5b80256-2315-44e4-9e8a-92c2f9bef566 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-94a97622-a41b-4051-b780-0dbeb551e592 {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:01:27 devstack sudo[112020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-a5b80256-2315-44e4-9e8a-92c2f9bef566 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-94a97622-a41b-4051-b780-0dbeb551e592 Jun 17 05:01:27 devstack sudo[112020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:01:28 devstack sudo[112015]: pam_unix(sudo:session): session closed for user root Jun 17 05:01:28 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-82580cd3-ea72-492e-be9f-61bab3783c1a tempest-CreateVolumesFromSnapshotTest-393697735 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-72e76a05-c3fb-44e5-af2b-246663135f4d" returned: 0 in 0.713s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:01:28 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-82580cd3-ea72-492e-be9f-61bab3783c1a tempest-CreateVolumesFromSnapshotTest-393697735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-72e76a05-c3fb-44e5-af2b-246663135f4d {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:01:28 devstack sudo[112028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-72e76a05-c3fb-44e5-af2b-246663135f4d Jun 17 05:01:28 devstack sudo[112028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:01:28 devstack sudo[112028]: pam_unix(sudo:session): session closed for user root Jun 17 05:01:28 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-82580cd3-ea72-492e-be9f-61bab3783c1a tempest-CreateVolumesFromSnapshotTest-393697735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-72e76a05-c3fb-44e5-af2b-246663135f4d" returned: 0 in 0.718s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:01:28 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-82580cd3-ea72-492e-be9f-61bab3783c1a tempest-CreateVolumesFromSnapshotTest-393697735 None] Lock "cinder-quobyte-72e76a05-c3fb-44e5-af2b-246663135f4d" released by "delete_volume" :: held 1.484s {{(pid=92060) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 05:01:29 devstack cinder-volume[92060]: DEBUG cinder.quota [None req-82580cd3-ea72-492e-be9f-61bab3783c1a tempest-CreateVolumesFromSnapshotTest-393697735 None] Created reservations ['7610c235-46a8-4bbb-ae6e-7b3c3519fb24', '42749ead-a520-4294-94b2-6378f52ba068', '85146911-c706-45bf-99b7-35bad9754c26', '377e09b8-e072-4f33-be71-c96844527685'] {{(pid=92060) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 17 05:01:29 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-82580cd3-ea72-492e-be9f-61bab3783c1a tempest-CreateVolumesFromSnapshotTest-393697735 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 05:01:29 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-82580cd3-ea72-492e-be9f-61bab3783c1a tempest-CreateVolumesFromSnapshotTest-393697735 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 05:01:29 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-82580cd3-ea72-492e-be9f-61bab3783c1a tempest-CreateVolumesFromSnapshotTest-393697735 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588': None} {{(pid=92060) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 17 05:01:29 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-82580cd3-ea72-492e-be9f-61bab3783c1a tempest-CreateVolumesFromSnapshotTest-393697735 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588'] {{(pid=92060) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 17 05:01:29 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-82580cd3-ea72-492e-be9f-61bab3783c1a tempest-CreateVolumesFromSnapshotTest-393697735 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 05:01:29 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-82580cd3-ea72-492e-be9f-61bab3783c1a tempest-CreateVolumesFromSnapshotTest-393697735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:01:29 devstack sudo[112049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a Jun 17 05:01:29 devstack sudo[112049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:01:29 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-e9f5327c-2969-4759-b6b2-a79ea18fbe6f tempest-CreateVolumesFromSnapshotTest-393697735 None] Acquiring lock "cinder-76c9266e-4e7e-46ae-a1d4-1859dbc9d0fe-delete_snapshot" by "delete_snapshot" {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 05:01:29 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-e9f5327c-2969-4759-b6b2-a79ea18fbe6f tempest-CreateVolumesFromSnapshotTest-393697735 None] Lock "cinder-76c9266e-4e7e-46ae-a1d4-1859dbc9d0fe-delete_snapshot" acquired by "delete_snapshot" :: waited 0.106s {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 05:01:29 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-e9f5327c-2969-4759-b6b2-a79ea18fbe6f tempest-CreateVolumesFromSnapshotTest-393697735 None] Acquiring lock "cinder-quobyte-2e021f8d-2755-45ac-becc-c4fd16820102" by "delete_snapshot" {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 05:01:29 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-e9f5327c-2969-4759-b6b2-a79ea18fbe6f tempest-CreateVolumesFromSnapshotTest-393697735 None] Lock "cinder-quobyte-2e021f8d-2755-45ac-becc-c4fd16820102" acquired by "delete_snapshot" :: waited 0.050s {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 05:01:29 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-e9f5327c-2969-4759-b6b2-a79ea18fbe6f tempest-CreateVolumesFromSnapshotTest-393697735 None] Acquiring lock "cinder-quobyte-76c9266e-4e7e-46ae-a1d4-1859dbc9d0fe" by "_delete_snapshot" {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 05:01:30 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-e9f5327c-2969-4759-b6b2-a79ea18fbe6f tempest-CreateVolumesFromSnapshotTest-393697735 None] Lock "cinder-quobyte-76c9266e-4e7e-46ae-a1d4-1859dbc9d0fe" acquired by "_delete_snapshot" :: waited 0.040s {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 05:01:30 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.remotefs [None req-e9f5327c-2969-4759-b6b2-a79ea18fbe6f tempest-CreateVolumesFromSnapshotTest-393697735 None] Deleting offline snapshot 76c9266e-4e7e-46ae-a1d4-1859dbc9d0fe of volume 2e021f8d-2755-45ac-becc-c4fd16820102 {{(pid=92060) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 17 05:01:30 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.remotefs [None req-e9f5327c-2969-4759-b6b2-a79ea18fbe6f tempest-CreateVolumesFromSnapshotTest-393697735 None] snapshot_file for this snap is: volume-2e021f8d-2755-45ac-becc-c4fd16820102.76c9266e-4e7e-46ae-a1d4-1859dbc9d0fe {{(pid=92060) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 17 05:01:30 devstack cinder-volume[92060]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a0c8340-a30f-478f-b15a-1b6c959c2e83]: (4, 'qcow2') {{(pid=93130) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 05:01:30 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-e9f5327c-2969-4759-b6b2-a79ea18fbe6f tempest-CreateVolumesFromSnapshotTest-393697735 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-2e021f8d-2755-45ac-becc-c4fd16820102.76c9266e-4e7e-46ae-a1d4-1859dbc9d0fe {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:01:30 devstack sudo[112077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-2e021f8d-2755-45ac-becc-c4fd16820102.76c9266e-4e7e-46ae-a1d4-1859dbc9d0fe Jun 17 05:01:30 devstack sudo[112077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:01:30 devstack sudo[112049]: pam_unix(sudo:session): session closed for user root Jun 17 05:01:30 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-82580cd3-ea72-492e-be9f-61bab3783c1a tempest-CreateVolumesFromSnapshotTest-393697735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a" returned: 0 in 1.630s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:01:30 devstack cinder-volume[92060]: DEBUG cinder.manager [None req-82580cd3-ea72-492e-be9f-61bab3783c1a tempest-CreateVolumesFromSnapshotTest-393697735 None] Notifying Schedulers of capabilities ... {{(pid=92060) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 17 05:01:30 devstack cinder-volume[92060]: INFO cinder.volume.manager [None req-82580cd3-ea72-492e-be9f-61bab3783c1a tempest-CreateVolumesFromSnapshotTest-393697735 None] Deleted volume successfully. Jun 17 05:01:30 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-82580cd3-ea72-492e-be9f-61bab3783c1a tempest-CreateVolumesFromSnapshotTest-393697735 None] Lock "cinder-72e76a05-c3fb-44e5-af2b-246663135f4d-delete_volume" released by "delete_volume" :: held 3.521s {{(pid=92060) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 05:01:31 devstack sudo[112077]: pam_unix(sudo:session): session closed for user root Jun 17 05:01:31 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-e9f5327c-2969-4759-b6b2-a79ea18fbe6f tempest-CreateVolumesFromSnapshotTest-393697735 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-2e021f8d-2755-45ac-becc-c4fd16820102.76c9266e-4e7e-46ae-a1d4-1859dbc9d0fe" returned: 0 in 1.837s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:01:31 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.remotefs [None req-e9f5327c-2969-4759-b6b2-a79ea18fbe6f tempest-CreateVolumesFromSnapshotTest-393697735 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2e021f8d-2755-45ac-becc-c4fd16820102(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=92060) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 17 05:01:32 devstack cinder-volume[92060]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc2b5783-ae2d-4e85-b3af-627c66af7dec]: (4, 'qcow2') {{(pid=93130) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 05:01:32 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-e9f5327c-2969-4759-b6b2-a79ea18fbe6f tempest-CreateVolumesFromSnapshotTest-393697735 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-2e021f8d-2755-45ac-becc-c4fd16820102 {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:01:32 devstack sudo[112084]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-2e021f8d-2755-45ac-becc-c4fd16820102 Jun 17 05:01:32 devstack sudo[112084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:01:32 devstack sudo[112020]: pam_unix(sudo:session): session closed for user root Jun 17 05:01:32 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-f17ca52f-70bc-484f-b4ad-3abd84eb7bbb tempest-SnapshotDependencyTests-543619335 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-a5b80256-2315-44e4-9e8a-92c2f9bef566 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-94a97622-a41b-4051-b780-0dbeb551e592" returned: 0 in 5.222s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:01:32 devstack cinder-volume[92060]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d5bff26-6c26-43c1-be59-28a85f449908]: (4, 'qcow2') {{(pid=93130) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 05:01:32 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-f17ca52f-70bc-484f-b4ad-3abd84eb7bbb tempest-SnapshotDependencyTests-543619335 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-a5b80256-2315-44e4-9e8a-92c2f9bef566 {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:01:32 devstack sudo[112086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-a5b80256-2315-44e4-9e8a-92c2f9bef566 Jun 17 05:01:32 devstack sudo[112086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:01:33 devstack sudo[112084]: pam_unix(sudo:session): session closed for user root Jun 17 05:01:33 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-e9f5327c-2969-4759-b6b2-a79ea18fbe6f tempest-CreateVolumesFromSnapshotTest-393697735 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-2e021f8d-2755-45ac-becc-c4fd16820102" returned: 0 in 1.140s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:01:33 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-e9f5327c-2969-4759-b6b2-a79ea18fbe6f tempest-CreateVolumesFromSnapshotTest-393697735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-2e021f8d-2755-45ac-becc-c4fd16820102.76c9266e-4e7e-46ae-a1d4-1859dbc9d0fe {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:01:33 devstack sudo[112091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-2e021f8d-2755-45ac-becc-c4fd16820102.76c9266e-4e7e-46ae-a1d4-1859dbc9d0fe Jun 17 05:01:33 devstack sudo[112091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:01:33 devstack sudo[112086]: pam_unix(sudo:session): session closed for user root Jun 17 05:01:33 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-f17ca52f-70bc-484f-b4ad-3abd84eb7bbb tempest-SnapshotDependencyTests-543619335 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-a5b80256-2315-44e4-9e8a-92c2f9bef566" returned: 0 in 0.846s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:01:33 devstack cinder-volume[92060]: DEBUG cinder.image.image_utils [None req-f17ca52f-70bc-484f-b4ad-3abd84eb7bbb tempest-SnapshotDependencyTests-543619335 None] Image conversion details: src /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-a5b80256-2315-44e4-9e8a-92c2f9bef566, size 1024.00 MB, duration 5.22 sec, destination /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-94a97622-a41b-4051-b780-0dbeb551e592 {{(pid=92060) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 17 05:01:33 devstack cinder-volume[92060]: INFO cinder.image.image_utils [None req-f17ca52f-70bc-484f-b4ad-3abd84eb7bbb tempest-SnapshotDependencyTests-543619335 None] Converted 1024.00 MB image at 196.02 MB/s Jun 17 05:01:33 devstack cinder-volume[92060]: WARNING cinder.volume.drivers.remotefs [None req-f17ca52f-70bc-484f-b4ad-3abd84eb7bbb tempest-SnapshotDependencyTests-543619335 None] /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-94a97622-a41b-4051-b780-0dbeb551e592 is being set with open permissions: ugo+rw Jun 17 05:01:33 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-f17ca52f-70bc-484f-b4ad-3abd84eb7bbb tempest-SnapshotDependencyTests-543619335 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-94a97622-a41b-4051-b780-0dbeb551e592 {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:01:33 devstack sudo[112099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-94a97622-a41b-4051-b780-0dbeb551e592 Jun 17 05:01:33 devstack sudo[112099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:01:33 devstack sudo[112091]: pam_unix(sudo:session): session closed for user root Jun 17 05:01:33 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-e9f5327c-2969-4759-b6b2-a79ea18fbe6f tempest-CreateVolumesFromSnapshotTest-393697735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-2e021f8d-2755-45ac-becc-c4fd16820102.76c9266e-4e7e-46ae-a1d4-1859dbc9d0fe" returned: 0 in 0.687s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:01:33 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-e9f5327c-2969-4759-b6b2-a79ea18fbe6f tempest-CreateVolumesFromSnapshotTest-393697735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-2e021f8d-2755-45ac-becc-c4fd16820102.76c9266e-4e7e-46ae-a1d4-1859dbc9d0fe {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:01:33 devstack sudo[112101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-2e021f8d-2755-45ac-becc-c4fd16820102.76c9266e-4e7e-46ae-a1d4-1859dbc9d0fe Jun 17 05:01:33 devstack sudo[112101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:01:34 devstack sudo[112099]: pam_unix(sudo:session): session closed for user root Jun 17 05:01:34 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-f17ca52f-70bc-484f-b4ad-3abd84eb7bbb tempest-SnapshotDependencyTests-543619335 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-94a97622-a41b-4051-b780-0dbeb551e592" returned: 0 in 0.574s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:01:34 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-f17ca52f-70bc-484f-b4ad-3abd84eb7bbb tempest-SnapshotDependencyTests-543619335 None] Lock "cinder-quobyte-94a97622-a41b-4051-b780-0dbeb551e592" released by "_copy_volume_from_snapshot" :: held 8.158s {{(pid=92060) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 05:01:34 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-f17ca52f-70bc-484f-b4ad-3abd84eb7bbb tempest-SnapshotDependencyTests-543619335 None] Lock "cinder-quobyte-2fa3a771-54b4-49de-87b6-2e81bd0b1e72-94a97622-a41b-4051-b780-0dbeb551e592" released by "_create_volume_from_snapshot" :: held 8.188s {{(pid=92060) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 05:01:34 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-f17ca52f-70bc-484f-b4ad-3abd84eb7bbb tempest-SnapshotDependencyTests-543619335 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.203s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 05:01:34 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-f17ca52f-70bc-484f-b4ad-3abd84eb7bbb tempest-SnapshotDependencyTests-543619335 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a614d65b-1aad-45d9-a797-2b7eedd25182) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-94a97622-a41b-4051-b780-0dbeb551e592', 'volume_size': 1, 'snapshot_id': '2fa3a771-54b4-49de-87b6-2e81bd0b1e72'}' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:01:34 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-f17ca52f-70bc-484f-b4ad-3abd84eb7bbb tempest-SnapshotDependencyTests-543619335 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9b9ffe6e-c5f5-40e5-ad9e-8832bcaaf063) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Jun 17 05:01:34 devstack cinder-volume[92060]: INFO cinder.volume.flows.manager.create_volume [None req-f17ca52f-70bc-484f-b4ad-3abd84eb7bbb tempest-SnapshotDependencyTests-543619335 None] Volume volume-94a97622-a41b-4051-b780-0dbeb551e592 (94a97622-a41b-4051-b780-0dbeb551e592): created successfully Jun 17 05:01:34 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-f17ca52f-70bc-484f-b4ad-3abd84eb7bbb tempest-SnapshotDependencyTests-543619335 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9b9ffe6e-c5f5-40e5-ad9e-8832bcaaf063) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=92060) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Jun 17 05:01:34 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-f17ca52f-70bc-484f-b4ad-3abd84eb7bbb tempest-SnapshotDependencyTests-543619335 None] Flow 'volume_create_manager' (4a159531-acb4-4981-b91a-1f5816c6c921) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=92060) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Jun 17 05:01:34 devstack cinder-volume[92060]: INFO cinder.volume.manager [None req-f17ca52f-70bc-484f-b4ad-3abd84eb7bbb tempest-SnapshotDependencyTests-543619335 None] Created volume successfully. Jun 17 05:01:34 devstack sudo[112101]: pam_unix(sudo:session): session closed for user root Jun 17 05:01:34 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-e9f5327c-2969-4759-b6b2-a79ea18fbe6f tempest-CreateVolumesFromSnapshotTest-393697735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-2e021f8d-2755-45ac-becc-c4fd16820102.76c9266e-4e7e-46ae-a1d4-1859dbc9d0fe" returned: 0 in 0.574s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:01:34 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-e9f5327c-2969-4759-b6b2-a79ea18fbe6f tempest-CreateVolumesFromSnapshotTest-393697735 None] Lock "cinder-quobyte-76c9266e-4e7e-46ae-a1d4-1859dbc9d0fe" released by "_delete_snapshot" :: held 4.459s {{(pid=92060) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 05:01:34 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-e9f5327c-2969-4759-b6b2-a79ea18fbe6f tempest-CreateVolumesFromSnapshotTest-393697735 None] Lock "cinder-quobyte-2e021f8d-2755-45ac-becc-c4fd16820102" released by "delete_snapshot" :: held 4.507s {{(pid=92060) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 05:01:34 devstack cinder-volume[92060]: DEBUG cinder.quota [None req-e9f5327c-2969-4759-b6b2-a79ea18fbe6f tempest-CreateVolumesFromSnapshotTest-393697735 None] Created reservations ['5373f804-6fe7-48a3-8e23-99a0cb31a8c3', 'dde8ccce-e03f-4f88-80c6-66d88c2127a4', '340226ac-8cfe-4eb1-a3a6-6d9e8d28f489', '91e8c1b0-01a5-4b16-b52d-3712c0d60a5c'] {{(pid=92060) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 17 05:01:34 devstack cinder-volume[92060]: INFO cinder.volume.manager [None req-e9f5327c-2969-4759-b6b2-a79ea18fbe6f tempest-CreateVolumesFromSnapshotTest-393697735 None] Delete snapshot completed successfully. Jun 17 05:01:34 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-e9f5327c-2969-4759-b6b2-a79ea18fbe6f tempest-CreateVolumesFromSnapshotTest-393697735 None] Lock "cinder-76c9266e-4e7e-46ae-a1d4-1859dbc9d0fe-delete_snapshot" released by "delete_snapshot" :: held 4.666s {{(pid=92060) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 05:01:34 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-f869c96b-af0d-4b04-9ab9-006d72ae4145 tempest-SnapshotDependencyTests-543619335 None] Acquiring lock "cinder-2fa3a771-54b4-49de-87b6-2e81bd0b1e72-delete_snapshot" by "delete_snapshot" {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 05:01:34 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-f869c96b-af0d-4b04-9ab9-006d72ae4145 tempest-SnapshotDependencyTests-543619335 None] Lock "cinder-2fa3a771-54b4-49de-87b6-2e81bd0b1e72-delete_snapshot" acquired by "delete_snapshot" :: waited 0.015s {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 05:01:34 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-f869c96b-af0d-4b04-9ab9-006d72ae4145 tempest-SnapshotDependencyTests-543619335 None] Acquiring lock "cinder-quobyte-a5b80256-2315-44e4-9e8a-92c2f9bef566" by "delete_snapshot" {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 05:01:34 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-f869c96b-af0d-4b04-9ab9-006d72ae4145 tempest-SnapshotDependencyTests-543619335 None] Lock "cinder-quobyte-a5b80256-2315-44e4-9e8a-92c2f9bef566" acquired by "delete_snapshot" :: waited 0.013s {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 05:01:34 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-f869c96b-af0d-4b04-9ab9-006d72ae4145 tempest-SnapshotDependencyTests-543619335 None] Acquiring lock "cinder-quobyte-2fa3a771-54b4-49de-87b6-2e81bd0b1e72" by "_delete_snapshot" {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 05:01:34 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-f869c96b-af0d-4b04-9ab9-006d72ae4145 tempest-SnapshotDependencyTests-543619335 None] Lock "cinder-quobyte-2fa3a771-54b4-49de-87b6-2e81bd0b1e72" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 05:01:34 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.remotefs [None req-f869c96b-af0d-4b04-9ab9-006d72ae4145 tempest-SnapshotDependencyTests-543619335 None] Deleting offline snapshot 2fa3a771-54b4-49de-87b6-2e81bd0b1e72 of volume a5b80256-2315-44e4-9e8a-92c2f9bef566 {{(pid=92060) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 17 05:01:34 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.remotefs [None req-f869c96b-af0d-4b04-9ab9-006d72ae4145 tempest-SnapshotDependencyTests-543619335 None] snapshot_file for this snap is: volume-a5b80256-2315-44e4-9e8a-92c2f9bef566.2fa3a771-54b4-49de-87b6-2e81bd0b1e72 {{(pid=92060) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 17 05:01:35 devstack cinder-volume[92060]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2ab8b25-d08b-46b4-abd9-3fdc7d58f880]: (4, 'qcow2') {{(pid=93130) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 05:01:35 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-f869c96b-af0d-4b04-9ab9-006d72ae4145 tempest-SnapshotDependencyTests-543619335 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-a5b80256-2315-44e4-9e8a-92c2f9bef566.2fa3a771-54b4-49de-87b6-2e81bd0b1e72 {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:01:35 devstack sudo[112105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-a5b80256-2315-44e4-9e8a-92c2f9bef566.2fa3a771-54b4-49de-87b6-2e81bd0b1e72 Jun 17 05:01:35 devstack sudo[112105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:01:35 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-1895c900-64e2-4f27-85c5-1a9f60dd0eb2 tempest-CreateVolumesFromSnapshotTest-393697735 None] Acquiring lock "cinder-2e021f8d-2755-45ac-becc-c4fd16820102-delete_volume" by "delete_volume" {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 05:01:35 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-1895c900-64e2-4f27-85c5-1a9f60dd0eb2 tempest-CreateVolumesFromSnapshotTest-393697735 None] Lock "cinder-2e021f8d-2755-45ac-becc-c4fd16820102-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 05:01:35 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-1895c900-64e2-4f27-85c5-1a9f60dd0eb2 tempest-CreateVolumesFromSnapshotTest-393697735 None] Acquiring lock "cinder-quobyte-2e021f8d-2755-45ac-becc-c4fd16820102" by "delete_volume" {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 05:01:35 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-1895c900-64e2-4f27-85c5-1a9f60dd0eb2 tempest-CreateVolumesFromSnapshotTest-393697735 None] Lock "cinder-quobyte-2e021f8d-2755-45ac-becc-c4fd16820102" acquired by "delete_volume" :: waited 0.016s {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 05:01:35 devstack cinder-volume[92060]: DEBUG oslo.privsep.daemon [-] privsep: reply[09847ee9-d44a-4a49-94a3-16010593a19d]: (4, 'qcow2') {{(pid=93130) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 05:01:35 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-1895c900-64e2-4f27-85c5-1a9f60dd0eb2 tempest-CreateVolumesFromSnapshotTest-393697735 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-2e021f8d-2755-45ac-becc-c4fd16820102 {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:01:35 devstack sudo[112109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-2e021f8d-2755-45ac-becc-c4fd16820102 Jun 17 05:01:35 devstack sudo[112109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:01:35 devstack sudo[112105]: pam_unix(sudo:session): session closed for user root Jun 17 05:01:35 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-f869c96b-af0d-4b04-9ab9-006d72ae4145 tempest-SnapshotDependencyTests-543619335 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-a5b80256-2315-44e4-9e8a-92c2f9bef566.2fa3a771-54b4-49de-87b6-2e81bd0b1e72" returned: 0 in 0.698s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:01:35 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.remotefs [None req-f869c96b-af0d-4b04-9ab9-006d72ae4145 tempest-SnapshotDependencyTests-543619335 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a5b80256-2315-44e4-9e8a-92c2f9bef566(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=92060) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 17 05:01:35 devstack cinder-volume[92060]: DEBUG oslo.privsep.daemon [-] privsep: reply[7999cb7e-3a57-4bc2-920e-20a9b90882e9]: (4, 'qcow2') {{(pid=93130) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 05:01:35 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-f869c96b-af0d-4b04-9ab9-006d72ae4145 tempest-SnapshotDependencyTests-543619335 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-a5b80256-2315-44e4-9e8a-92c2f9bef566 {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:01:35 devstack sudo[112115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-a5b80256-2315-44e4-9e8a-92c2f9bef566 Jun 17 05:01:35 devstack sudo[112115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:01:36 devstack sudo[112109]: pam_unix(sudo:session): session closed for user root Jun 17 05:01:36 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-1895c900-64e2-4f27-85c5-1a9f60dd0eb2 tempest-CreateVolumesFromSnapshotTest-393697735 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-2e021f8d-2755-45ac-becc-c4fd16820102" returned: 0 in 0.695s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:01:36 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-1895c900-64e2-4f27-85c5-1a9f60dd0eb2 tempest-CreateVolumesFromSnapshotTest-393697735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-2e021f8d-2755-45ac-becc-c4fd16820102 {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:01:36 devstack sudo[112120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-2e021f8d-2755-45ac-becc-c4fd16820102 Jun 17 05:01:36 devstack sudo[112120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:01:36 devstack sudo[112115]: pam_unix(sudo:session): session closed for user root Jun 17 05:01:36 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-f869c96b-af0d-4b04-9ab9-006d72ae4145 tempest-SnapshotDependencyTests-543619335 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-a5b80256-2315-44e4-9e8a-92c2f9bef566" returned: 0 in 0.703s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:01:36 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-f869c96b-af0d-4b04-9ab9-006d72ae4145 tempest-SnapshotDependencyTests-543619335 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-a5b80256-2315-44e4-9e8a-92c2f9bef566.2fa3a771-54b4-49de-87b6-2e81bd0b1e72 {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:01:36 devstack sudo[112125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-a5b80256-2315-44e4-9e8a-92c2f9bef566.2fa3a771-54b4-49de-87b6-2e81bd0b1e72 Jun 17 05:01:36 devstack sudo[112125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:01:36 devstack sudo[112120]: pam_unix(sudo:session): session closed for user root Jun 17 05:01:36 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-1895c900-64e2-4f27-85c5-1a9f60dd0eb2 tempest-CreateVolumesFromSnapshotTest-393697735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-2e021f8d-2755-45ac-becc-c4fd16820102" returned: 0 in 0.566s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:01:36 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-1895c900-64e2-4f27-85c5-1a9f60dd0eb2 tempest-CreateVolumesFromSnapshotTest-393697735 None] Lock "cinder-quobyte-2e021f8d-2755-45ac-becc-c4fd16820102" released by "delete_volume" :: held 1.329s {{(pid=92060) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 05:01:36 devstack cinder-volume[92060]: DEBUG cinder.quota [None req-1895c900-64e2-4f27-85c5-1a9f60dd0eb2 tempest-CreateVolumesFromSnapshotTest-393697735 None] Created reservations ['2eec6168-36c5-4ce6-85b4-4f31de97cd88', 'c96a2e97-70a6-4e34-831b-e83e9a0bb79d', '89c985ad-6529-4814-a1db-0fa7ded4e609', '8f7ac981-aff0-47e1-9ecb-e70b3eb8f432'] {{(pid=92060) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 17 05:01:36 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-1895c900-64e2-4f27-85c5-1a9f60dd0eb2 tempest-CreateVolumesFromSnapshotTest-393697735 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 05:01:36 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-1895c900-64e2-4f27-85c5-1a9f60dd0eb2 tempest-CreateVolumesFromSnapshotTest-393697735 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 05:01:36 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-1895c900-64e2-4f27-85c5-1a9f60dd0eb2 tempest-CreateVolumesFromSnapshotTest-393697735 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588': None} {{(pid=92060) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 17 05:01:36 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-1895c900-64e2-4f27-85c5-1a9f60dd0eb2 tempest-CreateVolumesFromSnapshotTest-393697735 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588'] {{(pid=92060) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 17 05:01:36 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-1895c900-64e2-4f27-85c5-1a9f60dd0eb2 tempest-CreateVolumesFromSnapshotTest-393697735 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 05:01:36 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-1895c900-64e2-4f27-85c5-1a9f60dd0eb2 tempest-CreateVolumesFromSnapshotTest-393697735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:01:36 devstack sudo[112129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a Jun 17 05:01:36 devstack sudo[112129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:01:37 devstack sudo[112125]: pam_unix(sudo:session): session closed for user root Jun 17 05:01:37 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-f869c96b-af0d-4b04-9ab9-006d72ae4145 tempest-SnapshotDependencyTests-543619335 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-a5b80256-2315-44e4-9e8a-92c2f9bef566.2fa3a771-54b4-49de-87b6-2e81bd0b1e72" returned: 0 in 0.676s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:01:37 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-f869c96b-af0d-4b04-9ab9-006d72ae4145 tempest-SnapshotDependencyTests-543619335 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-a5b80256-2315-44e4-9e8a-92c2f9bef566.2fa3a771-54b4-49de-87b6-2e81bd0b1e72 {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:01:37 devstack sudo[112133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-a5b80256-2315-44e4-9e8a-92c2f9bef566.2fa3a771-54b4-49de-87b6-2e81bd0b1e72 Jun 17 05:01:37 devstack sudo[112133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:01:37 devstack sudo[112129]: pam_unix(sudo:session): session closed for user root Jun 17 05:01:37 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-1895c900-64e2-4f27-85c5-1a9f60dd0eb2 tempest-CreateVolumesFromSnapshotTest-393697735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a" returned: 0 in 0.586s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:01:37 devstack cinder-volume[92060]: DEBUG cinder.manager [None req-1895c900-64e2-4f27-85c5-1a9f60dd0eb2 tempest-CreateVolumesFromSnapshotTest-393697735 None] Notifying Schedulers of capabilities ... {{(pid=92060) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 17 05:01:37 devstack cinder-volume[92060]: INFO cinder.volume.manager [None req-1895c900-64e2-4f27-85c5-1a9f60dd0eb2 tempest-CreateVolumesFromSnapshotTest-393697735 None] Deleted volume successfully. Jun 17 05:01:37 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-1895c900-64e2-4f27-85c5-1a9f60dd0eb2 tempest-CreateVolumesFromSnapshotTest-393697735 None] Lock "cinder-2e021f8d-2755-45ac-becc-c4fd16820102-delete_volume" released by "delete_volume" :: held 2.175s {{(pid=92060) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 05:01:37 devstack sudo[112133]: pam_unix(sudo:session): session closed for user root Jun 17 05:01:37 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-f869c96b-af0d-4b04-9ab9-006d72ae4145 tempest-SnapshotDependencyTests-543619335 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-a5b80256-2315-44e4-9e8a-92c2f9bef566.2fa3a771-54b4-49de-87b6-2e81bd0b1e72" returned: 0 in 0.578s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:01:37 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-f869c96b-af0d-4b04-9ab9-006d72ae4145 tempest-SnapshotDependencyTests-543619335 None] Lock "cinder-quobyte-2fa3a771-54b4-49de-87b6-2e81bd0b1e72" released by "_delete_snapshot" :: held 2.754s {{(pid=92060) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 05:01:37 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-f869c96b-af0d-4b04-9ab9-006d72ae4145 tempest-SnapshotDependencyTests-543619335 None] Lock "cinder-quobyte-a5b80256-2315-44e4-9e8a-92c2f9bef566" released by "delete_snapshot" :: held 2.775s {{(pid=92060) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 05:01:37 devstack cinder-volume[92060]: DEBUG cinder.quota [None req-f869c96b-af0d-4b04-9ab9-006d72ae4145 tempest-SnapshotDependencyTests-543619335 None] Created reservations ['033617b7-7e07-4382-8e99-c79adb17b93c', 'c6a0698a-3860-4f93-8d9e-34f78acc954c', '5349382b-1354-4e3a-ba9b-44339440b0d5', 'e3a1e092-0656-4377-8e97-c8c965b9abf4'] {{(pid=92060) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 17 05:01:37 devstack cinder-volume[92060]: INFO cinder.volume.manager [None req-f869c96b-af0d-4b04-9ab9-006d72ae4145 tempest-SnapshotDependencyTests-543619335 None] Delete snapshot completed successfully. Jun 17 05:01:37 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-f869c96b-af0d-4b04-9ab9-006d72ae4145 tempest-SnapshotDependencyTests-543619335 None] Lock "cinder-2fa3a771-54b4-49de-87b6-2e81bd0b1e72-delete_snapshot" released by "delete_snapshot" :: held 2.907s {{(pid=92060) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 05:01:38 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-dcf2c611-13d5-47b3-8933-d4403665bab0 tempest-SnapshotDependencyTests-543619335 None] Acquiring lock "cinder-a5b80256-2315-44e4-9e8a-92c2f9bef566-delete_volume" by "delete_volume" {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 05:01:38 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-dcf2c611-13d5-47b3-8933-d4403665bab0 tempest-SnapshotDependencyTests-543619335 None] Lock "cinder-a5b80256-2315-44e4-9e8a-92c2f9bef566-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 05:01:38 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-dcf2c611-13d5-47b3-8933-d4403665bab0 tempest-SnapshotDependencyTests-543619335 None] Acquiring lock "cinder-quobyte-a5b80256-2315-44e4-9e8a-92c2f9bef566" by "delete_volume" {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 05:01:38 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-dcf2c611-13d5-47b3-8933-d4403665bab0 tempest-SnapshotDependencyTests-543619335 None] Lock "cinder-quobyte-a5b80256-2315-44e4-9e8a-92c2f9bef566" acquired by "delete_volume" :: waited 0.016s {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 05:01:38 devstack cinder-volume[92060]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb32319b-5853-48bb-b8cb-d8f42fa80942]: (4, 'qcow2') {{(pid=93130) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 05:01:38 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-dcf2c611-13d5-47b3-8933-d4403665bab0 tempest-SnapshotDependencyTests-543619335 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-a5b80256-2315-44e4-9e8a-92c2f9bef566 {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:01:38 devstack sudo[112137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-a5b80256-2315-44e4-9e8a-92c2f9bef566 Jun 17 05:01:38 devstack sudo[112137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:01:38 devstack sudo[112137]: pam_unix(sudo:session): session closed for user root Jun 17 05:01:38 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-dcf2c611-13d5-47b3-8933-d4403665bab0 tempest-SnapshotDependencyTests-543619335 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-a5b80256-2315-44e4-9e8a-92c2f9bef566" returned: 0 in 0.739s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:01:38 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-dcf2c611-13d5-47b3-8933-d4403665bab0 tempest-SnapshotDependencyTests-543619335 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-a5b80256-2315-44e4-9e8a-92c2f9bef566 {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:01:39 devstack sudo[112144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-a5b80256-2315-44e4-9e8a-92c2f9bef566 Jun 17 05:01:39 devstack sudo[112144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:01:39 devstack sudo[112144]: pam_unix(sudo:session): session closed for user root Jun 17 05:01:39 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-dcf2c611-13d5-47b3-8933-d4403665bab0 tempest-SnapshotDependencyTests-543619335 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-a5b80256-2315-44e4-9e8a-92c2f9bef566" returned: 0 in 0.589s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:01:39 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-dcf2c611-13d5-47b3-8933-d4403665bab0 tempest-SnapshotDependencyTests-543619335 None] Lock "cinder-quobyte-a5b80256-2315-44e4-9e8a-92c2f9bef566" released by "delete_volume" :: held 1.404s {{(pid=92060) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 05:01:39 devstack cinder-volume[92060]: DEBUG cinder.quota [None req-dcf2c611-13d5-47b3-8933-d4403665bab0 tempest-SnapshotDependencyTests-543619335 None] Created reservations ['3638aedb-a980-48a2-a617-544163d36d23', '110432af-4e19-476d-b6d0-7608cb56d2ae', '357e732c-f2a4-4923-a3e8-8efdacc7fc68', '9ed1969c-6462-43ec-bfb5-7a5130b82d14'] {{(pid=92060) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 17 05:01:39 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-dcf2c611-13d5-47b3-8933-d4403665bab0 tempest-SnapshotDependencyTests-543619335 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 05:01:39 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-dcf2c611-13d5-47b3-8933-d4403665bab0 tempest-SnapshotDependencyTests-543619335 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 05:01:39 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-dcf2c611-13d5-47b3-8933-d4403665bab0 tempest-SnapshotDependencyTests-543619335 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588': None} {{(pid=92060) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 17 05:01:39 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-dcf2c611-13d5-47b3-8933-d4403665bab0 tempest-SnapshotDependencyTests-543619335 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588'] {{(pid=92060) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 17 05:01:39 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-dcf2c611-13d5-47b3-8933-d4403665bab0 tempest-SnapshotDependencyTests-543619335 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 05:01:39 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-dcf2c611-13d5-47b3-8933-d4403665bab0 tempest-SnapshotDependencyTests-543619335 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:01:39 devstack sudo[112147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a Jun 17 05:01:39 devstack sudo[112147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:01:40 devstack sudo[112147]: pam_unix(sudo:session): session closed for user root Jun 17 05:01:40 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-dcf2c611-13d5-47b3-8933-d4403665bab0 tempest-SnapshotDependencyTests-543619335 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a" returned: 0 in 0.555s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:01:40 devstack cinder-volume[92060]: DEBUG cinder.manager [None req-dcf2c611-13d5-47b3-8933-d4403665bab0 tempest-SnapshotDependencyTests-543619335 None] Notifying Schedulers of capabilities ... {{(pid=92060) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 17 05:01:40 devstack cinder-volume[92060]: INFO cinder.volume.manager [None req-dcf2c611-13d5-47b3-8933-d4403665bab0 tempest-SnapshotDependencyTests-543619335 None] Deleted volume successfully. Jun 17 05:01:40 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-dcf2c611-13d5-47b3-8933-d4403665bab0 tempest-SnapshotDependencyTests-543619335 None] Lock "cinder-a5b80256-2315-44e4-9e8a-92c2f9bef566-delete_volume" released by "delete_volume" :: held 2.138s {{(pid=92060) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 05:01:40 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-5b7137fa-6a3a-49e2-84d2-7561b0a19e9e tempest-SnapshotDependencyTests-543619335 None] Acquiring lock "cinder-94a97622-a41b-4051-b780-0dbeb551e592-delete_volume" by "delete_volume" {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 05:01:40 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-5b7137fa-6a3a-49e2-84d2-7561b0a19e9e tempest-SnapshotDependencyTests-543619335 None] Lock "cinder-94a97622-a41b-4051-b780-0dbeb551e592-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 05:01:40 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-5b7137fa-6a3a-49e2-84d2-7561b0a19e9e tempest-SnapshotDependencyTests-543619335 None] Acquiring lock "cinder-quobyte-94a97622-a41b-4051-b780-0dbeb551e592" by "delete_volume" {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 17 05:01:40 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-5b7137fa-6a3a-49e2-84d2-7561b0a19e9e tempest-SnapshotDependencyTests-543619335 None] Lock "cinder-quobyte-94a97622-a41b-4051-b780-0dbeb551e592" acquired by "delete_volume" :: waited 0.014s {{(pid=92060) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 17 05:01:40 devstack cinder-volume[92060]: DEBUG oslo.privsep.daemon [-] privsep: reply[38317945-d4ba-4b81-a2cd-233b263e46c4]: (4, 'qcow2') {{(pid=93130) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Jun 17 05:01:40 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-5b7137fa-6a3a-49e2-84d2-7561b0a19e9e tempest-SnapshotDependencyTests-543619335 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-94a97622-a41b-4051-b780-0dbeb551e592 {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:01:40 devstack sudo[112150]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-94a97622-a41b-4051-b780-0dbeb551e592 Jun 17 05:01:40 devstack sudo[112150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:01:41 devstack sudo[112150]: pam_unix(sudo:session): session closed for user root Jun 17 05:01:41 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-5b7137fa-6a3a-49e2-84d2-7561b0a19e9e tempest-SnapshotDependencyTests-543619335 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-94a97622-a41b-4051-b780-0dbeb551e592" returned: 0 in 0.664s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:01:41 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-5b7137fa-6a3a-49e2-84d2-7561b0a19e9e tempest-SnapshotDependencyTests-543619335 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-94a97622-a41b-4051-b780-0dbeb551e592 {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:01:41 devstack sudo[112155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-94a97622-a41b-4051-b780-0dbeb551e592 Jun 17 05:01:41 devstack sudo[112155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:01:41 devstack sudo[112155]: pam_unix(sudo:session): session closed for user root Jun 17 05:01:41 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-5b7137fa-6a3a-49e2-84d2-7561b0a19e9e tempest-SnapshotDependencyTests-543619335 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a/volume-94a97622-a41b-4051-b780-0dbeb551e592" returned: 0 in 0.589s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:01:41 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-5b7137fa-6a3a-49e2-84d2-7561b0a19e9e tempest-SnapshotDependencyTests-543619335 None] Lock "cinder-quobyte-94a97622-a41b-4051-b780-0dbeb551e592" released by "delete_volume" :: held 1.296s {{(pid=92060) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 05:01:41 devstack cinder-volume[92060]: DEBUG cinder.quota [None req-5b7137fa-6a3a-49e2-84d2-7561b0a19e9e tempest-SnapshotDependencyTests-543619335 None] Created reservations ['5d374557-01f6-476f-9dc5-d0dde4503580', '628c1a7f-6801-4d3a-abb8-2ecf2e3664d9', '45cd38b3-971a-48c7-8bd1-dd34d48476fd', '190e526e-4990-4a15-bddb-8de889488f32'] {{(pid=92060) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 17 05:01:41 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-5b7137fa-6a3a-49e2-84d2-7561b0a19e9e tempest-SnapshotDependencyTests-543619335 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 05:01:41 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-5b7137fa-6a3a-49e2-84d2-7561b0a19e9e tempest-SnapshotDependencyTests-543619335 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 05:01:41 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-5b7137fa-6a3a-49e2-84d2-7561b0a19e9e tempest-SnapshotDependencyTests-543619335 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588': None} {{(pid=92060) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 17 05:01:41 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-5b7137fa-6a3a-49e2-84d2-7561b0a19e9e tempest-SnapshotDependencyTests-543619335 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588'] {{(pid=92060) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 17 05:01:41 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-5b7137fa-6a3a-49e2-84d2-7561b0a19e9e tempest-SnapshotDependencyTests-543619335 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 05:01:41 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-5b7137fa-6a3a-49e2-84d2-7561b0a19e9e tempest-SnapshotDependencyTests-543619335 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:01:41 devstack sudo[112159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a Jun 17 05:01:41 devstack sudo[112159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:01:42 devstack sudo[112159]: pam_unix(sudo:session): session closed for user root Jun 17 05:01:42 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-5b7137fa-6a3a-49e2-84d2-7561b0a19e9e tempest-SnapshotDependencyTests-543619335 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a" returned: 0 in 0.585s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:01:42 devstack cinder-volume[92060]: DEBUG cinder.manager [None req-5b7137fa-6a3a-49e2-84d2-7561b0a19e9e tempest-SnapshotDependencyTests-543619335 None] Notifying Schedulers of capabilities ... {{(pid=92060) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 17 05:01:42 devstack cinder-volume[92060]: INFO cinder.volume.manager [None req-5b7137fa-6a3a-49e2-84d2-7561b0a19e9e tempest-SnapshotDependencyTests-543619335 None] Deleted volume successfully. Jun 17 05:01:42 devstack cinder-volume[92060]: DEBUG cinder.coordination [None req-5b7137fa-6a3a-49e2-84d2-7561b0a19e9e tempest-SnapshotDependencyTests-543619335 None] Lock "cinder-94a97622-a41b-4051-b780-0dbeb551e592-delete_volume" released by "delete_volume" :: held 2.055s {{(pid=92060) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 17 05:01:44 devstack cinder-volume[92060]: DEBUG oslo_service.periodic_task [None req-60d279ad-ad8c-4d36-a4b8-f593e74fb922 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=92060) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 17 05:01:44 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-60d279ad-ad8c-4d36-a4b8-f593e74fb922 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Jun 17 05:01:44 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-60d279ad-ad8c-4d36-a4b8-f593e74fb922 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Jun 17 05:01:44 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-60d279ad-ad8c-4d36-a4b8-f593e74fb922 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588': None} {{(pid=92060) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 17 05:01:44 devstack cinder-volume[92060]: DEBUG cinder.volume.drivers.quobyte [None req-60d279ad-ad8c-4d36-a4b8-f593e74fb922 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-30bb4fd4-a017-4553-95c0-71230fbcf588'] {{(pid=92060) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 17 05:01:44 devstack cinder-volume[92060]: DEBUG oslo_concurrency.lockutils [None req-60d279ad-ad8c-4d36-a4b8-f593e74fb922 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=92060) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Jun 17 05:01:44 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-60d279ad-ad8c-4d36-a4b8-f593e74fb922 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 17 05:01:45 devstack sudo[112164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a Jun 17 05:01:45 devstack sudo[112164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 17 05:01:45 devstack sudo[112164]: pam_unix(sudo:session): session closed for user root Jun 17 05:01:45 devstack cinder-volume[92060]: DEBUG oslo_concurrency.processutils [None req-60d279ad-ad8c-4d36-a4b8-f593e74fb922 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/8ddfc6b49c537fa834880163c93e710a" returned: 0 in 0.617s {{(pid=92060) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 17 05:01:45 devstack cinder-volume[92060]: DEBUG cinder.manager [None req-60d279ad-ad8c-4d36-a4b8-f593e74fb922 None None] Notifying Schedulers of capabilities ... {{(pid=92060) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 17 05:01:45 devstack cinder-volume[92060]: DEBUG oslo_service.periodic_task [None req-60d279ad-ad8c-4d36-a4b8-f593e74fb922 None None] Running periodic task VolumeManager._thread_info {{(pid=92060) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Jun 17 05:01:45 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-60d279ad-ad8c-4d36-a4b8-f593e74fb922 None None] thread count: 28 {{(pid=92060) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 17 05:01:45 devstack cinder-volume[92060]: DEBUG cinder.volume.manager [None req-60d279ad-ad8c-4d36-a4b8-f593e74fb922 None None] thread info: [<_MainThread(MainThread, started 130061806440576)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=92060) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 17 05:01:51 devstack cinder-volume[92060]: DEBUG dbcounter [-] [92060] Writing DB stats cinder:SELECT=84,cinder:INSERT=37,cinder:UPDATE=125,cinder:DELETE=13 {{(pid=92060) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 17 05:01:52 devstack cinder-volume[92060]: DEBUG dbcounter [-] [92060] Writing DB stats cinder:SELECT=100,cinder:INSERT=32,cinder:UPDATE=129,cinder:DELETE=8 {{(pid=92060) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}